Implementation and deployment 

The following are implementation objectives that are required to implement the recommendations system:

1. Download the past weapons sales order and weapon lead sales datasets from the ModernScalaProjects data folder.
2. You may develop the pipeline in three ways:
   • Incrementally in your local Spark Shell.
   • Recommended: Flesh out your code in IntelliJ and wire up all necessary dependencies in the build.sbt file. Set SBT up to generate a fat JAR by wiring in an assembly plugin. The resultant self-contained SBT application is then deployed to your local spark cluster using spark-submit.
   • Run the application and interpret the results.

3. In the next section, Implementation, we will document step-by-step instructions for implementing the project. 

Implementation

Implementation is documented in the following subsections. All code is developed in an Intellij code editor. The very first step is to create an empty Scala project called Chapter7.

Step 1 – creating the Scala project

Let's create...