Configuring and using EMR-Spark clusters
In this section, we will present two simple examples of EMR clusters suitable for basic Spark development. In the first example, we will spin up an EMR cluster, start the Spark shell, and do some Spark-Scala work. In the second example, we will spin up an EMR cluster and run a simple Spark program.
Follow the step-by-step instructions specified next for this hands-on exercise:
- Log in to the AWS Management Console and open the Amazon EMR console and click on the
Create cluster
button:

- We will use the
Create Cluster - Quick Options
for selecting the options for our cluster. Specify a name for the cluster (FirstEMRSparkClusterUsingQuickOptions
). ChooseLaunch mode
asCluster
:

In the Software configuration
section, ensure you have selected the latest available version of EMR and select the Spark option:

Leave the defaults for Hardware configuration
unchanged. We will be creating a three-node cluster with suggested instance types:

Select your EC2 key pair from...