Installation and Setup

Installing Anaconda:

1. Visit https://www.anaconda.com/download/ in your browser.
2. Click on Windows, Mac, or Linux, depending on the OS you are working on.
3. Next, click on the Download option. Make sure you download the latest version.
4. Open the installer after download.
5. Follow the steps in the installer and that's it! Your Anaconda distribution is ready.

PySpark is available on PyPi. To install PySpark run the following command:

pip install pyspark --upgrade

Updating Jupyter and installing dependencies:

1. Search for Anaconda Prompt and open it.
2. Type the following commands to update Conda and Jupyter:

   #Update conda

   conda update conda

   #Update Jupyter

   conda update Jupyter

   #install packages

   conda install numpy

   conda install pandas

   conda install statsmodels

   conda install matplotlib

   conda install seaborn

3. To open Jupyter Notebook from Anaconda Prompt, use the following command:

   jupyter notebook

   pip install -U scikit-learn