.NET for Apache Spark™ Tutorial - Get started in 10 minutes

Install Prerequisites

.NET for Apache Spark runs on the 64-bit version of the Windows operating system and assumes the same from this point onwards.

Install 7-zip

Apache Spark is downloaded as a compressed .tgz file. You'll need 7-zip to extract the file.

If you already have an alternative extraction program installed, you can use that instead.

  1. Visit 7-Zip downloads.
  2. In the first table on the page, select the 64-bit x64 download.
  3. When the download completes, run the installer.

Install Java

Apache Spark requires the Java SE Development Kit (JDK) 8.1.

  1. Visit Java SE Development Kit 8 Downloads.
  2. Find the Java SE Development Kit 8u211 section.
  3. Click the download for Windows x64.
  4. Review the License agreement, and accept if you agree.
  5. Oracle requires an account to download the JDK. So, sign in to an existing account or complete the account registration process to start downloading.
  6. Once the download completes, run the installer using the default settings.

Once you've installed, open a new command prompt and run the following command:

Command prompt
java -version

If the command runs and prints your Java version information, you're good to go.

If the command fails and you can't resolve the issue, use the I ran into an issue button to get help fixing the problem.

Install Java

Apache Spark requires the Java Development Kit (JDK).

Open a terminal and run the following command:

Command prompt
sudo apt install openjdk-8-jdk openjdk-8-jre

Ensure you're using Java 8

Apache Spark requires Java 8. Run the following command and select Java 8 when prompted:

Terminal
sudo update-alternatives --config java

Check everything is installed correctly

Once the previous command completes, run the following command:

Command prompt
java -version

If the command runs and prints your Java version information, you're good to go.

If the command fails and you can't resolve the issue, use the I ran into an issue button to get help fixing the problem.

Continue