1. Requirements for Mac
Name
Description
Installation Guide
Brew
The package installation soft for mac. Very helpful for this installation and in life in general.
brew install
Anaconda
A distribution of python, with packaged modules and libraries. Note: we recommend installing Anaconda 2 (for python 2.7)
anaconda install
JDK 8
Java Development Kit, used in both Hadoop and Spark.
brew cask install java
在安装brew的时候如果出现报错:
curl: (7) Failed to connect to raw.githubusercontent.com port 443: Connection refused解决方案:如果能打开这个网页,https://raw.githubusercontent.com/Homebrew/install/master/install,将网页保存为brew_install.rb后,命令行进去该文件路径输入如下命令即可完成安装。
ruby brew_install.rb2. 安装scala
brew install scala3.安装spark
brew install apache-spark4.启动
spark-shell