python安装pyspark步骤 install method 20160824
合集下载
相关主题
- 1、下载文档前请自行甄别文档内容的完整性，平台不提供额外的编辑、内容补充、找答案等附加服务。
- 2、"仅部分预览"的文档,不可在线预览部分如存在完整性等问题,可反馈申请退款(可完整预览的文档不适用该条件!)。
- 3、如文档侵犯您的权益，请联系客服反馈,我们会尽快为您处理(人工客服工作时间：9:00-18:30)。
1) downloads spark-x.x.x-bin-hadoopx.x.tgz from offical website
and untgz to your path :
such as D:\google_downloads\spark-2.0.0-bin-hadoop2.7
here we call \Path_spark for short
2.1) install environment_path: append '/Path_spark/bin' to 'Path' environment_path var
2.2) add SPARK_HOME : set /Path_spark as new environment_var SPARK_HOME
3) copy file /Path_spark/python/pyspark to /your_python_Lib_path/site-packages
4) maybe should install py4j as usual method: run ' pip install py4j ' in cmd
5) now we can import pyspark in python_shell or relate python_IDE
---
success in python 3.5.1 ,spark 2.0.0 ,jdk 1.8.0_45