The jupyter notebook of win10 uses pyspark 2 3.2 error reporting problems solved

1、 Problems arise ：

py4j.protocol.Py4JJavaError: An error occurred while calling z:org.apache.spark.api.python.PythonRDD.collectAndServe.

About windows10 Next use jupyter notebook when , about pyspark The version can only take its spark2.3.2 edition , Concrete and simple demo as follows :

If the version is wrong , The following error will be reported ：


About python stay windows10 Next use pyspark The environment configuration of is as follows ：
spark-2.3.2-bin-hadoop2.7 Resource Pack ：https://pan.baidu.com/s/1EQV8VrDg_DDE39rXBILzRA Extraction code ：dflf
JDK1.8 Resource pack for ：https://pan.baidu.com/s/1HuwFyUnOaHfZNnKPS_uvUg Extraction code ：u8uu
winutils Resource pack for ： link ：https://pan.baidu.com/s/1v7UI5taiy83JcoXg_8akdA Extraction code ：3duu

2、 Environment building ：

java Installation path and environment configuration

 Variable name ：JAVA_HOME
 A variable's value ：C:\Kungs\Java\jdk1.8.0_201

To use commands pyspark Direct start jupyter notebook

 Variable name ：PYSPARK_DRIVER_PYTHON
 A variable's value ：jupyter

 Variable name ：PYSPARK_DRIVER_PYTHON_OPTS
 A variable's value ：notebook

pyspark Medium python Environment settings for

 Variable name ：PYTHONPATH
 A variable's value ：%SPARK_HOME%\python\lib\py4j;%SPARK_HOME%\python\lib\pyspark

spark Set in the local environment , The path is to unzip the front spark-2.3.2-bin-hadoop2.7 The location of the resource package

 Variable name ：SPARK_HOME
 A variable's value ：C:\Kungs\spark-2.3.2-bin-hadoop2.7

At the same time path Add environment to environment ：

 Variable name ：path
 A variable's value ：;C:\Kungs\Java\jdk1.8.0_201\bin;%JAVA_HOME%\bin;%SPARK_HOME%\bin;C:\Kungs\spark-2.3.2-bin-hadoop2.7\bin;

winutils The resource package is placed directly in spark In the path of , Put it here. C:\Kungs\spark-2.3.2-bin-hadoop2.7\bin Under the table of contents

recycling pip install pyspark==2.3.2 Pack

test pyspark success ：pyspark
test java success ：java、javac