How to run sample spark application

      No Comments on How to run sample spark application

To submit a sample spark application we can use spark-submit command also spark itself includes some examples of spark application which we can run to check the sanity of our spark platform or generally called spark cluster

Spark 1.6.3

Submit a sample spark pi job using below command

./bin/spark-submit --class org.apache.spark.examples.SparkPi \
     --master yarn-client \
     --num-executors 1 \
     --driver-memory 512m \
     --executor-memory 512m \
     --executor-cores 1 \
     lib/spark-examples*.jar 10

Leave a Reply