Skip to main content

All Questions

Filter by
Sorted by
Tagged with
0 votes
1 answer
525 views

Spark: Reporting Total, and Available Memory of the Cluster

I'm running a Spark job on an Amazon EMR; I would like to keep reporting the total, and free memory of the cluster from within the program itself. Is there any method in Spark API which provides ...
user1888243's user avatar
  • 2,661
5 votes
2 answers
3k views

What does spark exitCode: 12 mean?

I'm trying to run a spark application written in scala 11.8, spark 2.1 on an EMR cluster version 5.3.0. I configured the cluster with the following json: [ { "Classification": "hadoop-env", ...
NetanelRabinowitz's user avatar