All Questions
1 question
0
votes
1
answer
778
views
Spark SparkFiles.get() returns driver path instead of worker path
I am piping the partitions of an RDD through an external executable. I use sparkContext.addFiles() so that the executable will be available to the workers.
I when I attempt to run the code I am ...
- 1,039