I am getting the below error with serverless Dataproc (Batches) for a job.
"org.apache.spark.shuffle.FetchFailedException"
This is due to autoscaling removing executors, Serverless data proc doesn't support EFM; is there a way to handle this issue? Any help/pointer is appreciated.
Thanks in advance.
Try with these Stackoverflow posts:
User | Count |
---|---|
4 | |
4 | |
2 | |
1 | |
1 |