All Questions
3 questions
0
votes
1
answer
181
views
GCS Connector on EMR failing with java.lang.ClassNotFoundException
I have created an emr cluster with the instructions on how to create a connection from gcs provided here and keep running the hadoop distcp command.
It keeps failing with the following error:
2023-07-...
1
vote
2
answers
1k
views
Is it possible to specify the number of mappers-reducers while using s3-dist-cp?
I'm trying to copy data from an EMR cluster to S3 using s3-distcp. Can I specify the number of reducers to a greater value than the default so as to fasten my process?
- 4,373
1
vote
1
answer
990
views
AWS file upload
I want to upload few files into AWS bucket from hadoop. I have
AWS ACCESS KEY, SECRET KEY and S3 IMPORT PATH.
I am not able to access though AWS CLI command.
I set the keys in aws credential file....
- 43