All Questions
10 questions
0
votes
1
answer
103
views
Oozie not starting with Mysql in AWS EC2 instance
We are installing an Hadoop cluster on AWS Ec2 instance(5 nodes) for POC purpose.
Software Stack - Hadoop, HDFS, Oozie and MongoDB.
We are able to successfully install Hadoop, HDFS and MongoDB. But ...
- 452
1
vote
1
answer
315
views
Sqoop export is not honoring the --columns argument
I have a sqoop job where I only want to export 3 columns from a HIVE table into mysql table that has only these 3 fields.
export --connect <table> --username <U> --password <p>
--...
- 1,060
1
vote
1
answer
648
views
sqoop job export data into mysql,stuck at map 100% with status running
So I was trying to export data from impala into mysql with sqoop,which is scheduled by oozie job.But when the first sqoop action start,it stuck at map 100% and reduce 0%.and all other action stuffed.
...
- 11
1
vote
1
answer
2k
views
How to pass shell script arguments to a oozie
I have a shell script to import data from MySQL to hdfs i.e sqoop shell script. I want to use oozie to schedule the sqoop import jobs.
The script has the following sqoop query
sqoop import --...
- 5,450
0
votes
1
answer
1k
views
How to write hive script for return result in shell variable in an Oozie coordinator?
Then i coordinate my script.sh in an Oozie there is nothing in a variables S.
Here is shell script
S=$(hive -S -hiveconf MY_VAR1=$DB -hiveconf MY_VAR2=$avgpay -hiveconf MY_VAR3=$Date_LastDay -...
- 13
0
votes
0
answers
620
views
How to import a csv file resides on hdfs to mysql database using python scripts
I have a use cases where after aggregation(using map-reduce), a csv file is generated. Now, i want to import this csv file which is resides on hdfs to directly to mysql database.
I have written this ...
0
votes
1
answer
2k
views
Sqoop job running forever using Oozie
We have two node hadoop yarn cluster, it is hadoop 2.2, on which We have scheduled two actions in a single workflow using oozie, the first action is a python map-reduce streaming action, and the ...
- 407
2
votes
1
answer
7k
views
Oozie - Got exception running sqoop: Could not load db driver class: com.mysql.jdbc.Driver
I am trying to perform an sqoop export on HDP sandbox 2.1 via Oozie. When I run the Oozie job I get the following java runtime exception.
'>>> Invoking Sqoop command line now >>>
7598 [main] ...
- 175
1
vote
4
answers
2k
views
Loading data to MySQL table from Hive using Sqoop/Oozie
I am facing some grave issue (tried unsuccessful 196 times) while loading data using Sqoop (sqoop command inside Oozie) to MySQL table. If there is only one column of data in HDFS (here foo) then ...
- 783
1
vote
0
answers
191
views
Partition Oozie table for Faster Purge
We run oozie and the jobs are scheduled too frequently that causes the database to grow really fast which in turn leads to slowness of the db.
So we started to purge records frequently and with time ...
- 661