Week 1, 2:: Hadoop &bigdata Lab
Week 1, 2:: Hadoop &bigdata Lab
Week 1, 2:: Hadoop &bigdata Lab
Week 1, 2:
2. (i)Perform setting up and Installing Hadoop in its three operating modes:
Standalone,
Pseudo distributed,
Fully distributed.
(ii)Use web based tools to monitor your Hadoop setup.
Week 3:
3. Implement the following file management tasks in Hadoop:
Adding files and directories
Retrieving files
Deleting files
Hint: A typical Hadoop workflow creates data files (such as log files) elsewhere and copies them
into HDFS using one of the above command line utilities.
Week 4:
4. Run a basic Word Count Map Reduce program to understand Map Reduce Paradigm.
Week 5:
5. Write a Map Reduce program that mines weather data.
Weather sensors collecting data every hour at many locations across the globe gather a large
volume of log data, which is a good candidate for analysis with MapReduce, since it is semi
structured and record oriented.
Week 6:
6. Implement Matrix Multiplication with Hadoop Map Reduce
Week 7 , 8:
7. Install and Run Pig then write Pig Latin scripts to sort, group, join, project, and filter your data.
Week 9,10:
8. Install and Run Hive then use Hive to create, alter, and drop databases, tables, views,functions,
and indexes
FEEDBACK FORM FOR EMPLOYERS
(Regarding Curriculum Review)
Dear employers,
a) Please remove Apache Pig and replace it’s assignment with Apache Sqoop
b)
c)