Manual Task2
User Manual:
Open the PDF directly: View PDF
.
Page Count: 3
| Download | |
| Open PDF In Browser | View PDF |
Manual for Task #2 Prerequisites: This tutorial is developed on Ubuntu operating System. You should have Hadoop (version 2.2.0 used for this tutorial) already installed. You should have Java(version 1.8.0 used for this tutorial) already installed on the system. Steps to run the code: Step 1) change directory to reach the path where hadoop installed $ cd /usr/local/hadoop Step 2)Start Hadoop $HADOOP_HOME/sbin/start-dfs.sh Step 3)make a directory on the hdfs Hadoop hdfs dfs -mkdir transactions Step 4)put the transaction & user files on this directory Hadoop dfs -put ~/task2/job1/User.txt Hadoop dfs -put ~/task2/job1/Transaction.txt Step 5)run the mapper & reducer on those file using hadoop streaming hadoop jar /usr/local/hadoop2.8.1/share/hadoop/tools/lib/hadoopstreaming-2.8.1.jar -input /usr/ahmedsaied/section3/* -output /usr/ahmedsaied/section3/output1 -mapper ~/task2hadoop/job1/mapper.py -reducer ~/task2hadoop/job1/reducer.py Step 6) run the second mapreduce to get the expected output hadoop jar /usr/local/hadoop2.8.1/share/hadoop/tools/lib/hadoopstreaming-2.8.1.jar -input /usr/ahmedsaied/section3/output/part00000 -output /usr/ahmedsaied/section3/output2 -mapper ~/task2hadoop/job1/mapper.py -reducer ~/task2hadoop/job1/reducer.py
Source Exif Data:
File Type : PDF File Type Extension : pdf MIME Type : application/pdf PDF Version : 1.5 Linearized : No Page Count : 3 Language : en-US Tagged PDF : Yes Author : AhMeD SaIeD Creator : Microsoft® Word 2016 Create Date : 2017:12:16 21:31:16+00:00 Producer : www.ilovepdf.com Modify Date : 2017:12:16 21:31:17ZEXIF Metadata provided by EXIF.tools