Manual Task2

User Manual:

Open the PDF directly: View PDF PDF.
Page Count: 3

DownloadManual Task2
Open PDF In BrowserView PDF
Manual for Task #2
Prerequisites:
This tutorial is developed on Ubuntu operating
System.
 You should have Hadoop (version 2.2.0 used for this
tutorial) already installed.
 You should have Java(version 1.8.0 used for this
tutorial) already installed on the system.


Steps to run the code:
Step 1) change directory to reach the path where hadoop
installed
$ cd /usr/local/hadoop
Step 2)Start Hadoop
$HADOOP_HOME/sbin/start-dfs.sh
Step 3)make a directory on the hdfs
Hadoop hdfs dfs -mkdir transactions
Step 4)put the transaction & user files on
this directory

Hadoop dfs -put ~/task2/job1/User.txt
Hadoop dfs -put
~/task2/job1/Transaction.txt
Step 5)run the mapper & reducer on those
file using hadoop streaming
hadoop jar /usr/local/hadoop2.8.1/share/hadoop/tools/lib/hadoopstreaming-2.8.1.jar -input
/usr/ahmedsaied/section3/* -output
/usr/ahmedsaied/section3/output1 -mapper
~/task2hadoop/job1/mapper.py -reducer
~/task2hadoop/job1/reducer.py
Step 6) run the second mapreduce to get
the expected output
hadoop jar /usr/local/hadoop2.8.1/share/hadoop/tools/lib/hadoopstreaming-2.8.1.jar -input
/usr/ahmedsaied/section3/output/part00000 -output
/usr/ahmedsaied/section3/output2 -mapper

~/task2hadoop/job1/mapper.py -reducer
~/task2hadoop/job1/reducer.py



Source Exif Data:
File Type                       : PDF
File Type Extension             : pdf
MIME Type                       : application/pdf
PDF Version                     : 1.5
Linearized                      : No
Page Count                      : 3
Language                        : en-US
Tagged PDF                      : Yes
Author                          : AhMeD SaIeD
Creator                         : Microsoft® Word 2016
Create Date                     : 2017:12:16 21:31:16+00:00
Producer                        : www.ilovepdf.com
Modify Date                     : 2017:12:16 21:31:17Z
EXIF Metadata provided by EXIF.tools

Navigation menu