TUTORIAL PROGRAM JAVA : MAPREDUCE PADA HADOOP ~ NATIONAL

Tutorial ini dibuat untuk memenuhi tugas mata kuliah Big Data Program Studi Teknologi Informasi, Fakultas Ilmu Komputer, Universitas Brawijaya.

Anggota kelompok terdiri atas 4 orang, yaitu :

Norma Desitasari (165150700111014)
Sausan Zahrah (165150700111023)
Renaldi Muhammad (165150701111021)
Ferina Kusuma Anjani (165150701111024)

Langkah-langkah yang dijalankan :

Membuat file csv

Membuat class java program

SalesMapper.java

SalesCountryReducer.java

SalesCountryDriver.java

package SalesCountry;

import org.apache.hadoop.fs.Path;
import org.apache.hadoop.io.*;
import org.apache.hadoop.mapred.*;

public class SalesCountryDriver {
 public static void main(String[] args) {
  JobClient my_client = new JobClient();
  // Create a configuration object for the job
  JobConf job_conf = new JobConf(SalesCountryDriver.class);

// Set a name of the Job
  job_conf.setJobName("SalePerCountry");

// Specify data type of output key and value
  job_conf.setOutputKeyClass(Text.class);
  job_conf.setOutputValueClass(IntWritable.class);

// Specify names of Mapper and Reducer Class
  job_conf.setMapperClass(SalesCountry.SalesMapper.class);
  job_conf.setReducerClass(SalesCountry.SalesCountryReducer.class);

// Specify formats of the data type of Input and output
  job_conf.setInputFormat(TextInputFormat.class);
  job_conf.setOutputFormat(TextOutputFormat.class);

// Set input and output directories using command line arguments, 
  //arg[0] = name of input directory on HDFS, and arg[1] =  name of output directory to be created to store the output file.
  
  FileInputFormat.setInputPaths(job_conf, new Path(args[0]));
  FileOutputFormat.setOutputPath(job_conf, new Path(args[1]));

my_client.setConf(job_conf);
  try {
   // Run the job 
   JobClient.runJob(job_conf);
  } catch (Exception e) {
   e.printStackTrace();
  }
 }
}

Memulai daemon pada HDFS