Hadoop HUJI: Measurement Hook-Points

From Lawa
Revision as of 16:09, 7 May 2011 by Direwolf007 (Talk | contribs)

Jump to: navigation, search

1.Mapper Input:

  • Location: org.apache.hadoop.hdfs.BlockReader.readChunk()

2.Reducer Input:

  • Location #1: org.apache.hadoop.mapreduce.task.reduce.Fetcher.shuffleToMemory()
  • Location #2: org.apache.hadoop.mapreduce.task.reduce.Fetcher.shuffleToDisk()

3.HDFS Writes:

  • Location: org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock()