Hadoop HUJI: Measurement Hook-Points

From Lawa
Revision as of 16:08, 7 May 2011 by Direwolf007 (Talk | contribs)

(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to: navigation, search

1.Mapper Input:

  • Location: org.apache.hadoop.hdfs.BlockReader.readChunk()

2.Reducer Input:

  • Location #1: org.apache.hadoop.mapreduce.task.reduce.Fetcher.shuffleToMemory()
  • Location #2: org.apache.hadoop.mapreduce.task.reduce.Fetcher.shuffleToDisk()

3.HDFS Writes:

  • Location: org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock()