Difference between revisions of "Main Page"

From Lawa
Jump to: navigation, search
Line 34: Line 34:
 
== Processing of ARCs ==
 
== Processing of ARCs ==
 
* [https://www.cs.huji.ac.il/wikis/MediaWiki/lawa/index.php/ArcFiles: Package to parse and process arc files]
 
* [https://www.cs.huji.ac.il/wikis/MediaWiki/lawa/index.php/ArcFiles: Package to parse and process arc files]
 
== General information about our cluster ==
 
* [https://www.cs.huji.ac.il/wikis/MediaWiki/lawa/index.php/Cluster: Information about the main cluster]
 
  
 
== Related work ==
 
== Related work ==

Revision as of 23:49, 24 May 2011

Welcome to the LAWA Wiki

This site is dedicated to the arcane art of Hadooping (very) large data.

What is LAWA?

Please refer to: https://www.cs.huji.ac.il/wikis/MediaWiki/lawa/index.php/LawaWiki:Community_Portal

Getting started

Building Hadoop

The Hadoop 0.21 Innards

Hadoop HUJI Modifications

The Hadoop 0.21 Test Cluster

The test cluster for Hadoop 0.21 development is now live and its NameNode and JobTracker (master node) is located on hadoop23@cs. If you wish to access the web applications for the NameNode and JobTracker, please follow these links from inside the CS network:

NameNode statistics:

http://hadoop23:50070

JobTracker statistics:

http://hadoop23:50030

Processing of ARCs

Related work

Disk-Locality in Datacenter Computing Considered Irrelevant
G. Ananthanarayanan, A. Ghodsi, S. Shenker, I. Stoica]

Reining in the Outliers in MapReduce Clusters using Mantri
G. Ananthanarayanan, S. Kandula, A. Greenberg, I. Stoica, Y. Lu, B. Saha, E. Harris