GitHub - shivtej1505/HDFS-MapReduce: Distributed grep using MapReduce on top of Distributed File System.

shivtej1505 / HDFS-MapReduce Public

Notifications You must be signed in to change notification settings
Fork 0
Star 0

Distributed grep using MapReduce on top of Distributed File System.

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 66 Commits
IDataNode		IDataNode
IJobTracker		IJobTracker
IMapper		IMapper
INameNode		INameNode
IReducer		IReducer
MapReduceProto		MapReduceProto
Protobuf		Protobuf
Utils		Utils
.gitignore		.gitignore
Client.java		Client.java
DataNode.java		DataNode.java
JobClient.java		JobClient.java
JobTracker.java		JobTracker.java
Makefile		Makefile
MapNode.jar		MapNode.jar
MapNode.java		MapNode.java
MapReduce.proto		MapReduce.proto
NameNode.java		NameNode.java
README		README
ReduceNode.jar		ReduceNode.jar
ReduceNode.java		ReduceNode.java
TaskTracker.java		TaskTracker.java
hdfs.proto		hdfs.proto
protobuf-java-3.0.2.jar		protobuf-java-3.0.2.jar

Repository files navigation

MapReduce on top of Distributed File System.

Features:
* Read/Write files
* Replications
* List files
* Heartbeat


TODO:
* Make it persistent
* Append operation
* Makefile

Command:
rmiregistry // run to start rmiregistry, inside bin
java -cp protobuf-java-3.0.2.jar: <className> // To run a class