Tuesday, November 20, 2012

Best Way to add nodes to hadoop cluster

Add the new node's DNS name to the conf/slaves file on the master node.  Then log in to the new slave node and execute:

If you are using Cloudera's distribution of Hadoop:

service hadoop-0.20-datanode start
service hadoop-0.20-tasktracker start

If you are using Apache distribution of Hadoop:



$ cd path/to/hadoop
$ bin/hadoop-daemon.sh start datanode
$ bin/hadoop-daemon.sh start tasktracker
Posted by at
Labels: , , ,

No comments:

Post a Comment

Thank you for Commenting Will reply soon ......

Subscribe to: Post Comments (Atom)

Featured Posts

#Linux Commands Unveiled: #date, #uname, #hostname, #hostid, #arch, #nproc

 #Linux Commands Unveiled: #date, #uname, #hostname, #hostid, #arch, #nproc Linux is an open-source operating system that is loved by millio...

  • Hadoop : Hive
    Hadoop is a batch processing system, and Hadoop jobs tend to have high latency and incur substantial overhead in job submission and sched...
  • Print a triangle using shell script
    Print numbers in order : #!/bin/bash for i in $(seq 0 4) do for j in  $(seq $i -1 0) do     echo -n $j done echo done Will gi...