slu

Søren's Blog

Random Ramblings

Previous Entry Share Next Entry
Installing Hadoop 1.0.4 on Ubuntu 12.04
slu

I've been playing a bit with Hadoop. Below you'll find notes and screenshots showing how to install a simple development setup (on a virtual server).



You'll need




  • A Linux Server. I'm using Ubuntu 12.04 LTS 64 bit, but any should do

  • Java JDK 1.6_24 64 bit for Linux (jdk-6u24-linux-x64.bin) get it here

  • Hadoop 1.0.4 (hadoop-1.0.4-bin.tar.gz) get it here



Install your server. I wont describe how to do that.



I'm using a virtual machine running on VirtualBox. After installing linux, you'll need to configure port forwarding. Open "Settings", select the "Network" tab and click "Port Forwarding":

hadoop-01


Then configure the following four port forwards:

hadoop-02


Now you're ready to copy Java and Hadoop to the server. I usually use command line tools: E.g. on Windows with PuTTY:


pscp -l ubuntu -P 9022 hadoop-1.0.4-bin.tar.gz jdk-6u24-linux-x64.bin 127.0.0.1:





Or on Linux:


scp hadoop-1.0.4-bin.tar.gz jdk-6u24-linux-x64.bin ubuntu@127.0.0.1:9022:




Now you need to log on to your server. On Windows you should use PuTTY; enter "Host Name" and "Port" and click "Open":

hadoop-03


First install java. Make the file executable and run it as root using sudo:

hadoop-04


A lot of files will be unpacked:

hadoop-05


Finally you can press enter followed by a few commands to move java into /opt, create a softlink and create a profile for java:

hadoop-06


In the profile set the JAVA_HOME environment variable and prepend Java bin directory to PATH:

hadoop-07


Check the settings by source'ing and verifying the version of Java:

hadoop-08


More:

hadoop-09


More:

hadoop-10


More:

hadoop-11


More:

hadoop-12


More:

hadoop-13


More:

hadoop-14


More:

hadoop-15


More:

hadoop-16


More:

hadoop-17


More:

hadoop-18


More:

hadoop-19


More:

hadoop-20


More:

hadoop-21


More:

hadoop-22


More:

hadoop-23


More:

hadoop-24


More:

hadoop-25


More:

hadoop-26


More:

hadoop-27


More:

hadoop-28


More:

hadoop-29


More:

hadoop-30


More:

hadoop-31


More:

hadoop-32


More:

hadoop-33


More:

hadoop-34


More:

hadoop-35


More:

hadoop-36


More:

hadoop-37


More:

hadoop-38


More:

hadoop-39


More:

hadoop-40


More:

hadoop-41


More:

hadoop-42


More:

hadoop-43


More:

hadoop-44


More:

hadoop-45


More:

hadoop-46


More:

hadoop-47


More:

hadoop-48


More:

hadoop-49


More:

hadoop-50


More:

hadoop-51



All screenshots can be downloaded here.


?

Log in