Ravi Prakash's Homepage: Secure single node hadoop cluster

How to setup you own secure single node hadoop cluster

These are the steps I followed to setup a single node secure 0.20 cluster. I’m sure there are other ways, but this is how I did it.

Follow all the steps outlined under the “Kerberos” section at http://yahoo.github.com/hadoop-common/installing.html to set up a KDC.
You can refer to my /var/kerberos/krb5kdc/kdc.conf and /etc/krb5.conf
To clean up everything : http://mailman.mit.edu/pipermail/kerberos/2003-June/003312.html
Create Kerberos database $ sudo kdb5_util create -s
Start Kerberos $ sudo /etc/rc.d/init.d/kadmin start $ sudo /etc/rc.d/init.d/krb5kdc start
Create principal raviprak/localhost.localdomain@localdomain http://web.mit.edu/kerberos/krb5-1.5/krb5-1.5.4/doc/krb5-admin/Adding-or-Modifying-Principals.html
Create keytab file using xst -k /home/raviprak/raviprak.keytab raviprak/localhost.localdomain@localdomain
Setup hdfs-site.xml and core-site.xml
sudo hostname localhost.localdomain # If that is not already your hostname
hadoop-daemon.sh start namenode
sudo bash. Then export HADOOP_SECURE_DN_USER=raviprak . Then hadoop-daemon.sh start datanode

Please add comments here:

All content on this website is licensed as Creative Commons-Attribution-ShareAlike 4.0 License. Opinions expressed are solely my own.