<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>Mind.random() &#187; hadoop</title>
	<atom:link href="http://arunma.com/category/hadoop/feed/" rel="self" type="application/rss+xml" />
	<link>http://arunma.com</link>
	<description>random thoughts of an eccentric programmer</description>
	<lastBuildDate>Thu, 29 Jul 2010 07:41:10 +0000</lastBuildDate>
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.0</generator>
		<item>
		<title>Random thoughts</title>
		<link>http://arunma.com/2009/04/29/random-thoughts/</link>
		<comments>http://arunma.com/2009/04/29/random-thoughts/#comments</comments>
		<pubDate>Wed, 29 Apr 2009 16:48:11 +0000</pubDate>
		<dc:creator>Arun Manivannan</dc:creator>
				<category><![CDATA[Uncategorized]]></category>
		<category><![CDATA[hadoop]]></category>
		<category><![CDATA[azureus]]></category>
		<category><![CDATA[java]]></category>
		<category><![CDATA[open source]]></category>
		<category><![CDATA[random]]></category>

		<guid isPermaLink="false">http://arunma.com/?p=316</guid>
		<description><![CDATA[1) Read that the open source movement got a big spur during the 2000 slow down and researchers estimate another spur now. Very evident by the increase in the number of participants and projects. Blessing in disguise but lets keep the laid off in our prayers. 2) Planning for integrating IzPack into Snapman over the [...]]]></description>
			<content:encoded><![CDATA[<p>1) Read that the open source movement got a big spur during the 2000 slow down and researchers estimate another spur now. Very evident by the increase in the number of participants and projects. Blessing in disguise but lets keep the laid off in our prayers.</p>
<p>2) Planning for integrating IzPack into Snapman over the weekend.  Successfully implemented the InfixToPostFix conversion and evaluation algorithm. Need to have more tricks in my bag (Man !! i really wish i got good comp science education)</p>
<p>3) Had trouble running azureus on Jaunty Jantelope (Ubuntu 9.04). Executing from terminal showed that it is looking for open jdk 6. So, just installed Open JDK after uninstalling the gcj. Noob fix but still it solves my problem.</p>
<p>4) Bug # 1 in Ubuntu bugs.. hahhaha<a href="https://launchpad.net/ubuntu/+bug/1" target="_blank"> https://launchpad.net/ubuntu/+bug/1</a> Yup. Thats the real bug.</p>
<p>I think i seriously need to develop some expertise to write something daily for my blog.</p>
]]></content:encoded>
			<wfw:commentRss>http://arunma.com/2009/04/29/random-thoughts/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>HBase Tutorial</title>
		<link>http://arunma.com/2008/10/26/hbase-tutorial/</link>
		<comments>http://arunma.com/2008/10/26/hbase-tutorial/#comments</comments>
		<pubDate>Sun, 26 Oct 2008 12:51:32 +0000</pubDate>
		<dc:creator>Arun Manivannan</dc:creator>
				<category><![CDATA[hadoop]]></category>
		<category><![CDATA[hbase]]></category>
		<category><![CDATA[tutorial]]></category>

		<guid isPermaLink="false">http://arunma.com/?p=295</guid>
		<description><![CDATA[These are some excellent links to learn Hbase (or to say, unlearn RDBMS way of thinking) http://jimbojw.com/wiki/index.php?title=Understanding_Hbase_and_BigTable http://jimbojw.com/wiki/index.php?title=Understanding_HBase_column-family_performance_options I use Ubuntu (saves me a lot of trouble setting up the ssh and stuff). For ubuntu users, here is your link http://www.michael-noll.com/wiki/Running_Hadoop_On_Ubuntu_Linux_(Multi-Node_Cluster)]]></description>
			<content:encoded><![CDATA[<p>These are some excellent links to learn Hbase (or to say, unlearn RDBMS way of thinking)<br />
<a href="http://jimbojw.com/wiki/index.php?title=Understanding_Hbase_and_BigTable" target="_blank">http://jimbojw.com/wiki/index.php?title=Understanding_Hbase_and_BigTable</a><br />
<a href="http://jimbojw.com/wiki/index.php?title=Understanding_HBase_column-family_performance_options" target="_blank">http://jimbojw.com/wiki/index.php?title=Understanding_HBase_column-family_performance_options</a></p>
<p>I use Ubuntu (saves me a lot of trouble setting up the ssh and stuff). For ubuntu users, here is your link<br />
<a href="http://www.michael-noll.com/wiki/Running_Hadoop_On_Ubuntu_Linux_%28Multi-Node_Cluster%29" target="_blank">http://www.michael-noll.com/wiki/Running_Hadoop_On_Ubuntu_Linux_(Multi-Node_Cluster)</a></p>
]]></content:encoded>
			<wfw:commentRss>http://arunma.com/2008/10/26/hbase-tutorial/feed/</wfw:commentRss>
		<slash:comments>1</slash:comments>
		</item>
		<item>
		<title>Hadoop and HBase &#8211; setting up as pseudo-distributed</title>
		<link>http://arunma.com/2008/10/26/hadoop-and-hbase-setting-up-on-local-machine/</link>
		<comments>http://arunma.com/2008/10/26/hadoop-and-hbase-setting-up-on-local-machine/#comments</comments>
		<pubDate>Sun, 26 Oct 2008 12:47:51 +0000</pubDate>
		<dc:creator>Arun Manivannan</dc:creator>
				<category><![CDATA[hadoop]]></category>
		<category><![CDATA[hbase]]></category>
		<category><![CDATA[subrecord]]></category>
		<category><![CDATA[distributed]]></category>
		<category><![CDATA[MasterNotRunningException]]></category>
		<category><![CDATA[pseudo]]></category>
		<category><![CDATA[setup]]></category>

		<guid isPermaLink="false">http://arunma.com/?p=294</guid>
		<description><![CDATA[For the past many months i have been out of blogging due to personal reasons. By the Grace of God, things have just turned perfectly good for me.  So, i am back to experimenting with some really cool stuff. These instructions are an excerpt from http://www.michael-noll.com/wiki/Running_Hadoop_On_Ubuntu_Linux_(Multi-Node_Cluster) and Hadoop, HBase API documentation. 1) Download Hadoop (hadoop-0.18.1) [...]]]></description>
			<content:encoded><![CDATA[<p>For the past many months i have been out of blogging due to personal reasons. By the Grace of God, things have just turned perfectly good for me.  So, i am back to experimenting with some really cool stuff.</p>
<p>These instructions are an excerpt from</p>
<p><a href="http://www.michael-noll.com/wiki/Running_Hadoop_On_Ubuntu_Linux_(Multi-Node_Cluster)">http://www.michael-noll.com/wiki/Running_Hadoop_On_Ubuntu_Linux_(Multi-Node_Cluster)</a></p>
<p>and Hadoop, HBase API documentation.</p>
<p>1)  Download Hadoop (hadoop-0.18.1)<br />
2)  Download HBase (hbase-0.18.0)<br />
3)  I just setup the environment as Pseudo-Distributed.</p>
<p>a) Open up the hadoop-env.sh file in the conf directory of hadoop. Change the JAVA_HOME directory to point to your own machine setup. Mine looks like this :</p>
<p><strong> export JAVA_HOME=/usr/lib/jvm/java-6-sun-1.6.0.07 </strong></p>
<p>b)  Open up the hbase-env.sh file in the conf directory of hbase and set JAVA_HOME.</p>
<p>c)  Edit hbase-site.xml and make your configuration tag look like this :</p>
<p><strong>&lt;configuration&gt;<br />
&lt;property&gt;<br />
&lt;name&gt;fs.default.name&lt;/name&gt;<br />
&lt;value&gt;hdfs://localhost/hbase&lt;/value&gt;<br />
&lt;/property&gt;<br />
&lt;/configuration&gt; </strong></p>
<p>d)  Make hadoop-site.xml to look like the following :</p>
<p><strong>&lt;configuration&gt;<br />
&lt;property&gt;<br />
&lt;name&gt;fs.default.name&lt;/name&gt;<br />
&lt;value&gt;hdfs://localhost/&lt;/value&gt;<br />
&lt;/property&gt;<br />
&lt;property&gt;<br />
&lt;name&gt;dfs.replication&lt;/name&gt;<br />
&lt;value&gt;1&lt;/value&gt;<br />
&lt;/property&gt;<br />
&lt;/configuration&gt; </strong></p>
<p>e) Issue the following command inside the bin directory of your hadoop<br />
./start-all.sh</p>
<p><strong> eg : <a href="mailto:arun@arun-laptop:%7E/softy/hadoop-0.18.1" target="_new">arun@arun-laptop:~/softy/hadoop-0.18.1</a>/bin$ ./start-all.sh </strong></p>
<p>f) Issue the following command to start HBase</p>
<p><strong> eg : <a href="mailto:arun@arun-laptop:%7E/softy/hbase-0.18.0" target="_new">arun@arun-laptop:~/softy/hbase-0.18.0</a>/bin$ ./start-hbase.sh </strong></p>
<p>You can play with the shell if you wanted to.</p>
<p><a href="mailto:arun@arun-laptop:%7E/softy/hbase-0.18.0" target="_new">arun@arun-laptop:~/softy/hbase-0.18.0</a>/bin$ ./hbase shell</p>
<p>There is an example on <a href="http://hadoop.apache.org/hbase/docs/r0.18.0/api/index.html" target="_blank">http://hadoop.apache.org/hbase/docs/r0.18.0/api/index.html</a> which</p>
<p>i used to test my setup. The example would need us to create a table &#8216;myTable&#8217; with a column family &#8216;myColumnFamily&#8217;</p>
<p>Execute the following command on the shell</p>
<p><strong> create &#8216;myTable&#8217;,'myColumnFamily&#8217; </strong></p>
<p>Here is what i got as output on execution of the example program :</p>
<p><strong> Found row: myRow with value: timestamp=1225023942810, value=columnQualifier1 value! </strong></p>
<p>Let me know if I could help you with any of the setup problems. I didnt copy the hadoop-site.xml to hbase conf. Later i learnt that it is useful only on &#8220;truly&#8221; distributed environment.</p>
<p>The above setup instructions were just derived from<br />
a) <a href="http://hadoop.apache.org/core/docs/r0.18.1/api/index.html" target="_blank">http://hadoop.apache.org/core/docs/r0.18.1/api/index.html</a><br />
and<br />
b) <a href="http://hadoop.apache.org/hbase/docs/r0.18.0/api/index.html" target="_blank">http://hadoop.apache.org/hbase/docs/r0.18.0/api/index.html</a></p>
<p>Food for the bots : Here is the list of exceptions i got during the process of setting this up :</p>
<p>INFO  20:39:19 [org.apache.hadoop.hbase.client.HConnectionManager$TableServers (202):getMaster]:</p>
<p>Attempt 0 of 10 failed with &lt;java.io.IOException: Call failed on local exception&gt;.</p>
<p>Retrying after sleep of 5000</p>
<p>Exception in thread &#8220;main&#8221; org.apache.hadoop.hbase.MasterNotRunningException: localhost:60000</p>
<p>The above log just means that the hbase and hadoop are not started at all. Check the log for exceptions.</p>
<p>Remember, Hadoop must be started first followed by HBase.</p>
]]></content:encoded>
			<wfw:commentRss>http://arunma.com/2008/10/26/hadoop-and-hbase-setting-up-on-local-machine/feed/</wfw:commentRss>
		<slash:comments>1</slash:comments>
		</item>
	</channel>
</rss>
