Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS >> mail # user >> Data processing in DFSClient


+
Sesha Kumar 2012-01-16, 14:20
+
Uma Maheswara Rao G 2012-01-16, 14:34
+
Joey Echeverria 2012-01-16, 16:06
+
Sesha Kumar 2012-01-18, 14:54
Copy link to this message
-
RE: Data processing in DFSClient
I did not get your complete idea here but before that, file will be splitted into blocks. Then how will you extract ?
Why con't you create tar file and one index file which will maintain index of each file..something like this?

________________________________
From: Sesha Kumar [[EMAIL PROTECTED]]
Sent: Wednesday, January 18, 2012 8:24 PM
To: [EMAIL PROTECTED]
Subject: Re: Data processing in DFSClient
Sorry for the delay. I'm trying to implement an IEEE paper which combines a bunch of files into a single file and when the file is requested the datanode extracts the desired file from the block and sends the file to DFSClient.
+
Sesha Kumar 2012-01-19, 16:52
+
Joey Echeverria 2012-01-20, 00:54
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB