Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS, mail # user - Data processing in DFSClient


Copy link to this message
-
RE: Data processing in DFSClient
Uma Maheswara Rao G 2012-01-18, 15:22
I did not get your complete idea here but before that, file will be splitted into blocks. Then how will you extract ?
Why con't you create tar file and one index file which will maintain index of each file..something like this?

________________________________
From: Sesha Kumar [[EMAIL PROTECTED]]
Sent: Wednesday, January 18, 2012 8:24 PM
To: [EMAIL PROTECTED]
Subject: Re: Data processing in DFSClient
Sorry for the delay. I'm trying to implement an IEEE paper which combines a bunch of files into a single file and when the file is requested the datanode extracts the desired file from the block and sends the file to DFSClient.