Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop >> mail # user >> RE: Sending the entire file content as value to the mapper


Copy link to this message
-
RE: Sending the entire file content as value to the mapper
Hi,

  You could send the file meta info to the map function as key/value through the split, and then you can read the entire file in your map function.

Thanks
Devaraj k
-----Original Message-----
From: Kasi Subrahmanyam [mailto:[EMAIL PROTECTED]]
Sent: 11 July 2013 13:38
To: [EMAIL PROTECTED]; [EMAIL PROTECTED]
Subject: Sending the entire file content as value to the mapper

Hi Team,

I have a file which has semi structured text  data with no definite start and end points.
How can i send the entire content of the file at once as key or value to the mapper instead of line by line.

Thanks,
Subbu
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB