Hi Subbu. Sounds like you'll have to implement a custom non-splittable InputFormat which instantiates a custom RecordReader which in turn consumes the entire file when it's next(K,V) method is called. Once implemented, you specify the input format to the JobConf object:
From: Kasi Subrahmanyam [mailto:[EMAIL PROTECTED]] Sent: Thursday, July 11, 2013 1:08 AM To: [EMAIL PROTECTED]; [EMAIL PROTECTED] Subject: Sending the entire file content as value to the mapper
I have a file which has semi structured text data with no definite start and end points.
How can i send the entire content of the file at once as key or value to the mapper instead of line by line.
If you are not the intended recipient of this mail SDL requests and requires that you delete it without acting upon or copying any of its contents, and we further request that you advise us.<BR><BR> SDL Enterprise Technologies, Inc. - all rights reserved. The information contained in this email may be confidential and/or legally privileged. It has been sent for the sole use of the intended recipient(s). If you are not the intended recipient of this mail, you are hereby notified that any unauthorized review, use, disclosure, dissemination, distribution, or copying of this communication, or any of its contents, is strictly prohibited. If you have received this communication in error, please reply to the sender and destroy all copies of the message. <BR>Registered address: 201 Edgewater Drive, Suite 225, Wakefield, MA 01880, USA </font>
NEW: Monitor These Apps!
All projects made searchable here are trademarks of the Apache Software Foundation.
Service operated by Sematext