Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Getting filename in case of MultipleInputs


Copy link to this message
-
Re: Getting filename in case of MultipleInputs
There is already a JIRA for this:

MAPREDUCE-1743

On 05/03/2012 09:06 AM, Harsh J wrote:
> Subbu,
>
> The only way I can think of, is to use an overridden
> InputFormat/RecordReader pair that sets the "map.input.file" config
> value during its initialization, using the received FileSplit object.
>
> This should be considered as a bug, however, and even 2.x is affected.
> Can you please file a JIRA on
> https://issues.apache.org/jira/browse/MAPREDUCE and post back the ID
> on this thread for posterity?
>
> On Thu, May 3, 2012 at 6:25 PM, Kasi Subrahmanyam
> <[EMAIL PROTECTED]>  wrote:
>> Hi,
>>
>> Could anyone suggest how to get the filename in the mapper.
>> I have gone through the JIRA ticket that map.input.file doesnt work in case
>> of multiple inputs,TaggedInputSplit also doesnt work in case of 0.20.2
>> version as it is not a public class.
>> I tried to find any other approach than this but i could find none in the
>> search
>> Could anyone suggest a solution other tan these
>>
>>
>>
>> Thanks in advance;
>> Subbu.
>
> Thanks,
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB