Hi,

Could anyone suggest how to get the filename in the mapper.
I have gone through the JIRA ticket that map.input.file doesnt work in case
of multiple inputs,TaggedInputSplit also doesnt work in case of 0.20.2
version as it is not a public class.
I tried to find any other approach than this but i could find none in the
search
Could anyone suggest a solution other tan these

Thanks in advance;
Subbu.

Hi Subbu,

      The file/split processed by  a mapper could be obtained from
WebUI as soon as the job is executed. However this detail can't be
obtained once the job is moved to JT history.

Regards
Bejoy

On Thu, May 3, 2012 at 6:25 PM, Kasi Subrahmanyam
<[EMAIL PROTECTED]> wrote:
> Hi,
>
> Could anyone suggest how to get the filename in the mapper.
> I have gone through the JIRA ticket that map.input.file doesnt work in case
> of multiple inputs,TaggedInputSplit also doesnt work in case of 0.20.2
> version as it is not a public class.
> I tried to find any other approach than this but i could find none in the
> search
> Could anyone suggest a solution other tan these
>
>
>
> Thanks in advance;
> Subbu.

Hi Subbu,

   I am not sure which input format you are using. If you are using FileInputFormat, you can get the file name this way in map function..

import org.apache.hadoop.mapred.FileSplit;
import org.apache.hadoop.mapreduce.InputSplit;
import org.apache.hadoop.mapreduce.Mapper;

public class TestMapper extends Mapper<Object, Object, Object, Object> {

  private String fileName;

  public void setup(
      org.apache.hadoop.mapreduce.Mapper<Object, Object, Object, Object>.Context context)
      throws java.io.IOException, InterruptedException {
    InputSplit inputSplit = context.getInputSplit();
    fileName = ((FileSplit) inputSplit).getPath().getName();
  }

  protected void map(
      Object key,
      Object value,
      org.apache.hadoop.mapreduce.Mapper<Object, Object, Object, Object>.Context context)
      throws java.io.IOException, InterruptedException {

    // you can use the fileName here
    System.out.println(fileName);
  }
}
Thanks

Devaraj

________________________________
From: Kasi Subrahmanyam [[EMAIL PROTECTED]]
Sent: Thursday, May 03, 2012 6:25 PM
To: [EMAIL PROTECTED]
Subject: Getting filename in case of MultipleInputs

Hi,

Could anyone suggest how to get the filename in the mapper.
I have gone through the JIRA ticket that map.input.file doesnt work in case of multiple inputs,TaggedInputSplit also doesnt work in case of 0.20.2 version as it is not a public class.
I tried to find any other approach than this but i could find none in the search
Could anyone suggest a solution other tan these

Thanks in advance;
Subbu.

Subbu,

The only way I can think of, is to use an overridden
InputFormat/RecordReader pair that sets the "map.input.file" config
value during its initialization, using the received FileSplit object.

This should be considered as a bug, however, and even 2.x is affected.
Can you please file a JIRA on
https://issues.apache.org/jira/browse/MAPREDUCE and post back the ID
on this thread for posterity?

On Thu, May 3, 2012 at 6:25 PM, Kasi Subrahmanyam
<[EMAIL PROTECTED]> wrote:
> Hi,
>
> Could anyone suggest how to get the filename in the mapper.
> I have gone through the JIRA ticket that map.input.file doesnt work in case
> of multiple inputs,TaggedInputSplit also doesnt work in case of 0.20.2
> version as it is not a public class.
> I tried to find any other approach than this but i could find none in the
> search
> Could anyone suggest a solution other tan these
>
>
>
> Thanks in advance;
> Subbu.
Thanks,
--
Harsh J

There is already a JIRA for this:

MAPREDUCE-1743

On 05/03/2012 09:06 AM, Harsh J wrote:
> Subbu,
>
> The only way I can think of, is to use an overridden
> InputFormat/RecordReader pair that sets the "map.input.file" config
> value during its initialization, using the received FileSplit object.
>
> This should be considered as a bug, however, and even 2.x is affected.
> Can you please file a JIRA on
> https://issues.apache.org/jira/browse/MAPREDUCE and post back the ID
> on this thread for posterity?
>
> On Thu, May 3, 2012 at 6:25 PM, Kasi Subrahmanyam
> <[EMAIL PROTECTED]>  wrote:
>> Hi,
>>
>> Could anyone suggest how to get the filename in the mapper.
>> I have gone through the JIRA ticket that map.input.file doesnt work in case
>> of multiple inputs,TaggedInputSplit also doesnt work in case of 0.20.2
>> version as it is not a public class.
>> I tried to find any other approach than this but i could find none in the
>> search
>> Could anyone suggest a solution other tan these
>>
>>
>>
>> Thanks in advance;
>> Subbu.
>
> Thanks,

Yeah Jim,
I have gone through the comments in that JIRA ticket and am able to solve
my problem

On Sat, May 5, 2012 at 11:25 PM, Jim Donofrio <[EMAIL PROTECTED]> wrote:

> There is already a JIRA for this:
>
> MAPREDUCE-1743
>
>
> On 05/03/2012 09:06 AM, Harsh J wrote:
>
>> Subbu,
>>
>> The only way I can think of, is to use an overridden
>> InputFormat/RecordReader pair that sets the "map.input.file" config
>> value during its initialization, using the received FileSplit object.
>>
>> This should be considered as a bug, however, and even 2.x is affected.
>> Can you please file a JIRA on
>> https://issues.apache.org/**jira/browse/MAPREDUCE<https://issues.apache.org/jira/browse/MAPREDUCE>and post back the ID
>> on this thread for posterity?
>>
>> On Thu, May 3, 2012 at 6:25 PM, Kasi Subrahmanyam
>> <[EMAIL PROTECTED]>  wrote:
>>
>>> Hi,
>>>
>>> Could anyone suggest how to get the filename in the mapper.
>>> I have gone through the JIRA ticket that map.input.file doesnt work in
>>> case
>>> of multiple inputs,TaggedInputSplit also doesnt work in case of 0.20.2
>>> version as it is not a public class.
>>> I tried to find any other approach than this but i could find none in the
>>> search
>>> Could anyone suggest a solution other tan these
>>>
>>>
>>>
>>> Thanks in advance;
>>> Subbu.
>>>
>>
>> Thanks,
>>
>