Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop, mail # user - Re: get recent changed files in hadoop


Copy link to this message
-
Re: get recent changed files in hadoop
Jean-Marc Spaggiari 2013-05-08, 03:58
You can still parse the hadoop ls ouput with bash and sort it (revert,
cut, sort, etc.), but that will read all the entries, just just the x
first one...

2013/5/7 Winston  Lin <[EMAIL PROTECTED]>:
> look like we cannot even sort the output of ls by date with fs command?
>
> In *ux system, we can do ls -t ...to  sort by modification time, newest
> first
>
> Winston
>
>
>
>
> On Wed, May 8, 2013 at 1:47 PM, Mohammad Tariq <[EMAIL PROTECTED]> wrote:
>>
>> I don't think any such thing is available OOTB.
>>
>> Warm Regards,
>> Tariq
>> https://mtariq.jux.com/
>> cloudfront.blogspot.com
>>
>>
>> On Wed, May 8, 2013 at 8:51 AM, Rahul Bhattacharjee
>> <[EMAIL PROTECTED]> wrote:
>>>
>>> Is any such option available in other posix shells?
>>>
>>>
>>> On Wednesday, May 8, 2013, Winston Lin wrote:
>>>>
>>>> Any idea to get recent changed file in hadoop? e.g. files created
>>>> yesterday?
>>>>
>>>> fs -ls will only give us all the files.
>>>>
>>>> Thanks
>>>> Winston
>>>
>>>
>>>
>>> --
>>> Sent from Gmail Mobile
>>
>>
>