Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop >> mail # user >> Re: MR2 submit job help


+
Rahul Bhattacharjee 2013-06-01, 08:05
+
Shahab Yunus 2013-06-01, 13:11
+
Shashidhar Rao 2013-06-01, 16:37
Copy link to this message
-
Re: MR2 submit job help
Thats a warn

You might not have the users dir in hdfs.

 try
hadoop fs -put sample.txt /sample.txt

Rahul
On Sat, Jun 1, 2013 at 10:07 PM, Shashidhar Rao
<[EMAIL PROTECTED]>wrote:

> After building MR2 , I am able to start all the daemons
> 27873 Jps
> 27096 NameNode
> 27169 DataNode
> 27326 NodeManager
> 27398 JobHistoryServer
> 13329
> 27257 ResourceManager
> 27043 Bootstrap
>
> but when I run bin/hadoop fs -put sample.txt sample.txt
> I get the error
> 13/06/01 22:05:48 WARN util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
> put: `sample.txt': No such file or directory
>
> Native-hadoop library is not loaded
>
> what I need to do?
>
> Thanks
> shashidhar
>
>
>
>
> On Sat, Jun 1, 2013 at 6:41 PM, Shahab Yunus <[EMAIL PROTECTED]>wrote:
>
>> Is you file name file.txt or file that you are trying to upload? Have you
>> made sure about that? Is any other command working? Have you tried
>> copyFromLocal?
>>
>> Regards,
>> Shahab
>>
>>
>> On Sat, Jun 1, 2013 at 4:05 AM, Rahul Bhattacharjee <
>> [EMAIL PROTECTED]> wrote:
>>
>>> you should be able to use hadoop fs -put <file> . file in the directory
>>> where you are running the command.
>>>
>>>
>>>
>>> On Sat, Jun 1, 2013 at 5:31 AM, Shashidhar Rao <
>>> [EMAIL PROTECTED]> wrote:
>>>
>>>> Hi Users,
>>>>
>>>> Please help me with some documentation on how to submit job in YARN and
>>>> upload files in HDFS. Can I still use the MR1 commands for file uploading
>>>> to hadoop fs -put and hadoop jar job.jar input ouput? Because I ran with
>>>> errors saying file cannot be uploaded as file cannot found. The directory
>>>> structure is same .
>>>>
>>>> MR2 Directory structure/same as MR1
>>>> hadoop/bin/~all hadoop files including hadoop excecutable
>>>> hadoop/ file.txt, job.jar etc
>>>> hadoop/etc/hadoop/ ~all site files and properties
>>>>
>>>> I cd to hadoop and then I am executing bin/hadoop fs -put file file
>>>> It says file cannot be found but I was able to run without error in MR1
>>>>
>>>> Thanks
>>>> shashidhar
>>>>
>>>>
>>>>
>>>>
>>>
>>
>
+
Shashidhar Rao 2013-06-01, 17:22
+
Shahab Yunus 2013-06-01, 19:21
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB