| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
144 (0.113s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: Hadoop fs -getmerge - Hadoop - [mail # user]
|
|
...I don't think that is possible. When we use -getmerge, the destination filesystem happens to be a LocalFileSystem which extends from ChecksumFileSystem. I believe that's why the CRC files ar...
|
|
|
Author: Hemanth Yamijala,
2013-04-18, 04:25
|
|
|
Re: How to configure mapreduce archive size? - Hadoop - [mail # user]
|
|
...Hi, This directory is used as part of the 'DistributedCache' feature. ( http://hadoop.apache.org/docs/r1.0.4/mapred_tutorial.html#DistributedCache). There is a configuration key "local...
|
|
|
Author: Hemanth Yamijala,
2013-04-09, 04:09
|
|
|
Re: Auto clean DistCache? - Hadoop - [mail # user]
|
|
...I don't think it is documented in mapred-default.xml, where it should ideally be. I could see it only in code. You can take a look at it here, if you are interested: http://goo.gl/k5xsI &nbs...
|
|
|
Author: Hemanth Yamijala,
2013-03-28, 05:09
|
|
|
Re: Child JVM memory allocation / Usage - Hadoop - [mail # user]
|
|
...Hi, The file names don't match - can you check your script / command line args. Thanks hemanth On Wed, Mar 27, 2013 at 3:21 PM, nagarjuna kanamarlapudi wrote:...
|
|
|
Author: Hemanth Yamijala,
2013-03-27, 09:55
|
|
|
Re: How to tell my Hadoop cluster to read data from an external server - Hadoop - [mail # user]
|
|
...The stack trace indicates the job client is trying to submit a job to the MR cluster and it is failing. Are you certain that at the time of submitting the job, the JobTracker is running ? (O...
|
|
|
Author: Hemanth Yamijala,
2013-03-27, 05:13
|
|
|
Re: Child JVM memory allocation / Usage - Hadoop - [mail # user]
|
|
...Koji, Works beautifully. Thanks a lot. I learnt at least 3 different things with your script today ! Hemanth On Tue, Mar 26, 2013 at 9:41 PM, Koji Noguchi wrote: ...
|
|
|
Author: Hemanth Yamijala,
2013-03-27, 04:46
|
|
|
Re: Child JVM memory allocation / Usage - Hadoop - [mail # user]
|
|
...If your task is running out of memory, you could add the option * -XX:+HeapDumpOnOutOfMemoryError * *to *mapred.child.java.opts (along with the heap memory). However, I am not sure whe...
|
|
|
Author: Hemanth Yamijala,
2013-03-26, 06:07
|
|
|
Re: hadoop cluster not working - Hadoop - [mail # user]
|
|
...Have you configured your JobTracker's IPC port as 54311. Sharing your configuration may be helpful. Thanks Hemanth On Sun, Mar 10, 2013 at 11:56 AM, mallik arjun wrote: ...
|
|
|
Author: Hemanth Yamijala,
2013-03-10, 14:01
|
|
|
Re: How to add another file system in Hadoop - Hadoop - [mail # user]
|
|
...I may be guessing here a bit. Basically a filesystem is identified by the protocol part of the URI of a file - so a file on the S3 filesystem will have a URI like s3://... If you look at the...
|
|
|
Author: Hemanth Yamijala,
2013-02-21, 12:49
|
|
|
Re: OutOfMemoryError during reduce shuffle - Hadoop - [mail # user]
|
|
...Hi, I might be going slightly tangential here. Since you mention sorting - is this sorting the total input ? In that case, does HashPartitioner even work ? Because the partitions would...
|
|
|
Author: Hemanth Yamijala,
2013-02-21, 12:43
|
|
|
|
