| clear query|facets|time |
Search criteria: .
Results from 31 to 40 from
148 (0.217s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: DFSClient error - Hadoop - [mail # user]
|
|
...I even tried to lower number of parallel jobs even further but I still get these errors. Any suggestion on how to troubleshoot this issue would be very helpful. Should I run hadoop fsck? How...
|
|
|
Author: Mohit Anchlia,
2012-04-29, 20:05
|
|
|
Re: DFSClient error - Hadoop - [mail # user]
|
|
...After all the jobs fail I can't run anything. Once I restart the cluster I am able to run other jobs with no problems, hadoop fs and other io intensive jobs run just fine. On Fri, Apr ...
|
|
|
Author: Mohit Anchlia,
2012-04-27, 22:45
|
|
|
Re: DFSClient error - Hadoop - [mail # user]
|
|
...I even tried to reduce number of jobs but didn't help. This is what I see: datanode logs: Initializing secure datanode resources Successfully obtained privileged resources (strea...
|
|
|
Author: Mohit Anchlia,
2012-04-27, 21:36
|
|
|
Re: DFSClient error - Hadoop - [mail # user]
|
|
...On Thu, Apr 26, 2012 at 10:24 PM, Harsh J wrote: "shortRead" errors. I am not sure about threading. I am using pig script to read .gz file ...
|
|
|
Author: Mohit Anchlia,
2012-04-27, 14:50
|
|
|
DFSClient error - Hadoop - [mail # user]
|
|
...I had 20 mappers in parallel reading 20 gz files and each file around 30-40MB data over 5 hadoop nodes and then writing to the analytics database. Almost midway it started to get this error:...
|
|
|
Author: Mohit Anchlia,
2012-04-26, 23:49
|
|
|
Re: Design question - Hadoop - [mail # user]
|
|
...Ant suggestion or pointers would be helpful. Are there any best practices? On Mon, Apr 23, 2012 at 3:27 PM, Mohit Anchlia wrote: ...
|
|
|
Author: Mohit Anchlia,
2012-04-26, 14:43
|
|
|
Design question - Hadoop - [mail # user]
|
|
...I just wanted to check how do people design their storage directories for data that is sent to the system continuously. For eg: for a given functionality we get data feed continuously writen...
|
|
|
Author: Mohit Anchlia,
2012-04-23, 22:27
|
|
|
Re: Get Current Block or Split ID, and using it, the Block Path - Hadoop - [mail # user]
|
|
...I think if you called getInputFormat on JobConf and then called getSplits you would atleast get the locations. http://hadoop.apache.org/common/docs/current/api/org/apache/hadoop/mapred...
|
|
|
Author: Mohit Anchlia,
2012-04-08, 16:36
|
|
|
Re: Doubt from the book "Definitive Guide" - Hadoop - [mail # user]
|
|
...On Wed, Apr 4, 2012 at 10:02 PM, Prashant Kommireddi wrote: Only advantage I was thinking of was that in some cases reducers might be able to take advantage of data locality and avoid ...
|
|
|
Author: Mohit Anchlia,
2012-04-05, 14:03
|
|
|
Re: Doubt from the book "Definitive Guide" - Hadoop - [mail # user]
|
|
...On Wed, Apr 4, 2012 at 8:42 PM, Harsh J wrote: if the mapper output (merged output in the end or the shuffle output) is stored in HDFS then reducers can just retrieve it from HDF...
|
|
|
Author: Mohit Anchlia,
2012-04-05, 04:54
|
|
|
|
