| clear query|facets|time |
Search criteria: .
Results from 61 to 69 from
69 (0.118s).
|
|
|
Loading phrases to help you refine your search...
|
|
Re: cannot open an hdfs file in O_RDWR mode - Hadoop - [mail # user]
|
|
...HDFS does not allow you to overwrite bytes of a file that have already been written. The only operations it supports are read (an existing file), write (a new file), and (in newer vers...
|
|
|
Author: Philip Zeyliger,
2009-05-02, 01:34
|
|
|
Re: No route to host prevents from storing files to HDFS - Hadoop - [mail # user]
|
|
...Very naively looking at the code, the exception you see is happening in the write path, on the way to sending a copy of your data to a second data node. One data node is pipelining the...
|
|
|
Author: Philip Zeyliger,
2009-04-21, 23:18
|
|
|
a script to re-write JIRA subject lines for easier GMail threading - Hadoop - [mail # user]
|
|
...If you subscribe to core-dev and use gmail, you might be interested in a quick script I wrote to log into my e-mail and re-write JIRA subject lines, to fix the threading in gmail. This...
|
|
|
Author: Philip Zeyliger,
2009-04-10, 19:27
|
|
|
Re: Does the HDFS client read the data from NameNode, or from DataNode directly? - Hadoop - [mail # user]
|
|
... What happens here is that the NameNode redirects you to a "smartly" (a data node that has some of the file's first 5 blocks, I think) chosen DataNode, and that DataNode proxies the fil...
|
|
|
Author: Philip Zeyliger,
2009-04-10, 19:18
|
|
|
Re: reduce task specific jvm arg - Hadoop - [mail # user]
|
|
...There doesn't seem to be. The command line for the JVM is computed in org.apache.hadoop.mapred.TaskRunner#run(). On Thu, Apr 9, 2009 at 10:30 AM, Jun Rao wrote: ...
|
|
|
Author: Philip Zeyliger,
2009-04-09, 20:55
|
|
|
Re: Web ui - Hadoop - [mail # user]
|
|
...On Tue, Apr 7, 2009 at 5:11 AM, Rasit OZDAS wrote: https://issues.apache.org/jira/browse/HADOOP-5257 proposes a plugin layer for Hadoop daemons. Might be useful for ...
|
|
|
Author: Philip Zeyliger,
2009-04-07, 19:55
|
|
|
Re: connecting two clusters - Hadoop - [mail # user]
|
|
...DistCp is the standard way to copy data between clusters. What it does is run a mapreduce job to copy data between a source cluster and a destination cluster. See http://hadoop.a...
|
|
|
Author: Philip Zeyliger,
2009-04-07, 04:54
|
|
|
Re: Hardware - please sanity check? - Hadoop - [mail # user]
|
|
...Hadoop data nodes are often configured without RAID (i.e., "JBOD" = Just a Bunch of Disks)--HDFS already provides for the data redundancy. Also, if you stripe across disks, you're liab...
|
|
|
Author: Philip Zeyliger,
2009-04-02, 22:48
|
|
|
Re: DataNode gets 'stuck', ends up with two DataNode processes - Hadoop - [mail # user]
|
|
...Very naively looking at the stack traces, a common theme is that there's a call out to "df" to find the system capacity. If you see two data node processes, perhaps the fork/exec to ca...
|
|
|
Author: Philip Zeyliger,
2009-03-09, 17:40
|
|
|
|