| clear query|facets|time |
Search criteria: .
Results from 11 to 20 from
454 (0.098s).
|
|
|
Loading phrases to help you refine your search...
|
|
Re: Install Hadoop on Linux Pseudo Distributed Mode - Root Required? - HDFS - [mail # user]
|
|
...Raj, Apache Hadoop by itself does not require root privileges to run (assuming a non-secure setup). You can run it out of a tarball from a home directory you have on the server machine...
|
|
|
Author: Harsh J,
2013-05-13, 16:34
|
|
|
Re: Wrapping around BitSet with the Writable interface - HDFS - [mail # user]
|
|
...You can perhaps consider using the experimental JavaSerialization [1] enhancement to skip transforming to Writables/other-serialization-formats. It may be slower but looks like you are looki...
|
|
|
Author: Harsh J,
2013-05-12, 20:09
|
|
|
Re: problem building lzo - HDFS - [mail # user]
|
|
...What repo of the hadoop-lzo are you using? If you're using a typical Linux OS such as those similar to RedHat/Debian/etc., it is easier to run the "hadoop-lzo-packager" project mentioned at ...
|
|
|
Author: Harsh J,
2013-05-09, 03:45
|
|
|
Re: How to restore HDFS data - HDFS - [mail # user]
|
|
...If you've already run -delete (-move is a better choice if you know DN fault is temporary), then the missing blocks are already deleted from the namespace permanently. No way to recover the ...
|
|
|
Author: Harsh J,
2013-05-02, 13:19
|
|
|
Re: datanode's write_block_op_avg_time value - HDFS - [mail # user]
|
|
...What are you finding alarming w.r.t. your cluster? The metric is simple: When did the write start, and when did it finally end, for a single block? The difference is the writeBlockOp t...
|
|
|
Author: Harsh J,
2013-05-02, 11:21
|
|
|
Re: High IO Usage in Datanodes due to Replication - HDFS - [mail # user]
|
|
...If your partitions are only storing about 1 MB in each, I don't know if its a good key design or a good application for Hadoop. But if you mean that there are many files under a single parti...
|
|
|
Author: Harsh J,
2013-05-01, 10:15
|
|
|
Re: High IO Usage in Datanodes due to Replication - HDFS - [mail # user]
|
|
...The block scanner is a simple, independent operation of the DN that runs periodically and does work in small phases, to ensure that no blocks exist that aren't matching their checksums (its ...
|
|
|
Author: Harsh J,
2013-05-01, 06:07
|
|
|
Re: Warnings? - HDFS - [mail # user]
|
|
...The env-var is auto-created by the "hadoop" script for you when you invoke "hadoop jar". You do not necessarily have to manually set it, nor do you have to compile the native libs if what yo...
|
|
|
Author: Harsh J,
2013-04-29, 19:30
|
|
|
Re: VersionInfoAnnotation Unknown for Hadoop/HBase - HDFS - [mail # user]
|
|
...Well… Bingo! :) We don't write our projects for 1.5 JVMs, and especially not the GCJ (1.5 didn't have annotations either IIRC? We depend on that here). Try with a Sun/Oracle/OpenJDK 1....
|
|
|
Author: Harsh J,
2013-04-29, 15:05
|
|
|
Re: High IO Usage in Datanodes due to Replication - HDFS - [mail # user]
|
|
...They seem to be transferring blocks between one another. This may most likely be due to under-replication and the NN UI will have numbers on work left to perform. The inter-DN transfer is co...
|
|
|
Author: Harsh J,
2013-04-27, 18:33
|
|
|
|