| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
10 (0.115s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: Selecting a task for the tasktracker - HDFS - [mail # user]
|
|
...Thanks a lot! On Thu, Dec 27, 2012 at 8:11 PM, Vinod Kumar Vavilapalli wrote: ...
|
|
|
Author: Yaron Gonen,
2012-12-27, 21:18
|
|
|
Selecting a task for the tasktracker - HDFS - [mail # user]
|
|
...Hi, If I understand correctly, the job scheduler (why is the class called TaskScheduler?) is responsible for assigning the task whose split is as close as possible to the tasktacker. Meaning...
|
|
|
Author: Yaron Gonen,
2012-12-27, 10:40
|
|
|
Re: Some general questions about DBInputFormat - HDFS - [mail # user]
|
|
...Thanks for the fast response. Nick, regarding locking a table: as far as I understood from the code, each mapper opens its own connection to the DB. I didn't see any code such that the job c...
|
|
|
Author: Yaron Gonen,
2012-09-11, 14:25
|
|
|
Re: Understanding compression in hdfs - HDFS - [mail # user]
|
|
...Is the checksum pluggable? CRC-32 is good for error detection not for duplication check. I need this for duplication check. On Sun, Jul 29, 2012 at 8:41 PM, Brock Noland wrote: &...
|
|
|
Author: Yaron Gonen,
2012-07-29, 20:23
|
|
|
Re: Understanding compression in hdfs - HDFS - [mail # user]
|
|
...Thanks! I'll dig into those classes to figure out my next step. Anyway, I just realized the block-level compression has nothing to do with HDFS blocks. An HDFS block can contain an unk...
|
|
|
Author: Yaron Gonen,
2012-07-29, 17:35
|
|
|
Understanding compression in hdfs - HDFS - [mail # user]
|
|
...Hi, I've created a SequeceFile.Writer with block-level compression. I'd like to create a SHA1 hash for each block written. How do I do that? I didn't see any way to take the compression unde...
|
|
|
Author: Yaron Gonen,
2012-07-29, 14:40
|
|
|
Re: Accessing list of blocks on a datanode via Java interface - HDFS - [mail # user]
|
|
...Thanks a lot! If I do it via the NN can I get down to the block level? On Jul 7, 2012 4:51 AM, "Harsh J" wrote: ...
|
|
|
Author: Yaron Gonen,
2012-07-07, 09:17
|
|
|
Re: Accessing list of blocks on a datanode via Java interface - HDFS - [mail # user]
|
|
...Thanks, I'll look at that tool. I still wish to iterate the blocks from the Java interface since I want to look at their metadata. I'll look at the source code of the command line tools you ...
|
|
|
Author: Yaron Gonen,
2012-07-06, 18:58
|
|
|
Re: Accessing list of blocks on a datanode via Java interface - HDFS - [mail # user]
|
|
...Thanks for the fast reply. My top goal is to backup any new blocks on the DN. What i'd like to do is to go over all the blocks in the DN and to make a signature for any one of them. I'll com...
|
|
|
Author: Yaron Gonen,
2012-07-06, 17:53
|
|
|
Accessing list of blocks on a datanode via Java interface - HDFS - [mail # user]
|
|
...Hi, I'm trying to write an agent that will run on a datanode and will scan blocks on a that datanode. The logical thing to do is to look in the DataBlockScanner code, which lists all the blo...
|
|
|
Author: Yaron Gonen,
2012-07-06, 14:28
|
|
|
|
