| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
29 (0.127s).
|
|
|
Loading phrases to help you refine your search...
|
|
Re: SSD support in HDFS - HDFS - [mail # user]
|
|
...I could have sworn there was a thread on this already. (Maybe the HBase list?) Andrew P. kinda nailed it when he talked about the fact that you had to write the replication(s). ...
|
|
|
Author: Michael Segel,
2013-06-13, 02:35
|
|
|
Re: recovery accidently deleted pig script - HDFS - [mail # user]
|
|
...Where was the pig script? On HDFS? How often does your cluster clean up the trash? (Deleted stuff doesn't get cleaned up when the file is deleted... ) Its a configurable settin...
|
|
|
Author: Michael Segel,
2013-06-13, 02:28
|
|
|
Re: Aggregating data nested into JSON documents - HDFS - [mail # user]
|
|
...Hi.. Have you thought about HBase? I would suggest that if you're using Hive or Pig, to look at taking these files and putting the JSON records in to a sequence file. Or s...
|
|
|
Author: Michael Segel,
2013-06-13, 02:26
|
|
|
Re: Reading json format input - HDFS - [mail # user]
|
|
...Yeah, I have to agree w Russell. Pig is definitely the way to go on this. If you want to do it as a Java program you will have to do some work on the input string but it too sho...
|
|
|
Author: Michael Segel,
2013-05-29, 23:30
|
|
|
Re: Question about Name Spaces… - HDFS - [mail # user]
|
|
...Actually creating links, symbolic or hard links makes sense in a couple of scenarios. Especially in terms of hive... ;-) So it kind of goes back to my extension of the question ...
|
|
|
Author: Michael Segel,
2013-05-15, 22:19
|
|
|
Re: hadoop pipes or java with jni? - HDFS - [mail # user]
|
|
...I'm partial to using Java and JNI and then use the distributed cache to push the native libraries out to each node if not already there. But that's just me... ;-) HTH -Mi...
|
|
|
Author: Michael Segel,
2013-03-04, 02:04
|
|
|
Re: Encryption in HDFS - HDFS - [mail # user]
|
|
...You can encrypt the splits separately. The issue of key management is actually a layer above this. Looks like the research is on the encryption process w a known key. The...
|
|
|
Author: Michael Segel,
2013-02-27, 12:58
|
|
|
Re: why my test result on dfs short circuit read is slower? - HDFS - [mail # user]
|
|
...On Feb 17, 2013, at 7:09 PM, "Liu, Raymond" wrote: Drop this down to 64KB not 128KB. You have 16 cpu which really means 8 cores and 4 disks. Do you have Gang...
|
|
|
Author: Michael Segel,
2013-02-18, 10:16
|
|
|
Re: Mainframe to ASCII conversion - HDFS - [mail # user]
|
|
...Depends. If the data is straight EBCDIC you have somewhat splittable data, however its really better to do this in a single stream. If the data is COMP-3 (Zoned and Packed Data)...
|
|
|
Author: Michael Segel,
2013-02-11, 17:01
|
|
|
Re: How can I limit reducers to one-per-node? - HDFS - [mail # user]
|
|
...Adding a combiner step first then reduce? On Feb 8, 2013, at 11:18 PM, Harsh J wrote: Michael Segel | (m) 312.755.9623 Segel and Associates ...
|
|
|
Author: Michael Segel,
2013-02-11, 01:30
|
|
|
|