| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
16 (0.204s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: concurrency - Hadoop - [mail # user]
|
|
...Hey Harsh & Joep, My main worry was actually the simpler situation in which only new subdirs are created by loaders. If we for a second focus on this "append-only" situation, which i a...
|
|
|
Author: Koert Kuipers,
2012-10-12, 17:05
|
|
|
concurrency - Hadoop - [mail # user]
|
|
...We have a dataset that is heavily partitioned, like this /data partition1/ _SUCESS part-00000 part-00001 ... partition1/...
|
|
|
Author: Koert Kuipers,
2012-10-12, 14:30
|
|
|
Re: fs cache giving me headaches - Hadoop - [mail # user]
|
|
...I am a little confused.... I do create new ugis, and i do not hand them off to threads. However i assumed that FileSystem.get(conf) would fetch from the filesystem cache based on the ugi (ba...
|
|
|
Author: Koert Kuipers,
2012-08-07, 15:44
|
|
|
is hadoop FileSystem class thread-safe? - Hadoop - [mail # user]
|
|
...Can i share one instance safely amount multiple threads?...
|
|
|
Author: Koert Kuipers,
2012-08-05, 22:13
|
|
|
fs cache giving me headaches - Hadoop - [mail # user]
|
|
...nothing has confused me as much in hadoop as FileSystem.close(). any decent java programmer that sees that an object implements Closable writes code like this: Final FileSystem fs = FileSyst...
|
|
|
Author: Koert Kuipers,
2012-08-04, 17:54
|
|
|
Re: hadoop FileSystem.close() - Hadoop - [mail # user]
|
|
...my suspicion is that fs.close() closes the FileSystem in the cache, regardless of whether if it is used by other processes as well at that point (as opposed to a system where the cache keeps...
|
|
|
Author: Koert Kuipers,
2012-07-24, 17:50
|
|
|
hadoop FileSystem.close() - Hadoop - [mail # user]
|
|
...Since FileSystem is a Closeable i would expect code using it to be like this: FileSystem fs = path.getFileSystem(conf); try { // do something with fs, such as read from t...
|
|
|
Author: Koert Kuipers,
2012-07-24, 14:34
|
|
|
memory usage tasks - Hadoop - [mail # user]
|
|
...silly question, but i have our hadoop slave boxes configured with 7 mappers each, yet i see java 14 process for user mapred on each box. and each process takes up about 2GB, which is equals ...
|
|
|
Author: Koert Kuipers,
2012-06-09, 00:49
|
|
|
Re: kerberos mapreduce question - Hadoop - [mail # user]
|
|
...thanks for your answer. so at a large place like say yahoo, or facebook, assuming they use kerberos, every analyst that uses hive has an account on every node of their large cluster? s...
|
|
|
Author: Koert Kuipers,
2012-06-07, 14:49
|
|
|
kerberos mapreduce question - Hadoop - [mail # user]
|
|
...with kerberos enabled a mapreduce job "runs as" the user that submitted it. does this mean the user that submitted the job needs to have linux accounts on all machines on the cluster? ...
|
|
|
Author: Koert Kuipers,
2012-06-07, 13:20
|
|
|
|
