| clear query|facets|time |
Search criteria: .
Results from 1 to 10 from
16 (0.352s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: Cannot communicate - HDFS - [mail # dev]
|
|
...It means what it says: that hadoop native library isn't available for some reason. See http://hadoop.apache.org/docs/stable/native_libraries.html Thanks, +Vinod Kumar Vavilapalli Horto...
|
|
|
Author: Vinod Kumar Vavilapalli,
2013-04-22, 17:02
|
|
|
Re: Auto clean DistCache? - HDFS - [mail # user]
|
|
...All the files are not opened at the same time ever, so you shouldn't see any "# of open files exceeds error". Thanks, +Vinod Kumar Vavilapalli Hortonworks Inc. http://hortonworks.com/ ...
|
|
|
Author: Vinod Kumar Vavilapalli,
2013-03-26, 20:44
|
|
|
Re: Auto clean DistCache? - HDFS - [mail # user]
|
|
...You can control the limit of these cache files, the default is 10GB (value of 10737418240L): Try changing local.cache.size or mapreduce.tasktracker.cache.local.size in mapred-site.xml ...
|
|
|
Author: Vinod Kumar Vavilapalli,
2013-03-26, 20:43
|
|
|
Re: Regarding: Merging two hadoop clusters - HDFS - [mail # user]
|
|
...Copy data into one of the clusters using distcp *without* downtime (assuming you have enough capacity) and then merge the clusters? Thanks, +Vinod Kumar Vavilapalli Hortonworks Inc. ht...
|
|
|
Author: Vinod Kumar Vavilapalli,
2013-03-14, 06:46
|
|
|
Re: SequenceFile.createWriter - throws FileNotFoundException - HDFS - [mail # user]
|
|
...As it clearly says, check the file permissions of your input directory (* /hama/input/center/*). Also whether you want the input on local file-sytem or DFS. +Vinod On Fri, Feb 1...
|
|
|
Author: Vinod Kumar Vavilapalli,
2013-02-01, 21:01
|
|
|
Re: Hadoop-Yarn-MR reading InputSplits and processing them by the RecordReader, architecture/design question. - HDFS - [mail # user]
|
|
...You got that mostly right. And it doesn't differ much in Hadoop 1.* either. With MR AM doing the work that was earlier done in JobTracker., the JobClient and the task side doesn't change muc...
|
|
|
Author: Vinod Kumar Vavilapalli,
2013-02-01, 20:58
|
|
|
Re: Selecting a task for the tasktracker - HDFS - [mail # user]
|
|
...On top of that, the message indicates that you need to have your scheduler class in the mapred package. Thanks, +Vinod Kumar Vavilapalli Hortonworks Inc. http://hortonworks.com/ ...
|
|
|
Author: Vinod Kumar Vavilapalli,
2012-12-27, 18:11
|
|
|
Re: Stop at CallObjectMethod when daemon running - HDFS - [mail # user]
|
|
...Not familiar with your apr stuff, but you should capture getJobStatus() method instead of getAllJobs(). getJobStatus() is what is called for individual jobs, getAllJobs() is called only when...
|
|
|
Author: Vinod Kumar Vavilapalli,
2012-12-10, 19:02
|
|
|
Re: "attempt*" directories in user logs - HDFS - [mail # user]
|
|
...MR launches multiple attempts for single Task in case of TaskAttempt failures or when speculative execution is turned on. In either case, a given Task will only ever have one successful Task...
|
|
|
Author: Vinod Kumar Vavilapalli,
2012-12-10, 18:49
|
|
|
Re: Start time, end time, and task tracker of individual tasks of a job - HDFS - [mail # user]
|
|
...Most of this information is already available in the JobHistory files. And there are parsers to read from these files. HTH +Vinod Kumar Vavilapalli Hortonworks Inc. http://hortonworks....
|
|
|
Author: Vinod Kumar Vavilapalli,
2012-11-20, 18:43
|
|
|
|
