| clear query|facets|time |
Search criteria: .
Results from 31 to 40 from
53 (0.092s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: how to get rid of -libjars ? - Hadoop - [mail # user]
|
|
...Hi Jane + Adding on to Joey's comments If you want to eliminate the process of distributing the dependent jars every time, then you need to manually pre-distribute these jars acr...
|
|
|
Author: Bejoy Ks,
2012-03-06, 16:04
|
|
|
Re: Writing small files to one big file in hdfs - Hadoop - [mail # user]
|
|
...Hi Mohit AFAIK XMLLoader in pig won't be suited for Sequence Files. Please post the same to Pig user group for some workaround over the same. ...
|
|
|
Author: Bejoy Ks,
2012-02-21, 18:25
|
|
|
Re: Writing small files to one big file in hdfs - Hadoop - [mail # user]
|
|
...Mohit Rather than just appending the content into a normal text file or so, you can create a sequence file with the individual smaller file content as values. &nbs...
|
|
|
Author: Bejoy Ks,
2012-02-21, 17:25
|
|
|
Re: Processing compressed files in Hadoop - Hadoop - [mail # user]
|
|
...Hi Leo You can index the LZO files as //Run theLZO indexer on files in hdfs LzoIndexer indexer = new LzoIndexer(fs.getConf()); indexer.index(filePath); ...
|
|
|
Author: Bejoy Ks,
2012-02-08, 18:33
|
|
|
Re: how to specify class name to run in mapreduce job - Hadoop - [mail # user]
|
|
...Hi Vinod You can use the format as hadoop jar Like -> hadoop jar /home/user/sample.jar com.sample.apps.MainClass ...... Don't sp...
|
|
|
Author: Bejoy Ks,
2012-01-11, 06:58
|
|
|
Re: has bzip2 compression been deprecated? - Hadoop - [mail # user]
|
|
...Hi Tony Please find responses inline So, to summarise: when I CREATE EXTERNAL TABLE in Hive, the STORED AS, ROW FORMAT and other parameters you mention are telling...
|
|
|
Author: Bejoy Ks,
2012-01-10, 18:01
|
|
|
Re: has bzip2 compression been deprecated? - Hadoop - [mail # user]
|
|
...Hi Tony As I understand your requirement, your mapreduce job produces a Sequence File as ouput and you need to use this file as an input to hive table. ...
|
|
|
Author: Bejoy Ks,
2012-01-09, 18:59
|
|
|
Re: increase number of map tasks - Hadoop - [mail # user]
|
|
...Hi Satish What is your value for mapred.max.split.size? Try setting these values as well mapred.min.split.size=0 (it is the default value) mapred.max.split.size=40 ...
|
|
|
Author: Bejoy Ks,
2012-01-09, 17:41
|
|
|
Re: has bzip2 compression been deprecated? - Hadoop - [mail # user]
|
|
...Hi Tony Adding on to Harsh's comments. If you want the generated sequence files to be utilized by a hive table. Define your hive table as CREATE EXTERNAL TAB...
|
|
|
Author: Bejoy Ks,
2012-01-09, 17:33
|
|
|
Re: How to create Output files of about fixed size - Hadoop - [mail # user]
|
|
...Hi JJ If you use the default TextInputFormat, it wont do the job as it would generate at least one split for each file. So in your case there would be a min of 78 ...
|
|
|
Author: Bejoy Ks,
2011-12-21, 20:13
|
|
|
|
