Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
clear query|facets|time Search criteria: .   Results from 11 to 20 from 94 (0.173s).
Loading phrases to help you
refine your search...
Re: is there anyway to detect the file size as am i writing a sequence file? - Hadoop - [mail # user]
...I think you mean Writer.getLength(). It returns the current position in the output stream in bytes (more or less the current size of the file).  -Joey  On Tue, Mar 6, 2012 at 9:53 ...
   Author: Joey Echeverria, 2012-03-06, 15:00
[expand - 2 more] - Re: LZO exception decompressing (returned -8) - Hadoop - [mail # user]
...I know this doesn't fix lzo, but have you considered Snappy for the intermediate output compression? It gets similar compression ratios and compress/decompress speed, but arguably has better...
   Author: Joey Echeverria, 2012-03-02, 04:15
[expand - 1 more] - Re: Adding nodes - Hadoop - [mail # user]
...Not quite. Datanodes get the namenode host from fs.defalt.name in core-site. xml. Task trackers find the job tracker from the mapred.job.tracker setting i n mapred-site.xml.   Sent from...
   Author: Joey Echeverria, 2012-03-02, 00:57
Re: dfs.block.size - Hadoop - [mail # user]
...dfs.block.size can be set per job.  mapred.tasktracker.map.tasks.maximum is per tasktracker.  -Joey  On Mon, Feb 27, 2012 at 10:19 AM, Mohit Anchlia  wrote:    ...
   Author: Joey Echeverria, 2012-02-27, 15:59
[expand - 1 more] - Re: Backupnode in 1.0.0? - Hadoop - [mail # user]
...Check out this branch for the 0.22 version of Bigtop:  https://svn.apache.org/repos/asf/incubator/bigtop/branches/hadoop-0.22/  However, I don't think BackupNode is what you want. ...
   Author: Joey Echeverria, 2012-02-23, 01:24
Re: Security at file level in Hadoop - Hadoop - [mail # user]
...HDFS supports POSIX style file and directory permissions (read, write, execu te) for the owner, group and world. You can change the permissions with hado op fs -chmod    -Joey &nbs...
   Author: Joey Echeverria, 2012-02-22, 12:33
Re: Writing small files to one big file in hdfs - Hadoop - [mail # user]
...I'd recommend making a SequenceFile[1] to store each XML file as a value.  -Joey  [1] http://hadoop.apache.org/common/docs/r1.0.0/api/org/apache/hadoop/io/SequenceFile.html  O...
   Author: Joey Echeverria, 2012-02-21, 17:23
[expand - 1 more] - Re: Adding mahout math jar to hadoop mapreduce execution - Hadoop - [mail # user]
...The -libjars feature is needed if you use the classes in your remote code (m ap and reduce functions). Is it possible you only use it in your main() meth od?  -Joey  Sent from my i...
   Author: Joey Echeverria, 2012-02-01, 13:50
Re: NameNode per-block memory usage? - Hadoop - [mail # user]
...I don't remember the exact number, it also depends on which version of Hadoop you're using   It's 1 GB for every *million* objects (files, blocks, etc.). This is a good rule of thumb, a...
   Author: Joey Echeverria, 2012-01-17, 15:20
Re: Can you unset a mapred.input.dir configuration value? - Hadoop - [mail # user]
...You can useĀ  FileInptuFormat.setInputPaths(configuration, job1-output). This will overwrite the old input path(s).  -Joey  On Mon, Jan 16, 2012 at 7:16 PM, W.P. McNeill  wrote...
   Author: Joey Echeverria, 2012-01-17, 00:21
Sort:
project
Hadoop (93)
HBase (60)
MapReduce (56)
Accumulo (35)
HDFS (32)
Flume (17)
Sqoop (10)
Avro (8)
Hive (7)
Zookeeper (2)
Bigtop (1)
Kafka (1)
type
mail # user (91)
issue (3)
date
last 7 days (0)
last 30 days (0)
last 90 days (0)
last 6 months (1)
last 9 months (94)
author
Harsh J (561)
Steve Loughran (406)
Owen O'Malley (394)
Todd Lipcon (237)
Eli Collins (182)
Alejandro Abdelnur (179)
Arun C Murthy (166)
Allen Wittenauer (162)
Chris Nauroth (156)
Ted Yu (139)
Tom White (121)
Daryn Sharp (115)
Nigel Daley (115)
Konstantin Shvachko (107)
Colin Patrick McCabe (101)
Doug Cutting (96)
Aaron Kimball (94)
Edward Capriolo (87)
Mark Kerzner (87)
jason hadoop (82)
Hairong Kuang (74)
Benoy Antony (72)
Konstantin Boudnik (72)
Runping Qi (72)
Karthik Kambatla (67)
Joey Echeverria
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB