Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 1 to 10 from 24 (0.08s).
Loading phrases to help you
refine your search...
Re: - Hadoop - [mail # user]
...In my opinion, another 2782829 times, give or take a few.  Or try reading and understanding http://hadoop.apache.org/mailing_lists.html otherwise which tells you to send an email to [EM...
   Author: Kai Voigt, 2013-03-06, 13:04
Re: aggregation by time window - Hadoop - [mail # user]
...Hi again,  the idea is that you emit every event multiple times. So your map input record (event1, 10:07) will be emitted seven times during the map() call. Like I said, (10:04,event1),...
   Author: Kai Voigt, 2013-01-28, 13:48
Re: Get the name of node where mapper is running - Hadoop - [mail # user]
...Hello,  the JobTracker has a built-in Web UI (http://hostname_of_jobtracker:50030/) where you can get details for all completed and running jobs. For the map phase, it will tell you on ...
   Author: Kai Voigt, 2012-11-21, 18:06
Re: Transfer large file >50Gb with DistCp from s3 to cluster - Hadoop - [mail # user]
...Hi,  my guess is that you run "hadoop distcp" on one of the datanodes... In  that case, the node will get the first replica of each block. But you  should also see copies on m...
   Author: Kai Voigt, 2012-09-04, 20:09
Re: Hadoop or HBase - Hadoop - [mail # user]
...Having a distributed filesystem doesn't save you from having backups. If  someone deletes a file in HDFS, it's gone.  What backend storage is supported by your CMS?  Kai  ...
   Author: Kai Voigt, 2012-08-28, 10:18
Re: Simple hadoop processes/testing on windows machine - Hadoop - [mail # user]
...I suggest using a virtual machine with all required services installed  and configured.  Cloudera offers a distribution as a VM, at  https://ccp.cloudera.com/display/SUPPORT/C...
   Author: Kai Voigt, 2012-07-25, 22:15
Re: Counting records - Hadoop - [mail # user]
...Hi,  an additional idea is to use the counter API inside the framework.   http://diveintodata.org/2011/03/15/an-example-of-hadoop-mapreduce-counter/  has a good example.  ...
   Author: Kai Voigt, 2012-07-23, 14:32
Re: HDFS APPEND - Hadoop - [mail # dev]
...Hello,  Am 13.07.2012 um 22:19 schrieb abhiTowson cal:   Yes!!  Check out  http://archive.cloudera.com/cdh4/cdh/4/hadoop/api/org/apache/hadoop/fs/Fil eSystem.html#append(...
   Author: Kai Voigt, 2012-07-13, 20:23
Re: Binary Files With No Record Begin and End - Hadoop - [mail # user]
...Hi,  if you know the block size, you can calculate the offsets for your  records. And write a custom record reader class to seek into your  records.  Kai  Am 05.07.2...
   Author: Kai Voigt, 2012-07-05, 18:57
Re: file checksum - Hadoop - [mail # user]
...HDFS has block checksums. Whenever a block is written to the datanodes,  a checksum is calculated and written with the block to the datanodes'  disks.  Whenever a block is req...
   Author: Kai Voigt, 2012-06-25, 11:33
Hadoop (24)
MapReduce (11)
HDFS (5)
Pig (1)
Sqoop (1)
mail # user (22)
mail # dev (2)
last 7 days (0)
last 30 days (0)
last 90 days (0)
last 6 months (0)
last 9 months (24)
Harsh J (537)
Owen O'Malley (403)
Steve Loughran (358)
Todd Lipcon (234)
Eli Collins (181)
Arun C Murthy (157)
Chris Nauroth (130)
Alejandro Abdelnur (121)
Allen Wittenauer (115)
Nigel Daley (112)
Tom White (111)
Daryn Sharp (108)
Konstantin Shvachko (102)
Ted Yu (95)
Aaron Kimball (93)
Kai Voigt