Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 1 to 10 from 11 (0.097s).
Loading phrases to help you
refine your search...
Re: Why block sizes shown by 'fsck' and '-stat' are inconsistent? - Hadoop - [mail # user]
...Thanks for your comments!As I mentioned HDFS use only what it needs on the local file system. Forexample, a 16 KB hdfs file only use 16 KB local file system storage, not 64MB(its hdfs block ...
   Author: sam liu, 2014-04-05, 14:06
Re: How to submit the patch MAPREDUCE-4490.patch which works for branch-1.2, not trunk? - Hadoop - [mail # user]
...Hi Arpit,Thanks for your guide!  As a new contributor, I still have following twoquestions need your help:1) So I guess I should run 'test-patch.sh' on my local environment againstbranc...
   Author: sam liu, 2014-02-16, 08:54
Any method to get input splits by column? - Hadoop - [mail # user]
...Hi,  By default, MR inputformat classes break input file into splits by rows. However, we have a specilal requirement on MR app: get input splits by column.  Is there any good meth...
   Author: sam liu, 2013-12-23, 13:37
Re: How to set the handler count related parameters? - Hadoop - [mail # user]
...Thanks Nitin!  For dfs.namenode.handler.count, how many memory will be consumed for 1 thread?   2013/12/22 Nitin Pawar  ...
   Author: sam liu, 2013-12-22, 14:09
Re: hdfs unable to create new block with 'Too many open fiiles' exception - Hadoop - [mail # user]
...In this cluster, data nodes runs as user 'mapred'. Actually, all hadoop daemons runs as user 'mapred'.   2013/12/22 Ted Yu  ...
   Author: sam liu, 2013-12-21, 17:25
Re: Yarn never use TeraSort#TotalOrderPartitioner when run TeraSort job? - Hadoop - [mail # user]
...Furthermore, I did another test: rename TeraSort#TotalOrderPartitioner to TeraSort#MyOwnTotalOrderPartitioner to avoid conflicting with other homonymic classes in hadoop classpath. Also, in ...
   Author: sam liu, 2013-10-20, 13:26
Re: ArrayIndexOutOfBoundsException occurs from MapTask - Hadoop - [mail # user]
...Thanks for your information!  However, if so, it should be a Hadoop bug, because there is no restrictions on setting the value to "mapreduce.task.io.sort.mb"   2013/9/12 Brahma Red...
   Author: sam liu, 2013-09-12, 02:18
UnsupportedOperationException occurs with Hadoop-2.1.0-beta jar files - Hadoop - [mail # user]
...Hi,  With Hadoop-2.1.0-beta jar files, Sqoop-1.4.3 test TestAllTables failed by exception UnsupportedOperationException, however it works with Hadoop-2.0.4-alpha jar files. Below are th...
   Author: sam liu, 2013-09-09, 07:51
Re: Hang when add/remove a datanode into/from a 2 datanode cluster - Hadoop - [mail # user]
...But, please mention that the value of 'dfs.replication' of the cluster is always 2, even when the datanode number is 3. And I am pretty sure I did not manually create any files with rep=3. S...
   Author: sam liu, 2013-08-01, 02:37
Re: Why my tests shows Yarn is worse than MRv1 for terasort? - Hadoop - [mail # user]
...The terasort execution log shows that reduce spent about 5.5 mins from 33% to 35% as below. 13/06/10 08:02:22 INFO mapreduce.Job:  map 100% reduce 31% 13/06/10 08:02:25 INFO mapreduce.J...
   Author: sam liu, 2013-06-07, 05:21
Sort:
project
Sqoop (21)
MapReduce (12)
HDFS (10)
Hadoop (7)
type
mail # user (11)
date
last 7 days (0)
last 30 days (1)
last 90 days (2)
last 6 months (6)
last 9 months (11)
author
Harsh J (537)
Owen O'Malley (402)
Steve Loughran (358)
Todd Lipcon (233)
Eli Collins (181)
Arun C Murthy (157)
Chris Nauroth (129)
Alejandro Abdelnur (121)
Allen Wittenauer (115)
Nigel Daley (112)
Tom White (111)
Daryn Sharp (108)
Konstantin Shvachko (102)
Aaron Kimball (93)
Ted Yu (93)
sam liu