Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 1 to 10 from 42 (0.113s).
Loading phrases to help you
refine your search...
[expand - 1 more] - Re: job.getCounters returns null in Yarn-based job - Hadoop - [mail # user]
...For those who are interested, this got resolved.The issue was that I was creating more counters than what was configured inthe settings.I upped mapreduce.job.counters.max property to a large...
   Author: Shahab Yunus, 2014-08-23, 00:40
Re: Hadoop InputFormat - Processing large number of small files - Hadoop - [mail # user]
...Have you looked at the WholeFileInputFormat implementations? There arequite a few if search for them...http://hadoop-sandy.blogspot.com/2013/02/wholefileinputformat-in-java-hadoop.htmlhttps:...
   Author: Shahab Yunus, 2014-08-20, 13:19
Relationship between number of reducers and number of regions in the table - Hadoop - [mail # user]
...I couldn't decide that whether it is an HBase question or Hadoop/Yarn.In the utility class for MR jobs integerated with HBase,*org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil, *in the m...
   Author: Shahab Yunus, 2014-08-14, 12:23
Re: One datanode is down then write/read starts failing - Hadoop - [mail # user]
...The reason being that when you write something in HDFS, it guarantees thatit will be written to the specified number of replicas. So if yourreplication factor is 2 and one of your node (out ...
   Author: Shahab Yunus, 2014-07-28, 17:07
Re: Difference between different tar - Hadoop - [mail # user]
...The '-bin' file does not have the source code (bin for binaries) while theother does. You can check and see the major difference in the 'src' foldersunder the top-level directory after unzip...
   Author: Shahab Yunus, 2014-07-21, 13:00
Re: Data cleansing in modern data architecture - Hadoop - [mail # user]
...I am assuming you meant the batch jobs that are/were used in old world fordata cleansing.As far as I understand there is no hard and fast rule for it and it dependsfunctional and system requ...
   Author: Shahab Yunus, 2014-07-20, 21:20
[expand - 1 more] - Re: Merging small files - Hadoop - [mail # user]
...Why it isn't appropriate to discuss too much vendor specific topics on avendor-neutral apache mailing list? Checkout this thread:http://mail-archives.apache.org/mod_mbox/hadoop-mapreduce-use...
   Author: Shahab Yunus, 2014-07-20, 16:32
Re: what exactly does data in HDFS look like? - Hadoop - [mail # user]
...The data itself is eventually store in a form of file. Each blocks of thefile and it replicas are stored in files and directories on differentnodes. The Namenode that keep the information an...
   Author: Shahab Yunus, 2014-07-19, 05:03
[expand - 1 more] - Re: Providing a file instead of a directory to a M/R job - Hadoop - [mail # user]
...That is what I thought so too but when I give the parent directory as theinput path of that same file, it works. Perhaps I am messing something up.I am suing cloudera 4.6 btw.Meanwhile I hav...
   Author: Shahab Yunus, 2014-07-17, 15:27
Re: How to recover reducer task data on a different data node? - Hadoop - [mail # user]
...Adding to what Jungi Jeong said, if you can get your hands on the book*Hadoop: The Definitive Guide *by Tom White, then that would help as well asit is explains this in significant detail.Re...
   Author: Shahab Yunus, 2014-07-03, 11:40
Sort:
project
HBase (46)
MapReduce (43)
Hadoop (37)
Pig (35)
HDFS (17)
Spark (1)
type
mail # user (42)
date
last 7 days (2)
last 30 days (4)
last 90 days (14)
last 6 months (24)
last 9 months (42)
author
Harsh J (558)
Owen O'Malley (394)
Steve Loughran (383)
Todd Lipcon (238)
Eli Collins (182)
Alejandro Abdelnur (167)
Arun C Murthy (163)
Chris Nauroth (145)
Allen Wittenauer (137)
Tom White (121)
Ted Yu (120)
Nigel Daley (115)
Daryn Sharp (114)
Konstantin Shvachko (107)
Doug Cutting (96)
Aaron Kimball (94)
Colin Patrick McCabe (90)
Edward Capriolo (88)
Mark Kerzner (87)
jason hadoop (82)
Hairong Kuang (74)
Konstantin Boudnik (72)
Runping Qi (72)
Benoy Antony (70)
Suresh Srinivas (64)
Shahab Yunus