Home | About | Sematext search-lucene.com search-hadoop.com
clear query|facets|time Search criteria: .   Results from 1 to 10 from 10 (0.072s).
Loading phrases to help you
refine your search...
Re: Splitting input file - increasing number of mappers - HDFS - [mail # user]
...More mappers will make it faster      U can try this parameter       mapreduce.input.fileinputformat.split.maxsize=      This will control the in...
   Author: Sanjay Subramanian, 2013-07-06, 15:18
Piping to HDFS (from Linux or HDFS) - HDFS - [mail # user]
...Hi guys  While I was trying to get some test data and configurations done quickly I realized one can do this and I think its super cool  Processing existing file on Linux/HDFS and ...
   Author: Sanjay Subramanian, 2013-06-24, 20:34
Many Errors at the last step of copying files from _temporary to Output Directory - HDFS - [mail # user]
...Hi  My environment is like this  INPUT FILES ========= 400 GZIP files , one from each server - average size gzipped 25MB  REDUCER ====== Uses MultipleOutput  OUTPUT  ...
   Author: Sanjay Subramanian, 2013-06-14, 16:28
Re: How to design the mapper and reducer for the following problem - HDFS - [mail # user]
...Hi  My quick and dirty non-optimized solution would be as follows  MAPPER ====== OUTPUT from Mapper                       &nb...
   Author: Sanjay Subramanian, 2013-06-14, 16:15
Re: Now give .gz file as input to the MAP - HDFS - [mail # user]
...Rahul-da  I found bz2 pretty slow (although splittable) so I switched to snappy (only sequence files are splittable but compress-decompress is fast)  Thanks Sanjay  From: Rahu...
   Author: Sanjay Subramanian, 2013-06-12, 17:43
Re: Problem in uploading file in WebHDFS - HDFS - [mail # user]
...Can u try one of the following  hdfs dfs -put localfile /path/to/dir/in/hdfs  hdfs dfs -copyFromLocal localfile /path/to/dir/in/hdfs  Thanks Sanjay.  Sent from my iPhone ...
   Author: Sanjay Subramanian, 2013-05-25, 15:50
[expand - 1 more] - Re: Where to begin from?? - HDFS - [mail # user]
...Hey guys  Is there a way to dynamically change the input dir and outputdir  I have the following CONSTANT directories in HDFS    *   /path/to/input/9999-99-99 (empty...
   Author: Sanjay Subramanian, 2013-05-24, 17:43
Re: Project ideas - HDFS - [mail # user]
...+1  My $0.02 is look look around and see problems u can solve…Its better to get a list of problems and see if u can model a solution using map-reduce framework  An example is as fo...
   Author: Sanjay Subramanian, 2013-05-21, 18:21
Re: Did any one used Hive on Oracle Metastore - HDFS - [mail # user]
...Raj It should be pretty much similar to setting it up in MySQL. Except any syntax differences. Read the cloudera hive installation notes. They have a separate Section for using mysql and ora...
   Author: Sanjay Subramanian, 2013-05-18, 20:30
Re: Hive on Oracle - HDFS - [mail # user]
...Try installing cloudera manager 4.1.2. It has bundled Hadoop hive and few other components.  I have this version in production. Cloudera has pretty good documentation. This way u don't ...
   Author: Sanjay Subramanian, 2013-05-18, 15:16
Hive (120)
HDFS (10)
MapReduce (5)
Hadoop (2)
Spark (2)
mail # user (10)
last 7 days (0)
last 30 days (0)
last 90 days (0)
last 6 months (0)
last 9 months (10)
Todd Lipcon (326)
Eli Collins (263)
Harsh J (261)
Colin Patrick McCabe (240)
Tsz Wo (203)
Jing Zhao (174)
Chris Nauroth (166)
Arpit Agarwal (152)
Andrew Wang (142)
Aaron T. Myers (141)
Suresh Srinivas (138)
Brandon Li (137)
Haohui Mai (137)
Kihwal Lee (114)
Daryn Sharp (105)
Ted Yu (83)
Uma Maheswara Rao G (82)
Alejandro Abdelnur (73)
Konstantin Shvachko (63)
Tsz Wo Nicholas Sze (63)
Akira AJISAKA (61)
Stephen Chu (58)
Yongjun Zhang (57)
Steve Loughran (52)
Allen Wittenauer (48)
Sanjay Subramanian