Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
clear query|facets|time Search criteria: .   Results from 1 to 10 from 162 (0.221s).
Loading phrases to help you
refine your search...
[expand - 1 more] - Re: MappedRDD signature - Spark - [mail # user]
...Thanks Sean. that works and I started the join of this mappedRDD to another one I have.I have to internalize the use of Map versus FlatMap. Thinking Map Reduce Java Hadoop code often blinds ...
   Author: Sanjay Subramanian, 2015-01-28, 20:04
[expand - 2 more] - Re: Hive JSON Serde question - Hive - [mail # user]
...sure will try get_json_objectthank uregardssanjay        From: 丁桂涛(桂花)  To: [EMAIL PROTECTED]; Sanjay Subramanian   Sent: Sunday, January 25, 2015 4:45 PM&...
   Author: Sanjay Subramanian, 2015-01-26, 02:54
[expand - 1 more] - Re: Writing Hive Query Output to local system - Hive - [mail # user]
...I am using Cloudera Manager and I know how to add a param thru Safety Valve I don't know how to ignore a param thru Safety Valve :-) Actually I will put the question on the CDH groups as wel...
   Author: Sanjay Subramanian, 2015-01-16, 21:48
Using IF in the JOIN  clause - Hive - [mail # user]
...hey guysThis is a portion of a long query we wrote.Can u advise if the bold portion will work ?    and if(f.fr_name is not null, f.fr_name, e.fr_name)=d.fr_name     and if(f.pos_bin is not n...
   Author: Sanjay Subramanian, 2015-01-09, 00:08
Re: How to convert RDBMS DDL to Hive DDL ? - Hive - [mail # user]
...@Krishare u looking for an automated tool that takes RDBMS DDL as input and outputs Hive DDL ?I exported the DDLS of all tables with col sequence numbersI wrote code that converted all DB2 t...
   Author: Sanjay Subramanian, 2015-01-09, 00:04
[expand - 5 more] - Re: FlatMapValues - Spark - [mail # user]
...cool let me adapt that. thanks a tonregardssanjay      From: Sean Owen  To: Sanjay Subramanian  Cc: "[EMAIL PROTECTED]"   Sent: Monday, January 5, 201...
   Author: Sanjay Subramanian, 2015-01-05, 18:32
Re: A spark newbie question - Spark - [mail # user]
...val sconf = new SparkConf().setMaster("local").setAppName("MedicalSideFx-CassandraLogsMessageTypeCount")val sc = new SparkContext(sconf)val inputDir = "/path/to/cassandralogs.txt"sc.textFile...
   Author: Sanjay Subramanian, 2015-01-04, 20:42
[expand - 2 more] - Re: Joining by values - Spark - [mail # user]
...so I changed the code tordd1InvIndex.join(rdd2Pair).map(str => str._2).groupByKey().map(str => (str._1,str._2.toList)).collect().foreach(println)Now it prints. Don't worry I will work ...
   Author: Sanjay Subramanian, 2015-01-04, 04:25
Re: saveAsTextFile - Spark - [mail # user]
...@lailaBased on the error u mentioned in the nabble link below, it seems like there are no permissions to write to HDFS. So this is possibly why saveAsTextFile is failing.     ...
   Author: Sanjay Subramanian, 2015-01-03, 16:47
[expand - 2 more] - Re: How to identify erroneous input record ? - Spark - [mail # user]
...Although not elegantly I got the output via my code but totally agree on the parsing 5 times (thats really bad).Will add your suggested logic and check it out. I have a "long" way to the fin...
   Author: Sanjay Subramanian, 2014-12-24, 17:20
Sort:
project
Hive (128)
Spark (12)
HDFS (10)
Impala (5)
MapReduce (5)
Hadoop (2)
type
mail # user (160)
issue (1)
wiki (1)
date
last 7 days (2)
last 30 days (9)
last 90 days (16)
last 6 months (26)
last 9 months (162)
author
Ted Yu (1921)
Harsh J (1307)
Jun Rao (1053)
Todd Lipcon (1003)
Stack (995)
Andrew Purtell (913)
Jonathan Ellis (855)
stack (788)
Jarek Jarcec Cecho (754)
Yusaku Sako (751)
Jean-Daniel Cryans (750)
Hitesh Shah (726)
Josh Elser (724)
Eric Newton (712)
Brock Noland (685)
Jonathan Hsieh (685)
Roman Shaposhnik (682)
Siddharth Seth (677)
Steve Loughran (661)
Namit Jain (648)
Owen O'Malley (621)
Hyunsik Choi (597)
Neha Narkhede (571)
James Taylor (570)
Arun C Murthy (548)
Sanjay Subramanian
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB