Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
clear query|facets|time Search criteria: .   Results from 1 to 10 from 11 (0.274s).
Loading phrases to help you
refine your search...
How to create data frame from an avro file in  Spark 1.3.0 - Spark - [mail # user]
...In spark-avro 0.1,  the method AvroContext.avroFile  returns a SchemaRDD, which is deprecated in Spark 1.3.0 package com.databricks.sparkimport org.apache.spark.sql.{SQLContext, SchemaRDD}pa...
   Author: Shing Hing Man, 2015-03-14, 20:18
How to query Spark master for cluster status ? - Spark - [mail # user]
...Hi,  I am using Spark 1.2.  The Spark master UI has a status.Is there a web service on the Spark master that returns the status of the cluster in Json ?Alternatively, what is the best way to...
   Author: Shing Hing Man, 2015-01-15, 13:05
Re: ScalaReflectionException when using saveAsParquetFile in sbt - Spark - [mail # user]
...I have the same exception when I run the following example fromSpark SQL Programming Guide - Spark 1.2.0 Documentation|   ||   |   |   |   |   || Spark SQL Programming Guide - Spark 1.2.0 Do...
   Author: Shing Hing Man, 2015-01-11, 12:45
How to autogenerate timestamp with Spark Cassandra connector - Cassandra - [mail # user]
...Hi,I am trying to insert into the following column family using Spark Cassandra connector. CREATE TABLE myks.mycf (id bigint,msg text,type text,ts, timestamp,primary key (id, msg)) Is there ...
   Author: Shing Hing Man, 2014-11-11, 13:15
[expand - 2 more] - Re: Apache Cassandra 2.1.0 : cassandra-stress performance discrepancy between SSD and SATA drive - Cassandra - [mail # user]
...I have run a sysbench  file io test on my home PC and office PC. The result is  given below. The result shows my office PC (with a SSD) is about 3 times more performant than my hom...
   Author: Shing Hing Man, 2014-09-29, 18:49
Cassandra 2.0.5 : *-jb-27-Data.db (No such file or directory) - Cassandra - [mail # user]
...Hi,   I am running Cassandra 2.0.5 on my PC (with just one node and the default cassandra.yaml). I have inserted  one million rows into a column family (each row has a int key...
   Author: Shing Hing Man, 2014-09-08, 15:23
[expand - 1 more] - Re: Spark 1.0.2  Can  GroupByTest example be run in Eclipse without change - Spark - [mail # user]
...After looking at the source code of SparkConf.scala,   I found the following solution.Just set the following Java system property :-Dspark.master=localShingOn Monday, 1 September 2014, ...
   Author: Shing Hing Man, 2014-09-07, 08:14
Spark-cassandra-connector 1.0.0-rc5: java.io.NotSerializableException - Spark - [mail # user]
...Hi,My version of Spark is 1.0.2.I am trying to use Spark-cassandra-connector to execute an update csql statement inside an CassandraConnector(conf).withSessionDo  block :CassandraConnec...
   Author: Shing Hing Man, 2014-09-05, 14:27
Hadoop 2.2.0 :  Job not showing on resource management web UI - Hadoop - [mail # user]
...Hi, I have set up a single node Hadoop 2.2.0 .I can submit  wordcount  hadoop job to YARN from the command line.It run successfully and I checked the result is in hdfs. matmsh@gaus...
   Author: Shing Hing Man, 2014-06-28, 23:21
[expand - 5 more] - Re: How to lower the total number of map tasks - MapReduce - [mail # user]
...I have followed a suggestion on the given link, and set  mapred.min.sp lit.size to 134217728.  With the above mapred.min.split.size, I get     mapred.map.tasks =121 (previously it ...
   Author: Shing Hing Man, 2012-10-03, 13:50
Sort:
project
Spark (5)
Cassandra (3)
MapReduce (2)
Hadoop (1)
type
mail # user (11)
date
last 7 days (0)
last 30 days (1)
last 90 days (3)
last 6 months (5)
last 9 months (11)
author
Ted Yu (1987)
Harsh J (1315)
Jun Rao (1089)
Todd Lipcon (1012)
Stack (1000)
Andrew Purtell (973)
GitHub Import (895)
Jonathan Ellis (858)
Josh Elser (820)
stack (818)
Jarek Jarcec Cecho (807)
Yusaku Sako (785)
Hitesh Shah (765)
Jean-Daniel Cryans (754)
Siddharth Seth (739)
Eric Newton (733)
Brock Noland (725)
Jonathan Hsieh (700)
Steve Loughran (692)
Roman Shaposhnik (686)
Namit Jain (648)
Hyunsik Choi (640)
James Taylor (636)
Owen O'Malley (619)
Neha Narkhede (579)
Shing Hing Man
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB