Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
clear query|facets|time Search criteria: .   Results from 1 to 10 from 13 (0.321s).
Loading phrases to help you
refine your search...
How to skip corrupted avro files - Spark - [mail # user]
...Hi, I am using Spark 1.3.1 to read a directory of about 2000 avro files. The avro files are from a third party and a few of them are corrupted.  val path = "{myDirecotry of avro fi...
   Author: Shing Hing Man, 2015-05-03, 17:57
[expand - 1 more] - Re: org.apache.avro.AvroRuntimeException: java.io.IOException: Invalid sync! - Avro - [mail # user]
...I do not know  whether there is sync markers in the avro file. The avro file is supplied to us by another data vendor.Shing       On Saturday, 11 April 2015, 16:02, "ÐΞ€ρ...
   Author: Shing Hing Man, 2015-04-11, 15:08
How to create data frame from an avro file in  Spark 1.3.0 - Spark - [mail # user]
...In spark-avro 0.1,  the method AvroContext.avroFile  returns a SchemaRDD, which is deprecated in Spark 1.3.0 package com.databricks.sparkimport org.apache.spark.sql.{SQLContext, SchemaRDD}pa...
   Author: Shing Hing Man, 2015-03-14, 20:18
How to query Spark master for cluster status ? - Spark - [mail # user]
...Hi,  I am using Spark 1.2.  The Spark master UI has a status.Is there a web service on the Spark master that returns the status of the cluster in Json ?Alternatively, what is the best way to...
   Author: Shing Hing Man, 2015-01-15, 13:05
Re: ScalaReflectionException when using saveAsParquetFile in sbt - Spark - [mail # user]
...I have the same exception when I run the following example fromSpark SQL Programming Guide - Spark 1.2.0 Documentation|   ||   |   |   |   |   || Spark SQL Programming Guide - Spark 1.2.0 Do...
   Author: Shing Hing Man, 2015-01-11, 12:45
How to autogenerate timestamp with Spark Cassandra connector - Cassandra - [mail # user]
...Hi,I am trying to insert into the following column family using Spark Cassandra connector. CREATE TABLE myks.mycf (id bigint,msg text,type text,ts, timestamp,primary key (id, msg)) Is there ...
   Author: Shing Hing Man, 2014-11-11, 13:15
[expand - 2 more] - Re: Apache Cassandra 2.1.0 : cassandra-stress performance discrepancy between SSD and SATA drive - Cassandra - [mail # user]
...I have run a sysbench  file io test on my home PC and office PC. The result is  given below. The result shows my office PC (with a SSD) is about 3 times more performant than my hom...
   Author: Shing Hing Man, 2014-09-29, 18:49
Cassandra 2.0.5 : *-jb-27-Data.db (No such file or directory) - Cassandra - [mail # user]
...Hi,   I am running Cassandra 2.0.5 on my PC (with just one node and the default cassandra.yaml). I have inserted  one million rows into a column family (each row has a int key...
   Author: Shing Hing Man, 2014-09-08, 15:23
[expand - 1 more] - Re: Spark 1.0.2  Can  GroupByTest example be run in Eclipse without change - Spark - [mail # user]
...After looking at the source code of SparkConf.scala,   I found the following solution.Just set the following Java system property :-Dspark.master=localShingOn Monday, 1 September 2014, ...
   Author: Shing Hing Man, 2014-09-07, 08:14
Spark-cassandra-connector 1.0.0-rc5: java.io.NotSerializableException - Spark - [mail # user]
...Hi,My version of Spark is 1.0.2.I am trying to use Spark-cassandra-connector to execute an update csql statement inside an CassandraConnector(conf).withSessionDo  block :CassandraConnec...
   Author: Shing Hing Man, 2014-09-05, 14:27
Sort:
project
Spark (6)
Cassandra (3)
MapReduce (2)
Avro (1)
Hadoop (1)
type
mail # user (13)
date
last 7 days (1)
last 30 days (2)
last 90 days (3)
last 6 months (6)
last 9 months (13)
author
Ted Yu (2034)
Harsh J (1318)
Jun Rao (1101)
Andrew Purtell (1016)
Todd Lipcon (1016)
Stack (1005)
GitHub Import (895)
Josh Elser (876)
Jonathan Ellis (865)
stack (829)
Jarek Jarcec Cecho (814)
Hitesh Shah (801)
Yusaku Sako (793)
Siddharth Seth (780)
Jean-Daniel Cryans (753)
Eric Newton (739)
Brock Noland (723)
Steve Loughran (721)
Jonathan Hsieh (702)
James Taylor (693)
Roman Shaposhnik (687)
Hyunsik Choi (648)
Namit Jain (648)
Owen O'Malley (617)
Bikas Saha (585)
Shing Hing Man
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB