Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Flume, mail # user - Debug HDFS sink


Copy link to this message
-
Debug HDFS sink
Mohit Anchlia 2012-09-08, 01:11
I am using HDFS sink with snappycompression. After I write data and read
from the hdfs file I only see the keys but not data. How can I debug this
with flume?
DEFINE SequenceFileLoader
org.apache.pig.piggybank.storage.SequenceFileLoader();

A = LOAD '/flume_vol/flume/2012/09/07/17/dslg1/*.snappy*' USING
SequenceFileLoader AS (key:long, document:bytearray);

DUMP A;

(1347065726395,)

(1347065726395,)

(1347065726395,)

(1347065726395,)

(1347065726395,)

(1347065726395,)

(1347065726396,)

(1347065726396,)

(1347065726396,)

(1347065726396,)

(1347065726396,)
+
Alexander Lorenz 2012-09-10, 17:28