Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig >> mail # user >> Set block size of output


+
Johannes Schwenk 2012-10-15, 10:04
+
Joe Crobak 2012-10-22, 02:01
+
Johannes Schwenk 2012-10-31, 15:53
Copy link to this message
-
Re: Set block size of output
Sorry, forgot to mention I am using

Cloudera 2.0.0-cdh4.0.1 with pig 0.10.0-SNAPSHOT
Am 15.10.2012 12:04, schrieb Johannes Schwenk:
> Hi,
>
> I would like to set the HDFS block size of my pig scripts output files.
> How do I do that? I tried to use
>
> PIG_OPTS="-Dpig.path.block.size=1048576";
>
> which seemed to me the only appropriate option I could find.
>
> Thanks for any hints!
> Johannes Schwenk
>

Johannes Schwenk

--
Softwareentwickler (Reporting)
________________________________________________________

ADITION technologies AG
Schwarzwaldstraße 78b
79117 Freiburg

http://www.adition.com

T +49 / (0)761 / 88147 - 30
F +49 / (0)761 / 88147 - 77
SUPPORT +49  / (0)1805 - ADITION

(Festnetzpreis 14 ct/min; Mobilfunkpreise maximal 42 ct/min)

Eingetragen beim Amtsgericht Düsseldorf unter HRB 54076
Vorstände: Andreas Kleiser, Jörg Klekamp, Tihomir Perkovic, Marcus Schlüter
Aufsichtsratsvorsitzender: Rechtsanwalt Daniel Raimer
UStIDNr.: DE 218 858 434

NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB