Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Set block size of output


Copy link to this message
-
Re: Set block size of output
Sorry, forgot to mention I am using

Cloudera 2.0.0-cdh4.0.1 with pig 0.10.0-SNAPSHOT
Am 15.10.2012 12:04, schrieb Johannes Schwenk:
> Hi,
>
> I would like to set the HDFS block size of my pig scripts output files.
> How do I do that? I tried to use
>
> PIG_OPTS="-Dpig.path.block.size=1048576";
>
> which seemed to me the only appropriate option I could find.
>
> Thanks for any hints!
> Johannes Schwenk
>

Johannes Schwenk

--
Softwareentwickler (Reporting)
________________________________________________________

ADITION technologies AG
Schwarzwaldstraße 78b
79117 Freiburg

http://www.adition.com

T +49 / (0)761 / 88147 - 30
F +49 / (0)761 / 88147 - 77
SUPPORT +49  / (0)1805 - ADITION

(Festnetzpreis 14 ct/min; Mobilfunkpreise maximal 42 ct/min)

Eingetragen beim Amtsgericht Düsseldorf unter HRB 54076
Vorstände: Andreas Kleiser, Jörg Klekamp, Tihomir Perkovic, Marcus Schlüter
Aufsichtsratsvorsitzender: Rechtsanwalt Daniel Raimer
UStIDNr.: DE 218 858 434