Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> Embedded Pig in a Python Module?


Copy link to this message
-
Re: Embedded Pig in a Python Module?
Sweet! That actually works. I don't know why I didn't just try that. For
some reason, I was convinced it would break. Thanks for the advice!

Eli

On 3/14/12 8:40 AM, Norbert Burger wrote:
> What prevents you from collecting your embedded PIg imports/calls into a
> Python module, and calling out to it from there?  As an example,
> http://techblug.wordpress.com/2011/07/29/pagerank-implementation-in-pig/has
> only a single file, but seems that it could be easily externalized if
> needed.
>
> Norbert
>
> On Wed, Mar 14, 2012 at 2:15 AM, Eli Finkelshteyn<[EMAIL PROTECTED]>wrote:
>
>> Hi Folks,
>> I'm currently working on a framework that's going to do some awesome
>> graphing stuff grabbing data out using Pig. What I'm wondering is, is there
>> any way I can put embedded pig in a module and call it that way? Normally,
>> I need to run embedded pig in a Python script as something like "pig
>> embedded_pig_thing.py," which I can't really do when calling it out of a
>> module. Ideas? It would make the framework much cleaner if this were
>> something I could do, and I imagine it would be useful to others as well.
>>
>> Cheers,
>> Eli
>>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB