Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Helper files in python


Copy link to this message
-
Re: Helper files in python
If you mean to make those files available in map/reduce tasks:
How about put them in one directory, say "app", and specify -file app
-mapper app/xxx -reducer app/xx...  , hadoop will pack entire dir for you.
On Thu, Aug 29, 2013 at 7:49 AM, Chengi Liu <[EMAIL PROTECTED]> wrote:

> Hi,
>  I have four files
> mapper.py
> mapper_helper.py
> reducer.py
> reducer_helper.py
>
> How do i specify those helper files in hadoop?
> Thanks
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB