Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
MapReduce >> mail # user >> Helper files in python


+
Chengi Liu 2013-08-28, 23:49
Copy link to this message
-
Re: Helper files in python
If you mean to make those files available in map/reduce tasks:
How about put them in one directory, say "app", and specify -file app
-mapper app/xxx -reducer app/xx...  , hadoop will pack entire dir for you.
On Thu, Aug 29, 2013 at 7:49 AM, Chengi Liu <[EMAIL PROTECTED]> wrote:

> Hi,
>  I have four files
> mapper.py
> mapper_helper.py
> reducer.py
> reducer_helper.py
>
> How do i specify those helper files in hadoop?
> Thanks
>
+
Shahab Yunus 2013-08-29, 03:10
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB