| clear query|facets|time |
Search criteria: .
Results from 121 to 130 from
135 (0.127s).
|
|
|
Loading phrases to help you
refine your search...
|
|
Re: Problems adding JARs to distributed classpath in Hadoop 0.20.2 - MapReduce - [mail # user]
|
|
...What is exactly that does not work? Oozie uses DistributeCache as the only mechanism to set classpaths to jobs and it works fine. Thanks. Alejandro On Mon, May 30, 20...
|
|
|
Author: Alejandro Abdelnur,
2011-05-31, 19:02
|
|
|
Re: Problems adding JARs to distributed classpath in Hadoop 0.20.2 - MapReduce - [mail # user]
|
|
...John, Now I get what you are trying to do. My recommendation would be: * Use a Java action to do all the stuff prior to starting your MR job * Use a mapreduce action to sta...
|
|
|
Author: Alejandro Abdelnur,
2011-05-30, 16:43
|
|
|
Re: Problems adding JARs to distributed classpath in Hadoop 0.20.2 - MapReduce - [mail # user]
|
|
...John, If you are using Oozie, dropping all the JARs your MR jobs needs in the Oozie WF lib/ directory should suffice. Oozie will make sure all those JARs are in the distributed cache. ...
|
|
|
Author: Alejandro Abdelnur,
2011-05-27, 22:47
|
|
|
Re: MultipleOutputFormat - MapReduce - [mail # user]
|
|
...You should be able to create partitions on the fly. Check the last example in the javadocs: http://hadoop.apache.org/mapreduce/docs/r0.21.0/api/org/apache/hadoop/mapreduce/lib/ou...
|
|
|
Author: Alejandro Abdelnur,
2011-03-30, 04:09
|
|
|
Re: MultipleOutputFormat - MapReduce - [mail # user]
|
|
...Dmitriy, Have you check the MultipleOutputs instead? It provides similar functionality. Alejandro On Wed, Mar 30, 2011 at 11:39 AM, Dmitriy Lyubimov wrote: ...
|
|
|
Author: Alejandro Abdelnur,
2011-03-30, 03:56
|
|
|
Re: running a job without user - MapReduce - [mail # user]
|
|
...Sagar, Set the following property in your JobConf (or using -D) * mapred*.*reduce*.*tasks=0* * * That should do the trick. Alejandro *** * On Fri, Mar 11, 2011...
|
|
|
Author: Alejandro Abdelnur,
2011-03-11, 07:31
|
|
|
Re: how to use hadoop apis with cloudera distribution ? - MapReduce - [mail # user]
|
|
...If write your code within a Maven project (which you can open from Eclipse) then you should the following in your pom.xml: * Define Cloudera repository: ... ...
|
|
|
Author: Alejandro Abdelnur,
2011-03-09, 03:49
|
|
|
Re: use DistributedCache to add many files to class path - MapReduce - [mail # user]
|
|
...Lei Liu, You have a cut&paste error the second addition should use 'tairJarPath' but it is using the 'jeJarPath' Hope this helps. Alejandro On Thu, Feb 17, 2011 at 11...
|
|
|
Author: Alejandro Abdelnur,
2011-02-17, 03:59
|
|
|
Re: Problem while installing Oozie - MapReduce - [mail # user]
|
|
...FYI, answered in the oozie-users@ alias: http://tech.groups.yahoo.com/group/Oozie-users/message/673 On Thu, Jan 20, 2011 at 7:15 PM, Giridhar Addepalli wrote: ...
|
|
|
Author: Alejandro Abdelnur,
2011-01-21, 06:31
|
|
|
Re: Too large class path for map reduce jobs - MapReduce - [mail # user]
|
|
...well, if the issue is a too long classpath, the softlink thingy will give some room to breath as the total CP length will be much smaller. A On Thu, Oct 7, 2010 at 3:43 PM, Henni...
|
|
|
Author: Alejandro Abdelnur,
2010-10-07, 08:23
|
|
|
|
