Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce, mail # user - Re: Running Contrail on hadoop


Copy link to this message
-
Re: Running Contrail on hadoop
Felipe Gutierrez 2013-09-09, 16:35
Since I didn't get to work with Contrail, I started to learn CloudBurst.
http://sourceforge.net/apps/mediawiki/cloudburst-bio/index.php?title=CloudBurst
After one hour learning I could run MpReduce jobs on Hadoop. :)

Felipe
On Mon, Sep 9, 2013 at 11:59 AM, Felipe Gutierrez <
[EMAIL PROTECTED]> wrote:

> Hi, I set the locale and after this I tryied to execute again the
> Contrail, but the results are files with size zero.
>
> Have antbody already runned Contrail on Hadoop?
> Thanks
> Felipe
>
> $ bin/hadoop jar contrail-1.0-SNAPSHOT.jar contrail.Contrail -asm assembly
> -k 25 -reads /user/hduser/reads/small.fq
> Contrail 0.8.2
>
> =================================================================================> Input: /user/hduser/reads/small.fq
> Workdir: assembly/
> ...
> ...
> ...
> $ bin/hadoop jar contrail-1.0-SNAPSHOT.jar contrail.BuildGraph -k 25
> -input /user/hduser/reads/small.fq -output /user/hduser/output -asm
> /user/hduser/assembly -reads /user/hduser/reads/small.fq
> 13/09/09 11:50:11 INFO contrail.BuildGraph: Tool name: BuildGraph
> 13/09/09 11:50:11 INFO contrail.BuildGraph:  - input:
> /user/hduser/reads/small.fq
> 13/09/09 11:50:11 INFO contrail.BuildGraph:  - output: /user/hduser/output
> 13/09/09 11:50:12 WARN mapred.JobClient: Use GenericOptionsParser for
> parsing the arguments. Applications should implement Tool for the same.
> 13/09/09 11:50:12 INFO util.NativeCodeLoader: Loaded the native-hadoop
> library
> 13/09/09 11:50:12 WARN snappy.LoadSnappy: Snappy native library not loaded
> 13/09/09 11:50:12 INFO mapred.FileInputFormat: Total input paths to
> process : 1
> 13/09/09 11:50:12 INFO mapred.JobClient: Running job: job_201309030936_0068
> 13/09/09 11:50:13 INFO mapred.JobClient:  map 0% reduce 0%
> 13/09/09 11:50:18 INFO mapred.JobClient:  map 3% reduce 0%
> ...
> ...
> ...
> hduser@cloud6:/usr/local/hadoop$ bin/hadoop fs -ls /user/hduser/output
> Found 52 items
> -rw-r--r--   3 hduser supergroup          0 2013-09-09 11:55
> /user/hduser/output/_SUCCESS
> drwxr-xr-x   - hduser supergroup          0 2013-09-09 11:50
> /user/hduser/output/_logs
> -rw-r--r--   3 hduser supergroup          0 2013-09-09 11:51
> /user/hduser/output/part-00000
> ...
> ...
>
>
>
> On Sat, Sep 7, 2013 at 2:44 PM, Jens Scheidtmann <
> [EMAIL PROTECTED]> wrote:
>
>> Dear Felipe,
>>
>> Did you set the locale on all machines of the cluster?
>>
>> Best regards,
>>
>> Jens
>>
>
>
>
> --
> *--
> -- Felipe Oliveira Gutierrez
> -- [EMAIL PROTECTED]
> -- https://sites.google.com/site/lipe82/Home/diaadia*
>

--
*--
-- Felipe Oliveira Gutierrez
-- [EMAIL PROTECTED]
-- https://sites.google.com/site/lipe82/Home/diaadia*