Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
MapReduce >> mail # user >> Hadoop Nutch Mkdirs failed to create file


Copy link to this message
-
Hadoop Nutch Mkdirs failed to create file
hi, everyone!
 I want use the nutch to crawl the web pages, but problem comes as  the log like, I think it maybe some permissions problem,but i am not sure.
Any help will be appreciated, think you
2013-01-23 07:37:21,809 ERROR mapred.FileOutputCommitter - Mkdirs failed to create file:/home/wj/apps/apache-nutch-1.6/bin/crawl/crawldb/190684692/_temporary
2013-01-23 07:37:24,836 WARN  mapred.LocalJobRunner - job_local_0002
java.io.IOException: The temporary job-output directory file:/home/wj/apps/apache-nutch-1.6/bin/crawl/crawldb/190684692/_temporary doesn't exist!
at org.apache.hadoop.mapred.FileOutputCommitter.getWorkPath(FileOutputCommitter.java:250)
at org.apache.hadoop.mapred.FileOutputFormat.getTaskOutputPath(FileOutputFormat.java:244)
at org.apache.hadoop.mapred.MapFileOutputFormat.getRecordWriter(MapFileOutputFormat.java:46)
at org.apache.hadoop.mapred.ReduceTask$OldTrackingRecordWriter.<init>(ReduceTask.java:448)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:490)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:420)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:260)
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB