Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS >> mail # user >> issue about terasort read partition file from local fs instead HDFS


Copy link to this message
-
issue about terasort read partition file from local fs instead HDFS
hi,maillist:
              i try to use terasort to benchmark my cluster ,when i run it
,i found tearsort try to read partition file from local filesystem
not HDFS,i see a partition file in HDFS ,when i copy this file into local
filesystem,run terasort again ,it's work fine ,but it run on local host
instead of cluster ,why? and how can i let it run on cluster?

# hadoop fs -ls /alex/terasort/1G-input
Found 3 items
-rw-r--r--   3 root hadoop          0 2013-12-05 14:34
/alex/terasort/1G-input/_SUCCESS
-rw-r--r--   3 root hadoop        129 2013-12-06 10:20
/alex/terasort/1G-input/_partition.lst
-rw-r--r--   3 root hadoop 1000000000 2013-12-05 14:34
/alex/terasort/1G-input/part-00000
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB