Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
HDFS, mail # user - issue about terasort read partition file from local fs instead HDFS


Copy link to this message
-
issue about terasort read partition file from local fs instead HDFS
ch huang 2013-12-06, 03:10
hi,maillist:
              i try to use terasort to benchmark my cluster ,when i run it
,i found tearsort try to read partition file from local filesystem
not HDFS,i see a partition file in HDFS ,when i copy this file into local
filesystem,run terasort again ,it's work fine ,but it run on local host
instead of cluster ,why? and how can i let it run on cluster?

# hadoop fs -ls /alex/terasort/1G-input
Found 3 items
-rw-r--r--   3 root hadoop          0 2013-12-05 14:34
/alex/terasort/1G-input/_SUCCESS
-rw-r--r--   3 root hadoop        129 2013-12-06 10:20
/alex/terasort/1G-input/_partition.lst
-rw-r--r--   3 root hadoop 1000000000 2013-12-05 14:34
/alex/terasort/1G-input/part-00000