Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop, mail # dev - python streaming error


Copy link to this message
-
Re:Re: python streaming error
springring 2013-01-12, 08:55
hi,

    I modify the file as below, there is still error

  1 #!/bin/env python
  2
  3 import sys
  4
  5 for line in sys.stdin:
  6     offset,filename = line.split("\t")
  7     file = "hdfs://computeb-13:9100/user/hdfs/catalog3/" + filename
  8     print line
  9     print filename
 10     print file
 11     file_obj = open(file)

At 2013-01-12 16:34:37,"Nitin Pawar" <[EMAIL PROTECTED]> wrote:
>is this correct path for writing onto hdfs?
>
>"hdfs://user/hdfs/catalog3."
>
>I don't see the namenode info in the path. Can this cause any issue. Just
>making an guess
>something like hdfs://host:port/path
>
>On Sat, Jan 12, 2013 at 12:30 AM, springring <[EMAIL PROTECTED]> wrote:
>
>> hdfs://user/hdfs/catalog3/
>
>
>
>
>
>--
>Nitin Pawar