Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hadoop, mail # dev - python streaming error


+
springring 2013-01-12, 08:30
+
Nitin Pawar 2013-01-12, 08:34
+
springring 2013-01-12, 08:55
Copy link to this message
-
Re: Re: python streaming error
Nitin Pawar 2013-01-12, 08:58
computedb-13 is not a valid host name

may be if you have local hadoop then you can name refer it with
hdfs://localhost:9100/ or hdfs://127.0.0.1:9100

if its on other machine then just try with IP address of that machine
On Sat, Jan 12, 2013 at 12:55 AM, springring <[EMAIL PROTECTED]> wrote:

> hi,
>
>     I modify the file as below, there is still error
>
>   1 #!/bin/env python
>   2
>   3 import sys
>   4
>   5 for line in sys.stdin:
>   6     offset,filename = line.split("\t")
>   7     file = "hdfs://computeb-13:9100/user/hdfs/catalog3/" + filename
>   8     print line
>   9     print filename
>  10     print file
>  11     file_obj = open(file)
>
>
>
>
>
>
>
>
>
> At 2013-01-12 16:34:37,"Nitin Pawar" <[EMAIL PROTECTED]> wrote:
> >is this correct path for writing onto hdfs?
> >
> >"hdfs://user/hdfs/catalog3."
> >
> >I don't see the namenode info in the path. Can this cause any issue. Just
> >making an guess
> >something like hdfs://host:port/path
> >
> >On Sat, Jan 12, 2013 at 12:30 AM, springring <[EMAIL PROTECTED]> wrote:
> >
> >> hdfs://user/hdfs/catalog3/
> >
> >
> >
> >
> >
> >--
> >Nitin Pawar
>

--
Nitin Pawar
+
springring 2013-01-14, 01:27
+
springring 2013-01-14, 01:53
+
Andy Isaacson 2013-01-14, 22:19
+
Andy Isaacson 2013-01-14, 22:24
+
Simone Leo 2013-01-15, 09:44