Dear all,

Today I am trying  to configure hadoop-0.20.205.0 on a 4  node Cluster.
When I start my cluster , all daemons got started except tasktracker,
don't know why task tracker fails due to following error logs.

Cluster is in private network.My /etc/hosts file contains all IP
hostname resolution commands in all  nodes.

2012-02-21 17:48:33,056 INFO
org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
TaskTrackerMetrics registered.
2012-02-21 17:48:33,094 ERROR org.apache.hadoop.mapred.TaskTracker: Can
not start task tracker because java.net.SocketException: Invalid argument
        at sun.nio.ch.Net.bind(Native Method)
        at
sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:119)
        at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:59)
        at org.apache.hadoop.ipc.Server.bind(Server.java:225)
        at org.apache.hadoop.ipc.Server$Listener.<init>(Server.java:301)
        at org.apache.hadoop.ipc.Server.<init>(Server.java:1483)
        at org.apache.hadoop.ipc.RPC$Server.<init>(RPC.java:545)
        at org.apache.hadoop.ipc.RPC.getServer(RPC.java:506)
        at
org.apache.hadoop.mapred.TaskTracker.initialize(TaskTracker.java:772)
        at
org.apache.hadoop.mapred.TaskTracker.<init>(TaskTracker.java:1428)
        at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:3673)

Any comments on the issue.
Thanks

Any update on the below issue.

Thanks

Adarsh Sharma wrote:
> Dear all,
>
> Today I am trying  to configure hadoop-0.20.205.0 on a 4  node Cluster.
> When I start my cluster , all daemons got started except tasktracker,
> don't know why task tracker fails due to following error logs.
>
> Cluster is in private network.My /etc/hosts file contains all IP
> hostname resolution commands in all  nodes.
>
> 2012-02-21 17:48:33,056 INFO
> org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source
> TaskTrackerMetrics registered.
> 2012-02-21 17:48:33,094 ERROR org.apache.hadoop.mapred.TaskTracker:
> Can not start task tracker because java.net.SocketException: Invalid
> argument
>        at sun.nio.ch.Net.bind(Native Method)
>        at
> sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:119)
>        at
> sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:59)
>        at org.apache.hadoop.ipc.Server.bind(Server.java:225)
>        at org.apache.hadoop.ipc.Server$Listener.<init>(Server.java:301)
>        at org.apache.hadoop.ipc.Server.<init>(Server.java:1483)
>        at org.apache.hadoop.ipc.RPC$Server.<init>(RPC.java:545)
>        at org.apache.hadoop.ipc.RPC.getServer(RPC.java:506)
>        at
> org.apache.hadoop.mapred.TaskTracker.initialize(TaskTracker.java:772)
>        at
> org.apache.hadoop.mapred.TaskTracker.<init>(TaskTracker.java:1428)
>        at
> org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:3673)
>
> Any comments on the issue.
>
>
> Thanks
>

Hm.. I would try first to stop all the deamons wtih
$haddop_home/bin/stop-all.sh. Afterwards check that on the master and one
of the slaves no deamons are running (jps). Maybe you could try to check if
your conf on tasktrackers for the jobtracker is pointing to the right place
(mapred-site.xml). Do you see any error in the jobtracker log too?
On 22 February 2012 09:44, Adarsh Sharma <[EMAIL PROTECTED]> wrote:

> Any update on the below issue.
>
> Thanks
>
>
> Adarsh Sharma wrote:
>
>> Dear all,
>>
>> Today I am trying  to configure hadoop-0.20.205.0 on a 4  node Cluster.
>> When I start my cluster , all daemons got started except tasktracker,
>> don't know why task tracker fails due to following error logs.
>>
>> Cluster is in private network.My /etc/hosts file contains all IP hostname
>> resolution commands in all  nodes.
>>
>> 2012-02-21 17:48:33,056 INFO org.apache.hadoop.metrics2.**impl.MetricsSourceAdapter:
>> MBean for source TaskTrackerMetrics registered.
>> 2012-02-21 17:48:33,094 ERROR org.apache.hadoop.mapred.**TaskTracker:
>> Can not start task tracker because java.net.SocketException: Invalid
>> argument
>>       at sun.nio.ch.Net.bind(Native Method)
>>       at sun.nio.ch.**ServerSocketChannelImpl.bind(**
>> ServerSocketChannelImpl.java:**119)
>>       at sun.nio.ch.**ServerSocketAdaptor.bind(**
>> ServerSocketAdaptor.java:59)
>>       at org.apache.hadoop.ipc.Server.**bind(Server.java:225)
>>       at org.apache.hadoop.ipc.Server$**Listener.<init>(Server.java:**
>> 301)
>>       at org.apache.hadoop.ipc.Server.<**init>(Server.java:1483)
>>       at org.apache.hadoop.ipc.RPC$**Server.<init>(RPC.java:545)
>>       at org.apache.hadoop.ipc.RPC.**getServer(RPC.java:506)
>>       at org.apache.hadoop.mapred.**TaskTracker.initialize(**
>> TaskTracker.java:772)
>>       at org.apache.hadoop.mapred.**TaskTracker.<init>(**
>> TaskTracker.java:1428)
>>       at org.apache.hadoop.mapred.**TaskTracker.main(TaskTracker.**
>> java:3673)
>>
>> Any comments on the issue.
>>
>>
>> Thanks
>>
>>
>

Hi guys !

Im trying to understand the way globstatus / deflate files work in hdfs.  I
cant read them using the globStatus API in the hadoop FileSystem , from
java.  the specifics are here if anyone wants some easy stackoverflow
points :)

http://stackoverflow.com/questions/9400739/hadoop-globstatus-and-deflate-files

On Wed, Feb 22, 2012 at 7:39 AM, Merto Mertek <[EMAIL PROTECTED]> wrote:

> Hm.. I would try first to stop all the deamons wtih
> $haddop_home/bin/stop-all.sh. Afterwards check that on the master and one
> of the slaves no deamons are running (jps). Maybe you could try to check if
> your conf on tasktrackers for the jobtracker is pointing to the right place
> (mapred-site.xml). Do you see any error in the jobtracker log too?
>
>
> On 22 February 2012 09:44, Adarsh Sharma <[EMAIL PROTECTED]> wrote:
>
> > Any update on the below issue.
> >
> > Thanks
> >
> >
> > Adarsh Sharma wrote:
> >
> >> Dear all,
> >>
> >> Today I am trying  to configure hadoop-0.20.205.0 on a 4  node Cluster.
> >> When I start my cluster , all daemons got started except tasktracker,
> >> don't know why task tracker fails due to following error logs.
> >>
> >> Cluster is in private network.My /etc/hosts file contains all IP
> hostname
> >> resolution commands in all  nodes.
> >>
> >> 2012-02-21 17:48:33,056 INFO
> org.apache.hadoop.metrics2.**impl.MetricsSourceAdapter:
> >> MBean for source TaskTrackerMetrics registered.
> >> 2012-02-21 17:48:33,094 ERROR org.apache.hadoop.mapred.**TaskTracker:
> >> Can not start task tracker because java.net.SocketException: Invalid
> >> argument
> >>       at sun.nio.ch.Net.bind(Native Method)
> >>       at sun.nio.ch.**ServerSocketChannelImpl.bind(**
> >> ServerSocketChannelImpl.java:**119)
> >>       at sun.nio.ch.**ServerSocketAdaptor.bind(**
> >> ServerSocketAdaptor.java:59)
> >>       at org.apache.hadoop.ipc.Server.**bind(Server.java:225)
> >>       at org.apache.hadoop.ipc.Server$**Listener.<init>(Server.java:**
> >> 301)
> >>       at org.apache.hadoop.ipc.Server.<**init>(Server.java:1483)
> >>       at org.apache.hadoop.ipc.RPC$**Server.<init>(RPC.java:545)
> >>       at org.apache.hadoop.ipc.RPC.**getServer(RPC.java:506)
> >>       at org.apache.hadoop.mapred.**TaskTracker.initialize(**
> >> TaskTracker.java:772)
> >>       at org.apache.hadoop.mapred.**TaskTracker.<init>(**
> >> TaskTracker.java:1428)
> >>       at org.apache.hadoop.mapred.**TaskTracker.main(TaskTracker.**
> >> java:3673)
> >>
> >> Any comments on the issue.
> >>
> >>
> >> Thanks
> >>
> >>
> >
>

--
Jay Vyas
MMSB/UCHC

I do not know how the distribution and splitting of deflate files exactly
works if that is your question but probably you will find something useful
in *Codec classes, where are located implementations of few compression
formats. Deflate files are just a type of compression files that you can
use for storing files in your system. There are several others types,
depending on your needs and tradeofs you are dealing (space or time for
compressing).

 Globs I think are just a matching strategy to match files/folders together
with regular expressions..
On 22 February 2012 19:29, Jay Vyas <[EMAIL PROTECTED]> wrote:

> Hi guys !
>
> Im trying to understand the way globstatus / deflate files work in hdfs.  I
> cant read them using the globStatus API in the hadoop FileSystem , from
> java.  the specifics are here if anyone wants some easy stackoverflow
> points :)
>
>
> http://stackoverflow.com/questions/9400739/hadoop-globstatus-and-deflate-files
>
> On Wed, Feb 22, 2012 at 7:39 AM, Merto Mertek <[EMAIL PROTECTED]> wrote:
>
> > Hm.. I would try first to stop all the deamons wtih
> > $haddop_home/bin/stop-all.sh. Afterwards check that on the master and one
> > of the slaves no deamons are running (jps). Maybe you could try to check
> if
> > your conf on tasktrackers for the jobtracker is pointing to the right
> place
> > (mapred-site.xml). Do you see any error in the jobtracker log too?
> >
> >
> > On 22 February 2012 09:44, Adarsh Sharma <[EMAIL PROTECTED]>
> wrote:
> >
> > > Any update on the below issue.
> > >
> > > Thanks
> > >
> > >
> > > Adarsh Sharma wrote:
> > >
> > >> Dear all,
> > >>
> > >> Today I am trying  to configure hadoop-0.20.205.0 on a 4  node
> Cluster.
> > >> When I start my cluster , all daemons got started except tasktracker,
> > >> don't know why task tracker fails due to following error logs.
> > >>
> > >> Cluster is in private network.My /etc/hosts file contains all IP
> > hostname
> > >> resolution commands in all  nodes.
> > >>
> > >> 2012-02-21 17:48:33,056 INFO
> > org.apache.hadoop.metrics2.**impl.MetricsSourceAdapter:
> > >> MBean for source TaskTrackerMetrics registered.
> > >> 2012-02-21 17:48:33,094 ERROR org.apache.hadoop.mapred.**TaskTracker:
> > >> Can not start task tracker because java.net.SocketException: Invalid
> > >> argument
> > >>       at sun.nio.ch.Net.bind(Native Method)
> > >>       at sun.nio.ch.**ServerSocketChannelImpl.bind(**
> > >> ServerSocketChannelImpl.java:**119)
> > >>       at sun.nio.ch.**ServerSocketAdaptor.bind(**
> > >> ServerSocketAdaptor.java:59)
> > >>       at org.apache.hadoop.ipc.Server.**bind(Server.java:225)
> > >>       at org.apache.hadoop.ipc.Server$**Listener.<init>(Server.java:**
> > >> 301)
> > >>       at org.apache.hadoop.ipc.Server.<**init>(Server.java:1483)
> > >>       at org.apache.hadoop.ipc.RPC$**Server.<init>(RPC.java:545)
> > >>       at org.apache.hadoop.ipc.RPC.**getServer(RPC.java:506)
> > >>       at org.apache.hadoop.mapred.**TaskTracker.initialize(**
> > >> TaskTracker.java:772)
> > >>       at org.apache.hadoop.mapred.**TaskTracker.<init>(**
> > >> TaskTracker.java:1428)
> > >>       at org.apache.hadoop.mapred.**TaskTracker.main(TaskTracker.**
> > >> java:3673)
> > >>
> > >> Any comments on the issue.
> > >>
> > >>
> > >> Thanks
> > >>
> > >>
> > >
> >
>
>
>
> --
> Jay Vyas
> MMSB/UCHC
>