|
|
shaik ahamed 2012-07-05, 06:47
Hi All, Im not able to fetch the data from the hive table ,getting the below error
FAILED: Error in semantic analysis:
hive> select * from vender; OK Failed with exception java.io.IOException:java.io.IOException: Could not obtain block: blk_-3328791500929854839_1178 file=/user/hive/warehouse/vender/bigtest.txt Time taken: 9.129 seconds Please help me in this
Regards shaik.
Nitin Pawar 2012-07-05, 06:53
can you check dfs health?
I think few of your nodes are down
On Thu, Jul 5, 2012 at 12:17 PM, shaik ahamed <[EMAIL PROTECTED]> wrote:
> Hi All, > > > Im not able to fetch the data from the hive table ,getting > the below error > > FAILED: Error in semantic analysis: > > hive> select * from vender; > OK > Failed with exception java.io.IOException:java.io.IOException: Could not > obtain block: blk_-3328791500929854839_1178 > file=/user/hive/warehouse/vender/bigtest.txt > Time taken: 9.129 seconds > Please help me in this > > Regards > shaik. >
-- Nitin Pawar
Mohammad Tariq 2012-07-05, 06:53
Hello shaik,
Were you able to fetch the data earlier. I mean is it happening for the first time or you were not able to fetch the data even once??
Regards, Mohammad Tariq On Thu, Jul 5, 2012 at 12:17 PM, shaik ahamed <[EMAIL PROTECTED]> wrote: > Hi All, > > > Im not able to fetch the data from the hive table ,getting > the below error > > FAILED: Error in semantic analysis: > > hive> select * from vender; > OK > Failed with exception java.io.IOException:java.io.IOException: Could not > obtain block: blk_-3328791500929854839_1178 > file=/user/hive/warehouse/vender/bigtest.txt > Time taken: 9.129 seconds > Please help me in this > > Regards > shaik.
shaik ahamed 2012-07-05, 06:57
Thanks for the reply guys,
Yesterday night im able to fecth the data .And my second node is down in the sence im not able to connect to the 2 machine as i have 3 machiens 1 master and 2 slave .As the 2 second one im not able to connect .Is this the prob for not retreiving the data, or other than this.
On Thu, Jul 5, 2012 at 12:23 PM, Nitin Pawar <[EMAIL PROTECTED]>wrote:
> can you check dfs health? > > I think few of your nodes are down > > > On Thu, Jul 5, 2012 at 12:17 PM, shaik ahamed <[EMAIL PROTECTED]> wrote: > >> Hi All, >> >> >> Im not able to fetch the data from the hive table ,getting >> the below error >> >> FAILED: Error in semantic analysis: >> >> hive> select * from vender; >> OK >> Failed with exception java.io.IOException:java.io.IOException: Could not >> obtain block: blk_-3328791500929854839_1178 >> file=/user/hive/warehouse/vender/bigtest.txt >> Time taken: 9.129 seconds >> Please help me in this >> >> Regards >> shaik. >> > > > > -- > Nitin Pawar > >
shaik ahamed 2012-07-05, 06:59
Hi Nitin,
How can i check the dfs health? could u plz guide me the steps...
On Thu, Jul 5, 2012 at 12:23 PM, Nitin Pawar <[EMAIL PROTECTED]>wrote:
> can you check dfs health? > > I think few of your nodes are down > > > On Thu, Jul 5, 2012 at 12:17 PM, shaik ahamed <[EMAIL PROTECTED]> wrote: > >> Hi All, >> >> >> Im not able to fetch the data from the hive table ,getting >> the below error >> >> FAILED: Error in semantic analysis: >> >> hive> select * from vender; >> OK >> Failed with exception java.io.IOException:java.io.IOException: Could not >> obtain block: blk_-3328791500929854839_1178 >> file=/user/hive/warehouse/vender/bigtest.txt >> Time taken: 9.129 seconds >> Please help me in this >> >> Regards >> shaik. >> > > > > -- > Nitin Pawar > >
Nitin Pawar 2012-07-05, 07:00
read for hadoop dfs fsck command
On Thu, Jul 5, 2012 at 12:29 PM, shaik ahamed <[EMAIL PROTECTED]> wrote:
> Hi Nitin, > > How can i check the dfs health? could u plz guide me the steps... > > On Thu, Jul 5, 2012 at 12:23 PM, Nitin Pawar <[EMAIL PROTECTED]>wrote: > >> can you check dfs health? >> >> I think few of your nodes are down >> >> >> On Thu, Jul 5, 2012 at 12:17 PM, shaik ahamed <[EMAIL PROTECTED]>wrote: >> >>> Hi All, >>> >>> >>> Im not able to fetch the data from the hive >>> table ,getting the below error >>> >>> FAILED: Error in semantic analysis: >>> >>> hive> select * from vender; >>> OK >>> Failed with exception java.io.IOException:java.io.IOException: Could not >>> obtain block: blk_-3328791500929854839_1178 >>> file=/user/hive/warehouse/vender/bigtest.txt >>> Time taken: 9.129 seconds >>> Please help me in this >>> >>> Regards >>> shaik. >>> >> >> >> >> -- >> Nitin Pawar >> >> > -- Nitin Pawar
Nitin Pawar 2012-07-05, 07:00
if you have 2 nodes and replication factor is 1 then this is a problem,
I would like to suggest minimum replication factor as 2 this would make sure that even if 1 node is down, data is served from replicated blocks
On Thu, Jul 5, 2012 at 12:27 PM, shaik ahamed <[EMAIL PROTECTED]> wrote:
> Thanks for the reply guys, > > Yesterday night im able to fecth the data .And my second node is down in > the sence im not able to connect to the 2 machine as i have 3 machiens 1 > master and 2 slave .As the 2 second one im not able to connect .Is this the > prob for not retreiving the data, or other than this. > > > > On Thu, Jul 5, 2012 at 12:23 PM, Nitin Pawar <[EMAIL PROTECTED]>wrote: > >> can you check dfs health? >> >> I think few of your nodes are down >> >> >> On Thu, Jul 5, 2012 at 12:17 PM, shaik ahamed <[EMAIL PROTECTED]>wrote: >> >>> Hi All, >>> >>> >>> Im not able to fetch the data from the hive >>> table ,getting the below error >>> >>> FAILED: Error in semantic analysis: >>> >>> hive> select * from vender; >>> OK >>> Failed with exception java.io.IOException:java.io.IOException: Could not >>> obtain block: blk_-3328791500929854839_1178 >>> file=/user/hive/warehouse/vender/bigtest.txt >>> Time taken: 9.129 seconds >>> Please help me in this >>> >>> Regards >>> shaik. >>> >> >> >> >> -- >> Nitin Pawar >> >> > -- Nitin Pawar
shaik ahamed 2012-07-05, 07:02
Thanks for ur reply nitin ..
On Thu, Jul 5, 2012 at 12:30 PM, Nitin Pawar <[EMAIL PROTECTED]>wrote:
> read for hadoop dfs fsck command > > > On Thu, Jul 5, 2012 at 12:29 PM, shaik ahamed <[EMAIL PROTECTED]> wrote: > >> Hi Nitin, >> >> How can i check the dfs health? could u plz guide me the steps... >> >> On Thu, Jul 5, 2012 at 12:23 PM, Nitin Pawar <[EMAIL PROTECTED]>wrote: >> >>> can you check dfs health? >>> >>> I think few of your nodes are down >>> >>> >>> On Thu, Jul 5, 2012 at 12:17 PM, shaik ahamed <[EMAIL PROTECTED]>wrote: >>> >>>> Hi All, >>>> >>>> >>>> Im not able to fetch the data from the hive >>>> table ,getting the below error >>>> >>>> FAILED: Error in semantic analysis: >>>> >>>> hive> select * from vender; >>>> OK >>>> Failed with exception java.io.IOException:java.io.IOException: Could >>>> not obtain block: blk_-3328791500929854839_1178 >>>> file=/user/hive/warehouse/vender/bigtest.txt >>>> Time taken: 9.129 seconds >>>> Please help me in this >>>> >>>> Regards >>>> shaik. >>>> >>> >>> >>> >>> -- >>> Nitin Pawar >>> >>> >> > > > -- > Nitin Pawar > >
Mohammad Tariq 2012-07-05, 07:06
Increase your replication factor as suggested by Nitin. Replication factor > 1 is a must to avoid data loss. And you can use "fsck" command to check the HDFS. Also verify whether you are able to see all the datanodes at the namenode WEBUI page.
Regards, Mohammad Tariq On Thu, Jul 5, 2012 at 12:30 PM, Nitin Pawar <[EMAIL PROTECTED]> wrote: > if you have 2 nodes and replication factor is 1 then this is a problem, > > I would like to suggest minimum replication factor as 2 > this would make sure that even if 1 node is down, data is served from > replicated blocks > > > On Thu, Jul 5, 2012 at 12:27 PM, shaik ahamed <[EMAIL PROTECTED]> wrote: >> >> Thanks for the reply guys, >> >> Yesterday night im able to fecth the data .And my second node is down in >> the sence im not able to connect to the 2 machine as i have 3 machiens 1 >> master and 2 slave .As the 2 second one im not able to connect .Is this the >> prob for not retreiving the data, or other than this. >> >> >> >> On Thu, Jul 5, 2012 at 12:23 PM, Nitin Pawar <[EMAIL PROTECTED]> >> wrote: >>> >>> can you check dfs health? >>> >>> I think few of your nodes are down >>> >>> >>> On Thu, Jul 5, 2012 at 12:17 PM, shaik ahamed <[EMAIL PROTECTED]> >>> wrote: >>>> >>>> Hi All, >>>> >>>> >>>> Im not able to fetch the data from the hive table >>>> ,getting the below error >>>> >>>> FAILED: Error in semantic analysis: >>>> >>>> hive> select * from vender; >>>> OK >>>> Failed with exception java.io.IOException:java.io.IOException: Could not >>>> obtain block: blk_-3328791500929854839_1178 >>>> file=/user/hive/warehouse/vender/bigtest.txt >>>> Time taken: 9.129 seconds >>>> Please help me in this >>>> >>>> Regards >>>> shaik. >>> >>> >>> >>> >>> -- >>> Nitin Pawar >>> >> > > > > -- > Nitin Pawar >
|
|