Hi,

I'm using PIG 0.8.1 with HBase 0.90 and the following script
somethime returns an empty set, and sometimes work !

start_sessions = LOAD 'startSession' USING
org.apache.pig.backend.hadoop.hbase.HBaseStorage('meta:sid
meta:infoid meta:imei meta:timestamp') AS (sid:chararray,
infoid:chararray, imei:chararray, start:long);
end_sessions = LOAD 'endSession' USING
org.apache.pig.backend.hadoop.hbase.HBaseStorage('meta:sid
meta:timestamp meta:locid') AS (sid:chararray, end:long,
locid:chararray);
infos = LOAD 'info.mde253811.preprod.ubithere.com' USING
org.apache.pig.backend.hadoop.hbase.HBaseStorage('meta:infoid') AS
(infoid:chararray);
sessions = JOIN start_sessions BY sid, end_sessions BY sid;
sessions = JOIN sessions BY infoid, infos BY infoid;
dump sessions;

(dumping the "infos" seems to make it work)

Any idea about this very irritating behavior ?

Hi,

I'm using PIG 0.8.1 with HBase 0.90 and the following script
sometime returns an empty set, and sometimes work !

start_sessions = LOAD 'startSession' USING
org.apache.pig.backend.hadoop.hbase.HBaseStorage('meta:sid
meta:infoid meta:imei meta:timestamp') AS (sid:chararray,
infoid:chararray, imei:chararray, start:long);
end_sessions = LOAD 'endSession' USING
org.apache.pig.backend.hadoop.hbase.HBaseStorage('meta:sid
meta:timestamp meta:locid') AS (sid:chararray, end:long,
locid:chararray);
infos = LOAD 'info.mde253811.preprod.ubithere.com' USING
org.apache.pig.backend.hadoop.hbase.HBaseStorage('meta:infoid') AS
(infoid:chararray);
sessions = JOIN start_sessions BY sid, end_sessions BY sid;
sessions = JOIN sessions BY infoid, infos BY infoid;
dump sessions;

(dumping the "infos" before the sessions seems to make it work)

Any idea about this very irritating behavior ?

FYI, this was fixed by PIG-2193.

Le 26/07/11 19:40, Vincent Barat a écrit :
> Hi,
>
> I'm using PIG 0.8.1 with HBase 0.90 and the following script
> sometime returns an empty set, and sometimes work !
>
> start_sessions = LOAD 'startSession' USING
> org.apache.pig.backend.hadoop.hbase.HBaseStorage('meta:sid
> meta:infoid meta:imei meta:timestamp') AS (sid:chararray,
> infoid:chararray, imei:chararray, start:long);
> end_sessions = LOAD 'endSession' USING
> org.apache.pig.backend.hadoop.hbase.HBaseStorage('meta:sid
> meta:timestamp meta:locid') AS (sid:chararray, end:long,
> locid:chararray);
> infos = LOAD 'info.mde253811.preprod.ubithere.com' USING
> org.apache.pig.backend.hadoop.hbase.HBaseStorage('meta:infoid') AS
> (infoid:chararray);
> sessions = JOIN start_sessions BY sid, end_sessions BY sid;
> sessions = JOIN sessions BY infoid, infos BY infoid;
> dump sessions;
>
> (dumping the "infos" before the sessions seems to make it work)
>
> Any idea about this very irritating behavior ?
>

Thanks Vincent for confirming that issue is resolved.

Ashutosh
On Fri, Aug 26, 2011 at 07:54, Vincent Barat <[EMAIL PROTECTED]>wrote:

> FYI, this was fixed by PIG-2193.
>
> Le 26/07/11 19:40, Vincent Barat a écrit :
>
>  Hi,
>>
>> I'm using PIG 0.8.1 with HBase 0.90 and the following script sometime
>> returns an empty set, and sometimes work !
>>
>> start_sessions = LOAD 'startSession' USING org.apache.pig.backend.hadoop.
>> **hbase.HBaseStorage('meta:sid meta:infoid meta:imei meta:timestamp') AS
>> (sid:chararray, infoid:chararray, imei:chararray, start:long);
>> end_sessions = LOAD 'endSession' USING org.apache.pig.backend.hadoop.**hbase.HBaseStorage('meta:sid
>> meta:timestamp meta:locid') AS (sid:chararray, end:long, locid:chararray);
>> infos = LOAD 'info.mde253811.preprod.**ubithere.com<http://info.mde253811.preprod.ubithere.com>'
>> USING org.apache.pig.backend.hadoop.**hbase.HBaseStorage('meta:**infoid')
>> AS (infoid:chararray);
>> sessions = JOIN start_sessions BY sid, end_sessions BY sid;
>> sessions = JOIN sessions BY infoid, infos BY infoid;
>> dump sessions;
>>
>> (dumping the "infos" before the sessions seems to make it work)
>>
>> Any idea about this very irritating behavior ?
>>
>>

Vincent, can you try replacing the HBase classes with those from trunk?
A couple of fixes went in that might address that.
Also, make sure you are running 0.90.3

D

On Tue, Jul 26, 2011 at 10:40 AM, Vincent Barat <[EMAIL PROTECTED]>wrote:

> Hi,
>
> I'm using PIG 0.8.1 with HBase 0.90 and the following script sometime
> returns an empty set, and sometimes work !
>
>
> start_sessions = LOAD 'startSession' USING org.apache.pig.backend.hadoop.*
> *hbase.HBaseStorage('meta:sid meta:infoid meta:imei meta:timestamp') AS
> (sid:chararray, infoid:chararray, imei:chararray, start:long);
> end_sessions = LOAD 'endSession' USING org.apache.pig.backend.hadoop.**hbase.HBaseStorage('meta:sid
> meta:timestamp meta:locid') AS (sid:chararray, end:long, locid:chararray);
> infos = LOAD 'info.mde253811.preprod.**ubithere.com<http://info.mde253811.preprod.ubithere.com>'
> USING org.apache.pig.backend.hadoop.**hbase.HBaseStorage('meta:**infoid')
> AS (infoid:chararray);
> sessions = JOIN start_sessions BY sid, end_sessions BY sid;
> sessions = JOIN sessions BY infoid, infos BY infoid;
> dump sessions;
>
> (dumping the "infos" before the sessions seems to make it work)
>
>
> Any idea about this very irritating behavior ?
>

Dmitriy,

Does the HBaseStorage class from Pig 0.8.1 and HBase 90.3 work together?  We
just upgraded our HBase cluster and a developer found some issues and we
aren't sure if they are related to the upgrade.

On Tue, Jul 26, 2011 at 12:16 PM, Dmitriy Ryaboy <[EMAIL PROTECTED]> wrote:

> Vincent, can you try replacing the HBase classes with those from trunk?
> A couple of fixes went in that might address that.
> Also, make sure you are running 0.90.3
>
> D
>
> On Tue, Jul 26, 2011 at 10:40 AM, Vincent Barat <[EMAIL PROTECTED]
> >wrote:
>
> > Hi,
> >
> > I'm using PIG 0.8.1 with HBase 0.90 and the following script sometime
> > returns an empty set, and sometimes work !
> >
> >
> > start_sessions = LOAD 'startSession' USING
> org.apache.pig.backend.hadoop.*
> > *hbase.HBaseStorage('meta:sid meta:infoid meta:imei meta:timestamp') AS
> > (sid:chararray, infoid:chararray, imei:chararray, start:long);
> > end_sessions = LOAD 'endSession' USING
> org.apache.pig.backend.hadoop.**hbase.HBaseStorage('meta:sid
> > meta:timestamp meta:locid') AS (sid:chararray, end:long,
> locid:chararray);
> > infos = LOAD 'info.mde253811.preprod.**ubithere.com<
> http://info.mde253811.preprod.ubithere.com>'
> > USING org.apache.pig.backend.hadoop.**hbase.HBaseStorage('meta:**infoid')
> > AS (infoid:chararray);
> > sessions = JOIN start_sessions BY sid, end_sessions BY sid;
> > sessions = JOIN sessions BY infoid, infos BY infoid;
> > dump sessions;
> >
> > (dumping the "infos" before the sessions seems to make it work)
> >
> >
> > Any idea about this very irritating behavior ?
> >
>

They better, that's the combination I'm running in production :).

D

On Tue, Jul 26, 2011 at 12:08 PM, Corbin Hoenes <[EMAIL PROTECTED]> wrote:

> Dmitriy,
>
> Does the HBaseStorage class from Pig 0.8.1 and HBase 90.3 work together?
>  We
> just upgraded our HBase cluster and a developer found some issues and we
> aren't sure if they are related to the upgrade.
>
>
>
> On Tue, Jul 26, 2011 at 12:16 PM, Dmitriy Ryaboy <[EMAIL PROTECTED]>
> wrote:
>
> > Vincent, can you try replacing the HBase classes with those from trunk?
> > A couple of fixes went in that might address that.
> > Also, make sure you are running 0.90.3
> >
> > D
> >
> > On Tue, Jul 26, 2011 at 10:40 AM, Vincent Barat <[EMAIL PROTECTED]
> > >wrote:
> >
> > > Hi,
> > >
> > > I'm using PIG 0.8.1 with HBase 0.90 and the following script sometime
> > > returns an empty set, and sometimes work !
> > >
> > >
> > > start_sessions = LOAD 'startSession' USING
> > org.apache.pig.backend.hadoop.*
> > > *hbase.HBaseStorage('meta:sid meta:infoid meta:imei meta:timestamp') AS
> > > (sid:chararray, infoid:chararray, imei:chararray, start:long);
> > > end_sessions = LOAD 'endSession' USING
> > org.apache.pig.backend.hadoop.**hbase.HBaseStorage('meta:sid
> > > meta:timestamp meta:locid') AS (sid:chararray, end:long,
> > locid:chararray);
> > > infos = LOAD 'info.mde253811.preprod.**ubithere.com<
> > http://info.mde253811.preprod.ubithere.com>'
> > > USING
> org.apache.pig.backend.hadoop.**hbase.HBaseStorage('meta:**infoid')
> > > AS (infoid:chararray);
> > > sessions = JOIN start_sessions BY sid, end_sessions BY sid;
> > > sessions = JOIN sessions BY infoid, infos BY infoid;
> > > dump sessions;
> > >
> > > (dumping the "infos" before the sessions seems to make it work)
> > >
> > >
> > > Any idea about this very irritating behavior ?
> > >
> >
>

Hi,

We are using HBase 0.90.3 and PIG 0.8.1.
I will try trunk classes and report to you ASAP...

Cheers,

Le 26/07/11 20:16, Dmitriy Ryaboy a �crit :
> Vincent, can you try replacing the HBase classes with those from trunk?
> A couple of fixes went in that might address that.
> Also, make sure you are running 0.90.3
>
> D
>
> On Tue, Jul 26, 2011 at 10:40 AM, Vincent Barat<[EMAIL PROTECTED]>wrote:
>
>> Hi,
>>
>> I'm using PIG 0.8.1 with HBase 0.90 and the following script sometime
>> returns an empty set, and sometimes work !
>>
>>
>> start_sessions = LOAD 'startSession' USING org.apache.pig.backend.hadoop.*
>> *hbase.HBaseStorage('meta:sid meta:infoid meta:imei meta:timestamp') AS
>> (sid:chararray, infoid:chararray, imei:chararray, start:long);
>> end_sessions = LOAD 'endSession' USING org.apache.pig.backend.hadoop.**hbase.HBaseStorage('meta:sid
>> meta:timestamp meta:locid') AS (sid:chararray, end:long, locid:chararray);
>> infos = LOAD 'info.mde253811.preprod.**ubithere.com<http://info.mde253811.preprod.ubithere.com>'
>> USING org.apache.pig.backend.hadoop.**hbase.HBaseStorage('meta:**infoid')
>> AS (infoid:chararray);
>> sessions = JOIN start_sessions BY sid, end_sessions BY sid;
>> sessions = JOIN sessions BY infoid, infos BY infoid;
>> dump sessions;
>>
>> (dumping the "infos" before the sessions seems to make it work)
>>
>>
>> Any idea about this very irritating behavior ?
>>

--

*Vincent BARAT, UBIKOD, CTO*
[EMAIL PROTECTED] <mailto:[EMAIL PROTECTED]>  Mob +33 (0)6 15 41 15 18

UBIKOD Paris, c/o ESSEC VENTURES, Avenue Bernard Hirsch, 95021
Cergy-Pontoise cedex, FRANCE, Tel +33 (0)1 34 43 28 89

UBIKOD Rennes, 10 rue Duhamel, 35000 Rennes, FRANCE, Tel. +33 (0)2
99 65 69 13
www.ubikod.com <http://www.ubikod.com/>@ubikod
<http://twitter.com/ubikod>

www.capptain.com <http://www.capptain.com/>@capptain_hq
<http://twitter.com/capptain_hq>
IMPORTANT NOTICE -- UBIKOD and CAPPTAIN are registered trademarks of
UBIKOD S.A.R.L., all copyrights are reserved.  The contents of this
email and attachments are confidential and may be subject to legal
privilege and/or protected by copyright. Copying or communicating
any part of it to others is prohibited and may be unlawful. If you
are not the intended recipient you must not use, copy, distribute or
rely on this email and should please return it immediately or notify
us by telephone. At present the integrity of email across the
Internet cannot be guaranteed. Therefore UBIKOD S.A.R.L. will not
accept liability for any claims arising as a result of the use of
this medium for transmissions by or to UBIKOD S.A.R.L.. UBIKOD
S.A.R.L. may exercise any of its rights under relevant law, to
monitor the content of all electronic communications. You should
therefore be aware that this communication and any responses might
have been monitored, and may be accessed by UBIKOD S.A.R.L. The
views expressed in this document are that of the individual and may
not necessarily constitute or imply its endorsement or
recommendation by UBIKOD S.A.R.L. The content of this electronic
mail may be subject to the confidentiality terms of a
"Non-Disclosure Agreement" (NDA).