Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Pig, mail # user - ERROR 1071: Cannot convert a generic_writablecomparable to a String


+
Niels Basjes 2013-07-10, 19:37
Copy link to this message
-
Re: ERROR 1071: Cannot convert a generic_writablecomparable to a String
Niels Basjes 2013-07-10, 19:51
Additional info:

If I do
Clicks   LOAD 'access_log.gz'
  USING <my loader> AS (useragent, status);

I get
Clicks: {useragent: bytearray,status: bytearray}
Followed by (on screen) the correct data.

I get the previously mentioned error when i do
Clicks   LOAD 'access_log.gz'
  USING <my loader> AS (useragent:*chararray*, status:*chararray*);

Niels

On Wed, Jul 10, 2013 at 9:37 PM, Niels Basjes <[EMAIL PROTECTED]> wrote:

> Hi,
>
> I'm writing a custom Loader for Pig and I'm stuck on the following problem.
>
> When I use this loader from a pig script and I do a "DESCRIBE Clicks;" I
> get
> *Clicks: {useragent: chararray,status: chararray}*
>
> So apparently the data from my loader is seen correctly.
>
> How ever when I then do:
> DUMP Clicks;
>
> I get
>
> *java.lang.Exception:
> org.apache.pig.backend.executionengine.ExecException: ERROR 1071: Cannot
> convert a generic_writablecomparable to a String*
> *        at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:404)*
> *Caused by: org.apache.pig.backend.executionengine.ExecException: ERROR
> 1071: Cannot convert a generic_writablecomparable to a String*
> *        at org.apache.pig.data.DataType.toString(DataType.java:1105)*
>
> What am I doing wrong here?
>
>
> My current Loader in summary looks like this:
>
> *public class Loader extends LoadFunc {
> *
> *   public Loader(String... parameters) { ... }
> *
> *   public InputFormat<?, ?> getInputFormat() throws IOException { ... }*
> *   public Tuple getNext() throws IOException { *
> *       ...*
> *       List<Text> values = new ArrayList<Text>();*
> *       for (...) {*
> *           Text value  = <get the value from somewhere>*
> *           values.add((Text)value);
> *
> *       }*
> *       tuple = tupleFactory.newTuple(values);
> *
> *       return tuple;
> *
> *   }*
> *
> *
> *   public void prepareToRead(...) { ... }
> *
> *   public void setLocation(String location, Job job) { ... }
> *
> *}*
>
>
> --
> Best regards / Met vriendelijke groeten,
>
> Niels Basjes
>

--
Best regards / Met vriendelijke groeten,

Niels Basjes
+
Pradeep Gollakota 2013-07-10, 20:01
+
Niels Basjes 2013-07-10, 21:12