Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig, mail # user - oddness with large numeric map[] values


Copy link to this message
-
oddness with large numeric map[] values
Guy Bayes 2009-07-19, 04:36
Hello all, new to this list, new to pig, running into some odd behavior with
map[] data types.

Please forgive me if these are known issues or problems with my syntax,

What am i doing wrong here? missing some cast somewhere?

This works:

grunt> cat data2
[apache#2000000000000000000000zzz,foo#foo1]
grunt> T1 = load 'data2' as (f1:map[]);
grunt> dump T1;
2009-07-18 21:35:11,871 [Thread-11] WARN  org.apache.hadoop.mapred.JobClient
- Use GenericOptionsParser for parsing the arguments. Applications should
implement Tool for the same.
2009-07-18 21:35:21,889 [main] INFO
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- 100% complete
2009-07-18 21:35:21,889 [main] INFO
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- Success!
([foo#foo1,apache#2000000000000000000000zzz])

This doesn't return anything.

grunt> cat data
[apache#2000000000000000000000,foo#foo1]
grunt> T1 = load 'data' as (f1:map[]);
grunt> dump T1;
2009-07-18 21:36:09,873 [Thread-21] WARN  org.apache.hadoop.mapred.JobClient
- Use GenericOptionsParser for parsing the arguments. Applications should
implement Tool for the same.
2009-07-18 21:36:19,886 [main] WARN
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- Encountered Warning FIELD_DISCARDED_TYPE_CONVERSION_FAILED 1 time(s).
2009-07-18 21:36:19,886 [main] INFO
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- 100% complete
2009-07-18 21:36:19,886 [main] INFO
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- Success!
()