Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> DATA not storing as comma-separted


Copy link to this message
-
Re: DATA not storing as comma-separted
Also, it would be help to go to the MapReduce web UI and having a look
at the details of the job corresponding to this query.

Regards,
    Mohammad Tariq
On Wed, Jul 25, 2012 at 5:31 PM, Mohammad Tariq <[EMAIL PROTECTED]> wrote:
> I have worked with pig-0.7.0 once and it was working fine. Try to see
> if there is anything interesting in the log files. Also, if possible,
> share 2-3 lines of your file..I'll give it a try on my machine.
>
> Regards,
>     Mohammad Tariq
>
>
> On Wed, Jul 25, 2012 at 5:20 PM,  <[EMAIL PROTECTED]> wrote:
>> Hi Mohammad,
>>
>> I have switched from pig 0.10.0 to 0.7.0 and its horrible experience.
>> I do perform
>>
>> grunt> A = load '/hello/demotry.txt'
>>>> as (name:chararray, roll:int, mssg:chararray);
>>
>> grunt> dump A;
>>
>> it shows this error:
>>
>> grunt> dump A;
>> 2012-07-25 17:20:34,081 [main] INFO  org.apache.pig.impl.logicalLayer.optimizer.PruneColumns - No column pruned for A
>> 2012-07-25 17:20:34,081 [main] INFO  org.apache.pig.impl.logicalLayer.optimizer.PruneColumns - No map keys pruned for A
>> 2012-07-25 17:20:34,102 [main] INFO  org.apache.hadoop.metrics.jvm.JvmMetrics - Initializing JVM Metrics with processName=JobTracker, sessionId>> 2012-07-25 17:20:34,169 [main] INFO  org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - (Name: Store(file:/tmp/temp61624047/tmp1087576502:org.apache.pig.builtin.BinStorage) - 1-18 Operator Key: 1-18)
>> 2012-07-25 17:20:34,195 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MultiQueryOptimizer - MR plan size before optimization: 1
>> 2012-07-25 17:20:34,195 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MultiQueryOptimizer - MR plan size after optimization: 1
>> 2012-07-25 17:20:34,211 [main] INFO  org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
>> 2012-07-25 17:20:34,217 [main] INFO  org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
>> 2012-07-25 17:20:34,217 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - mapred.job.reduce.markreset.buffer.percent is not set, set to default 0.3
>> 2012-07-25 17:20:35,570 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - Setting up single store job
>> 2012-07-25 17:20:35,599 [main] INFO  org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
>> 2012-07-25 17:20:35,600 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 1 map-reduce job(s) waiting for submission.
>> 2012-07-25 17:20:35,606 [Thread-7] WARN  org.apache.hadoop.mapred.JobClient - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
>> 2012-07-25 17:20:35,750 [Thread-7] INFO  org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
>> 2012-07-25 17:20:35,763 [Thread-7] INFO  org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
>> 2012-07-25 17:20:36,101 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 0% complete
>> 2012-07-25 17:20:36,101 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 100% complete
>> 2012-07-25 17:20:36,101 [main] ERROR org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 1 map reduce job(s) failed!
>> 2012-07-25 17:20:36,107 [main] ERROR org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Failed to produce result in: "file:/tmp/temp61624047/tmp1087576502"
>> 2012-07-25 17:20:36,107 [main] INFO  org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Failed!