Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hive >> mail # user >> hive map reduce output


Copy link to this message
-
Re: hive map reduce output
sorry , I forget report my environment.

Hadoop 0.19.1
hive 0.4.0

2010/2/9 Zheng Shao <[EMAIL PROTECTED]>

> Another possible reason is that we found sometimes hadoop framework
> does not return the correct count to the clients.
> In all these cases, the count is smaller than the number of rows
> actually loaded.
>
> which version of hadoop are you using?
>
> Zheng
>
> On Mon, Feb 8, 2010 at 11:27 PM, Jeff Hammerbacher <[EMAIL PROTECTED]>
> wrote:
> > Hey wd,
> >
> > Actually, what version are you running? Your bug sounds an awful lot like
> > http://issues.apache.org/jira/browse/HIVE-327, which was fixed many
> moons
> > ago.
> >
> > Thanks,
> > Jeff
> >
> > On Mon, Feb 8, 2010 at 11:25 PM, Carl Steinbach <[EMAIL PROTECTED]>
> wrote:
> >>
> >> Hi wd,
> >>
> >> Please file a JIRA ticket for this issue.
> >>
> >> Thanks.
> >>
> >> Carl
> >>
> >> On Mon, Feb 8, 2010 at 7:05 PM, wd <[EMAIL PROTECTED]> wrote:
> >>>
> >>> hi,
> >>>
> >>> I've use hive map reduce to process some log files. I found out that
> hive
> >>> will output like "num1 rows loaded to table_name" message every run.
> But the
> >>> "num1" not equal to "select count(1) from table_name" execute result.
> >>>
> >>> I think this should be a bug. If we can not count the right num, why we
> >>> output that message?
> >>
> >
> >
>
>
>
> --
> Yours,
> Zheng
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB