Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Hadoop, mail # user - Temporal query


Copy link to this message
-
Re: Temporal query
Mathias Herberts 2012-03-29, 17:34
rather easy to do in Pig with a UDF, filter values > threshold, Group ALL,
then nested foreach which does an order by on the timestamp and calls your
UDF on the sorted bag in the generate
On Mar 29, 2012 11:03 AM, "banermatt" <[EMAIL PROTECTED]> wrote:

>
> Hello,
>
> I'm developping a log file anomaly detection system on an hadoop cluster.
> I'm looking for a way to process query like: "select all values when
> value>threshold for a duration>30 secondes". Do you know a tool which could
> help me to process such a query?
> I documented on the script langages pig, hive and jaql which seem to have
> very similar application. I tried it but I was not be able to do what I
> want.
>
> Thank you in advance,
>
> Matthieu
>
> --
> View this message in context:
> http://old.nabble.com/Temporal-query-tp33544869p33544869.html
> Sent from the Hadoop core-user mailing list archive at Nabble.com.
>
>