Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig, mail # user - Machine Learning + Pig?


Copy link to this message
-
Re: Machine Learning + Pig?
Dmitriy Ryaboy 2012-09-06, 23:01
Please take a look at Alek and Jimmy's paper on ML in Pig; there are
also a few presentations they did on this, here's one from the Hadoop
Summit:
https://speakerdeck.com/u/lintool/p/large-scale-machine-learning-at-twitter

Note also that Ted Dunning has taken some of the stuff we open-sourced
that allows us to do this, and hooked it up with Mahout feature
vectors:
https://github.com/tdunning/pig-vector  (we do something quite similar
internally, using the same base libraries).

-Dmitriy

On Thu, Sep 6, 2012 at 12:27 AM, Manish Bhoge
<[EMAIL PROTECTED]> wrote:
> Thanks Siddharth this is really new stuff for me.
> Sent from my BlackBerry, pls excuse typo
>
> -----Original Message-----
> From: Siddharth Tiwari <[EMAIL PROTECTED]>
> Date: Thu, 6 Sep 2012 03:38:58
> To: <[EMAIL PROTECTED]>; <[EMAIL PROTECTED]>
> Reply-To: [EMAIL PROTECTED]
> Subject: Re: Machine Learning + Pig?
>
> HI Anurag,
>
> Yes its offcourse possible.
> Infact there are numerous implementations by twitter on pig as it saves them from a lot of java coding.
> Infact we are also working for AEXP on ML over Hadoop.
> You can try googling about mnesia, pignlproc, and there are many more implementations. Primarily clustering and classification.
>
>
> -----"Anurag Gulati" <[EMAIL PROTECTED]> wrote: -----
> To: "[EMAIL PROTECTED]" <[EMAIL PROTECTED]>
> From: "Anurag Gulati" <[EMAIL PROTECTED]>
> Date: 09/06/2012 02:59AM
> Subject: Machine Learning + Pig?
>
> Hello Everyone!
>
> I was wondering if there are any resources that show Machine Learning Algorithms implemented in Pig.
>
> Thanks for your Help!
>
> -Anurag G.
>
> American Express made the following annotations on Wed Sep 05 2012 14:28:25
>
> ******************************************************************************
>
> "This message and any attachments are solely for the intended recipient and may contain confidential or privileged information. If you are not the intended recipient, any disclosure, copying, use, or distribution of the information included in this message and any attachments is prohibited. If you have received this communication in error, please notify us by reply e-mail and immediately and permanently delete this message and any attachments. Thank you."
>
> American Express a ajouté le commentaire suivant le Wed Sep 05 2012 14:28:25
>
> Ce courrier et toute pièce jointe qu'il contient sont réservés au seul destinataire indiqué et peuvent renfermer des renseignements confidentiels et privilégiés. Si vous n'êtes pas le destinataire prévu, toute divulgation, duplication, utilisation ou distribution du courrier ou de toute pièce jointe est interdite. Si vous avez reçu cette communication par erreur, veuillez nous en aviser par courrier et détruire immédiatement le courrier et les pièces jointes. Merci.
>
> ******************************************************************************
> -------------------------------------------------------------------------------
>
> =====-----=====-----====> Notice: The information contained in this e-mail
> message and/or attachments to it may contain
> confidential or privileged information. If you are
> not the intended recipient, any dissemination, use,
> review, distribution, printing or copying of the
> information contained in this e-mail message
> and/or attachments to it are strictly prohibited. If
> you have received this communication in error,
> please notify us by reply e-mail or telephone and
> immediately and permanently delete the message
> and any attachments. Thank you
>
>
>