Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume, mail # user - Event breaking in flume


Copy link to this message
-
Re: Event breaking in flume
Ashish 2013-12-30, 10:34
I am not aware of any options out of the box. Maybe someone else can help.
Alternate way is to write a custom source.
On Mon, Dec 30, 2013 at 3:56 PM, Chhaya Vishwakarma <
[EMAIL PROTECTED]> wrote:

> Hi
>
> Exec as source and tail command
>
>
>
>
>
> *From:* Ashish [mailto:[EMAIL PROTECTED]]
> *Sent:* Monday, December 30, 2013 3:48 PM
> *To:* [EMAIL PROTECTED]
> *Subject:* Re: Event breaking in flume
>
>
>
> What is the Source you are using?
>
>
>
> On Mon, Dec 30, 2013 at 3:23 PM, Chhaya Vishwakarma <
> [EMAIL PROTECTED]> wrote:
>
> Hi,
>
>
>
> By default flume considers one line as one event, But I want to do
> breaking on some other criteria how it can be achieved in flume? Is it
> possible to do ?
>
>
>
> 10 Sep 2013 19:43:33,561 [WebContainer : 9] ERROR - An Error has occured
> for com.marsh.framework.core.exception.MarshException: Record has been
> modified since last retrieved - Resubmit transaction
>
>
>
> 10 Sep 2013 19:43:33,561 [WebContainer : 9] ERROR -
> handleException():com.marsh.framework.core.exception.MarshException: Record
> has been modified since last retrieved - Resubmit transaction
>
>      at
> com.marsh.csa.serviceagreement.ServiceAgreementImpl.updateAgreement(ServiceAgreementImpl.java(Compiled
> Code))
>
>      at
> com.marsh.csa.serviceagreementmgmt.CSAManagerImpl.updateCSA(CSAManagerImpl.java(Compiled
> Code))
>
>      at
> com.marsh.csa.serviceagreementmgmt.ejb.EJSRemoteStatelessServiceagreementManager_3dcfd156.updateCSA(Unknown
> Source)
>
>      at
> com.marsh.csa.serviceagreementmgmt.ejb._ServiceagreementManagerRemote_Stub.updateCSA(_ServiceagreementManagerRemote_Stub.java(Compiled
> Code))
>
>      at com.marsh.csa.proxy.CSAProxy.updateCSA(CSAProxy.java(Compiled
> Code))
>
>      at
> com.marsh.csa.serviceagreement.SaveCSAAction.performAction(SaveCSAAction.java(Compiled
> Code))
>
>      at
> com.marsh.csa.serviceagreement.CSAAbstractStrutsAction.execute(CSAAbstractStrutsAction.java(Compiled
> Code))
>
>      at
> org.apache.struts.action.RequestProcessor.processActionPerform(RequestProcessor.java(Inlined
> Compiled Code))
>
>      at com.ibm.ws.util.ThreadPool$Worker.run(ThreadPool.java(Compiled
> Code))
>
> Caused by: com.marsh.framework.core.exception.MarshException: Record has
> been modified since last retrieved - Resubmit transaction
>
>      at
> com.marsh.csa.serviceagreement.ServiceAgreementDAO.updateServiceAgreement(ServiceAgreementDAO.java(Compiled
> Code))
>
>      at
> com.marsh.csa.serviceagreement.ServiceAgreementDAO.update(ServiceAgreementDAO.java(Compiled
> Code))
>
>      at
> com.marsh.csa.serviceagreement.SAUpdateImpl.updateServiceAgreement(SAUpdateImpl.java(Compiled
> Code))
>
>      at
> com.marsh.csa.serviceagreement.SAUpdateImpl.update(SAUpdateImpl.java(Compiled
> Code))
>
>      ... 26 more
>
> Caused by: com.marsh.framework.core.exception.MarshException: Record has
> been modified since last retrieved - Resubmit transaction
>
>      at
> com.marsh.csa.serviceagreement.SaveCSAAction.performAction(SaveCSAAction.java(Compiled
> Code))
>
>      at
> com.marsh.csa.serviceagreement.CSAAbstractStrutsAction.execute(CSAAbstractStrutsAction.java(Compiled
> Code))
>
>      at
> org.apache.struts.action.RequestProcessor.processActionPerform(RequestProcessor.java(Inlined
> Compiled Code))
>
>      at
> org.apache.struts.action.RequestProcessor.process(RequestProcessor.java(Compiled
> Code))
>
>      at
> org.apache.struts.action.ActionServlet.process(ActionServlet.java(Inlined
> Compiled Code))
>
>      at
> org.apache.struts.action.ActionServlet.doPost(ActionServlet.java(Compiled
> Code))
>
>      at javax.servlet.http.HttpServlet.service(HttpServlet.java(Compiled
> Code))
>
>      at javax.servlet.http.HttpServlet.service(HttpServlet.java(Compiled
> Code))
>
>      at
> com.ibm.ws.webcontainer.servlet.ServletWrapper.service(ServletWrapper.java(Compiled
> Code))
>
>
>
> this is a log file which I am writing to HBase. Whatever is highlighted

thanks
ashish

Blog: http://www.ashishpaliwal.com/blog
My Photo Galleries: http://www.pbase.com/ashishpaliwal