Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Flume >> mail # user >> Event breaking in flume


Copy link to this message
-
Re: Event breaking in flume
I am not aware of any options out of the box. Maybe someone else can help.
Alternate way is to write a custom source.
On Mon, Dec 30, 2013 at 3:56 PM, Chhaya Vishwakarma <
[EMAIL PROTECTED]> wrote:

> Hi
>
> Exec as source and tail command
>
>
>
>
>
> *From:* Ashish [mailto:[EMAIL PROTECTED]]
> *Sent:* Monday, December 30, 2013 3:48 PM
> *To:* [EMAIL PROTECTED]
> *Subject:* Re: Event breaking in flume
>
>
>
> What is the Source you are using?
>
>
>
> On Mon, Dec 30, 2013 at 3:23 PM, Chhaya Vishwakarma <
> [EMAIL PROTECTED]> wrote:
>
> Hi,
>
>
>
> By default flume considers one line as one event, But I want to do
> breaking on some other criteria how it can be achieved in flume? Is it
> possible to do ?
>
>
>
> 10 Sep 2013 19:43:33,561 [WebContainer : 9] ERROR - An Error has occured
> for com.marsh.framework.core.exception.MarshException: Record has been
> modified since last retrieved - Resubmit transaction
>
>
>
> 10 Sep 2013 19:43:33,561 [WebContainer : 9] ERROR -
> handleException():com.marsh.framework.core.exception.MarshException: Record
> has been modified since last retrieved - Resubmit transaction
>
>      at
> com.marsh.csa.serviceagreement.ServiceAgreementImpl.updateAgreement(ServiceAgreementImpl.java(Compiled
> Code))
>
>      at
> com.marsh.csa.serviceagreementmgmt.CSAManagerImpl.updateCSA(CSAManagerImpl.java(Compiled
> Code))
>
>      at
> com.marsh.csa.serviceagreementmgmt.ejb.EJSRemoteStatelessServiceagreementManager_3dcfd156.updateCSA(Unknown
> Source)
>
>      at
> com.marsh.csa.serviceagreementmgmt.ejb._ServiceagreementManagerRemote_Stub.updateCSA(_ServiceagreementManagerRemote_Stub.java(Compiled
> Code))
>
>      at com.marsh.csa.proxy.CSAProxy.updateCSA(CSAProxy.java(Compiled
> Code))
>
>      at
> com.marsh.csa.serviceagreement.SaveCSAAction.performAction(SaveCSAAction.java(Compiled
> Code))
>
>      at
> com.marsh.csa.serviceagreement.CSAAbstractStrutsAction.execute(CSAAbstractStrutsAction.java(Compiled
> Code))
>
>      at
> org.apache.struts.action.RequestProcessor.processActionPerform(RequestProcessor.java(Inlined
> Compiled Code))
>
>      at com.ibm.ws.util.ThreadPool$Worker.run(ThreadPool.java(Compiled
> Code))
>
> Caused by: com.marsh.framework.core.exception.MarshException: Record has
> been modified since last retrieved - Resubmit transaction
>
>      at
> com.marsh.csa.serviceagreement.ServiceAgreementDAO.updateServiceAgreement(ServiceAgreementDAO.java(Compiled
> Code))
>
>      at
> com.marsh.csa.serviceagreement.ServiceAgreementDAO.update(ServiceAgreementDAO.java(Compiled
> Code))
>
>      at
> com.marsh.csa.serviceagreement.SAUpdateImpl.updateServiceAgreement(SAUpdateImpl.java(Compiled
> Code))
>
>      at
> com.marsh.csa.serviceagreement.SAUpdateImpl.update(SAUpdateImpl.java(Compiled
> Code))
>
>      ... 26 more
>
> Caused by: com.marsh.framework.core.exception.MarshException: Record has
> been modified since last retrieved - Resubmit transaction
>
>      at
> com.marsh.csa.serviceagreement.SaveCSAAction.performAction(SaveCSAAction.java(Compiled
> Code))
>
>      at
> com.marsh.csa.serviceagreement.CSAAbstractStrutsAction.execute(CSAAbstractStrutsAction.java(Compiled
> Code))
>
>      at
> org.apache.struts.action.RequestProcessor.processActionPerform(RequestProcessor.java(Inlined
> Compiled Code))
>
>      at
> org.apache.struts.action.RequestProcessor.process(RequestProcessor.java(Compiled
> Code))
>
>      at
> org.apache.struts.action.ActionServlet.process(ActionServlet.java(Inlined
> Compiled Code))
>
>      at
> org.apache.struts.action.ActionServlet.doPost(ActionServlet.java(Compiled
> Code))
>
>      at javax.servlet.http.HttpServlet.service(HttpServlet.java(Compiled
> Code))
>
>      at javax.servlet.http.HttpServlet.service(HttpServlet.java(Compiled
> Code))
>
>      at
> com.ibm.ws.webcontainer.servlet.ServletWrapper.service(ServletWrapper.java(Compiled
> Code))
>
>
>
> this is a log file which I am writing to HBase. Whatever is highlighted

thanks
ashish

Blog: http://www.ashishpaliwal.com/blog
My Photo Galleries: http://www.pbase.com/ashishpaliwal
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB