Hello Mike,

         How about adding a "common errors and possible solutions"
section?? Many of the newbies like me faced a few hiccups while trying
to build and use Flume-NG for the first time. It would be pretty
useful for people like me. But it's just a suggestion from my side.
Pardon me if it sounds too childish. I am actually very new to the
open source world. Many thanks.

Regards,
    Mohammad Tariq
On Mon, Jul 2, 2012 at 11:02 PM, Mike Percy <[EMAIL PROTECTED]> wrote:
> Hi Flume users & devs,
> Now that we have branched in preparation for a Flume 1.2.0 release, we have
> one week to improve the documentation coverage and find any major issues
> before RC0.
>
> Looking at the docs, we are missing coverage on several key components, so
> this is a ripe opportunity for new contributors come in and submit a patch
> or two. The plan is still to begin the release vote on Monday, July 9, and I
> know some folks in the U.S. plan on taking a few days off this week for
> Independence Day, so if you want to contribute, please get them in early so
> the available committers can review the patches and commit them.
>
> Committers - please commit any changes to the trunk as usual, and I'll be
> happy to backport applicable doc updates, build fixes, or any critical bug
> fixes to the release branch. Just send a note to the list.
>
> Looking forward to a great 1.2.0 release!
>
> Regards,
> Mike
>

Hi Mohammad,
That's a great idea. Since you recently ran into such issues, please feel
free to add that in to the User Guide and I would be happy to review it.

The RST source code for the User and Dev guides can be found here:

https://svn.apache.org/viewvc/incubator/flume/trunk/flume-ng-doc/sphinx/

Regards,
Mike

On Mon, Jul 2, 2012 at 1:53 PM, Mohammad Tariq <[EMAIL PROTECTED]> wrote:

> Hello Mike,
>
>          How about adding a "common errors and possible solutions"
> section?? Many of the newbies like me faced a few hiccups while trying
> to build and use Flume-NG for the first time. It would be pretty
> useful for people like me. But it's just a suggestion from my side.
> Pardon me if it sounds too childish. I am actually very new to the
> open source world. Many thanks.
>
> Regards,
>     Mohammad Tariq
>
>
> On Mon, Jul 2, 2012 at 11:02 PM, Mike Percy <[EMAIL PROTECTED]> wrote:
> > Hi Flume users & devs,
> > Now that we have branched in preparation for a Flume 1.2.0 release, we
> have
> > one week to improve the documentation coverage and find any major issues
> > before RC0.
> >
> > Looking at the docs, we are missing coverage on several key components,
> so
> > this is a ripe opportunity for new contributors come in and submit a
> patch
> > or two. The plan is still to begin the release vote on Monday, July 9,
> and I
> > know some folks in the U.S. plan on taking a few days off this week for
> > Independence Day, so if you want to contribute, please get them in early
> so
> > the available committers can review the patches and commit them.
> >
> > Committers - please commit any changes to the trunk as usual, and I'll be
> > happy to backport applicable doc updates, build fixes, or any critical
> bug
> > fixes to the release branch. Just send a note to the list.
> >
> > Looking forward to a great 1.2.0 release!
> >
> > Regards,
> > Mike
> >
>

By the way - if you want guidance on how to submit a patch, this page
should help:
https://cwiki.apache.org/confluence/display/FLUME/How+to+Contribute#HowtoContribute-ProvidingPatches

Regards,
MIke

On Mon, Jul 2, 2012 at 2:50 PM, Mike Percy <[EMAIL PROTECTED]> wrote:

> Hi Mohammad,
> That's a great idea. Since you recently ran into such issues, please feel
> free to add that in to the User Guide and I would be happy to review it.
>
> The RST source code for the User and Dev guides can be found here:
>
> https://svn.apache.org/viewvc/incubator/flume/trunk/flume-ng-doc/sphinx/
>
> Regards,
> Mike
>
>
> On Mon, Jul 2, 2012 at 1:53 PM, Mohammad Tariq <[EMAIL PROTECTED]> wrote:
>
>> Hello Mike,
>>
>>          How about adding a "common errors and possible solutions"
>> section?? Many of the newbies like me faced a few hiccups while trying
>> to build and use Flume-NG for the first time. It would be pretty
>> useful for people like me. But it's just a suggestion from my side.
>> Pardon me if it sounds too childish. I am actually very new to the
>> open source world. Many thanks.
>>
>> Regards,
>>     Mohammad Tariq
>>
>>
>> On Mon, Jul 2, 2012 at 11:02 PM, Mike Percy <[EMAIL PROTECTED]> wrote:
>> > Hi Flume users & devs,
>> > Now that we have branched in preparation for a Flume 1.2.0 release, we
>> have
>> > one week to improve the documentation coverage and find any major issues
>> > before RC0.
>> >
>> > Looking at the docs, we are missing coverage on several key components,
>> so
>> > this is a ripe opportunity for new contributors come in and submit a
>> patch
>> > or two. The plan is still to begin the release vote on Monday, July 9,
>> and I
>> > know some folks in the U.S. plan on taking a few days off this week for
>> > Independence Day, so if you want to contribute, please get them in
>> early so
>> > the available committers can review the patches and commit them.
>> >
>> > Committers - please commit any changes to the trunk as usual, and I'll
>> be
>> > happy to backport applicable doc updates, build fixes, or any critical
>> bug
>> > fixes to the release branch. Just send a note to the list.
>> >
>> > Looking forward to a great 1.2.0 release!
>> >
>> > Regards,
>> > Mike
>> >
>>
>
>

Thanks a lot for the pointers Mike. Since it is the first time I am
trying something like this, so I needed these.

Regards,
    Mohammad Tariq
On Tue, Jul 3, 2012 at 4:19 AM, Mike Percy <[EMAIL PROTECTED]> wrote:
> By the way - if you want guidance on how to submit a patch, this page should
> help:
> https://cwiki.apache.org/confluence/display/FLUME/How+to+Contribute#HowtoContribute-ProvidingPatches
>
> Regards,
> MIke
>
>
> On Mon, Jul 2, 2012 at 2:50 PM, Mike Percy <[EMAIL PROTECTED]> wrote:
>>
>> Hi Mohammad,
>> That's a great idea. Since you recently ran into such issues, please feel
>> free to add that in to the User Guide and I would be happy to review it.
>>
>> The RST source code for the User and Dev guides can be found here:
>>
>> https://svn.apache.org/viewvc/incubator/flume/trunk/flume-ng-doc/sphinx/
>>
>> Regards,
>> Mike
>>
>>
>> On Mon, Jul 2, 2012 at 1:53 PM, Mohammad Tariq <[EMAIL PROTECTED]> wrote:
>>>
>>> Hello Mike,
>>>
>>>          How about adding a "common errors and possible solutions"
>>> section?? Many of the newbies like me faced a few hiccups while trying
>>> to build and use Flume-NG for the first time. It would be pretty
>>> useful for people like me. But it's just a suggestion from my side.
>>> Pardon me if it sounds too childish. I am actually very new to the
>>> open source world. Many thanks.
>>>
>>> Regards,
>>>     Mohammad Tariq
>>>
>>>
>>> On Mon, Jul 2, 2012 at 11:02 PM, Mike Percy <[EMAIL PROTECTED]> wrote:
>>> > Hi Flume users & devs,
>>> > Now that we have branched in preparation for a Flume 1.2.0 release, we
>>> > have
>>> > one week to improve the documentation coverage and find any major
>>> > issues
>>> > before RC0.
>>> >
>>> > Looking at the docs, we are missing coverage on several key components,
>>> > so
>>> > this is a ripe opportunity for new contributors come in and submit a
>>> > patch
>>> > or two. The plan is still to begin the release vote on Monday, July 9,
>>> > and I
>>> > know some folks in the U.S. plan on taking a few days off this week for
>>> > Independence Day, so if you want to contribute, please get them in
>>> > early so
>>> > the available committers can review the patches and commit them.
>>> >
>>> > Committers - please commit any changes to the trunk as usual, and I'll
>>> > be
>>> > happy to backport applicable doc updates, build fixes, or any critical
>>> > bug
>>> > fixes to the release branch. Just send a note to the list.
>>> >
>>> > Looking forward to a great 1.2.0 release!
>>> >
>>> > Regards,
>>> > Mike
>>> >
>>
>>
>

No problem. If you decide to work on this, please feel free to create a
JIRA and post tentative patches if you want early feedback.

Also, don't hesitate to ping me or send a message the list if you have any
questions.

Regards,
Mike

On Tue, Jul 3, 2012 at 12:49 AM, Mohammad Tariq <[EMAIL PROTECTED]> wrote:

> Thanks a lot for the pointers Mike. Since it is the first time I am
> trying something like this, so I needed these.
>
> Regards,
>     Mohammad Tariq
>
>
> On Tue, Jul 3, 2012 at 4:19 AM, Mike Percy <[EMAIL PROTECTED]> wrote:
> > By the way - if you want guidance on how to submit a patch, this page
> should
> > help:
> >
> https://cwiki.apache.org/confluence/display/FLUME/How+to+Contribute#HowtoContribute-ProvidingPatches
> >
> > Regards,
> > MIke
> >
> >
> > On Mon, Jul 2, 2012 at 2:50 PM, Mike Percy <[EMAIL PROTECTED]> wrote:
> >>
> >> Hi Mohammad,
> >> That's a great idea. Since you recently ran into such issues, please
> feel
> >> free to add that in to the User Guide and I would be happy to review it.
> >>
> >> The RST source code for the User and Dev guides can be found here:
> >>
> >>
> https://svn.apache.org/viewvc/incubator/flume/trunk/flume-ng-doc/sphinx/
> >>
> >> Regards,
> >> Mike
> >>
> >>
> >> On Mon, Jul 2, 2012 at 1:53 PM, Mohammad Tariq <[EMAIL PROTECTED]>
> wrote:
> >>>
> >>> Hello Mike,
> >>>
> >>>          How about adding a "common errors and possible solutions"
> >>> section?? Many of the newbies like me faced a few hiccups while trying
> >>> to build and use Flume-NG for the first time. It would be pretty
> >>> useful for people like me. But it's just a suggestion from my side.
> >>> Pardon me if it sounds too childish. I am actually very new to the
> >>> open source world. Many thanks.
> >>>
> >>> Regards,
> >>>     Mohammad Tariq
> >>>
> >>>
> >>> On Mon, Jul 2, 2012 at 11:02 PM, Mike Percy <[EMAIL PROTECTED]> wrote:
> >>> > Hi Flume users & devs,
> >>> > Now that we have branched in preparation for a Flume 1.2.0 release,
> we
> >>> > have
> >>> > one week to improve the documentation coverage and find any major
> >>> > issues
> >>> > before RC0.
> >>> >
> >>> > Looking at the docs, we are missing coverage on several key
> components,
> >>> > so
> >>> > this is a ripe opportunity for new contributors come in and submit a
> >>> > patch
> >>> > or two. The plan is still to begin the release vote on Monday, July
> 9,
> >>> > and I
> >>> > know some folks in the U.S. plan on taking a few days off this week
> for
> >>> > Independence Day, so if you want to contribute, please get them in
> >>> > early so
> >>> > the available committers can review the patches and commit them.
> >>> >
> >>> > Committers - please commit any changes to the trunk as usual, and
> I'll
> >>> > be
> >>> > happy to backport applicable doc updates, build fixes, or any
> critical
> >>> > bug
> >>> > fixes to the release branch. Just send a note to the list.
> >>> >
> >>> > Looking forward to a great 1.2.0 release!
> >>> >
> >>> > Regards,
> >>> > Mike
> >>> >
> >>
> >>
> >
>

Sure Mike..And thanks again for the support and valuable guidance.

Regards,
    Mohammad Tariq
On Tue, Jul 3, 2012 at 10:05 PM, Mike Percy <[EMAIL PROTECTED]> wrote:
> No problem. If you decide to work on this, please feel free to create a JIRA
> and post tentative patches if you want early feedback.
>
> Also, don't hesitate to ping me or send a message the list if you have any
> questions.
>
> Regards,
> Mike
>
>
> On Tue, Jul 3, 2012 at 12:49 AM, Mohammad Tariq <[EMAIL PROTECTED]> wrote:
>>
>> Thanks a lot for the pointers Mike. Since it is the first time I am
>> trying something like this, so I needed these.
>>
>> Regards,
>>     Mohammad Tariq
>>
>>
>> On Tue, Jul 3, 2012 at 4:19 AM, Mike Percy <[EMAIL PROTECTED]> wrote:
>> > By the way - if you want guidance on how to submit a patch, this page
>> > should
>> > help:
>> >
>> > https://cwiki.apache.org/confluence/display/FLUME/How+to+Contribute#HowtoContribute-ProvidingPatches
>> >
>> > Regards,
>> > MIke
>> >
>> >
>> > On Mon, Jul 2, 2012 at 2:50 PM, Mike Percy <[EMAIL PROTECTED]> wrote:
>> >>
>> >> Hi Mohammad,
>> >> That's a great idea. Since you recently ran into such issues, please
>> >> feel
>> >> free to add that in to the User Guide and I would be happy to review
>> >> it.
>> >>
>> >> The RST source code for the User and Dev guides can be found here:
>> >>
>> >>
>> >> https://svn.apache.org/viewvc/incubator/flume/trunk/flume-ng-doc/sphinx/
>> >>
>> >> Regards,
>> >> Mike
>> >>
>> >>
>> >> On Mon, Jul 2, 2012 at 1:53 PM, Mohammad Tariq <[EMAIL PROTECTED]>
>> >> wrote:
>> >>>
>> >>> Hello Mike,
>> >>>
>> >>>          How about adding a "common errors and possible solutions"
>> >>> section?? Many of the newbies like me faced a few hiccups while trying
>> >>> to build and use Flume-NG for the first time. It would be pretty
>> >>> useful for people like me. But it's just a suggestion from my side.
>> >>> Pardon me if it sounds too childish. I am actually very new to the
>> >>> open source world. Many thanks.
>> >>>
>> >>> Regards,
>> >>>     Mohammad Tariq
>> >>>
>> >>>
>> >>> On Mon, Jul 2, 2012 at 11:02 PM, Mike Percy <[EMAIL PROTECTED]> wrote:
>> >>> > Hi Flume users & devs,
>> >>> > Now that we have branched in preparation for a Flume 1.2.0 release,
>> >>> > we
>> >>> > have
>> >>> > one week to improve the documentation coverage and find any major
>> >>> > issues
>> >>> > before RC0.
>> >>> >
>> >>> > Looking at the docs, we are missing coverage on several key
>> >>> > components,
>> >>> > so
>> >>> > this is a ripe opportunity for new contributors come in and submit a
>> >>> > patch
>> >>> > or two. The plan is still to begin the release vote on Monday, July
>> >>> > 9,
>> >>> > and I
>> >>> > know some folks in the U.S. plan on taking a few days off this week
>> >>> > for
>> >>> > Independence Day, so if you want to contribute, please get them in
>> >>> > early so
>> >>> > the available committers can review the patches and commit them.
>> >>> >
>> >>> > Committers - please commit any changes to the trunk as usual, and
>> >>> > I'll
>> >>> > be
>> >>> > happy to backport applicable doc updates, build fixes, or any
>> >>> > critical
>> >>> > bug
>> >>> > fixes to the release branch. Just send a note to the list.
>> >>> >
>> >>> > Looking forward to a great 1.2.0 release!
>> >>> >
>> >>> > Regards,
>> >>> > Mike
>> >>> >
>> >>
>> >>
>> >
>
>

Hello Mike,

      Before creating the JIRA, I need your green signal. Actually, I
just wanted to know if these things are worth mentioning in the
official documentation as they may seem very primitive to some of the
folks. For example, many newbies face following 4 problems quite often
:
1 - Maven dependency problem.
     FIX : Use maven3 in place of maven2.
             We can also specify the maven version to be used in the
pom.xml file-
             <plugin>
       <artifactId>maven-compiler-plugin</artifactId>
       <configuration>
         <executable>${JAVA_HOME}/bin/javac</executable>***
       </configuration>
   </plugin>

2 - Out of resource issue while trying to build from trunk.
     FIX : Increase the memory before building the project -
     xport MAVEN_OPTS='-Xmx512m -XX:MaxPermSize=1024m'

3 - "hostname" directory is not getting created even after using the
%{host} sequence parameter.
     FIX : Using the  HDFS interceptor that adds a host header key to
each event, along with the corresponding hostname as the header value.
     Add the following lines in the configuration file to achieve this -
     agent.sources.tail.interceptors = hostint
     agent.sources.tail.interceptors.hostint.type org.apache.flume.interceptor.HostInterceptor$Builder
     agent.sources.tail.interceptors.hostint.preserveExisting = true
     agent.sources.tail.interceptors.hostint.useIP = false

4 - Unable to move data to the Hdfs and getting the following error -
     ERROR hdfs.HDFSEventSink: process failed
java.lang.NoSuchMethodError:
org.apache.hadoop.io.SequenceFile$Writer.syncFs()V
     FIX : Use a version of Hadoop that supports sync() operations,
which is required for sinks that flush periodically. Apache Hadoop
0.20.205
     or higher or any CDH3 version for sync() support on 0.20.x/1.x
must be used.

Regards,
    Mohammad Tariq
On Wed, Jul 4, 2012 at 1:14 AM, Mohammad Tariq <[EMAIL PROTECTED]> wrote:
> Sure Mike..And thanks again for the support and valuable guidance.
>
> Regards,
>     Mohammad Tariq
>
>
> On Tue, Jul 3, 2012 at 10:05 PM, Mike Percy <[EMAIL PROTECTED]> wrote:
>> No problem. If you decide to work on this, please feel free to create a JIRA
>> and post tentative patches if you want early feedback.
>>
>> Also, don't hesitate to ping me or send a message the list if you have any
>> questions.
>>
>> Regards,
>> Mike
>>
>>
>> On Tue, Jul 3, 2012 at 12:49 AM, Mohammad Tariq <[EMAIL PROTECTED]> wrote:
>>>
>>> Thanks a lot for the pointers Mike. Since it is the first time I am
>>> trying something like this, so I needed these.
>>>
>>> Regards,
>>>     Mohammad Tariq
>>>
>>>
>>> On Tue, Jul 3, 2012 at 4:19 AM, Mike Percy <[EMAIL PROTECTED]> wrote:
>>> > By the way - if you want guidance on how to submit a patch, this page
>>> > should
>>> > help:
>>> >
>>> > https://cwiki.apache.org/confluence/display/FLUME/How+to+Contribute#HowtoContribute-ProvidingPatches
>>> >
>>> > Regards,
>>> > MIke
>>> >
>>> >
>>> > On Mon, Jul 2, 2012 at 2:50 PM, Mike Percy <[EMAIL PROTECTED]> wrote:
>>> >>
>>> >> Hi Mohammad,
>>> >> That's a great idea. Since you recently ran into such issues, please
>>> >> feel
>>> >> free to add that in to the User Guide and I would be happy to review
>>> >> it.
>>> >>
>>> >> The RST source code for the User and Dev guides can be found here:
>>> >>
>>> >>
>>> >> https://svn.apache.org/viewvc/incubator/flume/trunk/flume-ng-doc/sphinx/
>>> >>
>>> >> Regards,
>>> >> Mike
>>> >>
>>> >>
>>> >> On Mon, Jul 2, 2012 at 1:53 PM, Mohammad Tariq <[EMAIL PROTECTED]>
>>> >> wrote:
>>> >>>
>>> >>> Hello Mike,
>>> >>>
>>> >>>          How about adding a "common errors and possible solutions"
>>> >>> section?? Many of the newbies like me faced a few hiccups while trying
>>> >>> to build and use Flume-NG for the first time. It would be pretty
>>> >>> useful for people like me. But it's just a suggestion from my side.
>>> >>> Pardon me if it sounds too childish. I am actually very new to the
>>> >>> open source world. Many thanks.

I am currently working on the web site. I believe that once that is in place both 1 and 2 will not be required.

Ralph

On Jul 4, 2012, at 7:40 AM, Mohammad Tariq wrote:

> Hello Mike,
>
>      Before creating the JIRA, I need your green signal. Actually, I
> just wanted to know if these things are worth mentioning in the
> official documentation as they may seem very primitive to some of the
> folks. For example, many newbies face following 4 problems quite often
> :
> 1 - Maven dependency problem.
>     FIX : Use maven3 in place of maven2.
>             We can also specify the maven version to be used in the
> pom.xml file-
>             <plugin>
>        <artifactId>maven-compiler-plugin</artifactId>
>        <configuration>
>          <executable>${JAVA_HOME}/bin/javac</executable>***
>        </configuration>
>    </plugin>
>
> 2 - Out of resource issue while trying to build from trunk.
>     FIX : Increase the memory before building the project -
>     xport MAVEN_OPTS='-Xmx512m -XX:MaxPermSize=1024m'
>
> 3 - "hostname" directory is not getting created even after using the
> %{host} sequence parameter.
>     FIX : Using the  HDFS interceptor that adds a host header key to
> each event, along with the corresponding hostname as the header value.
>     Add the following lines in the configuration file to achieve this -
>     agent.sources.tail.interceptors = hostint
>     agent.sources.tail.interceptors.hostint.type > org.apache.flume.interceptor.HostInterceptor$Builder
>     agent.sources.tail.interceptors.hostint.preserveExisting = true
>     agent.sources.tail.interceptors.hostint.useIP = false
>
> 4 - Unable to move data to the Hdfs and getting the following error -
>     ERROR hdfs.HDFSEventSink: process failed
> java.lang.NoSuchMethodError:
> org.apache.hadoop.io.SequenceFile$Writer.syncFs()V
>     FIX : Use a version of Hadoop that supports sync() operations,
> which is required for sinks that flush periodically. Apache Hadoop
> 0.20.205
>     or higher or any CDH3 version for sync() support on 0.20.x/1.x
> must be used.
>
> Regards,
>    Mohammad Tariq
>
>
> On Wed, Jul 4, 2012 at 1:14 AM, Mohammad Tariq <[EMAIL PROTECTED]> wrote:
>> Sure Mike..And thanks again for the support and valuable guidance.
>>
>> Regards,
>>    Mohammad Tariq
>>
>>
>> On Tue, Jul 3, 2012 at 10:05 PM, Mike Percy <[EMAIL PROTECTED]> wrote:
>>> No problem. If you decide to work on this, please feel free to create a JIRA
>>> and post tentative patches if you want early feedback.
>>>
>>> Also, don't hesitate to ping me or send a message the list if you have any
>>> questions.
>>>
>>> Regards,
>>> Mike
>>>
>>>
>>> On Tue, Jul 3, 2012 at 12:49 AM, Mohammad Tariq <[EMAIL PROTECTED]> wrote:
>>>>
>>>> Thanks a lot for the pointers Mike. Since it is the first time I am
>>>> trying something like this, so I needed these.
>>>>
>>>> Regards,
>>>>    Mohammad Tariq
>>>>
>>>>
>>>> On Tue, Jul 3, 2012 at 4:19 AM, Mike Percy <[EMAIL PROTECTED]> wrote:
>>>>> By the way - if you want guidance on how to submit a patch, this page
>>>>> should
>>>>> help:
>>>>>
>>>>> https://cwiki.apache.org/confluence/display/FLUME/How+to+Contribute#HowtoContribute-ProvidingPatches
>>>>>
>>>>> Regards,
>>>>> MIke
>>>>>
>>>>>
>>>>> On Mon, Jul 2, 2012 at 2:50 PM, Mike Percy <[EMAIL PROTECTED]> wrote:
>>>>>>
>>>>>> Hi Mohammad,
>>>>>> That's a great idea. Since you recently ran into such issues, please
>>>>>> feel
>>>>>> free to add that in to the User Guide and I would be happy to review
>>>>>> it.
>>>>>>
>>>>>> The RST source code for the User and Dev guides can be found here:
>>>>>>
>>>>>>
>>>>>> https://svn.apache.org/viewvc/incubator/flume/trunk/flume-ng-doc/sphinx/
>>>>>>
>>>>>> Regards,
>>>>>> Mike
>>>>>>
>>>>>>
>>>>>> On Mon, Jul 2, 2012 at 1:53 PM, Mohammad Tariq <[EMAIL PROTECTED]>
>>>>>> wrote:
>>>>>>>
>>>>>>> Hello Mike,
>>>>>>>
>>>>>>>         How about adding a "common errors and possible solutions"
>>>>>>> section?? Many of the newbies like me faced a few hiccups while trying

Thanks for the comment Ralph.

Regards,
    Mohammad Tariq
On Wed, Jul 4, 2012 at 8:24 PM, Ralph Goers <[EMAIL PROTECTED]> wrote:
> I am currently working on the web site. I believe that once that is in place both 1 and 2 will not be required.
>
> Ralph
>
> On Jul 4, 2012, at 7:40 AM, Mohammad Tariq wrote:
>
>> Hello Mike,
>>
>>      Before creating the JIRA, I need your green signal. Actually, I
>> just wanted to know if these things are worth mentioning in the
>> official documentation as they may seem very primitive to some of the
>> folks. For example, many newbies face following 4 problems quite often
>> :
>> 1 - Maven dependency problem.
>>     FIX : Use maven3 in place of maven2.
>>             We can also specify the maven version to be used in the
>> pom.xml file-
>>             <plugin>
>>                               <artifactId>maven-compiler-plugin</artifactId>
>>                               <configuration>
>>                                 <executable>${JAVA_HOME}/bin/javac</executable>***
>>                               </configuration>
>>           </plugin>
>>
>> 2 - Out of resource issue while trying to build from trunk.
>>     FIX : Increase the memory before building the project -
>>     xport MAVEN_OPTS='-Xmx512m -XX:MaxPermSize=1024m'
>>
>> 3 - "hostname" directory is not getting created even after using the
>> %{host} sequence parameter.
>>     FIX : Using the  HDFS interceptor that adds a host header key to
>> each event, along with the corresponding hostname as the header value.
>>     Add the following lines in the configuration file to achieve this -
>>     agent.sources.tail.interceptors = hostint
>>     agent.sources.tail.interceptors.hostint.type >> org.apache.flume.interceptor.HostInterceptor$Builder
>>     agent.sources.tail.interceptors.hostint.preserveExisting = true
>>     agent.sources.tail.interceptors.hostint.useIP = false
>>
>> 4 - Unable to move data to the Hdfs and getting the following error -
>>     ERROR hdfs.HDFSEventSink: process failed
>> java.lang.NoSuchMethodError:
>> org.apache.hadoop.io.SequenceFile$Writer.syncFs()V
>>     FIX : Use a version of Hadoop that supports sync() operations,
>> which is required for sinks that flush periodically. Apache Hadoop
>> 0.20.205
>>     or higher or any CDH3 version for sync() support on 0.20.x/1.x
>> must be used.
>>
>> Regards,
>>    Mohammad Tariq
>>
>>
>> On Wed, Jul 4, 2012 at 1:14 AM, Mohammad Tariq <[EMAIL PROTECTED]> wrote:
>>> Sure Mike..And thanks again for the support and valuable guidance.
>>>
>>> Regards,
>>>    Mohammad Tariq
>>>
>>>
>>> On Tue, Jul 3, 2012 at 10:05 PM, Mike Percy <[EMAIL PROTECTED]> wrote:
>>>> No problem. If you decide to work on this, please feel free to create a JIRA
>>>> and post tentative patches if you want early feedback.
>>>>
>>>> Also, don't hesitate to ping me or send a message the list if you have any
>>>> questions.
>>>>
>>>> Regards,
>>>> Mike
>>>>
>>>>
>>>> On Tue, Jul 3, 2012 at 12:49 AM, Mohammad Tariq <[EMAIL PROTECTED]> wrote:
>>>>>
>>>>> Thanks a lot for the pointers Mike. Since it is the first time I am
>>>>> trying something like this, so I needed these.
>>>>>
>>>>> Regards,
>>>>>    Mohammad Tariq
>>>>>
>>>>>
>>>>> On Tue, Jul 3, 2012 at 4:19 AM, Mike Percy <[EMAIL PROTECTED]> wrote:
>>>>>> By the way - if you want guidance on how to submit a patch, this page
>>>>>> should
>>>>>> help:
>>>>>>
>>>>>> https://cwiki.apache.org/confluence/display/FLUME/How+to+Contribute#HowtoContribute-ProvidingPatches
>>>>>>
>>>>>> Regards,
>>>>>> MIke
>>>>>>
>>>>>>
>>>>>> On Mon, Jul 2, 2012 at 2:50 PM, Mike Percy <[EMAIL PROTECTED]> wrote:
>>>>>>>
>>>>>>> Hi Mohammad,
>>>>>>> That's a great idea. Since you recently ran into such issues, please
>>>>>>> feel
>>>>>>> free to add that in to the User Guide and I would be happy to review
>>>>>>> it.
>>>>>>>
>>>>>>> The RST source code for the User and Dev guides can be found here:
>>>>>>>
>>>>>>>
>>>>>>> https://svn.apache.org/viewvc/incubator/flume/trunk/flume-ng-doc/sphinx/

Mohammed,
That sounds fine, they sound like they would be in parts of a "getting
started" section. Please feel free create a Jira and submit a patch with
that stuff.

Regards,
Mike

On Wednesday, July 4, 2012, Mohammad Tariq wrote:

> Hello Mike,
>
>       Before creating the JIRA, I need your green signal. Actually, I
> just wanted to know if these things are worth mentioning in the
> official documentation as they may seem very primitive to some of the
> folks. For example, many newbies face following 4 problems quite often
> :
> 1 - Maven dependency problem.
>      FIX : Use maven3 in place of maven2.
>              We can also specify the maven version to be used in the
> pom.xml file-
>              <plugin>
>
> <artifactId>maven-compiler-plugin</artifactId>
>                                 <configuration>
>
> <executable>${JAVA_HOME}/bin/javac</executable>***
>                                 </configuration>
>             </plugin>
>
> 2 - Out of resource issue while trying to build from trunk.
>      FIX : Increase the memory before building the project -
>      xport MAVEN_OPTS='-Xmx512m -XX:MaxPermSize=1024m'
>
> 3 - "hostname" directory is not getting created even after using the
> %{host} sequence parameter.
>      FIX : Using the  HDFS interceptor that adds a host header key to
> each event, along with the corresponding hostname as the header value.
>      Add the following lines in the configuration file to achieve this -
>      agent.sources.tail.interceptors = hostint
>      agent.sources.tail.interceptors.hostint.type > org.apache.flume.interceptor.HostInterceptor$Builder
>      agent.sources.tail.interceptors.hostint.preserveExisting = true
>      agent.sources.tail.interceptors.hostint.useIP = false
>
> 4 - Unable to move data to the Hdfs and getting the following error -
>      ERROR hdfs.HDFSEventSink: process failed
> java.lang.NoSuchMethodError:
> org.apache.hadoop.io.SequenceFile$Writer.syncFs()V
>      FIX : Use a version of Hadoop that supports sync() operations,
> which is required for sinks that flush periodically. Apache Hadoop
> 0.20.205
>      or higher or any CDH3 version for sync() support on 0.20.x/1.x
> must be used.
>
> Regards,
>     Mohammad Tariq
>
>
> On Wed, Jul 4, 2012 at 1:14 AM, Mohammad Tariq <[EMAIL PROTECTED]> wrote:
> > Sure Mike..And thanks again for the support and valuable guidance.
> >
> > Regards,
> >     Mohammad Tariq
> >
> >
> > On Tue, Jul 3, 2012 at 10:05 PM, Mike Percy <[EMAIL PROTECTED]> wrote:
> >> No problem. If you decide to work on this, please feel free to create a
> JIRA
> >> and post tentative patches if you want early feedback.
> >>
> >> Also, don't hesitate to ping me or send a message the list if you have
> any
> >> questions.
> >>
> >> Regards,
> >> Mike
> >>
> >>
> >> On Tue, Jul 3, 2012 at 12:49 AM, Mohammad Tariq <[EMAIL PROTECTED]>
> wrote:
> >>>
> >>> Thanks a lot for the pointers Mike. Since it is the first time I am
> >>> trying something like this, so I needed these.
> >>>
> >>> Regards,
> >>>     Mohammad Tariq
> >>>
> >>>
> >>> On Tue, Jul 3, 2012 at 4:19 AM, Mike Percy <[EMAIL PROTECTED]> wrote:
> >>> > By the way - if you want guidance on how to submit a patch, this page
> >>> > should
> >>> > help:
> >>> >
> >>> >
> https://cwiki.apache.org/confluence/display/FLUME/How+to+Contribute#HowtoContribute-ProvidingPatches
> >>> >
> >>> > Regards,
> >>> > MIke
> >>> >
> >>> >
> >>> > On Mon, Jul 2, 2012 at 2:50 PM, Mike Percy <[EMAIL PROTECTED]>
> wrote:
> >>> >>
> >>> >> Hi Mohammad,
> >>> >> That's a great idea. Since you recently ran into such issues, please
> >>> >> feel
> >>> >> free to add that in to the User Guide and I would be happy to review
> >>> >> it.
> >>> >>
> >>> >> The RST source code for the User and Dev guides can be found here:
> >>> >>
> >>> >>
> >>> >>
> https://svn.apache.org/viewvc/incubator/flume/trunk/flume-ng-doc/sphinx/
> >>> >>
> >>> >> Regards,
> >>> >> Mike
> >>> >>
> >>> >>
> >>> >> On Mon, Jul 2, 2012 at 1:53 PM, Mohammad Tariq <[EMAIL PROTECTED]>

Ok Mike. I'll do that.

Regards,
    Mohammad Tariq
On Thu, Jul 5, 2012 at 12:18 PM, Mike Percy <[EMAIL PROTECTED]> wrote:
> Mohammed,
> That sounds fine, they sound like they would be in parts of a "getting
> started" section. Please feel free create a Jira and submit a patch with
> that stuff.
>
> Regards,
> Mike
>
>
> On Wednesday, July 4, 2012, Mohammad Tariq wrote:
>>
>> Hello Mike,
>>
>>       Before creating the JIRA, I need your green signal. Actually, I
>> just wanted to know if these things are worth mentioning in the
>> official documentation as they may seem very primitive to some of the
>> folks. For example, many newbies face following 4 problems quite often
>> :
>> 1 - Maven dependency problem.
>>      FIX : Use maven3 in place of maven2.
>>              We can also specify the maven version to be used in the
>> pom.xml file-
>>              <plugin>
>>
>> <artifactId>maven-compiler-plugin</artifactId>
>>                                 <configuration>
>>
>> <executable>${JAVA_HOME}/bin/javac</executable>***
>>                                 </configuration>
>>             </plugin>
>>
>> 2 - Out of resource issue while trying to build from trunk.
>>      FIX : Increase the memory before building the project -
>>      xport MAVEN_OPTS='-Xmx512m -XX:MaxPermSize=1024m'
>>
>> 3 - "hostname" directory is not getting created even after using the
>> %{host} sequence parameter.
>>      FIX : Using the  HDFS interceptor that adds a host header key to
>> each event, along with the corresponding hostname as the header value.
>>      Add the following lines in the configuration file to achieve this -
>>      agent.sources.tail.interceptors = hostint
>>      agent.sources.tail.interceptors.hostint.type >> org.apache.flume.interceptor.HostInterceptor$Builder
>>      agent.sources.tail.interceptors.hostint.preserveExisting = true
>>      agent.sources.tail.interceptors.hostint.useIP = false
>>
>> 4 - Unable to move data to the Hdfs and getting the following error -
>>      ERROR hdfs.HDFSEventSink: process failed
>> java.lang.NoSuchMethodError:
>> org.apache.hadoop.io.SequenceFile$Writer.syncFs()V
>>      FIX : Use a version of Hadoop that supports sync() operations,
>> which is required for sinks that flush periodically. Apache Hadoop
>> 0.20.205
>>      or higher or any CDH3 version for sync() support on 0.20.x/1.x
>> must be used.
>>
>> Regards,
>>     Mohammad Tariq
>>
>>
>> On Wed, Jul 4, 2012 at 1:14 AM, Mohammad Tariq <[EMAIL PROTECTED]> wrote:
>> > Sure Mike..And thanks again for the support and valuable guidance.
>> >
>> > Regards,
>> >     Mohammad Tariq
>> >
>> >
>> > On Tue, Jul 3, 2012 at 10:05 PM, Mike Percy <[EMAIL PROTECTED]> wrote:
>> >> No problem. If you decide to work on this, please feel free to create a
>> >> JIRA
>> >> and post tentative patches if you want early feedback.
>> >>
>> >> Also, don't hesitate to ping me or send a message the list if you have
>> >> any
>> >> questions.
>> >>
>> >> Regards,
>> >> Mike
>> >>
>> >>
>> >> On Tue, Jul 3, 2012 at 12:49 AM, Mohammad Tariq <[EMAIL PROTECTED]>
>> >> wrote:
>> >>>
>> >>> Thanks a lot for the pointers Mike. Since it is the first time I am
>> >>> trying something like this, so I needed these.
>> >>>
>> >>> Regards,
>> >>>     Mohammad Tariq
>> >>>
>> >>>
>> >>> On Tue, Jul 3, 2012 at 4:19 AM, Mike Percy <[EMAIL PROTECTED]> wrote:
>> >>> > By the way - if you want guidance on how to submit a patch, this
>> >>> > page
>> >>> > should
>> >>> > help:
>> >>> >
>> >>> >
>> >>> > https://cwiki.apache.org/confluence/display/FLUME/How+to+Contribute#HowtoContribute-ProvidingPatches
>> >>> >
>> >>> > Regards,
>> >>> > MIke
>> >>> >
>> >>> >
>> >>> > On Mon, Jul 2, 2012 at 2:50 PM, Mike Percy <[EMAIL PROTECTED]>
>> >>> > wrote:
>> >>> >>
>> >>> >> Hi Mohammad,
>> >>> >> That's a great idea. Since you recently ran into such issues,
>> >>> >> please
>> >>> >> feel
>> >>> >> free to add that in to the User Guide and I would be happy to
>> >>> >> review
>> >>> >

Hi Ralph,
I saw your code review request but haven't had time to look at it yet. I'll
dig into it tomorrow.

Regards,
Mike

On Wednesday, July 4, 2012, Ralph Goers wrote:

> I am currently working on the web site. I believe that once that is in
> place both 1 and 2 will not be required.
>
> Ralph
>
> On Jul 4, 2012, at 7:40 AM, Mohammad Tariq wrote:
>
> > Hello Mike,
> >
> >      Before creating the JIRA, I need your green signal. Actually, I
> > just wanted to know if these things are worth mentioning in the
> > official documentation as they may seem very primitive to some of the
> > folks. For example, many newbies face following 4 problems quite often
> > :
> > 1 - Maven dependency problem.
> >     FIX : Use maven3 in place of maven2.
> >             We can also specify the maven version to be used in the
> > pom.xml file-
> >             <plugin>
> >
> <artifactId>maven-compiler-plugin</artifactId>
> >                               <configuration>
> >
> <executable>${JAVA_HOME}/bin/javac</executable>***
> >                               </configuration>
> >           </plugin>
> >
> > 2 - Out of resource issue while trying to build from trunk.
> >     FIX : Increase the memory before building the project -
> >     xport MAVEN_OPTS='-Xmx512m -XX:MaxPermSize=1024m'
> >
> > 3 - "hostname" directory is not getting created even after using the
> > %{host} sequence parameter.
> >     FIX : Using the  HDFS interceptor that adds a host header key to
> > each event, along with the corresponding hostname as the header value.
> >     Add the following lines in the configuration file to achieve this -
> >     agent.sources.tail.interceptors = hostint
> >     agent.sources.tail.interceptors.hostint.type > > org.apache.flume.interceptor.HostInterceptor$Builder
> >     agent.sources.tail.interceptors.hostint.preserveExisting = true
> >     agent.sources.tail.interceptors.hostint.useIP = false
> >
> > 4 - Unable to move data to the Hdfs and getting the following error -
> >     ERROR hdfs.HDFSEventSink: process failed
> > java.lang.NoSuchMethodError:
> > org.apache.hadoop.io.SequenceFile$Writer.syncFs()V
> >     FIX : Use a version of Hadoop that supports sync() operations,
> > which is required for sinks that flush periodically. Apache Hadoop
> > 0.20.205
> >     or higher or any CDH3 version for sync() support on 0.20.x/1.x
> > must be used.
> >
> > Regards,
> >    Mohammad Tariq
> >
> >
> > On Wed, Jul 4, 2012 at 1:14 AM, Mohammad Tariq <[EMAIL PROTECTED]>
> wrote:
> >> Sure Mike..And thanks again for the support and valuable guidance.
> >>
> >> Regards,
> >>    Mohammad Tariq
> >>
> >>
> >> On Tue, Jul 3, 2012 at 10:05 PM, Mike Percy <[EMAIL PROTECTED]> wrote:
> >>> No problem. If you decide to work on this, please feel free to create
> a JIRA
> >>> and post tentative patches if you want early feedback.
> >>>
> >>> Also, don't hesitate to ping me or send a message the list if you have
> any
> >>> questions.
> >>>
> >>> Regards,
> >>> Mike
> >>>
> >>>
> >>> On Tue, Jul 3, 2012 at 12:49 AM, Mohammad Tariq <[EMAIL PROTECTED]>
> wrote:
> >>>>
> >>>> Thanks a lot for the pointers Mike. Since it is the first time I am
> >>>> trying something like this, so I needed these.
> >>>>
> >>>> Regards,
> >>>>    Mohammad Tariq
> >>>>
> >>>>
> >>>> On Tue, Jul 3, 2012 at 4:19 AM, Mike Percy <[EMAIL PROTECTED]> wrote:
> >>>>> By the way - if you want guidance on how to submit a patch, this page
> >>>>> should
> >>>>> help:
> >>>>>
> >>>>>
> <https://cwiki.apache.org/confluence/display/FLUME/How+to+Contribute#HowtoContribute-ProvidingPatches>