Jean-Marc Spaggiari
2013-02-25, 18:42
Andrew Purtell
2013-02-25, 18:52
Jean-Marc Spaggiari
2013-02-25, 19:09
Stack
2013-02-25, 19:59
Jean-Marc Spaggiari
2013-02-25, 20:09
Stack
2013-02-25, 20:42
Jean-Marc Spaggiari
2013-02-25, 20:54
Stack
2013-02-26, 00:10
Jean-Marc Spaggiari
2013-02-26, 02:22
Jean-Marc Spaggiari
2013-02-26, 13:36
Stack
2013-02-26, 20:04
-
Build performancesJean-Marc Spaggiari 2013-02-25, 18:42
Hi,
Buliding HBase locally is taking 1h for me:
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 59:36.659s
[INFO] Finished at: Mon Feb 25 13:11:36 EST 2013
[INFO] Final Memory: 64M/593M
[INFO] ------------------------------------------------------------------------
But from that our, it seems to be spending most of the time doing that:
[INFO] --- maven-assembly-plugin:2.2-beta-5:single (tarball) @ hbase ---
[INFO] Reading assembly descriptor: src/assembly/all.xml
[INFO] Copying files to
/home/jmspaggi/workspace/hbase-0.94/target/hbase-0.94.6-SNAPSHOT
My CPUs are not loaded at all (1.44/8 load5), CPUWIO is almost 0 too,
and disks are almost not working.
I have started the build with mvn clean site install assembly:assembly
-DskipTests -Prelease.
Is that really spending all this time copŷing files? I will move the
build to an SSD drive and retry, but is there anyway to reduce the
build time?
Thanks,
JM
Buliding HBase locally is taking 1h for me:
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 59:36.659s
[INFO] Finished at: Mon Feb 25 13:11:36 EST 2013
[INFO] Final Memory: 64M/593M
[INFO] ------------------------------------------------------------------------
But from that our, it seems to be spending most of the time doing that:
[INFO] --- maven-assembly-plugin:2.2-beta-5:single (tarball) @ hbase ---
[INFO] Reading assembly descriptor: src/assembly/all.xml
[INFO] Copying files to
/home/jmspaggi/workspace/hbase-0.94/target/hbase-0.94.6-SNAPSHOT
My CPUs are not loaded at all (1.44/8 load5), CPUWIO is almost 0 too,
and disks are almost not working.
I have started the build with mvn clean site install assembly:assembly
-DskipTests -Prelease.
Is that really spending all this time copŷing files? I will move the
build to an SSD drive and retry, but is there anyway to reduce the
build time?
Thanks,
JM
-
Re: Build performancesAndrew Purtell 2013-02-25, 18:52
If you run Maven with debug logging enabled, do you see it taking ~3
seconds per dependency jar to decide if it wants to include it in the
assembly or not?
On Mon, Feb 25, 2013 at 10:42 AM, Jean-Marc Spaggiari <
[EMAIL PROTECTED]> wrote:
> Hi,
>
> Buliding HBase locally is taking 1h for me:
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD SUCCESS
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 59:36.659s
> [INFO] Finished at: Mon Feb 25 13:11:36 EST 2013
> [INFO] Final Memory: 64M/593M
> [INFO]
> ------------------------------------------------------------------------
>
>
> But from that our, it seems to be spending most of the time doing that:
> [INFO] --- maven-assembly-plugin:2.2-beta-5:single (tarball) @ hbase ---
> [INFO] Reading assembly descriptor: src/assembly/all.xml
> [INFO] Copying files to
> /home/jmspaggi/workspace/hbase-0.94/target/hbase-0.94.6-SNAPSHOT
>
> My CPUs are not loaded at all (1.44/8 load5), CPUWIO is almost 0 too,
> and disks are almost not working.
>
> I have started the build with mvn clean site install assembly:assembly
> -DskipTests -Prelease.
>
> Is that really spending all this time copŷing files? I will move the
> build to an SSD drive and retry, but is there anyway to reduce the
> build time?
>
> Thanks,
>
> JM
>
--
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)
seconds per dependency jar to decide if it wants to include it in the
assembly or not?
On Mon, Feb 25, 2013 at 10:42 AM, Jean-Marc Spaggiari <
[EMAIL PROTECTED]> wrote:
> Hi,
>
> Buliding HBase locally is taking 1h for me:
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD SUCCESS
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 59:36.659s
> [INFO] Finished at: Mon Feb 25 13:11:36 EST 2013
> [INFO] Final Memory: 64M/593M
> [INFO]
> ------------------------------------------------------------------------
>
>
> But from that our, it seems to be spending most of the time doing that:
> [INFO] --- maven-assembly-plugin:2.2-beta-5:single (tarball) @ hbase ---
> [INFO] Reading assembly descriptor: src/assembly/all.xml
> [INFO] Copying files to
> /home/jmspaggi/workspace/hbase-0.94/target/hbase-0.94.6-SNAPSHOT
>
> My CPUs are not loaded at all (1.44/8 load5), CPUWIO is almost 0 too,
> and disks are almost not working.
>
> I have started the build with mvn clean site install assembly:assembly
> -DskipTests -Prelease.
>
> Is that really spending all this time copŷing files? I will move the
> build to an SSD drive and retry, but is there anyway to reduce the
> build time?
>
> Thanks,
>
> JM
>
--
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)
-
Re: Build performancesJean-Marc Spaggiari 2013-02-25, 19:09
Hi Andy.
With DEBUG enabled, what seems to be slow is that:
[DEBUG] Adding artifact: org.apache.commons:commons-math:jar:2.1 with
file: /home/jmspaggi/.m2/repository/org/apache/commons/commons-math/2.1/commons-math-2.1.jar
to assembly location: lib/commons-math-2.1.jar.
[DEBUG] Adding file:
/home/jmspaggi/.m2/repository/org/apache/commons/commons-math/2.1/commons-math-2.1.jar
to archive location: hbase-0.94.6-SNAPSHOT/lib/commons-math-2.1.jar
[DEBUG] Adding artifact: commons-net:commons-net:jar:1.4.1 with file:
/home/jmspaggi/.m2/repository/commons-net/commons-net/1.4.1/commons-net-1.4.1.jar
to assembly location: lib/commons-net-1.4.1.jar.
[DEBUG] Adding file:
/home/jmspaggi/.m2/repository/commons-net/commons-net/1.4.1/commons-net-1.4.1.jar
to archive location: hbase-0.94.6-SNAPSHOT/lib/commons-net-1.4.1.jar
About 3 minutes, displaying one line every 1 to 2 seconds.
Then this is taking a lot of time:
[INFO] Copying files to /tmp/hbase-0.94/target/hbase-0.94.6-SNAPSHOT
It's now running for 10 minutes and seems it's doing nothing. This is
what I saw without the debug enabled. I'm building on an SSD drive.
It's only about 250MB. I can even build it in memory if required. But
I don't think it's because of the disk.
JM
2013/2/25 Andrew Purtell <[EMAIL PROTECTED]>:
> If you run Maven with debug logging enabled, do you see it taking ~3
> seconds per dependency jar to decide if it wants to include it in the
> assembly or not?
>
>
>
> On Mon, Feb 25, 2013 at 10:42 AM, Jean-Marc Spaggiari <
> [EMAIL PROTECTED]> wrote:
>
>> Hi,
>>
>> Buliding HBase locally is taking 1h for me:
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] BUILD SUCCESS
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] Total time: 59:36.659s
>> [INFO] Finished at: Mon Feb 25 13:11:36 EST 2013
>> [INFO] Final Memory: 64M/593M
>> [INFO]
>> ------------------------------------------------------------------------
>>
>>
>> But from that our, it seems to be spending most of the time doing that:
>> [INFO] --- maven-assembly-plugin:2.2-beta-5:single (tarball) @ hbase ---
>> [INFO] Reading assembly descriptor: src/assembly/all.xml
>> [INFO] Copying files to
>> /home/jmspaggi/workspace/hbase-0.94/target/hbase-0.94.6-SNAPSHOT
>>
>> My CPUs are not loaded at all (1.44/8 load5), CPUWIO is almost 0 too,
>> and disks are almost not working.
>>
>> I have started the build with mvn clean site install assembly:assembly
>> -DskipTests -Prelease.
>>
>> Is that really spending all this time copŷing files? I will move the
>> build to an SSD drive and retry, but is there anyway to reduce the
>> build time?
>>
>> Thanks,
>>
>> JM
>>
>
>
>
> --
> Best regards,
>
> - Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> (via Tom White)
With DEBUG enabled, what seems to be slow is that:
[DEBUG] Adding artifact: org.apache.commons:commons-math:jar:2.1 with
file: /home/jmspaggi/.m2/repository/org/apache/commons/commons-math/2.1/commons-math-2.1.jar
to assembly location: lib/commons-math-2.1.jar.
[DEBUG] Adding file:
/home/jmspaggi/.m2/repository/org/apache/commons/commons-math/2.1/commons-math-2.1.jar
to archive location: hbase-0.94.6-SNAPSHOT/lib/commons-math-2.1.jar
[DEBUG] Adding artifact: commons-net:commons-net:jar:1.4.1 with file:
/home/jmspaggi/.m2/repository/commons-net/commons-net/1.4.1/commons-net-1.4.1.jar
to assembly location: lib/commons-net-1.4.1.jar.
[DEBUG] Adding file:
/home/jmspaggi/.m2/repository/commons-net/commons-net/1.4.1/commons-net-1.4.1.jar
to archive location: hbase-0.94.6-SNAPSHOT/lib/commons-net-1.4.1.jar
About 3 minutes, displaying one line every 1 to 2 seconds.
Then this is taking a lot of time:
[INFO] Copying files to /tmp/hbase-0.94/target/hbase-0.94.6-SNAPSHOT
It's now running for 10 minutes and seems it's doing nothing. This is
what I saw without the debug enabled. I'm building on an SSD drive.
It's only about 250MB. I can even build it in memory if required. But
I don't think it's because of the disk.
JM
2013/2/25 Andrew Purtell <[EMAIL PROTECTED]>:
> If you run Maven with debug logging enabled, do you see it taking ~3
> seconds per dependency jar to decide if it wants to include it in the
> assembly or not?
>
>
>
> On Mon, Feb 25, 2013 at 10:42 AM, Jean-Marc Spaggiari <
> [EMAIL PROTECTED]> wrote:
>
>> Hi,
>>
>> Buliding HBase locally is taking 1h for me:
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] BUILD SUCCESS
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] Total time: 59:36.659s
>> [INFO] Finished at: Mon Feb 25 13:11:36 EST 2013
>> [INFO] Final Memory: 64M/593M
>> [INFO]
>> ------------------------------------------------------------------------
>>
>>
>> But from that our, it seems to be spending most of the time doing that:
>> [INFO] --- maven-assembly-plugin:2.2-beta-5:single (tarball) @ hbase ---
>> [INFO] Reading assembly descriptor: src/assembly/all.xml
>> [INFO] Copying files to
>> /home/jmspaggi/workspace/hbase-0.94/target/hbase-0.94.6-SNAPSHOT
>>
>> My CPUs are not loaded at all (1.44/8 load5), CPUWIO is almost 0 too,
>> and disks are almost not working.
>>
>> I have started the build with mvn clean site install assembly:assembly
>> -DskipTests -Prelease.
>>
>> Is that really spending all this time copŷing files? I will move the
>> build to an SSD drive and retry, but is there anyway to reduce the
>> build time?
>>
>> Thanks,
>>
>> JM
>>
>
>
>
> --
> Best regards,
>
> - Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet Hein
> (via Tom White)
-
Re: Build performancesStack 2013-02-25, 19:59
Following on from Andrew, does the debug show you anything? (Copying
individual files?)
St.Ack
On Mon, Feb 25, 2013 at 11:09 AM, Jean-Marc Spaggiari <
[EMAIL PROTECTED]> wrote:
> Hi Andy.
>
> With DEBUG enabled, what seems to be slow is that:
> [DEBUG] Adding artifact: org.apache.commons:commons-math:jar:2.1 with
> file:
> /home/jmspaggi/.m2/repository/org/apache/commons/commons-math/2.1/commons-math-2.1.jar
> to assembly location: lib/commons-math-2.1.jar.
> [DEBUG] Adding file:
>
> /home/jmspaggi/.m2/repository/org/apache/commons/commons-math/2.1/commons-math-2.1.jar
> to archive location: hbase-0.94.6-SNAPSHOT/lib/commons-math-2.1.jar
> [DEBUG] Adding artifact: commons-net:commons-net:jar:1.4.1 with file:
>
> /home/jmspaggi/.m2/repository/commons-net/commons-net/1.4.1/commons-net-1.4.1.jar
> to assembly location: lib/commons-net-1.4.1.jar.
> [DEBUG] Adding file:
>
> /home/jmspaggi/.m2/repository/commons-net/commons-net/1.4.1/commons-net-1.4.1.jar
> to archive location: hbase-0.94.6-SNAPSHOT/lib/commons-net-1.4.1.jar
> About 3 minutes, displaying one line every 1 to 2 seconds.
>
> Then this is taking a lot of time:
> [INFO] Copying files to /tmp/hbase-0.94/target/hbase-0.94.6-SNAPSHOT
>
> It's now running for 10 minutes and seems it's doing nothing. This is
> what I saw without the debug enabled. I'm building on an SSD drive.
> It's only about 250MB. I can even build it in memory if required. But
> I don't think it's because of the disk.
>
> JM
>
>
>
> 2013/2/25 Andrew Purtell <[EMAIL PROTECTED]>:
> > If you run Maven with debug logging enabled, do you see it taking ~3
> > seconds per dependency jar to decide if it wants to include it in the
> > assembly or not?
> >
> >
> >
> > On Mon, Feb 25, 2013 at 10:42 AM, Jean-Marc Spaggiari <
> > [EMAIL PROTECTED]> wrote:
> >
> >> Hi,
> >>
> >> Buliding HBase locally is taking 1h for me:
> >> [INFO]
> >> ------------------------------------------------------------------------
> >> [INFO] BUILD SUCCESS
> >> [INFO]
> >> ------------------------------------------------------------------------
> >> [INFO] Total time: 59:36.659s
> >> [INFO] Finished at: Mon Feb 25 13:11:36 EST 2013
> >> [INFO] Final Memory: 64M/593M
> >> [INFO]
> >> ------------------------------------------------------------------------
> >>
> >>
> >> But from that our, it seems to be spending most of the time doing that:
> >> [INFO] --- maven-assembly-plugin:2.2-beta-5:single (tarball) @ hbase ---
> >> [INFO] Reading assembly descriptor: src/assembly/all.xml
> >> [INFO] Copying files to
> >> /home/jmspaggi/workspace/hbase-0.94/target/hbase-0.94.6-SNAPSHOT
> >>
> >> My CPUs are not loaded at all (1.44/8 load5), CPUWIO is almost 0 too,
> >> and disks are almost not working.
> >>
> >> I have started the build with mvn clean site install assembly:assembly
> >> -DskipTests -Prelease.
> >>
> >> Is that really spending all this time copŷing files? I will move the
> >> build to an SSD drive and retry, but is there anyway to reduce the
> >> build time?
> >>
> >> Thanks,
> >>
> >> JM
> >>
> >
> >
> >
> > --
> > Best regards,
> >
> > - Andy
> >
> > Problems worthy of attack prove their worth by hitting back. - Piet Hein
> > (via Tom White)
>
individual files?)
St.Ack
On Mon, Feb 25, 2013 at 11:09 AM, Jean-Marc Spaggiari <
[EMAIL PROTECTED]> wrote:
> Hi Andy.
>
> With DEBUG enabled, what seems to be slow is that:
> [DEBUG] Adding artifact: org.apache.commons:commons-math:jar:2.1 with
> file:
> /home/jmspaggi/.m2/repository/org/apache/commons/commons-math/2.1/commons-math-2.1.jar
> to assembly location: lib/commons-math-2.1.jar.
> [DEBUG] Adding file:
>
> /home/jmspaggi/.m2/repository/org/apache/commons/commons-math/2.1/commons-math-2.1.jar
> to archive location: hbase-0.94.6-SNAPSHOT/lib/commons-math-2.1.jar
> [DEBUG] Adding artifact: commons-net:commons-net:jar:1.4.1 with file:
>
> /home/jmspaggi/.m2/repository/commons-net/commons-net/1.4.1/commons-net-1.4.1.jar
> to assembly location: lib/commons-net-1.4.1.jar.
> [DEBUG] Adding file:
>
> /home/jmspaggi/.m2/repository/commons-net/commons-net/1.4.1/commons-net-1.4.1.jar
> to archive location: hbase-0.94.6-SNAPSHOT/lib/commons-net-1.4.1.jar
> About 3 minutes, displaying one line every 1 to 2 seconds.
>
> Then this is taking a lot of time:
> [INFO] Copying files to /tmp/hbase-0.94/target/hbase-0.94.6-SNAPSHOT
>
> It's now running for 10 minutes and seems it's doing nothing. This is
> what I saw without the debug enabled. I'm building on an SSD drive.
> It's only about 250MB. I can even build it in memory if required. But
> I don't think it's because of the disk.
>
> JM
>
>
>
> 2013/2/25 Andrew Purtell <[EMAIL PROTECTED]>:
> > If you run Maven with debug logging enabled, do you see it taking ~3
> > seconds per dependency jar to decide if it wants to include it in the
> > assembly or not?
> >
> >
> >
> > On Mon, Feb 25, 2013 at 10:42 AM, Jean-Marc Spaggiari <
> > [EMAIL PROTECTED]> wrote:
> >
> >> Hi,
> >>
> >> Buliding HBase locally is taking 1h for me:
> >> [INFO]
> >> ------------------------------------------------------------------------
> >> [INFO] BUILD SUCCESS
> >> [INFO]
> >> ------------------------------------------------------------------------
> >> [INFO] Total time: 59:36.659s
> >> [INFO] Finished at: Mon Feb 25 13:11:36 EST 2013
> >> [INFO] Final Memory: 64M/593M
> >> [INFO]
> >> ------------------------------------------------------------------------
> >>
> >>
> >> But from that our, it seems to be spending most of the time doing that:
> >> [INFO] --- maven-assembly-plugin:2.2-beta-5:single (tarball) @ hbase ---
> >> [INFO] Reading assembly descriptor: src/assembly/all.xml
> >> [INFO] Copying files to
> >> /home/jmspaggi/workspace/hbase-0.94/target/hbase-0.94.6-SNAPSHOT
> >>
> >> My CPUs are not loaded at all (1.44/8 load5), CPUWIO is almost 0 too,
> >> and disks are almost not working.
> >>
> >> I have started the build with mvn clean site install assembly:assembly
> >> -DskipTests -Prelease.
> >>
> >> Is that really spending all this time copŷing files? I will move the
> >> build to an SSD drive and retry, but is there anyway to reduce the
> >> build time?
> >>
> >> Thanks,
> >>
> >> JM
> >>
> >
> >
> >
> > --
> > Best regards,
> >
> > - Andy
> >
> > Problems worthy of attack prove their worth by hitting back. - Piet Hein
> > (via Tom White)
>
-
Re: Build performancesJean-Marc Spaggiari 2013-02-25, 20:09
When it's stuck on "Copying", there is nothing more displayed.
Before that, it's verbose.
[DEBUG] Adding file-set in: /mnt/security to archive location:
hbase-0.94.6-SNAPSHOT/security/
[DEBUG] FileSet[conf/] dir perms: 47777 file perms: 107777
[DEBUG] The archive base directory is 'null'
[DEBUG] NOT reformatting any files in /mnt/conf
[DEBUG] Adding file-set from directory: '/mnt/conf'
assembly output directory is: 'conf/'
[DEBUG] Adding file-set in: /mnt/conf to archive location:
hbase-0.94.6-SNAPSHOT/conf/
[DEBUG] FileSet[bin/] dir perms: 47777 file perms: 107777
[DEBUG] The archive base directory is 'null'
[DEBUG] NOT reformatting any files in /mnt/bin
[DEBUG] Adding file-set from directory: '/mnt/bin'
assembly output directory is: 'bin/'
[DEBUG] Adding file-set in: /mnt/bin to archive location:
hbase-0.94.6-SNAPSHOT/bin/
[DEBUG] FileSet[lib/ruby/] dir perms: 47777 file perms: 107777
[DEBUG] The archive base directory is 'null'
[DEBUG] NOT reformatting any files in /mnt/src/main/ruby
[DEBUG] Adding file-set from directory: '/mnt/src/main/ruby'
assembly output directory is: 'lib/ruby/'
[DEBUG] Adding file-set in: /mnt/src/main/ruby to archive location:
hbase-0.94.6-SNAPSHOT/lib/ruby/
[DEBUG] FileSet[] dir perms: 47777 file perms: 107777
[DEBUG] The archive base directory is 'null'
[DEBUG] NOT reformatting any files in /mnt/target
[DEBUG] Adding file-set from directory: '/mnt/target'
assembly output directory is: ''
[DEBUG] Adding file-set in: /mnt/target to archive location:
hbase-0.94.6-SNAPSHOT/
[DEBUG] FileSet[hbase-webapps/] dir perms: 47777 file perms: 107777
[DEBUG] The archive base directory is 'null'
[DEBUG] NOT reformatting any files in /mnt/target/hbase-webapps
[DEBUG] Adding file-set from directory: '/mnt/target/hbase-webapps'
assembly output directory is: 'hbase-webapps/'
[DEBUG] Adding file-set in: /mnt/target/hbase-webapps to archive
location: hbase-0.94.6-SNAPSHOT/hbase-webapps/
[DEBUG] FileSet[docs/] dir perms: 47777 file perms: 107777
[DEBUG] The archive base directory is 'null'
[DEBUG] NOT reformatting any files in /mnt/target/site
[DEBUG] Adding file-set from directory: '/mnt/target/site'
assembly output directory is: 'docs/'
[DEBUG] Adding file-set in: /mnt/target/site to archive location:
hbase-0.94.6-SNAPSHOT/docs/
[DEBUG] FileSet[sbin/] dir perms: 47777 file perms: 107777
[DEBUG] The archive base directory is 'null'
[DEBUG] NOT reformatting any files in /mnt/src/packages
[DEBUG] Adding file-set from directory: '/mnt/src/packages'
assembly output directory is: 'sbin/'
[DEBUG] Adding file-set in: /mnt/src/packages to archive location:
hbase-0.94.6-SNAPSHOT/sbin/
[INFO] Copying files to /mnt/target/hbase-0.94.6-SNAPSHOT
But now it's stuck again on the last line, not giving more
information. I killed it and I moved everything on tmpfs but it's not
faster. I have nothing else running.
How long should it normaly take?
Entire log are avaiable there: http://www.spaggiari.org/log.txt
JM
2013/2/25 Stack <[EMAIL PROTECTED]>:
> Following on from Andrew, does the debug show you anything? (Copying
> individual files?)
> St.Ack
>
>
> On Mon, Feb 25, 2013 at 11:09 AM, Jean-Marc Spaggiari <
> [EMAIL PROTECTED]> wrote:
>
>> Hi Andy.
>>
>> With DEBUG enabled, what seems to be slow is that:
>> [DEBUG] Adding artifact: org.apache.commons:commons-math:jar:2.1 with
>> file:
>> /home/jmspaggi/.m2/repository/org/apache/commons/commons-math/2.1/commons-math-2.1.jar
>> to assembly location: lib/commons-math-2.1.jar.
>> [DEBUG] Adding file:
>>
>> /home/jmspaggi/.m2/repository/org/apache/commons/commons-math/2.1/commons-math-2.1.jar
>> to archive location: hbase-0.94.6-SNAPSHOT/lib/commons-math-2.1.jar
>> [DEBUG] Adding artifact: commons-net:commons-net:jar:1.4.1 with file:
>>
>> /home/jmspaggi/.m2/repository/commons-net/commons-net/1.4.1/commons-net-1.4.1.jar
>> to assembly location: lib/commons-net-1.4.1.jar.
>> [DEBUG] Adding file:
>>
>> /home/jmspaggi/.m2/repository/commons-net/commons-net/1.4.1/commons-net-1.4.1.jar
Before that, it's verbose.
[DEBUG] Adding file-set in: /mnt/security to archive location:
hbase-0.94.6-SNAPSHOT/security/
[DEBUG] FileSet[conf/] dir perms: 47777 file perms: 107777
[DEBUG] The archive base directory is 'null'
[DEBUG] NOT reformatting any files in /mnt/conf
[DEBUG] Adding file-set from directory: '/mnt/conf'
assembly output directory is: 'conf/'
[DEBUG] Adding file-set in: /mnt/conf to archive location:
hbase-0.94.6-SNAPSHOT/conf/
[DEBUG] FileSet[bin/] dir perms: 47777 file perms: 107777
[DEBUG] The archive base directory is 'null'
[DEBUG] NOT reformatting any files in /mnt/bin
[DEBUG] Adding file-set from directory: '/mnt/bin'
assembly output directory is: 'bin/'
[DEBUG] Adding file-set in: /mnt/bin to archive location:
hbase-0.94.6-SNAPSHOT/bin/
[DEBUG] FileSet[lib/ruby/] dir perms: 47777 file perms: 107777
[DEBUG] The archive base directory is 'null'
[DEBUG] NOT reformatting any files in /mnt/src/main/ruby
[DEBUG] Adding file-set from directory: '/mnt/src/main/ruby'
assembly output directory is: 'lib/ruby/'
[DEBUG] Adding file-set in: /mnt/src/main/ruby to archive location:
hbase-0.94.6-SNAPSHOT/lib/ruby/
[DEBUG] FileSet[] dir perms: 47777 file perms: 107777
[DEBUG] The archive base directory is 'null'
[DEBUG] NOT reformatting any files in /mnt/target
[DEBUG] Adding file-set from directory: '/mnt/target'
assembly output directory is: ''
[DEBUG] Adding file-set in: /mnt/target to archive location:
hbase-0.94.6-SNAPSHOT/
[DEBUG] FileSet[hbase-webapps/] dir perms: 47777 file perms: 107777
[DEBUG] The archive base directory is 'null'
[DEBUG] NOT reformatting any files in /mnt/target/hbase-webapps
[DEBUG] Adding file-set from directory: '/mnt/target/hbase-webapps'
assembly output directory is: 'hbase-webapps/'
[DEBUG] Adding file-set in: /mnt/target/hbase-webapps to archive
location: hbase-0.94.6-SNAPSHOT/hbase-webapps/
[DEBUG] FileSet[docs/] dir perms: 47777 file perms: 107777
[DEBUG] The archive base directory is 'null'
[DEBUG] NOT reformatting any files in /mnt/target/site
[DEBUG] Adding file-set from directory: '/mnt/target/site'
assembly output directory is: 'docs/'
[DEBUG] Adding file-set in: /mnt/target/site to archive location:
hbase-0.94.6-SNAPSHOT/docs/
[DEBUG] FileSet[sbin/] dir perms: 47777 file perms: 107777
[DEBUG] The archive base directory is 'null'
[DEBUG] NOT reformatting any files in /mnt/src/packages
[DEBUG] Adding file-set from directory: '/mnt/src/packages'
assembly output directory is: 'sbin/'
[DEBUG] Adding file-set in: /mnt/src/packages to archive location:
hbase-0.94.6-SNAPSHOT/sbin/
[INFO] Copying files to /mnt/target/hbase-0.94.6-SNAPSHOT
But now it's stuck again on the last line, not giving more
information. I killed it and I moved everything on tmpfs but it's not
faster. I have nothing else running.
How long should it normaly take?
Entire log are avaiable there: http://www.spaggiari.org/log.txt
JM
2013/2/25 Stack <[EMAIL PROTECTED]>:
> Following on from Andrew, does the debug show you anything? (Copying
> individual files?)
> St.Ack
>
>
> On Mon, Feb 25, 2013 at 11:09 AM, Jean-Marc Spaggiari <
> [EMAIL PROTECTED]> wrote:
>
>> Hi Andy.
>>
>> With DEBUG enabled, what seems to be slow is that:
>> [DEBUG] Adding artifact: org.apache.commons:commons-math:jar:2.1 with
>> file:
>> /home/jmspaggi/.m2/repository/org/apache/commons/commons-math/2.1/commons-math-2.1.jar
>> to assembly location: lib/commons-math-2.1.jar.
>> [DEBUG] Adding file:
>>
>> /home/jmspaggi/.m2/repository/org/apache/commons/commons-math/2.1/commons-math-2.1.jar
>> to archive location: hbase-0.94.6-SNAPSHOT/lib/commons-math-2.1.jar
>> [DEBUG] Adding artifact: commons-net:commons-net:jar:1.4.1 with file:
>>
>> /home/jmspaggi/.m2/repository/commons-net/commons-net/1.4.1/commons-net-1.4.1.jar
>> to assembly location: lib/commons-net-1.4.1.jar.
>> [DEBUG] Adding file:
>>
>> /home/jmspaggi/.m2/repository/commons-net/commons-net/1.4.1/commons-net-1.4.1.jar
-
Re: Build performancesStack 2013-02-25, 20:42
Try stracing the process [1]?
St.Ack
1. http://www.cyberciti.biz/tips/linux-strace-command-examples.html
On Mon, Feb 25, 2013 at 12:09 PM, Jean-Marc Spaggiari <
[EMAIL PROTECTED]> wrote:
> When it's stuck on "Copying", there is nothing more displayed.
>
> Before that, it's verbose.
>
> [DEBUG] Adding file-set in: /mnt/security to archive location:
> hbase-0.94.6-SNAPSHOT/security/
> [DEBUG] FileSet[conf/] dir perms: 47777 file perms: 107777
> [DEBUG] The archive base directory is 'null'
> [DEBUG] NOT reformatting any files in /mnt/conf
> [DEBUG] Adding file-set from directory: '/mnt/conf'
> assembly output directory is: 'conf/'
> [DEBUG] Adding file-set in: /mnt/conf to archive location:
> hbase-0.94.6-SNAPSHOT/conf/
> [DEBUG] FileSet[bin/] dir perms: 47777 file perms: 107777
> [DEBUG] The archive base directory is 'null'
> [DEBUG] NOT reformatting any files in /mnt/bin
> [DEBUG] Adding file-set from directory: '/mnt/bin'
> assembly output directory is: 'bin/'
> [DEBUG] Adding file-set in: /mnt/bin to archive location:
> hbase-0.94.6-SNAPSHOT/bin/
> [DEBUG] FileSet[lib/ruby/] dir perms: 47777 file perms: 107777
> [DEBUG] The archive base directory is 'null'
> [DEBUG] NOT reformatting any files in /mnt/src/main/ruby
> [DEBUG] Adding file-set from directory: '/mnt/src/main/ruby'
> assembly output directory is: 'lib/ruby/'
> [DEBUG] Adding file-set in: /mnt/src/main/ruby to archive location:
> hbase-0.94.6-SNAPSHOT/lib/ruby/
> [DEBUG] FileSet[] dir perms: 47777 file perms: 107777
> [DEBUG] The archive base directory is 'null'
> [DEBUG] NOT reformatting any files in /mnt/target
> [DEBUG] Adding file-set from directory: '/mnt/target'
> assembly output directory is: ''
> [DEBUG] Adding file-set in: /mnt/target to archive location:
> hbase-0.94.6-SNAPSHOT/
> [DEBUG] FileSet[hbase-webapps/] dir perms: 47777 file perms: 107777
> [DEBUG] The archive base directory is 'null'
> [DEBUG] NOT reformatting any files in /mnt/target/hbase-webapps
> [DEBUG] Adding file-set from directory: '/mnt/target/hbase-webapps'
> assembly output directory is: 'hbase-webapps/'
> [DEBUG] Adding file-set in: /mnt/target/hbase-webapps to archive
> location: hbase-0.94.6-SNAPSHOT/hbase-webapps/
> [DEBUG] FileSet[docs/] dir perms: 47777 file perms: 107777
> [DEBUG] The archive base directory is 'null'
> [DEBUG] NOT reformatting any files in /mnt/target/site
> [DEBUG] Adding file-set from directory: '/mnt/target/site'
> assembly output directory is: 'docs/'
> [DEBUG] Adding file-set in: /mnt/target/site to archive location:
> hbase-0.94.6-SNAPSHOT/docs/
> [DEBUG] FileSet[sbin/] dir perms: 47777 file perms: 107777
> [DEBUG] The archive base directory is 'null'
> [DEBUG] NOT reformatting any files in /mnt/src/packages
> [DEBUG] Adding file-set from directory: '/mnt/src/packages'
> assembly output directory is: 'sbin/'
> [DEBUG] Adding file-set in: /mnt/src/packages to archive location:
> hbase-0.94.6-SNAPSHOT/sbin/
> [INFO] Copying files to /mnt/target/hbase-0.94.6-SNAPSHOT
>
>
> But now it's stuck again on the last line, not giving more
> information. I killed it and I moved everything on tmpfs but it's not
> faster. I have nothing else running.
>
> How long should it normaly take?
>
> Entire log are avaiable there: http://www.spaggiari.org/log.txt
>
> JM
>
> 2013/2/25 Stack <[EMAIL PROTECTED]>:
> > Following on from Andrew, does the debug show you anything? (Copying
> > individual files?)
> > St.Ack
> >
> >
> > On Mon, Feb 25, 2013 at 11:09 AM, Jean-Marc Spaggiari <
> > [EMAIL PROTECTED]> wrote:
> >
> >> Hi Andy.
> >>
> >> With DEBUG enabled, what seems to be slow is that:
> >> [DEBUG] Adding artifact: org.apache.commons:commons-math:jar:2.1 with
> >> file:
> >>
> /home/jmspaggi/.m2/repository/org/apache/commons/commons-math/2.1/commons-math-2.1.jar
> >> to assembly location: lib/commons-math-2.1.jar.
> >> [DEBUG] Adding file:
> >>
> >>
> /home/jmspaggi/.m2/repository/org/apache/commons/commons-math/2.1/commons-math-2.1.jar
> >> to archive location
St.Ack
1. http://www.cyberciti.biz/tips/linux-strace-command-examples.html
On Mon, Feb 25, 2013 at 12:09 PM, Jean-Marc Spaggiari <
[EMAIL PROTECTED]> wrote:
> When it's stuck on "Copying", there is nothing more displayed.
>
> Before that, it's verbose.
>
> [DEBUG] Adding file-set in: /mnt/security to archive location:
> hbase-0.94.6-SNAPSHOT/security/
> [DEBUG] FileSet[conf/] dir perms: 47777 file perms: 107777
> [DEBUG] The archive base directory is 'null'
> [DEBUG] NOT reformatting any files in /mnt/conf
> [DEBUG] Adding file-set from directory: '/mnt/conf'
> assembly output directory is: 'conf/'
> [DEBUG] Adding file-set in: /mnt/conf to archive location:
> hbase-0.94.6-SNAPSHOT/conf/
> [DEBUG] FileSet[bin/] dir perms: 47777 file perms: 107777
> [DEBUG] The archive base directory is 'null'
> [DEBUG] NOT reformatting any files in /mnt/bin
> [DEBUG] Adding file-set from directory: '/mnt/bin'
> assembly output directory is: 'bin/'
> [DEBUG] Adding file-set in: /mnt/bin to archive location:
> hbase-0.94.6-SNAPSHOT/bin/
> [DEBUG] FileSet[lib/ruby/] dir perms: 47777 file perms: 107777
> [DEBUG] The archive base directory is 'null'
> [DEBUG] NOT reformatting any files in /mnt/src/main/ruby
> [DEBUG] Adding file-set from directory: '/mnt/src/main/ruby'
> assembly output directory is: 'lib/ruby/'
> [DEBUG] Adding file-set in: /mnt/src/main/ruby to archive location:
> hbase-0.94.6-SNAPSHOT/lib/ruby/
> [DEBUG] FileSet[] dir perms: 47777 file perms: 107777
> [DEBUG] The archive base directory is 'null'
> [DEBUG] NOT reformatting any files in /mnt/target
> [DEBUG] Adding file-set from directory: '/mnt/target'
> assembly output directory is: ''
> [DEBUG] Adding file-set in: /mnt/target to archive location:
> hbase-0.94.6-SNAPSHOT/
> [DEBUG] FileSet[hbase-webapps/] dir perms: 47777 file perms: 107777
> [DEBUG] The archive base directory is 'null'
> [DEBUG] NOT reformatting any files in /mnt/target/hbase-webapps
> [DEBUG] Adding file-set from directory: '/mnt/target/hbase-webapps'
> assembly output directory is: 'hbase-webapps/'
> [DEBUG] Adding file-set in: /mnt/target/hbase-webapps to archive
> location: hbase-0.94.6-SNAPSHOT/hbase-webapps/
> [DEBUG] FileSet[docs/] dir perms: 47777 file perms: 107777
> [DEBUG] The archive base directory is 'null'
> [DEBUG] NOT reformatting any files in /mnt/target/site
> [DEBUG] Adding file-set from directory: '/mnt/target/site'
> assembly output directory is: 'docs/'
> [DEBUG] Adding file-set in: /mnt/target/site to archive location:
> hbase-0.94.6-SNAPSHOT/docs/
> [DEBUG] FileSet[sbin/] dir perms: 47777 file perms: 107777
> [DEBUG] The archive base directory is 'null'
> [DEBUG] NOT reformatting any files in /mnt/src/packages
> [DEBUG] Adding file-set from directory: '/mnt/src/packages'
> assembly output directory is: 'sbin/'
> [DEBUG] Adding file-set in: /mnt/src/packages to archive location:
> hbase-0.94.6-SNAPSHOT/sbin/
> [INFO] Copying files to /mnt/target/hbase-0.94.6-SNAPSHOT
>
>
> But now it's stuck again on the last line, not giving more
> information. I killed it and I moved everything on tmpfs but it's not
> faster. I have nothing else running.
>
> How long should it normaly take?
>
> Entire log are avaiable there: http://www.spaggiari.org/log.txt
>
> JM
>
> 2013/2/25 Stack <[EMAIL PROTECTED]>:
> > Following on from Andrew, does the debug show you anything? (Copying
> > individual files?)
> > St.Ack
> >
> >
> > On Mon, Feb 25, 2013 at 11:09 AM, Jean-Marc Spaggiari <
> > [EMAIL PROTECTED]> wrote:
> >
> >> Hi Andy.
> >>
> >> With DEBUG enabled, what seems to be slow is that:
> >> [DEBUG] Adding artifact: org.apache.commons:commons-math:jar:2.1 with
> >> file:
> >>
> /home/jmspaggi/.m2/repository/org/apache/commons/commons-math/2.1/commons-math-2.1.jar
> >> to assembly location: lib/commons-math-2.1.jar.
> >> [DEBUG] Adding file:
> >>
> >>
> /home/jmspaggi/.m2/repository/org/apache/commons/commons-math/2.1/commons-math-2.1.jar
> >> to archive location
-
Re: Build performancesJean-Marc Spaggiari 2013-02-25, 20:54
Hi Stack,
Thanks for pointing to stracing.
However, I fixed my issue...
Initially I was running with that:
Java version: 1.6.0_24, vendor: Sun Microsystems Inc.
Java home: /usr/lib/jvm/java-6-openjdk-amd64/jre
With "export JAVA_HOME=/usr/local/jdk1.7.0_13/":
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 5:37.573s
[INFO] Finished at: Mon Feb 25 15:50:26 EST 2013
[INFO] Final Memory: 62M/3020M
[INFO] ------------------------------------------------------------------------
Less than 6 minutes. 10 times faster!!!!
So I don't really know why it was so slow with the 1.6 OpenJDK, but
it's now running way faster!
Thanks,
JM
2013/2/25 Stack <[EMAIL PROTECTED]>:
> Try stracing the process [1]?
> St.Ack
>
> 1. http://www.cyberciti.biz/tips/linux-strace-command-examples.html
>
>
> On Mon, Feb 25, 2013 at 12:09 PM, Jean-Marc Spaggiari <
> [EMAIL PROTECTED]> wrote:
>
>> When it's stuck on "Copying", there is nothing more displayed.
>>
>> Before that, it's verbose.
>>
>> [DEBUG] Adding file-set in: /mnt/security to archive location:
>> hbase-0.94.6-SNAPSHOT/security/
>> [DEBUG] FileSet[conf/] dir perms: 47777 file perms: 107777
>> [DEBUG] The archive base directory is 'null'
>> [DEBUG] NOT reformatting any files in /mnt/conf
>> [DEBUG] Adding file-set from directory: '/mnt/conf'
>> assembly output directory is: 'conf/'
>> [DEBUG] Adding file-set in: /mnt/conf to archive location:
>> hbase-0.94.6-SNAPSHOT/conf/
>> [DEBUG] FileSet[bin/] dir perms: 47777 file perms: 107777
>> [DEBUG] The archive base directory is 'null'
>> [DEBUG] NOT reformatting any files in /mnt/bin
>> [DEBUG] Adding file-set from directory: '/mnt/bin'
>> assembly output directory is: 'bin/'
>> [DEBUG] Adding file-set in: /mnt/bin to archive location:
>> hbase-0.94.6-SNAPSHOT/bin/
>> [DEBUG] FileSet[lib/ruby/] dir perms: 47777 file perms: 107777
>> [DEBUG] The archive base directory is 'null'
>> [DEBUG] NOT reformatting any files in /mnt/src/main/ruby
>> [DEBUG] Adding file-set from directory: '/mnt/src/main/ruby'
>> assembly output directory is: 'lib/ruby/'
>> [DEBUG] Adding file-set in: /mnt/src/main/ruby to archive location:
>> hbase-0.94.6-SNAPSHOT/lib/ruby/
>> [DEBUG] FileSet[] dir perms: 47777 file perms: 107777
>> [DEBUG] The archive base directory is 'null'
>> [DEBUG] NOT reformatting any files in /mnt/target
>> [DEBUG] Adding file-set from directory: '/mnt/target'
>> assembly output directory is: ''
>> [DEBUG] Adding file-set in: /mnt/target to archive location:
>> hbase-0.94.6-SNAPSHOT/
>> [DEBUG] FileSet[hbase-webapps/] dir perms: 47777 file perms: 107777
>> [DEBUG] The archive base directory is 'null'
>> [DEBUG] NOT reformatting any files in /mnt/target/hbase-webapps
>> [DEBUG] Adding file-set from directory: '/mnt/target/hbase-webapps'
>> assembly output directory is: 'hbase-webapps/'
>> [DEBUG] Adding file-set in: /mnt/target/hbase-webapps to archive
>> location: hbase-0.94.6-SNAPSHOT/hbase-webapps/
>> [DEBUG] FileSet[docs/] dir perms: 47777 file perms: 107777
>> [DEBUG] The archive base directory is 'null'
>> [DEBUG] NOT reformatting any files in /mnt/target/site
>> [DEBUG] Adding file-set from directory: '/mnt/target/site'
>> assembly output directory is: 'docs/'
>> [DEBUG] Adding file-set in: /mnt/target/site to archive location:
>> hbase-0.94.6-SNAPSHOT/docs/
>> [DEBUG] FileSet[sbin/] dir perms: 47777 file perms: 107777
>> [DEBUG] The archive base directory is 'null'
>> [DEBUG] NOT reformatting any files in /mnt/src/packages
>> [DEBUG] Adding file-set from directory: '/mnt/src/packages'
>> assembly output directory is: 'sbin/'
>> [DEBUG] Adding file-set in: /mnt/src/packages to archive location:
>> hbase-0.94.6-SNAPSHOT/sbin/
>> [INFO] Copying files to /mnt/target/hbase-0.94.6-SNAPSHOT
>>
>>
>> But now it's stuck again on the last line, not giving more
>> information. I killed it and I moved everything on tmpfs but it's not
Thanks for pointing to stracing.
However, I fixed my issue...
Initially I was running with that:
Java version: 1.6.0_24, vendor: Sun Microsystems Inc.
Java home: /usr/lib/jvm/java-6-openjdk-amd64/jre
With "export JAVA_HOME=/usr/local/jdk1.7.0_13/":
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 5:37.573s
[INFO] Finished at: Mon Feb 25 15:50:26 EST 2013
[INFO] Final Memory: 62M/3020M
[INFO] ------------------------------------------------------------------------
Less than 6 minutes. 10 times faster!!!!
So I don't really know why it was so slow with the 1.6 OpenJDK, but
it's now running way faster!
Thanks,
JM
2013/2/25 Stack <[EMAIL PROTECTED]>:
> Try stracing the process [1]?
> St.Ack
>
> 1. http://www.cyberciti.biz/tips/linux-strace-command-examples.html
>
>
> On Mon, Feb 25, 2013 at 12:09 PM, Jean-Marc Spaggiari <
> [EMAIL PROTECTED]> wrote:
>
>> When it's stuck on "Copying", there is nothing more displayed.
>>
>> Before that, it's verbose.
>>
>> [DEBUG] Adding file-set in: /mnt/security to archive location:
>> hbase-0.94.6-SNAPSHOT/security/
>> [DEBUG] FileSet[conf/] dir perms: 47777 file perms: 107777
>> [DEBUG] The archive base directory is 'null'
>> [DEBUG] NOT reformatting any files in /mnt/conf
>> [DEBUG] Adding file-set from directory: '/mnt/conf'
>> assembly output directory is: 'conf/'
>> [DEBUG] Adding file-set in: /mnt/conf to archive location:
>> hbase-0.94.6-SNAPSHOT/conf/
>> [DEBUG] FileSet[bin/] dir perms: 47777 file perms: 107777
>> [DEBUG] The archive base directory is 'null'
>> [DEBUG] NOT reformatting any files in /mnt/bin
>> [DEBUG] Adding file-set from directory: '/mnt/bin'
>> assembly output directory is: 'bin/'
>> [DEBUG] Adding file-set in: /mnt/bin to archive location:
>> hbase-0.94.6-SNAPSHOT/bin/
>> [DEBUG] FileSet[lib/ruby/] dir perms: 47777 file perms: 107777
>> [DEBUG] The archive base directory is 'null'
>> [DEBUG] NOT reformatting any files in /mnt/src/main/ruby
>> [DEBUG] Adding file-set from directory: '/mnt/src/main/ruby'
>> assembly output directory is: 'lib/ruby/'
>> [DEBUG] Adding file-set in: /mnt/src/main/ruby to archive location:
>> hbase-0.94.6-SNAPSHOT/lib/ruby/
>> [DEBUG] FileSet[] dir perms: 47777 file perms: 107777
>> [DEBUG] The archive base directory is 'null'
>> [DEBUG] NOT reformatting any files in /mnt/target
>> [DEBUG] Adding file-set from directory: '/mnt/target'
>> assembly output directory is: ''
>> [DEBUG] Adding file-set in: /mnt/target to archive location:
>> hbase-0.94.6-SNAPSHOT/
>> [DEBUG] FileSet[hbase-webapps/] dir perms: 47777 file perms: 107777
>> [DEBUG] The archive base directory is 'null'
>> [DEBUG] NOT reformatting any files in /mnt/target/hbase-webapps
>> [DEBUG] Adding file-set from directory: '/mnt/target/hbase-webapps'
>> assembly output directory is: 'hbase-webapps/'
>> [DEBUG] Adding file-set in: /mnt/target/hbase-webapps to archive
>> location: hbase-0.94.6-SNAPSHOT/hbase-webapps/
>> [DEBUG] FileSet[docs/] dir perms: 47777 file perms: 107777
>> [DEBUG] The archive base directory is 'null'
>> [DEBUG] NOT reformatting any files in /mnt/target/site
>> [DEBUG] Adding file-set from directory: '/mnt/target/site'
>> assembly output directory is: 'docs/'
>> [DEBUG] Adding file-set in: /mnt/target/site to archive location:
>> hbase-0.94.6-SNAPSHOT/docs/
>> [DEBUG] FileSet[sbin/] dir perms: 47777 file perms: 107777
>> [DEBUG] The archive base directory is 'null'
>> [DEBUG] NOT reformatting any files in /mnt/src/packages
>> [DEBUG] Adding file-set from directory: '/mnt/src/packages'
>> assembly output directory is: 'sbin/'
>> [DEBUG] Adding file-set in: /mnt/src/packages to archive location:
>> hbase-0.94.6-SNAPSHOT/sbin/
>> [INFO] Copying files to /mnt/target/hbase-0.94.6-SNAPSHOT
>>
>>
>> But now it's stuck again on the last line, not giving more
>> information. I killed it and I moved everything on tmpfs but it's not
-
Re: Build performancesStack 2013-02-26, 00:10
Does hbase work on openjdk?
St.Ack
On Mon, Feb 25, 2013 at 12:54 PM, Jean-Marc Spaggiari <
[EMAIL PROTECTED]> wrote:
> Hi Stack,
>
> Thanks for pointing to stracing.
>
> However, I fixed my issue...
>
> Initially I was running with that:
> Java version: 1.6.0_24, vendor: Sun Microsystems Inc.
> Java home: /usr/lib/jvm/java-6-openjdk-amd64/jre
>
>
> With "export JAVA_HOME=/usr/local/jdk1.7.0_13/":
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD SUCCESS
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 5:37.573s
> [INFO] Finished at: Mon Feb 25 15:50:26 EST 2013
> [INFO] Final Memory: 62M/3020M
> [INFO]
> ------------------------------------------------------------------------
>
> Less than 6 minutes. 10 times faster!!!!
>
> So I don't really know why it was so slow with the 1.6 OpenJDK, but
> it's now running way faster!
>
> Thanks,
>
> JM
>
> 2013/2/25 Stack <[EMAIL PROTECTED]>:
> > Try stracing the process [1]?
> > St.Ack
> >
> > 1. http://www.cyberciti.biz/tips/linux-strace-command-examples.html
> >
> >
> > On Mon, Feb 25, 2013 at 12:09 PM, Jean-Marc Spaggiari <
> > [EMAIL PROTECTED]> wrote:
> >
> >> When it's stuck on "Copying", there is nothing more displayed.
> >>
> >> Before that, it's verbose.
> >>
> >> [DEBUG] Adding file-set in: /mnt/security to archive location:
> >> hbase-0.94.6-SNAPSHOT/security/
> >> [DEBUG] FileSet[conf/] dir perms: 47777 file perms: 107777
> >> [DEBUG] The archive base directory is 'null'
> >> [DEBUG] NOT reformatting any files in /mnt/conf
> >> [DEBUG] Adding file-set from directory: '/mnt/conf'
> >> assembly output directory is: 'conf/'
> >> [DEBUG] Adding file-set in: /mnt/conf to archive location:
> >> hbase-0.94.6-SNAPSHOT/conf/
> >> [DEBUG] FileSet[bin/] dir perms: 47777 file perms: 107777
> >> [DEBUG] The archive base directory is 'null'
> >> [DEBUG] NOT reformatting any files in /mnt/bin
> >> [DEBUG] Adding file-set from directory: '/mnt/bin'
> >> assembly output directory is: 'bin/'
> >> [DEBUG] Adding file-set in: /mnt/bin to archive location:
> >> hbase-0.94.6-SNAPSHOT/bin/
> >> [DEBUG] FileSet[lib/ruby/] dir perms: 47777 file perms: 107777
> >> [DEBUG] The archive base directory is 'null'
> >> [DEBUG] NOT reformatting any files in /mnt/src/main/ruby
> >> [DEBUG] Adding file-set from directory: '/mnt/src/main/ruby'
> >> assembly output directory is: 'lib/ruby/'
> >> [DEBUG] Adding file-set in: /mnt/src/main/ruby to archive location:
> >> hbase-0.94.6-SNAPSHOT/lib/ruby/
> >> [DEBUG] FileSet[] dir perms: 47777 file perms: 107777
> >> [DEBUG] The archive base directory is 'null'
> >> [DEBUG] NOT reformatting any files in /mnt/target
> >> [DEBUG] Adding file-set from directory: '/mnt/target'
> >> assembly output directory is: ''
> >> [DEBUG] Adding file-set in: /mnt/target to archive location:
> >> hbase-0.94.6-SNAPSHOT/
> >> [DEBUG] FileSet[hbase-webapps/] dir perms: 47777 file perms: 107777
> >> [DEBUG] The archive base directory is 'null'
> >> [DEBUG] NOT reformatting any files in /mnt/target/hbase-webapps
> >> [DEBUG] Adding file-set from directory: '/mnt/target/hbase-webapps'
> >> assembly output directory is: 'hbase-webapps/'
> >> [DEBUG] Adding file-set in: /mnt/target/hbase-webapps to archive
> >> location: hbase-0.94.6-SNAPSHOT/hbase-webapps/
> >> [DEBUG] FileSet[docs/] dir perms: 47777 file perms: 107777
> >> [DEBUG] The archive base directory is 'null'
> >> [DEBUG] NOT reformatting any files in /mnt/target/site
> >> [DEBUG] Adding file-set from directory: '/mnt/target/site'
> >> assembly output directory is: 'docs/'
> >> [DEBUG] Adding file-set in: /mnt/target/site to archive location:
> >> hbase-0.94.6-SNAPSHOT/docs/
> >> [DEBUG] FileSet[sbin/] dir perms: 47777 file perms: 107777
> >> [DEBUG] The archive base directory is 'null'
> >> [DEBUG] NOT reformatting any files in /mnt/src/packages
> >> [DEBUG] Adding file-set from directory: '/mnt/src/packages'
> >> assembly output directory is: 'sbin/'
St.Ack
On Mon, Feb 25, 2013 at 12:54 PM, Jean-Marc Spaggiari <
[EMAIL PROTECTED]> wrote:
> Hi Stack,
>
> Thanks for pointing to stracing.
>
> However, I fixed my issue...
>
> Initially I was running with that:
> Java version: 1.6.0_24, vendor: Sun Microsystems Inc.
> Java home: /usr/lib/jvm/java-6-openjdk-amd64/jre
>
>
> With "export JAVA_HOME=/usr/local/jdk1.7.0_13/":
> [INFO]
> ------------------------------------------------------------------------
> [INFO] BUILD SUCCESS
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 5:37.573s
> [INFO] Finished at: Mon Feb 25 15:50:26 EST 2013
> [INFO] Final Memory: 62M/3020M
> [INFO]
> ------------------------------------------------------------------------
>
> Less than 6 minutes. 10 times faster!!!!
>
> So I don't really know why it was so slow with the 1.6 OpenJDK, but
> it's now running way faster!
>
> Thanks,
>
> JM
>
> 2013/2/25 Stack <[EMAIL PROTECTED]>:
> > Try stracing the process [1]?
> > St.Ack
> >
> > 1. http://www.cyberciti.biz/tips/linux-strace-command-examples.html
> >
> >
> > On Mon, Feb 25, 2013 at 12:09 PM, Jean-Marc Spaggiari <
> > [EMAIL PROTECTED]> wrote:
> >
> >> When it's stuck on "Copying", there is nothing more displayed.
> >>
> >> Before that, it's verbose.
> >>
> >> [DEBUG] Adding file-set in: /mnt/security to archive location:
> >> hbase-0.94.6-SNAPSHOT/security/
> >> [DEBUG] FileSet[conf/] dir perms: 47777 file perms: 107777
> >> [DEBUG] The archive base directory is 'null'
> >> [DEBUG] NOT reformatting any files in /mnt/conf
> >> [DEBUG] Adding file-set from directory: '/mnt/conf'
> >> assembly output directory is: 'conf/'
> >> [DEBUG] Adding file-set in: /mnt/conf to archive location:
> >> hbase-0.94.6-SNAPSHOT/conf/
> >> [DEBUG] FileSet[bin/] dir perms: 47777 file perms: 107777
> >> [DEBUG] The archive base directory is 'null'
> >> [DEBUG] NOT reformatting any files in /mnt/bin
> >> [DEBUG] Adding file-set from directory: '/mnt/bin'
> >> assembly output directory is: 'bin/'
> >> [DEBUG] Adding file-set in: /mnt/bin to archive location:
> >> hbase-0.94.6-SNAPSHOT/bin/
> >> [DEBUG] FileSet[lib/ruby/] dir perms: 47777 file perms: 107777
> >> [DEBUG] The archive base directory is 'null'
> >> [DEBUG] NOT reformatting any files in /mnt/src/main/ruby
> >> [DEBUG] Adding file-set from directory: '/mnt/src/main/ruby'
> >> assembly output directory is: 'lib/ruby/'
> >> [DEBUG] Adding file-set in: /mnt/src/main/ruby to archive location:
> >> hbase-0.94.6-SNAPSHOT/lib/ruby/
> >> [DEBUG] FileSet[] dir perms: 47777 file perms: 107777
> >> [DEBUG] The archive base directory is 'null'
> >> [DEBUG] NOT reformatting any files in /mnt/target
> >> [DEBUG] Adding file-set from directory: '/mnt/target'
> >> assembly output directory is: ''
> >> [DEBUG] Adding file-set in: /mnt/target to archive location:
> >> hbase-0.94.6-SNAPSHOT/
> >> [DEBUG] FileSet[hbase-webapps/] dir perms: 47777 file perms: 107777
> >> [DEBUG] The archive base directory is 'null'
> >> [DEBUG] NOT reformatting any files in /mnt/target/hbase-webapps
> >> [DEBUG] Adding file-set from directory: '/mnt/target/hbase-webapps'
> >> assembly output directory is: 'hbase-webapps/'
> >> [DEBUG] Adding file-set in: /mnt/target/hbase-webapps to archive
> >> location: hbase-0.94.6-SNAPSHOT/hbase-webapps/
> >> [DEBUG] FileSet[docs/] dir perms: 47777 file perms: 107777
> >> [DEBUG] The archive base directory is 'null'
> >> [DEBUG] NOT reformatting any files in /mnt/target/site
> >> [DEBUG] Adding file-set from directory: '/mnt/target/site'
> >> assembly output directory is: 'docs/'
> >> [DEBUG] Adding file-set in: /mnt/target/site to archive location:
> >> hbase-0.94.6-SNAPSHOT/docs/
> >> [DEBUG] FileSet[sbin/] dir perms: 47777 file perms: 107777
> >> [DEBUG] The archive base directory is 'null'
> >> [DEBUG] NOT reformatting any files in /mnt/src/packages
> >> [DEBUG] Adding file-set from directory: '/mnt/src/packages'
> >> assembly output directory is: 'sbin/'
-
Re: Build performancesJean-Marc Spaggiari 2013-02-26, 02:22
Hi Stack,
When I'm testing locally with VMs I'm using openJDK for the standalone
mode so I don't have to install any additionnal JVM. And it's working
for my needs. I have not faced any issue so far.
I just started the entire test suite with OpenJDK1.7. I will keep you posted.
JM
2013/2/25 Stack <[EMAIL PROTECTED]>:
> Does hbase work on openjdk?
> St.Ack
>
>
> On Mon, Feb 25, 2013 at 12:54 PM, Jean-Marc Spaggiari <
> [EMAIL PROTECTED]> wrote:
>
>> Hi Stack,
>>
>> Thanks for pointing to stracing.
>>
>> However, I fixed my issue...
>>
>> Initially I was running with that:
>> Java version: 1.6.0_24, vendor: Sun Microsystems Inc.
>> Java home: /usr/lib/jvm/java-6-openjdk-amd64/jre
>>
>>
>> With "export JAVA_HOME=/usr/local/jdk1.7.0_13/":
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] BUILD SUCCESS
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] Total time: 5:37.573s
>> [INFO] Finished at: Mon Feb 25 15:50:26 EST 2013
>> [INFO] Final Memory: 62M/3020M
>> [INFO]
>> ------------------------------------------------------------------------
>>
>> Less than 6 minutes. 10 times faster!!!!
>>
>> So I don't really know why it was so slow with the 1.6 OpenJDK, but
>> it's now running way faster!
>>
>> Thanks,
>>
>> JM
>>
>> 2013/2/25 Stack <[EMAIL PROTECTED]>:
>> > Try stracing the process [1]?
>> > St.Ack
>> >
>> > 1. http://www.cyberciti.biz/tips/linux-strace-command-examples.html
>> >
>> >
>> > On Mon, Feb 25, 2013 at 12:09 PM, Jean-Marc Spaggiari <
>> > [EMAIL PROTECTED]> wrote:
>> >
>> >> When it's stuck on "Copying", there is nothing more displayed.
>> >>
>> >> Before that, it's verbose.
>> >>
>> >> [DEBUG] Adding file-set in: /mnt/security to archive location:
>> >> hbase-0.94.6-SNAPSHOT/security/
>> >> [DEBUG] FileSet[conf/] dir perms: 47777 file perms: 107777
>> >> [DEBUG] The archive base directory is 'null'
>> >> [DEBUG] NOT reformatting any files in /mnt/conf
>> >> [DEBUG] Adding file-set from directory: '/mnt/conf'
>> >> assembly output directory is: 'conf/'
>> >> [DEBUG] Adding file-set in: /mnt/conf to archive location:
>> >> hbase-0.94.6-SNAPSHOT/conf/
>> >> [DEBUG] FileSet[bin/] dir perms: 47777 file perms: 107777
>> >> [DEBUG] The archive base directory is 'null'
>> >> [DEBUG] NOT reformatting any files in /mnt/bin
>> >> [DEBUG] Adding file-set from directory: '/mnt/bin'
>> >> assembly output directory is: 'bin/'
>> >> [DEBUG] Adding file-set in: /mnt/bin to archive location:
>> >> hbase-0.94.6-SNAPSHOT/bin/
>> >> [DEBUG] FileSet[lib/ruby/] dir perms: 47777 file perms: 107777
>> >> [DEBUG] The archive base directory is 'null'
>> >> [DEBUG] NOT reformatting any files in /mnt/src/main/ruby
>> >> [DEBUG] Adding file-set from directory: '/mnt/src/main/ruby'
>> >> assembly output directory is: 'lib/ruby/'
>> >> [DEBUG] Adding file-set in: /mnt/src/main/ruby to archive location:
>> >> hbase-0.94.6-SNAPSHOT/lib/ruby/
>> >> [DEBUG] FileSet[] dir perms: 47777 file perms: 107777
>> >> [DEBUG] The archive base directory is 'null'
>> >> [DEBUG] NOT reformatting any files in /mnt/target
>> >> [DEBUG] Adding file-set from directory: '/mnt/target'
>> >> assembly output directory is: ''
>> >> [DEBUG] Adding file-set in: /mnt/target to archive location:
>> >> hbase-0.94.6-SNAPSHOT/
>> >> [DEBUG] FileSet[hbase-webapps/] dir perms: 47777 file perms: 107777
>> >> [DEBUG] The archive base directory is 'null'
>> >> [DEBUG] NOT reformatting any files in /mnt/target/hbase-webapps
>> >> [DEBUG] Adding file-set from directory: '/mnt/target/hbase-webapps'
>> >> assembly output directory is: 'hbase-webapps/'
>> >> [DEBUG] Adding file-set in: /mnt/target/hbase-webapps to archive
>> >> location: hbase-0.94.6-SNAPSHOT/hbase-webapps/
>> >> [DEBUG] FileSet[docs/] dir perms: 47777 file perms: 107777
>> >> [DEBUG] The archive base directory is 'null'
>> >> [DEBUG] NOT reformatting any files in /mnt/target/site
>> >> [DEBUG] Adding file-set from directory: '/mnt/target/site'
When I'm testing locally with VMs I'm using openJDK for the standalone
mode so I don't have to install any additionnal JVM. And it's working
for my needs. I have not faced any issue so far.
I just started the entire test suite with OpenJDK1.7. I will keep you posted.
JM
2013/2/25 Stack <[EMAIL PROTECTED]>:
> Does hbase work on openjdk?
> St.Ack
>
>
> On Mon, Feb 25, 2013 at 12:54 PM, Jean-Marc Spaggiari <
> [EMAIL PROTECTED]> wrote:
>
>> Hi Stack,
>>
>> Thanks for pointing to stracing.
>>
>> However, I fixed my issue...
>>
>> Initially I was running with that:
>> Java version: 1.6.0_24, vendor: Sun Microsystems Inc.
>> Java home: /usr/lib/jvm/java-6-openjdk-amd64/jre
>>
>>
>> With "export JAVA_HOME=/usr/local/jdk1.7.0_13/":
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] BUILD SUCCESS
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] Total time: 5:37.573s
>> [INFO] Finished at: Mon Feb 25 15:50:26 EST 2013
>> [INFO] Final Memory: 62M/3020M
>> [INFO]
>> ------------------------------------------------------------------------
>>
>> Less than 6 minutes. 10 times faster!!!!
>>
>> So I don't really know why it was so slow with the 1.6 OpenJDK, but
>> it's now running way faster!
>>
>> Thanks,
>>
>> JM
>>
>> 2013/2/25 Stack <[EMAIL PROTECTED]>:
>> > Try stracing the process [1]?
>> > St.Ack
>> >
>> > 1. http://www.cyberciti.biz/tips/linux-strace-command-examples.html
>> >
>> >
>> > On Mon, Feb 25, 2013 at 12:09 PM, Jean-Marc Spaggiari <
>> > [EMAIL PROTECTED]> wrote:
>> >
>> >> When it's stuck on "Copying", there is nothing more displayed.
>> >>
>> >> Before that, it's verbose.
>> >>
>> >> [DEBUG] Adding file-set in: /mnt/security to archive location:
>> >> hbase-0.94.6-SNAPSHOT/security/
>> >> [DEBUG] FileSet[conf/] dir perms: 47777 file perms: 107777
>> >> [DEBUG] The archive base directory is 'null'
>> >> [DEBUG] NOT reformatting any files in /mnt/conf
>> >> [DEBUG] Adding file-set from directory: '/mnt/conf'
>> >> assembly output directory is: 'conf/'
>> >> [DEBUG] Adding file-set in: /mnt/conf to archive location:
>> >> hbase-0.94.6-SNAPSHOT/conf/
>> >> [DEBUG] FileSet[bin/] dir perms: 47777 file perms: 107777
>> >> [DEBUG] The archive base directory is 'null'
>> >> [DEBUG] NOT reformatting any files in /mnt/bin
>> >> [DEBUG] Adding file-set from directory: '/mnt/bin'
>> >> assembly output directory is: 'bin/'
>> >> [DEBUG] Adding file-set in: /mnt/bin to archive location:
>> >> hbase-0.94.6-SNAPSHOT/bin/
>> >> [DEBUG] FileSet[lib/ruby/] dir perms: 47777 file perms: 107777
>> >> [DEBUG] The archive base directory is 'null'
>> >> [DEBUG] NOT reformatting any files in /mnt/src/main/ruby
>> >> [DEBUG] Adding file-set from directory: '/mnt/src/main/ruby'
>> >> assembly output directory is: 'lib/ruby/'
>> >> [DEBUG] Adding file-set in: /mnt/src/main/ruby to archive location:
>> >> hbase-0.94.6-SNAPSHOT/lib/ruby/
>> >> [DEBUG] FileSet[] dir perms: 47777 file perms: 107777
>> >> [DEBUG] The archive base directory is 'null'
>> >> [DEBUG] NOT reformatting any files in /mnt/target
>> >> [DEBUG] Adding file-set from directory: '/mnt/target'
>> >> assembly output directory is: ''
>> >> [DEBUG] Adding file-set in: /mnt/target to archive location:
>> >> hbase-0.94.6-SNAPSHOT/
>> >> [DEBUG] FileSet[hbase-webapps/] dir perms: 47777 file perms: 107777
>> >> [DEBUG] The archive base directory is 'null'
>> >> [DEBUG] NOT reformatting any files in /mnt/target/hbase-webapps
>> >> [DEBUG] Adding file-set from directory: '/mnt/target/hbase-webapps'
>> >> assembly output directory is: 'hbase-webapps/'
>> >> [DEBUG] Adding file-set in: /mnt/target/hbase-webapps to archive
>> >> location: hbase-0.94.6-SNAPSHOT/hbase-webapps/
>> >> [DEBUG] FileSet[docs/] dir perms: 47777 file perms: 107777
>> >> [DEBUG] The archive base directory is 'null'
>> >> [DEBUG] NOT reformatting any files in /mnt/target/site
>> >> [DEBUG] Adding file-set from directory: '/mnt/target/site'
-
Re: Build performancesJean-Marc Spaggiari 2013-02-26, 13:36
Hi Stack,
3 tests failed and 1271 passed.
So it seems to be pretty stable with openJDK1.7.
I retried and got only 2 failed.
In both cases testDeleteEditUnknownColumnFamilyAndOrTable was on the list.
I'm retrying another time, but for small tests, I will say that open
JDK is stable enought.
JM
2013/2/25 Jean-Marc Spaggiari <[EMAIL PROTECTED]>:
> Hi Stack,
>
> When I'm testing locally with VMs I'm using openJDK for the standalone
> mode so I don't have to install any additionnal JVM. And it's working
> for my needs. I have not faced any issue so far.
>
> I just started the entire test suite with OpenJDK1.7. I will keep you posted.
>
> JM
>
> 2013/2/25 Stack <[EMAIL PROTECTED]>:
>> Does hbase work on openjdk?
>> St.Ack
>>
>>
>> On Mon, Feb 25, 2013 at 12:54 PM, Jean-Marc Spaggiari <
>> [EMAIL PROTECTED]> wrote:
>>
>>> Hi Stack,
>>>
>>> Thanks for pointing to stracing.
>>>
>>> However, I fixed my issue...
>>>
>>> Initially I was running with that:
>>> Java version: 1.6.0_24, vendor: Sun Microsystems Inc.
>>> Java home: /usr/lib/jvm/java-6-openjdk-amd64/jre
>>>
>>>
>>> With "export JAVA_HOME=/usr/local/jdk1.7.0_13/":
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] BUILD SUCCESS
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] Total time: 5:37.573s
>>> [INFO] Finished at: Mon Feb 25 15:50:26 EST 2013
>>> [INFO] Final Memory: 62M/3020M
>>> [INFO]
>>> ------------------------------------------------------------------------
>>>
>>> Less than 6 minutes. 10 times faster!!!!
>>>
>>> So I don't really know why it was so slow with the 1.6 OpenJDK, but
>>> it's now running way faster!
>>>
>>> Thanks,
>>>
>>> JM
>>>
>>> 2013/2/25 Stack <[EMAIL PROTECTED]>:
>>> > Try stracing the process [1]?
>>> > St.Ack
>>> >
>>> > 1. http://www.cyberciti.biz/tips/linux-strace-command-examples.html
>>> >
>>> >
>>> > On Mon, Feb 25, 2013 at 12:09 PM, Jean-Marc Spaggiari <
>>> > [EMAIL PROTECTED]> wrote:
>>> >
>>> >> When it's stuck on "Copying", there is nothing more displayed.
>>> >>
>>> >> Before that, it's verbose.
>>> >>
>>> >> [DEBUG] Adding file-set in: /mnt/security to archive location:
>>> >> hbase-0.94.6-SNAPSHOT/security/
>>> >> [DEBUG] FileSet[conf/] dir perms: 47777 file perms: 107777
>>> >> [DEBUG] The archive base directory is 'null'
>>> >> [DEBUG] NOT reformatting any files in /mnt/conf
>>> >> [DEBUG] Adding file-set from directory: '/mnt/conf'
>>> >> assembly output directory is: 'conf/'
>>> >> [DEBUG] Adding file-set in: /mnt/conf to archive location:
>>> >> hbase-0.94.6-SNAPSHOT/conf/
>>> >> [DEBUG] FileSet[bin/] dir perms: 47777 file perms: 107777
>>> >> [DEBUG] The archive base directory is 'null'
>>> >> [DEBUG] NOT reformatting any files in /mnt/bin
>>> >> [DEBUG] Adding file-set from directory: '/mnt/bin'
>>> >> assembly output directory is: 'bin/'
>>> >> [DEBUG] Adding file-set in: /mnt/bin to archive location:
>>> >> hbase-0.94.6-SNAPSHOT/bin/
>>> >> [DEBUG] FileSet[lib/ruby/] dir perms: 47777 file perms: 107777
>>> >> [DEBUG] The archive base directory is 'null'
>>> >> [DEBUG] NOT reformatting any files in /mnt/src/main/ruby
>>> >> [DEBUG] Adding file-set from directory: '/mnt/src/main/ruby'
>>> >> assembly output directory is: 'lib/ruby/'
>>> >> [DEBUG] Adding file-set in: /mnt/src/main/ruby to archive location:
>>> >> hbase-0.94.6-SNAPSHOT/lib/ruby/
>>> >> [DEBUG] FileSet[] dir perms: 47777 file perms: 107777
>>> >> [DEBUG] The archive base directory is 'null'
>>> >> [DEBUG] NOT reformatting any files in /mnt/target
>>> >> [DEBUG] Adding file-set from directory: '/mnt/target'
>>> >> assembly output directory is: ''
>>> >> [DEBUG] Adding file-set in: /mnt/target to archive location:
>>> >> hbase-0.94.6-SNAPSHOT/
>>> >> [DEBUG] FileSet[hbase-webapps/] dir perms: 47777 file perms: 107777
>>> >> [DEBUG] The archive base directory is 'null'
>>> >> [DEBUG] NOT reformatting any files in /mnt/target/hbase-webapps
>>>
3 tests failed and 1271 passed.
So it seems to be pretty stable with openJDK1.7.
I retried and got only 2 failed.
In both cases testDeleteEditUnknownColumnFamilyAndOrTable was on the list.
I'm retrying another time, but for small tests, I will say that open
JDK is stable enought.
JM
2013/2/25 Jean-Marc Spaggiari <[EMAIL PROTECTED]>:
> Hi Stack,
>
> When I'm testing locally with VMs I'm using openJDK for the standalone
> mode so I don't have to install any additionnal JVM. And it's working
> for my needs. I have not faced any issue so far.
>
> I just started the entire test suite with OpenJDK1.7. I will keep you posted.
>
> JM
>
> 2013/2/25 Stack <[EMAIL PROTECTED]>:
>> Does hbase work on openjdk?
>> St.Ack
>>
>>
>> On Mon, Feb 25, 2013 at 12:54 PM, Jean-Marc Spaggiari <
>> [EMAIL PROTECTED]> wrote:
>>
>>> Hi Stack,
>>>
>>> Thanks for pointing to stracing.
>>>
>>> However, I fixed my issue...
>>>
>>> Initially I was running with that:
>>> Java version: 1.6.0_24, vendor: Sun Microsystems Inc.
>>> Java home: /usr/lib/jvm/java-6-openjdk-amd64/jre
>>>
>>>
>>> With "export JAVA_HOME=/usr/local/jdk1.7.0_13/":
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] BUILD SUCCESS
>>> [INFO]
>>> ------------------------------------------------------------------------
>>> [INFO] Total time: 5:37.573s
>>> [INFO] Finished at: Mon Feb 25 15:50:26 EST 2013
>>> [INFO] Final Memory: 62M/3020M
>>> [INFO]
>>> ------------------------------------------------------------------------
>>>
>>> Less than 6 minutes. 10 times faster!!!!
>>>
>>> So I don't really know why it was so slow with the 1.6 OpenJDK, but
>>> it's now running way faster!
>>>
>>> Thanks,
>>>
>>> JM
>>>
>>> 2013/2/25 Stack <[EMAIL PROTECTED]>:
>>> > Try stracing the process [1]?
>>> > St.Ack
>>> >
>>> > 1. http://www.cyberciti.biz/tips/linux-strace-command-examples.html
>>> >
>>> >
>>> > On Mon, Feb 25, 2013 at 12:09 PM, Jean-Marc Spaggiari <
>>> > [EMAIL PROTECTED]> wrote:
>>> >
>>> >> When it's stuck on "Copying", there is nothing more displayed.
>>> >>
>>> >> Before that, it's verbose.
>>> >>
>>> >> [DEBUG] Adding file-set in: /mnt/security to archive location:
>>> >> hbase-0.94.6-SNAPSHOT/security/
>>> >> [DEBUG] FileSet[conf/] dir perms: 47777 file perms: 107777
>>> >> [DEBUG] The archive base directory is 'null'
>>> >> [DEBUG] NOT reformatting any files in /mnt/conf
>>> >> [DEBUG] Adding file-set from directory: '/mnt/conf'
>>> >> assembly output directory is: 'conf/'
>>> >> [DEBUG] Adding file-set in: /mnt/conf to archive location:
>>> >> hbase-0.94.6-SNAPSHOT/conf/
>>> >> [DEBUG] FileSet[bin/] dir perms: 47777 file perms: 107777
>>> >> [DEBUG] The archive base directory is 'null'
>>> >> [DEBUG] NOT reformatting any files in /mnt/bin
>>> >> [DEBUG] Adding file-set from directory: '/mnt/bin'
>>> >> assembly output directory is: 'bin/'
>>> >> [DEBUG] Adding file-set in: /mnt/bin to archive location:
>>> >> hbase-0.94.6-SNAPSHOT/bin/
>>> >> [DEBUG] FileSet[lib/ruby/] dir perms: 47777 file perms: 107777
>>> >> [DEBUG] The archive base directory is 'null'
>>> >> [DEBUG] NOT reformatting any files in /mnt/src/main/ruby
>>> >> [DEBUG] Adding file-set from directory: '/mnt/src/main/ruby'
>>> >> assembly output directory is: 'lib/ruby/'
>>> >> [DEBUG] Adding file-set in: /mnt/src/main/ruby to archive location:
>>> >> hbase-0.94.6-SNAPSHOT/lib/ruby/
>>> >> [DEBUG] FileSet[] dir perms: 47777 file perms: 107777
>>> >> [DEBUG] The archive base directory is 'null'
>>> >> [DEBUG] NOT reformatting any files in /mnt/target
>>> >> [DEBUG] Adding file-set from directory: '/mnt/target'
>>> >> assembly output directory is: ''
>>> >> [DEBUG] Adding file-set in: /mnt/target to archive location:
>>> >> hbase-0.94.6-SNAPSHOT/
>>> >> [DEBUG] FileSet[hbase-webapps/] dir perms: 47777 file perms: 107777
>>> >> [DEBUG] The archive base directory is 'null'
>>> >> [DEBUG] NOT reformatting any files in /mnt/target/hbase-webapps
>>>
-
Re: Build performancesStack 2013-02-26, 20:04
I would be interested in folks experience running it in production.
St.Ack
On Tue, Feb 26, 2013 at 5:36 AM, Jean-Marc Spaggiari <
[EMAIL PROTECTED]> wrote:
> Hi Stack,
>
> 3 tests failed and 1271 passed.
>
> So it seems to be pretty stable with openJDK1.7.
>
> I retried and got only 2 failed.
>
> In both cases testDeleteEditUnknownColumnFamilyAndOrTable was on the list.
>
> I'm retrying another time, but for small tests, I will say that open
> JDK is stable enought.
>
> JM
>
> 2013/2/25 Jean-Marc Spaggiari <[EMAIL PROTECTED]>:
> > Hi Stack,
> >
> > When I'm testing locally with VMs I'm using openJDK for the standalone
> > mode so I don't have to install any additionnal JVM. And it's working
> > for my needs. I have not faced any issue so far.
> >
> > I just started the entire test suite with OpenJDK1.7. I will keep you
> posted.
> >
> > JM
> >
> > 2013/2/25 Stack <[EMAIL PROTECTED]>:
> >> Does hbase work on openjdk?
> >> St.Ack
> >>
> >>
> >> On Mon, Feb 25, 2013 at 12:54 PM, Jean-Marc Spaggiari <
> >> [EMAIL PROTECTED]> wrote:
> >>
> >>> Hi Stack,
> >>>
> >>> Thanks for pointing to stracing.
> >>>
> >>> However, I fixed my issue...
> >>>
> >>> Initially I was running with that:
> >>> Java version: 1.6.0_24, vendor: Sun Microsystems Inc.
> >>> Java home: /usr/lib/jvm/java-6-openjdk-amd64/jre
> >>>
> >>>
> >>> With "export JAVA_HOME=/usr/local/jdk1.7.0_13/":
> >>> [INFO]
> >>>
> ------------------------------------------------------------------------
> >>> [INFO] BUILD SUCCESS
> >>> [INFO]
> >>>
> ------------------------------------------------------------------------
> >>> [INFO] Total time: 5:37.573s
> >>> [INFO] Finished at: Mon Feb 25 15:50:26 EST 2013
> >>> [INFO] Final Memory: 62M/3020M
> >>> [INFO]
> >>>
> ------------------------------------------------------------------------
> >>>
> >>> Less than 6 minutes. 10 times faster!!!!
> >>>
> >>> So I don't really know why it was so slow with the 1.6 OpenJDK, but
> >>> it's now running way faster!
> >>>
> >>> Thanks,
> >>>
> >>> JM
> >>>
> >>> 2013/2/25 Stack <[EMAIL PROTECTED]>:
> >>> > Try stracing the process [1]?
> >>> > St.Ack
> >>> >
> >>> > 1. http://www.cyberciti.biz/tips/linux-strace-command-examples.html
> >>> >
> >>> >
> >>> > On Mon, Feb 25, 2013 at 12:09 PM, Jean-Marc Spaggiari <
> >>> > [EMAIL PROTECTED]> wrote:
> >>> >
> >>> >> When it's stuck on "Copying", there is nothing more displayed.
> >>> >>
> >>> >> Before that, it's verbose.
> >>> >>
> >>> >> [DEBUG] Adding file-set in: /mnt/security to archive location:
> >>> >> hbase-0.94.6-SNAPSHOT/security/
> >>> >> [DEBUG] FileSet[conf/] dir perms: 47777 file perms: 107777
> >>> >> [DEBUG] The archive base directory is 'null'
> >>> >> [DEBUG] NOT reformatting any files in /mnt/conf
> >>> >> [DEBUG] Adding file-set from directory: '/mnt/conf'
> >>> >> assembly output directory is: 'conf/'
> >>> >> [DEBUG] Adding file-set in: /mnt/conf to archive location:
> >>> >> hbase-0.94.6-SNAPSHOT/conf/
> >>> >> [DEBUG] FileSet[bin/] dir perms: 47777 file perms: 107777
> >>> >> [DEBUG] The archive base directory is 'null'
> >>> >> [DEBUG] NOT reformatting any files in /mnt/bin
> >>> >> [DEBUG] Adding file-set from directory: '/mnt/bin'
> >>> >> assembly output directory is: 'bin/'
> >>> >> [DEBUG] Adding file-set in: /mnt/bin to archive location:
> >>> >> hbase-0.94.6-SNAPSHOT/bin/
> >>> >> [DEBUG] FileSet[lib/ruby/] dir perms: 47777 file perms: 107777
> >>> >> [DEBUG] The archive base directory is 'null'
> >>> >> [DEBUG] NOT reformatting any files in /mnt/src/main/ruby
> >>> >> [DEBUG] Adding file-set from directory: '/mnt/src/main/ruby'
> >>> >> assembly output directory is: 'lib/ruby/'
> >>> >> [DEBUG] Adding file-set in: /mnt/src/main/ruby to archive location:
> >>> >> hbase-0.94.6-SNAPSHOT/lib/ruby/
> >>> >> [DEBUG] FileSet[] dir perms: 47777 file perms: 107777
> >>> >> [DEBUG] The archive base directory is 'null'
> >>> >> [DEBUG] NOT reformatting any files in /mnt/target
> >>> >> [DEBUG] Adding file-set from directory: '/mnt/target'
St.Ack
On Tue, Feb 26, 2013 at 5:36 AM, Jean-Marc Spaggiari <
[EMAIL PROTECTED]> wrote:
> Hi Stack,
>
> 3 tests failed and 1271 passed.
>
> So it seems to be pretty stable with openJDK1.7.
>
> I retried and got only 2 failed.
>
> In both cases testDeleteEditUnknownColumnFamilyAndOrTable was on the list.
>
> I'm retrying another time, but for small tests, I will say that open
> JDK is stable enought.
>
> JM
>
> 2013/2/25 Jean-Marc Spaggiari <[EMAIL PROTECTED]>:
> > Hi Stack,
> >
> > When I'm testing locally with VMs I'm using openJDK for the standalone
> > mode so I don't have to install any additionnal JVM. And it's working
> > for my needs. I have not faced any issue so far.
> >
> > I just started the entire test suite with OpenJDK1.7. I will keep you
> posted.
> >
> > JM
> >
> > 2013/2/25 Stack <[EMAIL PROTECTED]>:
> >> Does hbase work on openjdk?
> >> St.Ack
> >>
> >>
> >> On Mon, Feb 25, 2013 at 12:54 PM, Jean-Marc Spaggiari <
> >> [EMAIL PROTECTED]> wrote:
> >>
> >>> Hi Stack,
> >>>
> >>> Thanks for pointing to stracing.
> >>>
> >>> However, I fixed my issue...
> >>>
> >>> Initially I was running with that:
> >>> Java version: 1.6.0_24, vendor: Sun Microsystems Inc.
> >>> Java home: /usr/lib/jvm/java-6-openjdk-amd64/jre
> >>>
> >>>
> >>> With "export JAVA_HOME=/usr/local/jdk1.7.0_13/":
> >>> [INFO]
> >>>
> ------------------------------------------------------------------------
> >>> [INFO] BUILD SUCCESS
> >>> [INFO]
> >>>
> ------------------------------------------------------------------------
> >>> [INFO] Total time: 5:37.573s
> >>> [INFO] Finished at: Mon Feb 25 15:50:26 EST 2013
> >>> [INFO] Final Memory: 62M/3020M
> >>> [INFO]
> >>>
> ------------------------------------------------------------------------
> >>>
> >>> Less than 6 minutes. 10 times faster!!!!
> >>>
> >>> So I don't really know why it was so slow with the 1.6 OpenJDK, but
> >>> it's now running way faster!
> >>>
> >>> Thanks,
> >>>
> >>> JM
> >>>
> >>> 2013/2/25 Stack <[EMAIL PROTECTED]>:
> >>> > Try stracing the process [1]?
> >>> > St.Ack
> >>> >
> >>> > 1. http://www.cyberciti.biz/tips/linux-strace-command-examples.html
> >>> >
> >>> >
> >>> > On Mon, Feb 25, 2013 at 12:09 PM, Jean-Marc Spaggiari <
> >>> > [EMAIL PROTECTED]> wrote:
> >>> >
> >>> >> When it's stuck on "Copying", there is nothing more displayed.
> >>> >>
> >>> >> Before that, it's verbose.
> >>> >>
> >>> >> [DEBUG] Adding file-set in: /mnt/security to archive location:
> >>> >> hbase-0.94.6-SNAPSHOT/security/
> >>> >> [DEBUG] FileSet[conf/] dir perms: 47777 file perms: 107777
> >>> >> [DEBUG] The archive base directory is 'null'
> >>> >> [DEBUG] NOT reformatting any files in /mnt/conf
> >>> >> [DEBUG] Adding file-set from directory: '/mnt/conf'
> >>> >> assembly output directory is: 'conf/'
> >>> >> [DEBUG] Adding file-set in: /mnt/conf to archive location:
> >>> >> hbase-0.94.6-SNAPSHOT/conf/
> >>> >> [DEBUG] FileSet[bin/] dir perms: 47777 file perms: 107777
> >>> >> [DEBUG] The archive base directory is 'null'
> >>> >> [DEBUG] NOT reformatting any files in /mnt/bin
> >>> >> [DEBUG] Adding file-set from directory: '/mnt/bin'
> >>> >> assembly output directory is: 'bin/'
> >>> >> [DEBUG] Adding file-set in: /mnt/bin to archive location:
> >>> >> hbase-0.94.6-SNAPSHOT/bin/
> >>> >> [DEBUG] FileSet[lib/ruby/] dir perms: 47777 file perms: 107777
> >>> >> [DEBUG] The archive base directory is 'null'
> >>> >> [DEBUG] NOT reformatting any files in /mnt/src/main/ruby
> >>> >> [DEBUG] Adding file-set from directory: '/mnt/src/main/ruby'
> >>> >> assembly output directory is: 'lib/ruby/'
> >>> >> [DEBUG] Adding file-set in: /mnt/src/main/ruby to archive location:
> >>> >> hbase-0.94.6-SNAPSHOT/lib/ruby/
> >>> >> [DEBUG] FileSet[] dir perms: 47777 file perms: 107777
> >>> >> [DEBUG] The archive base directory is 'null'
> >>> >> [DEBUG] NOT reformatting any files in /mnt/target
> >>> >> [DEBUG] Adding file-set from directory: '/mnt/target'
