Hi,

HiBench, a Hadoop benchmark suite constructed by Intel, is used intensively for Hadoop benchmarking, tuning & optimizations both inside Intel and by our customers/partners. It consists of a set of representative Hadoop programs including both micro-benchmarks and more "real world" applications (e.g., search, machine learning and Hive queries).

We have made HiBench 2.1 available under Apache License 2.0 at https://github.com/hibench/HiBench-2.1, and would like to get your feedbacks on how it can be further improved. BTW, please stop by the Intel booth if you are at Hadoop summit, so that we can have more interactive discussions on both HiBench and HiTune (our Hadoop performance analyzer open sourced at https://github.com/hitune/hitune).

Thanks,
-Jason

Thank you, Jason!  Awesome news!  I'll be using that in our Distributed Lab at Cooper Union (cooper.edu). Perhaps Intel can come and give a seminar on it in the Fall?

Looking forward to it.

Kind regards,
Rob
--
Rob Marano
Adjunct Associate Professor
The Cooper Union
[EMAIL PROTECTED]

On Jun 14, 2012, at 12:27 AM, Dai, Jason wrote:

> Hi,
>
> HiBench, a Hadoop benchmark suite constructed by Intel, is used intensively for Hadoop benchmarking, tuning & optimizations both inside Intel and by our customers/partners. It consists of a set of representative Hadoop programs including both micro-benchmarks and more "real world" applications (e.g., search, machine learning and Hive queries).
>
> We have made HiBench 2.1 available under Apache License 2.0 at https://github.com/hibench/HiBench-2.1, and would like to get your feedbacks on how it can be further improved. BTW, please stop by the Intel booth if you are at Hadoop summit, so that we can have more interactive discussions on both HiBench and HiTune (our Hadoop performance analyzer open sourced at https://github.com/hitune/hitune).
>
> Thanks,
> -Jason
>
>

On 06/14/2012 03:11 PM, Rob Marano wrote:
> Thank you, Jason!  Awesome news!  I'll be using that in our Distributed Lab at Cooper Union (cooper.edu). Perhaps Intel can come and give a seminar on it in the Fall?
>
> Looking forward to it.
>
> Kind regards,
> Rob
> --
> Rob Marano
> Adjunct Associate Professor
> The Cooper Union
> [EMAIL PROTECTED]
>
> On Jun 14, 2012, at 12:27 AM, Dai, Jason wrote:
>
>> Hi,
>>
>> HiBench, a Hadoop benchmark suite constructed by Intel, is used intensively for Hadoop benchmarking, tuning&  optimizations both inside Intel and by our customers/partners. It consists of a set of representative Hadoop programs including both micro-benchmarks and more "real world" applications (e.g., search, machine learning and Hive queries).
>>
>> We have made HiBench 2.1 available under Apache License 2.0 at https://github.com/hibench/HiBench-2.1, and would like to get your feedbacks on how it can be further improved. BTW, please stop by the Intel booth if you are at Hadoop summit, so that we can have more interactive discussions on both HiBench and HiTune (our Hadoop performance analyzer open sourced at https://github.com/hitune/hitune).
>>
>> Thanks,
>> -Jason

It would be cool to have a page (maybe on a wiki) where people could
post their cluster set-up and their results for the various HiBench
tests they run.  It would give people an easy way to validate their
set-up.  Or maybe something like this exists already?

--
Luca Pireddu
CRS4 - Distributed Computing Group
Loc. Pixina Manna Edificio 1
09010 Pula (CA), Italy
Tel: +39 0709250452

That's a very good idea. Let us check if we can use the wiki page in github for people to post their results.

Thanks,
-Jason

-----Original Message-----
From: Luca Pireddu [mailto:[EMAIL PROTECTED]]
Sent: Thursday, June 14, 2012 8:31 AM
To: [EMAIL PROTECTED]
Subject: Re: Open source of HiBench 2.1 (a Hadoop benchmark suite)

On 06/14/2012 03:11 PM, Rob Marano wrote:
> Thank you, Jason!  Awesome news!  I'll be using that in our Distributed Lab at Cooper Union (cooper.edu). Perhaps Intel can come and give a seminar on it in the Fall?
>
> Looking forward to it.
>
> Kind regards,
> Rob
> --
> Rob Marano
> Adjunct Associate Professor
> The Cooper Union
> [EMAIL PROTECTED]
>
> On Jun 14, 2012, at 12:27 AM, Dai, Jason wrote:
>
>> Hi,
>>
>> HiBench, a Hadoop benchmark suite constructed by Intel, is used intensively for Hadoop benchmarking, tuning&  optimizations both inside Intel and by our customers/partners. It consists of a set of representative Hadoop programs including both micro-benchmarks and more "real world" applications (e.g., search, machine learning and Hive queries).
>>
>> We have made HiBench 2.1 available under Apache License 2.0 at https://github.com/hibench/HiBench-2.1, and would like to get your feedbacks on how it can be further improved. BTW, please stop by the Intel booth if you are at Hadoop summit, so that we can have more interactive discussions on both HiBench and HiTune (our Hadoop performance analyzer open sourced at https://github.com/hitune/hitune).
>>
>> Thanks,
>> -Jason

It would be cool to have a page (maybe on a wiki) where people could post their cluster set-up and their results for the various HiBench tests they run.  It would give people an easy way to validate their set-up.  Or maybe something like this exists already?

--
Luca Pireddu
CRS4 - Distributed Computing Group
Loc. Pixina Manna Edificio 1
09010 Pula (CA), Italy
Tel: +39 0709250452

Jason, HiBench looks very interesting, and I'm downloading the data files now to try it out.

HiTune looks extremely useful as well, but it looks like it is still at a prerelease level (0.9), and has been a year between commits. Is there ongoing development / maintenance on this project, and if so, will those updates be released to the public?

Thanks!

    - Tim.

________________________________________
From: Dai, Jason [[EMAIL PROTECTED]]
Sent: Wednesday, June 13, 2012 9:27 PM
To: [EMAIL PROTECTED]
Subject: Open source of HiBench 2.1 (a Hadoop benchmark suite)

Hi,

HiBench, a Hadoop benchmark suite constructed by Intel, is used intensively for Hadoop benchmarking, tuning & optimizations both inside Intel and by our customers/partners. It consists of a set of representative Hadoop programs including both micro-benchmarks and more "real world" applications (e.g., search, machine learning and Hive queries).

We have made HiBench 2.1 available under Apache License 2.0 at https://github.com/hibench/HiBench-2.1, and would like to get your feedbacks on how it can be further improved. BTW, please stop by the Intel booth if you are at Hadoop summit, so that we can have more interactive discussions on both HiBench and HiTune (our Hadoop performance analyzer open sourced at https://github.com/hitune/hitune).

Thanks,
-Jason

The information contained in this email is intended only for the personal and confidential use of the recipient(s) named above.  The information and any attached documents contained in this message may be Exar confidential and/or legally privileged.  If you are not the intended recipient, you are hereby notified that any review, use, dissemination or reproduction of this message is strictly prohibited and may be unlawful.  If you have received this communication in error, please notify us immediately by return email and delete the original message.

Hi Tim,

The data files are only for nutchindexing and bayes; other workloads can run without the data files.

There are still on-going development on HiTune, with the current focus on its ease of deployment (i.e., eliminating the additional Hadoop cluster used by Chukwa). And we would like to get your feedbacks on how to improve HiTune and HiTune after you try them out.

Thanks,
-Jason
From: Tim Broberg <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>
Date: Fri, Jun 15, 2012 at 1:07 PM
Subject: RE: Open source of HiBench 2.1 (a Hadoop benchmark suite)
To: "[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>" <[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>>
Jason, HiBench looks very interesting, and I'm downloading the data files now to try it out.

HiTune looks extremely useful as well, but it looks like it is still at a prerelease level (0.9), and has been a year between commits. Is there ongoing development / maintenance on this project, and if so, will those updates be released to the public?

Thanks!

   - Tim.

________________________________________
From: Dai, Jason [[EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>]
Sent: Wednesday, June 13, 2012 9:27 PM
To: [EMAIL PROTECTED]<mailto:[EMAIL PROTECTED]>
Subject: Open source of HiBench 2.1 (a Hadoop benchmark suite)

Hi,

HiBench, a Hadoop benchmark suite constructed by Intel, is used intensively for Hadoop benchmarking, tuning & optimizations both inside Intel and by our customers/partners. It consists of a set of representative Hadoop programs including both micro-benchmarks and more "real world" applications (e.g., search, machine learning and Hive queries).

We have made HiBench 2.1 available under Apache License 2.0 at https://github.com/hibench/HiBench-2.1, and would like to get your feedbacks on how it can be further improved. BTW, please stop by the Intel booth if you are at Hadoop summit, so that we can have more interactive discussions on both HiBench and HiTune (our Hadoop performance analyzer open sourced at https://github.com/hitune/hitune).

Thanks,
-Jason
The information contained in this email is intended only for the personal and confidential use of the recipient(s) named above.  The information and any attached documents contained in this message may be Exar confidential and/or legally privileged.  If you are not the intended recipient, you are hereby notified that any review, use, dissemination or reproduction of this message is strictly prohibited and may be unlawful.  If you have received this communication in error, please notify us immediately by return email and delete the original message.

Hi,

Apparently HiBench has been very popular and Dropbox just suspended the download of HiBench-Data as it generated too much traffic :( The suspension is only temporary and will resume in 3 days; in addition, HiBench-Data package is needed only for nutchindexing and bayes, and other eight workloads in HiBench can run without the data files.

In the meantime, we are exploring other options for hosting the large HiBench-Data package (~16GB), and please send me a note if you have any suggestions on that.

Thanks,
-Jason

_____________________________________________
From: Dai, Jason
Sent: Wednesday, June 13, 2012 9:27 PM
To: [EMAIL PROTECTED]
Subject: Open source of HiBench 2.1 (a Hadoop benchmark suite)
Hi,

HiBench, a Hadoop benchmark suite constructed by Intel, is used intensively for Hadoop benchmarking, tuning & optimizations both inside Intel and by our customers/partners. It consists of a set of representative Hadoop programs including both micro-benchmarks and more "real world" applications (e.g., search, machine learning and Hive queries).

We have made HiBench 2.1 available under Apache License 2.0 at https://github.com/hibench/HiBench-2.1, and would like to get your feedbacks on how it can be further improved. BTW, please stop by the Intel booth if you are at Hadoop summit, so that we can have more interactive discussions on both HiBench and HiTune (our Hadoop performance analyzer open sourced at https://github.com/hitune/hitune).

Thanks,
-Jason