Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Drill, mail # dev - Re: Drill on Amazon EMR


Copy link to this message
-
Re: Drill on Amazon EMR
Jacques Nadeau 2013-12-18, 15:14
Steve, Sumit and Tim, awesome work!

Look forward to trying it out.  I'll also try to get Sumit patch merged
ASAP.

thanks!
Jacques
On Tue, Dec 17, 2013 at 9:42 AM, Timothy Chen <[EMAIL PROTECTED]> wrote:

> Just verified and it works great!
>
> For folks that are going to try it, Drill is installed in
> /home/hadoop/drill
>
> Thanks,
>
> Tim
>
>
> On Tue, Dec 17, 2013 at 9:38 AM, McPherson, Steve <[EMAIL PROTECTED]
> >wrote:
>
> > Resending this per the Hangout.
> >
> >
> > On 12/12/13 11:10 PM, "McPherson, Steve" <[EMAIL PROTECTED]> wrote:
> >
> > Hi all,
> >
> > Sumit and Tim were able to get the bootstrap action working to launch
> > Drill on EMR.
> >
> > We'd love to get feedback.
> >
> > Instructions:
> >
> > From the Elastic MapReduce CLI (which you can install using these
> > instructions
> >
> http://docs.aws.amazon.com/ElasticMapReduce/latest/DeveloperGuide/emr-cli-i
> > nstall.html)
> >
> > ./elastic-mapreduce --create --alive --name "Drill.deploy"
> --instance-type
> > m1.large --ami-version 3.0.1 --hbase --bootstrap-action
> > "s3://beta.elasticmapreduce/bootstrap-actions/drill/install-drill.rb"
> --ssh
> >
> > Or, from the AWS EMR Web console
> > (https://console.aws.amazon.com/elasticmapreduce/) launch a 3.0.1
> cluster
> > with the bootstrap action:
> >
> > "s3://beta.elasticmapreduce/bootstrap-actions/drill/install-drill.rb"
> >
> > SSH to the master node cluster and run Drill.
> >
> > cd drill
> > /bin/sqlline -u jdbc:drill:schema=parquet-local -n admin -p admin
> > ..select * from "/drill/sample-data/region.parquet";
> > ..etc
> >
> >
> >
> > >On 12/12/13 7:59 PM, "Sumit Kumar (JIRA)" <[EMAIL PROTECTED]> wrote:
> > >
> > >>
> > >>     [
> > >>
> >
> https://issues.apache.org/jira/browse/DRILL-322?page=com.atlassian.jira.p
> > >>l
> > >>ugin.system.issuetabpanels:all-tabpanel ]
> > >>
> > >>Sumit Kumar reassigned DRILL-322:
> > >>---------------------------------
> > >>
> > >>    Assignee: Sumit Kumar  (was: Timothy Chen)
> > >>
> > >>> Fix classpath ordering in drill related scripts
> > >>> ------------------------------------------------
> > >>>
> > >>>                 Key: DRILL-322
> > >>>                 URL: https://issues.apache.org/jira/browse/DRILL-322
> > >>>             Project: Apache Drill
> > >>>          Issue Type: Bug
> > >>>            Reporter: Timothy Chen
> > >>>            Assignee: Sumit Kumar
> > >>>         Attachments: DRILL-322.patch
> > >>>
> > >>>
> > >>> While Sumit Kumar (from EMR) and I working on EMR launch script for
> > >>>Drill, Sumit found out our classpath is not correctly ordered as
> Drill's
> > >>>classes are loaded before other dependencies, and dependencies such as
> > >>>sqlline are not loaded the correct version.
> > >>
> > >>
> > >>
> > >>--
> > >>This message was sent by Atlassian JIRA
> > >>(v6.1.4#6159)
> > >
> >
> >
>