Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Drill >> mail # dev >> Re: Drill on Amazon EMR


Copy link to this message
-
Re: Drill on Amazon EMR
Steve, Sumit and Tim, awesome work!

Look forward to trying it out.  I'll also try to get Sumit patch merged
ASAP.

thanks!
Jacques
On Tue, Dec 17, 2013 at 9:42 AM, Timothy Chen <[EMAIL PROTECTED]> wrote:

> Just verified and it works great!
>
> For folks that are going to try it, Drill is installed in
> /home/hadoop/drill
>
> Thanks,
>
> Tim
>
>
> On Tue, Dec 17, 2013 at 9:38 AM, McPherson, Steve <[EMAIL PROTECTED]
> >wrote:
>
> > Resending this per the Hangout.
> >
> >
> > On 12/12/13 11:10 PM, "McPherson, Steve" <[EMAIL PROTECTED]> wrote:
> >
> > Hi all,
> >
> > Sumit and Tim were able to get the bootstrap action working to launch
> > Drill on EMR.
> >
> > We'd love to get feedback.
> >
> > Instructions:
> >
> > From the Elastic MapReduce CLI (which you can install using these
> > instructions
> >
> http://docs.aws.amazon.com/ElasticMapReduce/latest/DeveloperGuide/emr-cli-i
> > nstall.html)
> >
> > ./elastic-mapreduce --create --alive --name "Drill.deploy"
> --instance-type
> > m1.large --ami-version 3.0.1 --hbase --bootstrap-action
> > "s3://beta.elasticmapreduce/bootstrap-actions/drill/install-drill.rb"
> --ssh
> >
> > Or, from the AWS EMR Web console
> > (https://console.aws.amazon.com/elasticmapreduce/) launch a 3.0.1
> cluster
> > with the bootstrap action:
> >
> > "s3://beta.elasticmapreduce/bootstrap-actions/drill/install-drill.rb"
> >
> > SSH to the master node cluster and run Drill.
> >
> > cd drill
> > /bin/sqlline -u jdbc:drill:schema=parquet-local -n admin -p admin
> > ..select * from "/drill/sample-data/region.parquet";
> > ..etc
> >
> >
> >
> > >On 12/12/13 7:59 PM, "Sumit Kumar (JIRA)" <[EMAIL PROTECTED]> wrote:
> > >
> > >>
> > >>     [
> > >>
> >
> https://issues.apache.org/jira/browse/DRILL-322?page=com.atlassian.jira.p
> > >>l
> > >>ugin.system.issuetabpanels:all-tabpanel ]
> > >>
> > >>Sumit Kumar reassigned DRILL-322:
> > >>---------------------------------
> > >>
> > >>    Assignee: Sumit Kumar  (was: Timothy Chen)
> > >>
> > >>> Fix classpath ordering in drill related scripts
> > >>> ------------------------------------------------
> > >>>
> > >>>                 Key: DRILL-322
> > >>>                 URL: https://issues.apache.org/jira/browse/DRILL-322
> > >>>             Project: Apache Drill
> > >>>          Issue Type: Bug
> > >>>            Reporter: Timothy Chen
> > >>>            Assignee: Sumit Kumar
> > >>>         Attachments: DRILL-322.patch
> > >>>
> > >>>
> > >>> While Sumit Kumar (from EMR) and I working on EMR launch script for
> > >>>Drill, Sumit found out our classpath is not correctly ordered as
> Drill's
> > >>>classes are loaded before other dependencies, and dependencies such as
> > >>>sqlline are not loaded the correct version.
> > >>
> > >>
> > >>
> > >>--
> > >>This message was sent by Atlassian JIRA
> > >>(v6.1.4#6159)
> > >
> >
> >
>
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB