Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Threaded View
Drill >> mail # user >> Drill synthetic log generator


Copy link to this message
-
Re: Drill synthetic log generator
Hey Ted,  can we just change the dependency to a released version of Mahout
so people don't keep having this problem?
I wrote that code (for my sins).

The problem is that it depends on stuff that I added to Mahout which hadn't
yet been released.

The better way to satisfy the dependency is to download and compile and
install Mahout:

    mvn clone https://github.com/apache/mahout.git
    cd mahout
    git checkout mahout-0.8
    mvn -DskipTests install

Mahout is in the middle of a release process right now which makes this a
bit more complex.  The release should finish shortly and I will commit a
fix to the pom to avoid this in the future.
On Thu, Jul 11, 2013 at 10:13 AM, peter he <[EMAIL PROTECTED]> wrote:

> Hi All,
>
> I am new to the Drill project and maven/Java in general, but I find the
> Synthetic Log Generator part very interesting and was trying to use it.
>
> I was compiling drill-master\sandbox\prototype\contrib\synth-log using
> maven. Initially maven complained that dependency
> "mahout-math-0.8-SNAPSHOT.jar" is missing, so I found this jar file online
> and installed it to a local repository. Then when I try to compile it
again
> it gives errors like "package com.google.common.collect does not exist",
> which I don't really know how to fix after extensive search on Google. The
> detailed log info is below.
>
> Any help on this would be greatly appreciated, alternatively since I am
> only consuming the log-synth-0.1-SNAPSHOT-jar-with-dependencies.jar file,
> if someone could just send me the compiled jar file that would be great
> too.
>
> Many thanks,
> -Peter
>
>
> $ mvn clean compile
> [INFO] Scanning for projects...
> [INFO]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Building log-synth 0.1-SNAPSHOT
> [INFO]
> ------------------------------------------------------------------------
> [INFO]
> [INFO] --- maven-clean-plugin:2.4.1:clean (default-clean) @ log-synth ---
> [INFO] Deleting
>
>
E:\FuzzyJoin\Log-Gen\incubator-drill-master\incubator-drill-master\sandbox\prototype\contrib\synth-log\target
> [INFO]
> [INFO] --- maven-resources-plugin:2.5:resources (default-resources) @
> log-synth ---
> [debug] execute contextualize
> [WARNING] Using platform encoding (Cp1252 actually) to copy filtered
> resources, i.e. build is platform dependent!
> [INFO] Copying 4 resources
> [INFO]
> [INFO] --- maven-compiler-plugin:3.0:compile (default-compile) @ log-synth
> ---
> [INFO] Changes detected - recompiling the module!
> [WARNING] File encoding has not been set, using platform encoding Cp1252,
> i.e. build is platform dependent!
> [INFO] Compiling 7 source files to
>
>
E:\FuzzyJoin\Log-Gen\incubator-drill-master\incubator-drill-master\sandbox\prototype\contrib\synth-log\target\classes
> [parsing started
>
>
RegularFileObject[E:\FuzzyJoin\Log-Gen\incubator-drill-master\incubator-drill-master\sandbox\prototype\contrib\synth-log\src\main\java\org\apache\drill\synth\LogLine.java]]
> [parsing completed 9ms]
> [parsing started
>
>
RegularFileObject[E:\FuzzyJoin\Log-Gen\incubator-drill-master\incubator-drill-master\sandbox\prototype\contrib\synth-log\src\main\java\org\apache\drill\synth\WordGenerator.java]]
> [parsing completed 2ms]
> [parsing started
>
>
RegularFileObject[E:\FuzzyJoin\Log-Gen\incubator-drill-master\incubator-drill-master\sandbox\prototype\contrib\synth-log\src\main\java\org\apache\drill\synth\Main.java]]
> [parsing completed 2ms]
> [parsing started
>
>
RegularFileObject[E:\FuzzyJoin\Log-Gen\incubator-drill-master\incubator-drill-master\sandbox\prototype\contrib\synth-log\src\main\java\org\apache\drill\synth\LongTail.java]]
> [parsing completed 1ms]
> [parsing started
>
>
RegularFileObject[E:\FuzzyJoin\Log-Gen\incubator-drill-master\incubator-drill-master\sandbox\prototype\contrib\synth-log\src\main\java\org\apache\drill\synth\User.java]]
> [parsing completed 1ms]
> [parsing started
>
>
RegularFileObject[E:\FuzzyJoin\Log-Gen\incubator-drill-master\incubator-drill-master\sandbox\prototype\contrib\synth-log\src\main\java\org\apache\drill\synth\TermGenerator.java]]
RegularFileObject[E:\FuzzyJoin\Log-Gen\incubator-drill-master\incubator-drill-master\sandbox\prototype\contrib\synth-log\src\main\java\org\apache\drill\synth\LogGenerator.java]]
E:\FuzzyJoin\Log-Gen\incubator-drill-master\incubator-drill-master\sandbox\prototype\contrib\synth-log\src\main\java]
Files\Java\jdk1.7.0_25\jre\lib\ext\zipfs.jar,E:\FuzzyJoin\Log-Gen\incubator-drill-master\incubator-drill-master\sandbox\prototype\contrib\synth-log\target\classes,C:\Users\yy\.m2\repository\org\apache\mahout\mahout-math\0.8-SNAPSHOT\mahout-math-0.8-SNAPSHOT.jar,C:\Users\yy\.m2\repository\junit\junit\4.8.2\junit-4.8.2.jar,C:\Users\yy\.m2\repository\org\slf4j\slf4j-api\1.6.6\slf4j-api-1.6.6.jar,.]
Files\Java\jdk1.7.0_25\lib\ct.sym(META-INF/sym/rt.jar/java/net/InetAddress.class)]]
Files\Java\jdk1.7.0_25\lib\ct.sym(META-INF/sym/rt.jar/java/util/Formatter.class)]]
Files\Java\jdk1.7.0_25\lib\ct.sym(META-INF/sym/rt.jar/java/util/List.class)]]
Files\Java\jdk1.7.0_25\lib\ct.sym(META-INF/sym/rt.jar/java/lang/Object.class)]]
Files\Java\jdk1.7.0_25\lib\ct.sym(META-INF/sym/rt.jar/java/lang/String.class)]]
ZipFileIndexFileObject[C:\Users\yy\.m2\repository\org\apache\mahout\mahout-math\0.8-SNAPSHOT\mahout-math-0.8-SNAPSHOT.jar(org/apache/mahout/common/RandomUtils.class)]]
ZipFileIndexFileObject[C:\Users\yy\.m2\repository\org\apache\mahout\mahout-math\0.8-SNAPSHOT\mahout-math-0.8-SNAPSHOT.jar(org/apache/mahout/math/jet/random/Exponential.class)]]
ZipFileIndexFileObject[C:\Users\yy\.m2\repository\org\apache\mahout\mahout-math\0.8-SNAPSHOT\mahout-math-0.8-SNAPSHOT.jar(org/apache/mahout/math/random/Sampler.class)]]
ZipFileIndexFileObject[C:\Users\yy\.m2\repository\org\slf4j\slf4j-api\1.6.6\slf4j-api-1.6.6.jar(org/slf4j/Logger.class)]]
ZipFileIndexFileObject[C:\Users\yy\.m2\repository\org\slf4j\slf4j-api\1.6.6\slf4j-api-1.6.6.jar(org/slf4j/LoggerFactory.class)]]
Files\Java\jdk1.7.0_25\lib\
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB