Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Drill, mail # user - Drill synthetic log generator


Copy link to this message
-
Re: Drill synthetic log generator
Jacques Nadeau 2013-07-11, 19:47
Hey Ted,  can we just change the dependency to a released version of Mahout
so people don't keep having this problem?
I wrote that code (for my sins).

The problem is that it depends on stuff that I added to Mahout which hadn't
yet been released.

The better way to satisfy the dependency is to download and compile and
install Mahout:

    mvn clone https://github.com/apache/mahout.git
    cd mahout
    git checkout mahout-0.8
    mvn -DskipTests install

Mahout is in the middle of a release process right now which makes this a
bit more complex.  The release should finish shortly and I will commit a
fix to the pom to avoid this in the future.
On Thu, Jul 11, 2013 at 10:13 AM, peter he <[EMAIL PROTECTED]> wrote:

> Hi All,
>
> I am new to the Drill project and maven/Java in general, but I find the
> Synthetic Log Generator part very interesting and was trying to use it.
>
> I was compiling drill-master\sandbox\prototype\contrib\synth-log using
> maven. Initially maven complained that dependency
> "mahout-math-0.8-SNAPSHOT.jar" is missing, so I found this jar file online
> and installed it to a local repository. Then when I try to compile it
again
> it gives errors like "package com.google.common.collect does not exist",
> which I don't really know how to fix after extensive search on Google. The
> detailed log info is below.
>
> Any help on this would be greatly appreciated, alternatively since I am
> only consuming the log-synth-0.1-SNAPSHOT-jar-with-dependencies.jar file,
> if someone could just send me the compiled jar file that would be great
> too.
>
> Many thanks,
> -Peter
>
>
> $ mvn clean compile
> [INFO] Scanning for projects...
> [INFO]
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Building log-synth 0.1-SNAPSHOT
> [INFO]
> ------------------------------------------------------------------------
> [INFO]
> [INFO] --- maven-clean-plugin:2.4.1:clean (default-clean) @ log-synth ---
> [INFO] Deleting
>
>
E:\FuzzyJoin\Log-Gen\incubator-drill-master\incubator-drill-master\sandbox\prototype\contrib\synth-log\target
> [INFO]
> [INFO] --- maven-resources-plugin:2.5:resources (default-resources) @
> log-synth ---
> [debug] execute contextualize
> [WARNING] Using platform encoding (Cp1252 actually) to copy filtered
> resources, i.e. build is platform dependent!
> [INFO] Copying 4 resources
> [INFO]
> [INFO] --- maven-compiler-plugin:3.0:compile (default-compile) @ log-synth
> ---
> [INFO] Changes detected - recompiling the module!
> [WARNING] File encoding has not been set, using platform encoding Cp1252,
> i.e. build is platform dependent!
> [INFO] Compiling 7 source files to
>
>
E:\FuzzyJoin\Log-Gen\incubator-drill-master\incubator-drill-master\sandbox\prototype\contrib\synth-log\target\classes
> [parsing started
>
>
RegularFileObject[E:\FuzzyJoin\Log-Gen\incubator-drill-master\incubator-drill-master\sandbox\prototype\contrib\synth-log\src\main\java\org\apache\drill\synth\LogLine.java]]
> [parsing completed 9ms]
> [parsing started
>
>
RegularFileObject[E:\FuzzyJoin\Log-Gen\incubator-drill-master\incubator-drill-master\sandbox\prototype\contrib\synth-log\src\main\java\org\apache\drill\synth\WordGenerator.java]]
> [parsing completed 2ms]
> [parsing started
>
>
RegularFileObject[E:\FuzzyJoin\Log-Gen\incubator-drill-master\incubator-drill-master\sandbox\prototype\contrib\synth-log\src\main\java\org\apache\drill\synth\Main.java]]
> [parsing completed 2ms]
> [parsing started
>
>
RegularFileObject[E:\FuzzyJoin\Log-Gen\incubator-drill-master\incubator-drill-master\sandbox\prototype\contrib\synth-log\src\main\java\org\apache\drill\synth\LongTail.java]]
> [parsing completed 1ms]
> [parsing started
>
>
RegularFileObject[E:\FuzzyJoin\Log-Gen\incubator-drill-master\incubator-drill-master\sandbox\prototype\contrib\synth-log\src\main\java\org\apache\drill\synth\User.java]]
> [parsing completed 1ms]
> [parsing started
>
>
RegularFileObject[E:\FuzzyJoin\Log-Gen\incubator-drill-master\incubator-drill-master\sandbox\prototype\contrib\synth-log\src\main\java\org\apache\drill\synth\TermGenerator.java]]
RegularFileObject[E:\FuzzyJoin\Log-Gen\incubator-drill-master\incubator-drill-master\sandbox\prototype\contrib\synth-log\src\main\java\org\apache\drill\synth\LogGenerator.java]]
E:\FuzzyJoin\Log-Gen\incubator-drill-master\incubator-drill-master\sandbox\prototype\contrib\synth-log\src\main\java]
Files\Java\jdk1.7.0_25\jre\lib\ext\zipfs.jar,E:\FuzzyJoin\Log-Gen\incubator-drill-master\incubator-drill-master\sandbox\prototype\contrib\synth-log\target\classes,C:\Users\yy\.m2\repository\org\apache\mahout\mahout-math\0.8-SNAPSHOT\mahout-math-0.8-SNAPSHOT.jar,C:\Users\yy\.m2\repository\junit\junit\4.8.2\junit-4.8.2.jar,C:\Users\yy\.m2\repository\org\slf4j\slf4j-api\1.6.6\slf4j-api-1.6.6.jar,.]
Files\Java\jdk1.7.0_25\lib\ct.sym(META-INF/sym/rt.jar/java/net/InetAddress.class)]]
Files\Java\jdk1.7.0_25\lib\ct.sym(META-INF/sym/rt.jar/java/util/Formatter.class)]]
Files\Java\jdk1.7.0_25\lib\ct.sym(META-INF/sym/rt.jar/java/util/List.class)]]
Files\Java\jdk1.7.0_25\lib\ct.sym(META-INF/sym/rt.jar/java/lang/Object.class)]]
Files\Java\jdk1.7.0_25\lib\ct.sym(META-INF/sym/rt.jar/java/lang/String.class)]]
ZipFileIndexFileObject[C:\Users\yy\.m2\repository\org\apache\mahout\mahout-math\0.8-SNAPSHOT\mahout-math-0.8-SNAPSHOT.jar(org/apache/mahout/common/RandomUtils.class)]]
ZipFileIndexFileObject[C:\Users\yy\.m2\repository\org\apache\mahout\mahout-math\0.8-SNAPSHOT\mahout-math-0.8-SNAPSHOT.jar(org/apache/mahout/math/jet/random/Exponential.class)]]
ZipFileIndexFileObject[C:\Users\yy\.m2\repository\org\apache\mahout\mahout-math\0.8-SNAPSHOT\mahout-math-0.8-SNAPSHOT.jar(org/apache/mahout/math/random/Sampler.class)]]
ZipFileIndexFileObject[C:\Users\yy\.m2\repository\org\slf4j\slf4j-api\1.6.6\slf4j-api-1.6.6.jar(org/slf4j/Logger.class)]]
ZipFileIndexFileObject[C:\Users\yy\.m2\repository\org\slf4j\slf4j-api\1.6.6\slf4j-api-1.6.6.jar(org/slf4j/LoggerFactory.class)]]
Files\Java\jdk1.7.0_25\lib\