Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
Hive, mail # user -


Copy link to this message
-
imen Megdiche 2012-11-22, 09:13
Hello,

I tried to execute the example of worcount with hive but I have had this
error .
hive -e 'from ( from rawlines map rawlines.line using
"word_count_mapper.py"
as word, count cluster by word) mapoutput insert overwrite table wordcount
reduc
e mapoutput.word, mapoutput.count using "word_count_reducer.py" as
word,count '
                                                              WARNING:
org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please use
or
g.apache.hadoop.log.metrics.EventCounter in all the log4j.properties files.

Logging initialized using configuration in
jar:file:/C:/cygwin/home/xxx/hive-0.8.1-bin/lib/hive-common-0.8.1.jar!/hive-log4j.properties

Hive history file=/tmp/xxx/hive_job_log_xxx_201211220956_519871703.txt

Total MapReduce jobs = 1

Launching Job 1 out of 1

Number of reduce tasks not specified. Estimated from input data size: 1

In order to change the average load for a reducer (in bytes):

  set hive.exec.reducers.bytes.per.reducer=<number>

In order to limit the maximum number of reducers:

  set hive.exec.reducers.max=<number>

In order to set a constant number of reducers:

  set mapred.reduce.tasks=<number>

java.io.IOException: Cannot run program
"C:\cygwin\home\xxxx\hadoop-1.0.4\/bin/hadoop" (in directory
"C:\cygwin\home\xxxx"): CreateProcess error=193, %1 n?est pas une
application Win32 valid

        at java.lang.ProcessBuilder.start(ProcessBuilder.java:460)

        at java.lang.Runtime.exec(Runtime.java:593)

        at java.lang.Runtime.exec(Runtime.java:431)

        at
org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:267)

        at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:133)

        at
org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)

        at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1332)

        at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1123)

        at org.apache.hadoop.hive.ql.Driver.run(Driver.java:931)

        at
org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:255)

        at
org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:212)

        at
org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403)

        at
org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:338)

        at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:637)

        at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:554)

        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

        at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

        at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)

        at java.lang.reflect.Method.invoke(Method.java:597)

        at org.apache.hadoop.util.RunJar.main(RunJar.java:156)

Caused by: java.io.IOException: CreateProcess error=193, %1 n?est pas une
application Win32 valid

        at java.lang.ProcessImpl.create(Native Method)

        at java.lang.ProcessImpl.<init>(ProcessImpl.java:81)

        at java.lang.ProcessImpl.start(ProcessImpl.java:30)

        at java.lang.ProcessBuilder.start(ProcessBuilder.java:453)

        ... 19 more

FAILED: Execution Error, return code 1 from
org.apache.hadoop.hive.ql.exec.MapRedTask
Thank for your help.
+
Nitin Pawar 2012-11-22, 09:35