Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Pig >> mail # user >> python modules


Copy link to this message
-
Re: python modules
Hi Clay,

I am running a very recent version (one that contains this patch) of
pig which was compiled from the trunk.
How can I examine the jar file to determine which jython modules have
been added?

Thanks,

stan

On Tue, Oct 18, 2011 at 12:38 PM, Clay B. <[EMAIL PROTECTED]> wrote:
> Hi Stan,
>
> I believe you are hitting https://issues.apache.org/jira/browse/PIG-1824
>
> -Clay
>
> On Mon, 17 Oct 2011, Stan Rosenberg wrote:
>
>> Hi,
>>
>> What's a proper way to deploy python udfs? I've dropped the latest
>> version of jython.jar in $PIG_HOME/lib.
>> Things work in "local" mode, but when I run on a cluster, built-in
>> python modules cannot be found. E.g., urlparse cannot be located:
>>
>> ImportError: No module named urlparse
>>
>>       at org.python.core.PyException.fillInStackTrace(PyException.java:70)
>>       at java.lang.Throwable.<init>(Throwable.java:181)
>>       at java.lang.Exception.<init>(Exception.java:29)
>>       at java.lang.RuntimeException.<init>(RuntimeException.java:32)
>>       at org.python.core.PyException.<init>(PyException.java:46)
>>       at org.python.core.PyException.<init>(PyException.java:43)
>>       at org.python.core.PyException.<init>(PyException.java:61)
>>       at org.python.core.Py.ImportError(Py.java:290)
>>       at org.python.core.imp.import_first(imp.java:750)
>>       at org.python.core.imp.import_name(imp.java:834)
>>       at org.python.core.imp.importName(imp.java:884)
>>       at org.python.core.ImportFunction.__call__(__builtin__.java:1220)
>>       at org.python.core.PyObject.__call__(PyObject.java:357)
>>       at org.python.core.__builtin__.__import__(__builtin__.java:1173)
>>       at org.python.core.imp.importFromAs(imp.java:978)
>>       at org.python.core.imp.importFrom(imp.java:954)
>>       at org.python.pycode._pyx3.f$0(udfs.py:40)
>>       at org.python.pycode._pyx3.call_function(udfs.py)
>>       at org.python.core.PyTableCode.call(PyTableCode.java:165)
>>       at org.python.core.PyCode.call(PyCode.java:18)
>>       at org.python.core.Py.runCode(Py.java:1261)
>>       at
>> org.python.util.PythonInterpreter.execfile(PythonInterpreter.java:235)
>>       at
>> org.apache.pig.scripting.jython.JythonScriptEngine$Interpreter.execfile(JythonScriptEngine.java:176)
>>       ... 15 more
>>
>> Thanks,
>>
>> stan
>>
>