-debug pig UDF in production EC2 using eclipse ?
Yang 2012-02-03, 06:01
sometimes I need to debug a pig UDF in production EC2 cluster using eclipse,
this is normally what I do for debugging a remote jvm:
add "-Xdebug -Xrunjdwp:transport=dt_socket,address=12345,server=y,suspend=y
" to JVM options
then connect eclipse "debug remote application" to this remote host and
but EC2 normally does not open any ports, so I do ssh tunneling from my
laptop (where eclipse runs) to EC2,
and then tell eclipse to connect to localhost:12345 ( the ssh command is
"ssh -L12345:ec2_box:12345 ec2_box )
the above procedure works perfect for normal java jobs. but somehow it
takes a long while for pig (running in -x local mode ) to respond ---
although it does finally connect to eclipse
how do you handle such cases?