Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Threaded View
Sqoop, mail # user - /tmp dir for import configurable?


Copy link to this message
-
/tmp dir for import configurable?
Christian Prokopp 2013-03-28, 15:35
Hi,

I am using sqoop to copy data from MySQL to S3:

(Sqoop 1.4.2-cdh4.2.0)
$ sqoop import --connect jdbc:mysql://server:port/db --username user
--password pass  --table tablename --target-dir s3n://xyz@somehwere/a/b/c
--fields-terminated-by='\001' -m 1 --direct

My problem is that sqoop temporarily stores the data on /tmp, which is not
big enough for the data. I am unable to find a configuration option to
point sqoop to a bigger partition/disk. Any suggestions?

Cheers,
Christian