Home | About | Sematext search-lucene.com search-hadoop.com
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS >> mail # user >> hadoop fs -put vs writing text files to hadoop as sequence files


Copy link to this message
-
hadoop fs -put vs writing text files to hadoop as sequence files
Hi,
I have to upload some terabytes of data that is text files.

What would be good option to do so:

i) using hadoop fs -put to copy text files directly on hdfs.

ii) copying text files as sequence files on hdfs ? What would be extra time
in this case as opposed to (i).

Thanks,
Jimmy