Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
HDFS >> mail # user >> hadoop fs -put vs writing text files to hadoop as sequence files


Copy link to this message
-
hadoop fs -put vs writing text files to hadoop as sequence files
Hi,
I have to upload some terabytes of data that is text files.

What would be good option to do so:

i) using hadoop fs -put to copy text files directly on hdfs.

ii) copying text files as sequence files on hdfs ? What would be extra time
in this case as opposed to (i).

Thanks,
Jimmy
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB