Home | About | Sematext search-lucene.com search-hadoop.com
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB
 Search Hadoop and all its subprojects:

Switch to Plain View
Accumulo >> mail # dev >> TFile.java - is it needed?


Copy link to this message
-
TFile.java - is it needed?
I searched for TFile and found six references as shown below. Each
reference is to a static method or value. It seems like TFile comes
from Hadoop? Can we pull this information from an Hadoop jar file or
can we pull the static stuff into the BCFile class?

BCFile.java
  123: fsOutputBuffer.setCapacity(TFile.getFSOutputBufferSize(conf));
  461: decompressor, TFile.getFSInputBufferSize(conf));
Compression.java
  75: LZO(TFile.COMPRESSION_LZO) {
  140: GZ(TFile.COMPRESSION_GZ) {
  184: NONE(TFile.COMPRESSION_NONE) {
  213: SNAPPY(TFile.COMPRESSION_SNAPPY) {

Here is what is used from TFile.java:

  static int getFSInputBufferSize(Configuration conf) {
    return conf.getInt(FS_INPUT_BUF_SIZE_ATTR, 256 * 1024);
  }

  /** snappy codec **/
  public static final String COMPRESSION_SNAPPY = "snappy";
  /** compression: gzip */
  public static final String COMPRESSION_GZ = "gz";
  /** compression: lzo */
  public static final String COMPRESSION_LZO = "lzo";
  /** compression: none */
  public static final String COMPRESSION_NONE = "none";
NEW: Monitor These Apps!
elasticsearch, apache solr, apache hbase, hadoop, redis, casssandra, amazon cloudwatch, mysql, memcached, apache kafka, apache zookeeper, apache storm, ubuntu, centOS, red hat, debian, puppet labs, java, senseiDB