org.apache.hcatalog.common
Class HCatConstants

Object
  HCatConstants

public final class HCatConstants
extends Object

Field Summary

static String	CONF_MAPREDUCE_JOB_CREDENTIALS_BINARY
static String	HCAT_ADD_DATABASE_EVENT
static String	HCAT_ADD_PARTITION_EVENT
static String	HCAT_ADD_TABLE_EVENT
static String	HCAT_CREATE_DB_NAME
static String	HCAT_CREATE_TBL_NAME
static String	HCAT_DATA_CONVERT_BOOLEAN_TO_INTEGER "hcat.data.convert.boolean.to.integer" (default: false).
static boolean	HCAT_DATA_CONVERT_BOOLEAN_TO_INTEGER_DEFAULT
static String	HCAT_DATA_TINY_SMALL_INT_PROMOTION "hcat.data.tiny.small.int.promotion" (default: false).
static boolean	HCAT_DATA_TINY_SMALL_INT_PROMOTION_DEFAULT
static String	HCAT_DEFAULT_TOPIC_PREFIX
static String	HCAT_DESIRED_PARTITION_NUM_SPLITS The desired number of input splits produced for each partition.
static String	HCAT_DROP_DATABASE_EVENT
static String	HCAT_DROP_PARTITION_EVENT
static String	HCAT_DROP_TABLE_EVENT
static String	HCAT_DYNAMIC_PTN_JOBID
static String	HCAT_EVENT
static String	HCAT_GROUP
static String	HCAT_HIVE_CLIENT_EXPIRY_TIME
static int	HCAT_INPUT_BAD_RECORD_MIN_DEFAULT
static String	HCAT_INPUT_BAD_RECORD_MIN_KEY "hcat.input.bad.record.min" (default: 2).
static float	HCAT_INPUT_BAD_RECORD_THRESHOLD_DEFAULT
static String	HCAT_INPUT_BAD_RECORD_THRESHOLD_KEY "hcat.input.bad.record.threshold" (default: 9.999999747378752E-5f).
static boolean	HCAT_IS_DYNAMIC_MAX_PTN_CHECK_ENABLED
static String	HCAT_KEY_BASE
static String	HCAT_KEY_HIVE_CONF
static String	HCAT_KEY_JOB_INFO
static String	HCAT_KEY_OUTPUT_BASE
static String	HCAT_KEY_OUTPUT_INFO
static String	HCAT_KEY_OUTPUT_SCHEMA
static String	HCAT_KEY_TOKEN_SIGNATURE
static String	HCAT_METASTORE_PRINCIPAL
static String	HCAT_METASTORE_URI
static String	HCAT_MSG_CLEAN_FREQ
static String	HCAT_MSG_EXPIRY_DURATION
static String	HCAT_MSGBUS_TOPIC_NAME
static String	HCAT_MSGBUS_TOPIC_NAMING_POLICY
static String	HCAT_MSGBUS_TOPIC_PREFIX
static String	HCAT_PARTITION_DONE_EVENT
static String	HCAT_PERMS
static String	HCAT_PIG_ARGS_DELIMIT
static String	HCAT_PIG_ARGS_DELIMIT_DEFAULT
static String	HCAT_PIG_INNER_FIELD_NAME
static String	HCAT_PIG_INNER_FIELD_NAME_DEFAULT
static String	HCAT_PIG_INNER_TUPLE_NAME
static String	HCAT_PIG_INNER_TUPLE_NAME_DEFAULT
static String	HCAT_PIG_LOADER
static String	HCAT_PIG_LOADER_ARGS
static String	HCAT_PIG_LOADER_LOCATION_SET
static String	HCAT_PIG_STORAGE_CLASS
static String	HCAT_PIG_STORER
static String	HCAT_PIG_STORER_ARGS
static String	HCAT_PIG_STORER_EXTERNAL_LOCATION "hcat.pig.storer.external.location" (default: null) When the property is set in the UDFContext of the org.apache.hcatalog.pig.HCatStorer, HCatStorer writes to the location it specifies instead of the default HCatalog location format.
static String	HCAT_PIG_STORER_LOCATION_SET
static String	HCAT_TABLE_SCHEMA
static String	HIVE_RCFILE_IF_CLASS
static String	HIVE_RCFILE_OF_CLASS
static String[]	OUTPUT_CONFS_TO_SAVE
static String	SEQUENCEFILE_INPUT
static String	SEQUENCEFILE_OUTPUT
static String	SYSENV_HADOOP_TOKEN_FILE_LOCATION

Method Summary

Methods inherited from class Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

HIVE_RCFILE_IF_CLASS

public static final String HIVE_RCFILE_IF_CLASS

See Also:

Constant Field Values

HIVE_RCFILE_OF_CLASS

public static final String HIVE_RCFILE_OF_CLASS

See Also:

Constant Field Values

SEQUENCEFILE_INPUT

public static final String SEQUENCEFILE_INPUT

SEQUENCEFILE_OUTPUT

public static final String SEQUENCEFILE_OUTPUT

HCAT_PIG_STORAGE_CLASS

public static final String HCAT_PIG_STORAGE_CLASS

See Also:

Constant Field Values

HCAT_PIG_LOADER

public static final String HCAT_PIG_LOADER

See Also:

Constant Field Values

HCAT_PIG_LOADER_LOCATION_SET

public static final String HCAT_PIG_LOADER_LOCATION_SET

See Also:

Constant Field Values

HCAT_PIG_LOADER_ARGS

public static final String HCAT_PIG_LOADER_ARGS

See Also:

Constant Field Values

HCAT_PIG_STORER

public static final String HCAT_PIG_STORER

See Also:

Constant Field Values

HCAT_PIG_STORER_ARGS

public static final String HCAT_PIG_STORER_ARGS

See Also:

Constant Field Values

HCAT_PIG_ARGS_DELIMIT

public static final String HCAT_PIG_ARGS_DELIMIT

See Also:

Constant Field Values

HCAT_PIG_ARGS_DELIMIT_DEFAULT

public static final String HCAT_PIG_ARGS_DELIMIT_DEFAULT

See Also:

Constant Field Values

HCAT_PIG_STORER_LOCATION_SET

public static final String HCAT_PIG_STORER_LOCATION_SET

See Also:

Constant Field Values

HCAT_PIG_INNER_TUPLE_NAME

public static final String HCAT_PIG_INNER_TUPLE_NAME

See Also:

Constant Field Values

HCAT_PIG_INNER_TUPLE_NAME_DEFAULT

public static final String HCAT_PIG_INNER_TUPLE_NAME_DEFAULT

See Also:

Constant Field Values

HCAT_PIG_INNER_FIELD_NAME

public static final String HCAT_PIG_INNER_FIELD_NAME

See Also:

Constant Field Values

HCAT_PIG_INNER_FIELD_NAME_DEFAULT

public static final String HCAT_PIG_INNER_FIELD_NAME_DEFAULT

See Also:

Constant Field Values

HCAT_PIG_STORER_EXTERNAL_LOCATION

public static final String HCAT_PIG_STORER_EXTERNAL_LOCATION

"hcat.pig.storer.external.location" (default: null) When the property is set in the UDFContext of the org.apache.hcatalog.pig.HCatStorer, HCatStorer writes to the location it specifies instead of the default HCatalog location format. An example can be found in org.apache.hcatalog.pig.HCatStorerWrapper.

See Also:

Constant Field Values

HCAT_KEY_BASE

public static final String HCAT_KEY_BASE

See Also:

Constant Field Values

HCAT_KEY_OUTPUT_SCHEMA

public static final String HCAT_KEY_OUTPUT_SCHEMA

See Also:

Constant Field Values

HCAT_KEY_JOB_INFO

public static final String HCAT_KEY_JOB_INFO

See Also:

Constant Field Values

HCAT_HIVE_CLIENT_EXPIRY_TIME

public static final String HCAT_HIVE_CLIENT_EXPIRY_TIME

See Also:

Constant Field Values

HCAT_TABLE_SCHEMA

public static final String HCAT_TABLE_SCHEMA

See Also:

Constant Field Values

HCAT_METASTORE_URI

public static final String HCAT_METASTORE_URI

HCAT_PERMS

public static final String HCAT_PERMS

See Also:

Constant Field Values

HCAT_GROUP

public static final String HCAT_GROUP

See Also:

Constant Field Values

HCAT_CREATE_TBL_NAME

public static final String HCAT_CREATE_TBL_NAME

See Also:

Constant Field Values

HCAT_CREATE_DB_NAME

public static final String HCAT_CREATE_DB_NAME

See Also:

Constant Field Values

HCAT_METASTORE_PRINCIPAL

public static final String HCAT_METASTORE_PRINCIPAL

HCAT_DESIRED_PARTITION_NUM_SPLITS

public static final String HCAT_DESIRED_PARTITION_NUM_SPLITS

The desired number of input splits produced for each partition. When the input files are large and few, we want to split them into many splits, so as to increase the parallelizm of loading the splits. Try also two other parameters, mapred.min.split.size and mapred.max.split.size, to control the number of input splits.

See Also:

Constant Field Values

HCAT_KEY_OUTPUT_BASE

public static final String HCAT_KEY_OUTPUT_BASE

See Also:

Constant Field Values

HCAT_KEY_OUTPUT_INFO

public static final String HCAT_KEY_OUTPUT_INFO

See Also:

Constant Field Values

HCAT_KEY_HIVE_CONF

public static final String HCAT_KEY_HIVE_CONF

See Also:

Constant Field Values

HCAT_KEY_TOKEN_SIGNATURE

public static final String HCAT_KEY_TOKEN_SIGNATURE

See Also:

Constant Field Values

OUTPUT_CONFS_TO_SAVE

public static final String[] OUTPUT_CONFS_TO_SAVE

HCAT_MSG_CLEAN_FREQ

public static final String HCAT_MSG_CLEAN_FREQ

See Also:

Constant Field Values

HCAT_MSG_EXPIRY_DURATION

public static final String HCAT_MSG_EXPIRY_DURATION

See Also:

Constant Field Values

HCAT_MSGBUS_TOPIC_NAME

public static final String HCAT_MSGBUS_TOPIC_NAME

See Also:

Constant Field Values

HCAT_MSGBUS_TOPIC_NAMING_POLICY

public static final String HCAT_MSGBUS_TOPIC_NAMING_POLICY

See Also:

Constant Field Values

HCAT_MSGBUS_TOPIC_PREFIX

public static final String HCAT_MSGBUS_TOPIC_PREFIX

See Also:

Constant Field Values

HCAT_DYNAMIC_PTN_JOBID

public static final String HCAT_DYNAMIC_PTN_JOBID

See Also:

Constant Field Values

HCAT_IS_DYNAMIC_MAX_PTN_CHECK_ENABLED

public static final boolean HCAT_IS_DYNAMIC_MAX_PTN_CHECK_ENABLED

See Also:

Constant Field Values

HCAT_DEFAULT_TOPIC_PREFIX

public static final String HCAT_DEFAULT_TOPIC_PREFIX

See Also:

Constant Field Values

HCAT_EVENT

public static final String HCAT_EVENT

See Also:

Constant Field Values

HCAT_ADD_PARTITION_EVENT

public static final String HCAT_ADD_PARTITION_EVENT

See Also:

Constant Field Values

HCAT_DROP_PARTITION_EVENT

public static final String HCAT_DROP_PARTITION_EVENT

See Also:

Constant Field Values

HCAT_PARTITION_DONE_EVENT

public static final String HCAT_PARTITION_DONE_EVENT

See Also:

Constant Field Values

HCAT_ADD_TABLE_EVENT

public static final String HCAT_ADD_TABLE_EVENT

See Also:

Constant Field Values

HCAT_DROP_TABLE_EVENT

public static final String HCAT_DROP_TABLE_EVENT

See Also:

Constant Field Values

HCAT_ADD_DATABASE_EVENT

public static final String HCAT_ADD_DATABASE_EVENT

See Also:

Constant Field Values

HCAT_DROP_DATABASE_EVENT

public static final String HCAT_DROP_DATABASE_EVENT

See Also:

Constant Field Values

SYSENV_HADOOP_TOKEN_FILE_LOCATION

public static final String SYSENV_HADOOP_TOKEN_FILE_LOCATION

See Also:

Constant Field Values

CONF_MAPREDUCE_JOB_CREDENTIALS_BINARY

public static final String CONF_MAPREDUCE_JOB_CREDENTIALS_BINARY

See Also:

Constant Field Values

HCAT_DATA_CONVERT_BOOLEAN_TO_INTEGER

public static final String HCAT_DATA_CONVERT_BOOLEAN_TO_INTEGER

"hcat.data.convert.boolean.to.integer" (default: false). Pig < 0.10.0 does not have boolean support, and scripts written for pre-boolean Pig versions will not expect boolean values when upgrading Pig. For integration the option is offered to convert boolean fields to integers by setting this Hadoop configuration key.

See Also:

Constant Field Values

HCAT_DATA_CONVERT_BOOLEAN_TO_INTEGER_DEFAULT

public static final boolean HCAT_DATA_CONVERT_BOOLEAN_TO_INTEGER_DEFAULT

See Also:

Constant Field Values

HCAT_DATA_TINY_SMALL_INT_PROMOTION

public static final String HCAT_DATA_TINY_SMALL_INT_PROMOTION

"hcat.data.tiny.small.int.promotion" (default: false). Hive tables support tinyint and smallint columns, while not all processing frameworks support these types (Pig only has integer for example). Enable this property to promote tinyint and smallint columns to integer at runtime. Note that writes to tinyint and smallint columns enforce bounds checking and jobs will fail if attempting to write values outside the column bounds.

See Also:

Constant Field Values

HCAT_DATA_TINY_SMALL_INT_PROMOTION_DEFAULT

public static final boolean HCAT_DATA_TINY_SMALL_INT_PROMOTION_DEFAULT

See Also:

Constant Field Values

HCAT_INPUT_BAD_RECORD_THRESHOLD_KEY

public static final String HCAT_INPUT_BAD_RECORD_THRESHOLD_KEY

"hcat.input.bad.record.threshold" (default: 9.999999747378752E-5f). Threshold for the ratio of bad records that will be silently skipped without causing a task failure. This is useful when processing large data sets with corrupt records, when its acceptable to skip some bad records.

See Also:

Constant Field Values

HCAT_INPUT_BAD_RECORD_THRESHOLD_DEFAULT

public static final float HCAT_INPUT_BAD_RECORD_THRESHOLD_DEFAULT

See Also:

Constant Field Values

HCAT_INPUT_BAD_RECORD_MIN_KEY

public static final String HCAT_INPUT_BAD_RECORD_MIN_KEY

"hcat.input.bad.record.min" (default: 2). Number of bad records that will be accepted before applying "hcat.input.bad.record.threshold". This is necessary to prevent an initial bad record from causing a task failure.

See Also:

Constant Field Values

HCAT_INPUT_BAD_RECORD_MIN_DEFAULT

public static final int HCAT_INPUT_BAD_RECORD_MIN_DEFAULT

See Also:

Constant Field Values