Friday, 8 September 2017

4)Hive File Formats and Compression

Hive File Formats and Compression:

File Formats
Hive supports several file formats:
  •     Text File
  •     SequenceFile
  •     RCFile
  •     Avro Files
  •     ORC Files
  •     Parquet
  •     Custom INPUTFORMAT and OUTPUTFORMAT
The hive.default.fileformat configuration parameter determines the format to use if it is not specified in a CREATE TABLE or ALTER TABLE statement.  Text file is the parameter's default value.


File Compression
  •     Compressed Data Storage
  •     LZO Compression
  •     Snappy Compression
Previous page                                                                                                       Next page
at
Labels:

No comments:

Post a Comment

Subscribe to: Post Comments (Atom)

Fundamentals of Python programming

Fundamentals of Python programming: Following below are the fundamental constructs of Python programming: Python Data types Python...

  • 1)About Apache Spark
    Apache Spark: Apache Spark is in-memory cluster computing technology that increases the processing speed of an application. Spark uses ...
  • 6)Hive Data Definition Language(DDL)- Tables
    Hive Data Definition Language(DDL)- Tables Hive Tables: In Hive, Tables are collection of data records which have same schema for all th...
  • Custom date format in Data set
    Custom date format in Data set: Basically we receive data from different sources, so usually have different types of date formats. (may ...