Sqoop

Sqoop is a command-line interface application for transferring data between relational databases and Hadoop.

The Sqoop tool can help import the structured data from relational databases, NoSQL systems, and even from enterprise data warehouses. This tool makes it easy to import data from external systems to HDFS. This way it is possible to populate the tables in Hive and HBase. You can write Sqoop jobs using Sqoop scripts. Integrating Sqoop with Oozie allows for the scheduling and automating of import and export tasks. The Sqoop architecture is a connector-based architecture that can support plugins, which provides connectivity to new external sources.

This is the process in which individual tables are imported from the relational database to Hadoop Distributed File System (HDFS). For the purpose of transferring, the row in a table is considered as a record in HDFS. The recorded data is stored in the form of text data in text files, or they are stored in Sequence and Avro files as binary data.

Sqoop export is used for transferring data from HDFS to RDBMS. The input of the Sqoop file would be the records that are considered as rows in the table. This data is scanned and processed into records and used with the user-specified delimiter.