Chaos and Order

💡 왼쪽 원문을 읽으면서 오른쪽에 따라 써보세요. Tab 키로 힌트를 받을 수 있습니다.

원문 렌더가 준비되기 전까지 텍스트 가이드로 표시합니다.

Overview

Hive is a MapReduce wrapper that allows you to query data stored in Hadoop using SQL.

Installation Steps

MySQL Installation

sudo apt install mysql-server

MySQL Connector Installation

Download the mysql-connector version compatible with your installed MySQL from [mysql-connector-official-download-site](https://downloads.mysql.com/archives/c-j/).

wget https://downloads.mysql.com/archives/get/p/3/file/mysql-connector-java_8.0.30-1ubuntu22.04_all.deb

dpkg -x mysql-connector-java_8.0.30-1ubuntu22.04_all.deb ./

cp usr/share/java/mysql-connector-java-8.0.30.jar /usr/local/hive/lib/

Hive Installation

Find and download the appropriate Hive version from [https://www.apache.org/dyn/closer.cgi/hive/](https://www.apache.org/dyn/closer.cgi/hive/).

wget https://dlcdn.apache.org/hive/hive-3.1.3/apache-hive-3.1.3-bin.tar.gz

tar -zxvf apache-hive-3.1.3-bin.tar.gz

cd -R apache-hive-3.1.3-bin /usr/local/hive

Editing ~/.bashrc

Add the `HIVE_HOME` environment variable.

export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64

export HADOOP_HOME=/usr/local/hadoop

export HADOOP_MAPRED_HOME=$HADOOP_HOME

export HADOOP_COMMON_HOME=$HADOOP_HOME

export HADOOP_HDFS_HOME=$HADOOP_HOME

export YARN_HOME=$HADOOP_HOME

export HADOOP_CONF_DIR=$HADOOP_HOME/etc/hadoop

export YARN_CONF_DIR=$HADOOP_HOME/etc/hadoop

export HADOOP_YARN_USER=${HADOOP_YARN_USER:-yarn}

export HIVE_HOME=/usr/local/hive

PATH=$PATH:$HADOOP_HOME/bin:$HADOOP_HOME/sbin:$JAVA_HOME/bin:$HIVE_HOME/bin

Editing hive-env.sh

Set the Hadoop home directory below.

HADOOP_HOME=/usr/local/hadoop

Editing hive-site.xml

Since the hive-site.xml file does not exist initially, copy the `hive-default.xml.template` file to create hive-site.xml.

Add the following content.

Modify the following content.

JDBC connect string for a JDBC metastore.

To use SSL to encrypt/authenticate the connection, provide database-specific SSL flag in the connection URL.

For example, jdbc:postgresql://myhost/db?ssl=true for postgres database.

Metastore Schema Initialization

schematool -initSchema -dbType mysql -verbose

Running Hive

/usr/local/hive/bin/hive

Quiz

Learn how to install Apache Hive

MySQL Installation MySQL Connector Installation Download the mysql-connector version compatible

with your installed MySQL from mysql-connector-official-download-site.