经验首页 前端设计 程序设计 Java相关 移动开发 数据库/运维 软件/图像 大数据/云计算 其他经验
当前位置:技术经验 » 大数据/云/AI » Hadoop » 查看文章
Mac上Hive安装配置
来源:cnblogs  作者:涛姐涛哥  时间:2019/6/17 8:43:43  对本文有异议

Mac上Hive安装配置

 

1、安装

下载hive,地址:http://mirror.bit.edu.cn/apache/hive/
之前我配置了集群,tjt01、tjt02、tjt03,这里hive安装在tjt01机器上。
我下载的是“apache-hive-3.0.0-bin.tar.gz”,将hive 3.0版本上传到/opt目录,并解压到/usr/local下:
  1. [root@tjt01 ~]# cd /opt
  2. [root@tjt01 opt]# tar -zxvf apache-hive-3.0.0-bin.tar.gz -C /usr/local/

将目录重命名为hive目录:
  1. [root@tjt01 opt]# cd /usr/local/
  2. [root@tjt01 local]# mv apache-hive-3.0.0-bin hive
  3. [root@tjt01 local]#
修改环境变量/etc/profile:
  1. [root@tjt01 local]# vi /etc/profile

在profile文件中添加如下内容:

  1. export HIVE_HOME=/usr/local/hive
  2. export PATH=$PATH:$HIVE_HOME/bin

生效profile:

  1. [root@tjt01 local]# vi /etc/profile
  2. [root@tjt01 local]# source /etc/profile

执行 hive --version查看hive版本

  1. [root@tjt01 local]# hive --version
  2. SLF4J: Class path contains multiple SLF4J bindings.
  3. SLF4J: Found binding in [jar:file:/usr/local/hive/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
  4. SLF4J: Found binding in [jar:file:/opt/hadoop-2.7.6/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
  5. SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
  6. SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
  7. Hive 3.0.0
  8. Git git://vgargwork.local/Users/vgarg/repos/hive.apache.master.latest -r ce61711a5fa54ab34fc74d86d521ecaeea6b072a
  9. Compiled by vgarg on Fri May 18 11:38:33 PDT 2018
  10. From source with checksum 81fcb93b608965ed7ac968bae1187fab
  11. [root@tjt01 local]#

2、安装Mysql

我之前安装过了,Mysql安装参考:https://www.cnblogs.com/taojietaoge/p/10692557.html

 启动Mysql服务:

  1. [root@tjt03 ~]# sudo service mysqld start

启动过程报错了下,简单解决如下:

  1. [root@tjt03 ~]# /etc/init.d/mysqld start
  2. Starting mysqld (via systemctl): Job for mysqld.service failed because the control process exited with error code. See "systemctl status mysqld.service" and "journalctl -xe" for details.
  3. [FAILED]
  4. [root@tjt03 ~]# mkdir /var/run/mysqld/
  5. [root@tjt03 ~]# chown mysql.mysql /var/run/mysqld/
  6. [root@tjt03 ~]# sudo service mysqld start
  7. Starting mysqld (via systemctl): [ OK ]
  8. [root@tjt03 ~]#

设置Mysql开机启动:

  1. [root@tjt03 ~]# systemctl enable mysqld
  2. mysqld.service is not a native service, redirecting to /sbin/chkconfig.
  3. Executing /sbin/chkconfig mysqld on
  4. [root@tjt03 ~]# systemctl daemon-reload
  5. [root@tjt03 ~]#

3、配置

3.1 修改hive-site.xml

  1. [root@tjt01 conf]# cd ~
  2. [root@tjt01 ~]# cd /usr/local/hive/conf/
  3. [root@tjt01 conf]# cp hive-default.xml.template hive-site.xml
  4. [root@tjt01 conf]# vim hive-site.xml

xml内容如下:

  1. <?xml version="1.0" encoding="UTF-8" standalone="no"?>
  2. <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
  3. <configuration>
  4. <property>
  5. <name>javax.jdo.option.ConnectionURL</name>
  6. <value>jdbc:mysql://172.16.114.132:3306/hive</value>
  7. </property>
  8. <property>
  9. <name>javax.jdo.option.ConnectionDriverName</name>
  10. <value>com.mysql.jdbc.Driver</value>
  11. </property>
  12. <property>
  13. <name>javax.jdo.option.ConnectionUserName</name>
  14. <value>root</value>
  15. </property>
  16. <property>
  17. <name>javax.jdo.option.ConnectionPassword</name>
  18. <value>TANjintao@520</value>
  19. </property>
  20. <property>
  21. <name>hive.metastore.schema.verification</name>
  22. <value>false</value>
  23. </property>
  24. </configuration>

3.2 复制Mysql的程序程序到hive/lib下

mysql-connector-java.jar

3.3 创建Mysql下的hive数据库

  1. mysql> create database hive;
    Query OK, 1 row affected (0.01 sec)
    mysql>

3.4 在Mysql中hive的schema创建

  1. [root@tjt01 bin]# schematool -dbType mysql -initSchema
  2. SLF4J: Class path contains multiple SLF4J bindings.
  3. SLF4J: Found binding in [jar:file:/usr/local/hive/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
  4. SLF4J: Found binding in [jar:file:/opt/hadoop-2.7.6/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
  5. SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
  6. SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
  7. Metastore connection URL: jdbc:mysql://172.16.114.132:3306/hive
  8. Metastore Connection Driver : com.mysql.jdbc.Driver
  9. Metastore connection User: root
  10. Starting metastore schema initialization to 3.0.0
  11. Initialization script hive-schema-3.0.0.mysql.sql
  12. Initialization script completed
  13. schemaTool completed
  14. [root@tjt01 bin]#

4、测试

进入hive之前,开启hadoop,键入hive进入hive:

  1. [root@tjt01 bin]# start-dfs.sh
  2. Starting namenodes on [tjt01]
  3. tjt01: starting namenode, logging to /opt/hadoop-2.7.6/logs/hadoop-root-namenode-tjt01.out
  4. tjt03: starting datanode, logging to /opt/hadoop-2.7.6/logs/hadoop-root-datanode-tjt03.out
  5. tjt02: starting datanode, logging to /opt/hadoop-2.7.6/logs/hadoop-root-datanode-tjt02.out
  6. tjt01: starting datanode, logging to /opt/hadoop-2.7.6/logs/hadoop-root-datanode-tjt01.out
  7. Starting secondary namenodes [tjt02]
  8. tjt02: starting secondarynamenode, logging to /opt/hadoop-2.7.6/logs/hadoop-root-secondarynamenode-tjt02.out
  9. [root@tjt01 bin]#hive

创建hive数据库:

  1. hive> create database hive_1;
  2. OK
  3. Time taken: 0.709 seconds
  4. hive> show databases;
  5. OK
  6. default
  7. hive_1
  8. Time taken: 0.238 seconds, Fetched: 2 row(s)
  9. hive>

观察Mysql下hive数据库的变化:

  1. mysql> select * from DBS;

在hive_1下创建一个hive_01:

  1. hive> use hive_1;
  2. OK
  3. Time taken: 0.066 seconds
  4. hive> create table hive_01 (id int, name string);
  5. OK
  6. Time taken: 1.235 seconds
  7. hive>

再次观察Mysql下hive数据库的变化:

  1. mysql> select * from TBLS;

 

到此为止,Mac安装Hive完美收官!

 

 

 

 

原文链接:http://www.cnblogs.com/taojietaoge/p/11029529.html

 友情链接:直通硅谷  点职佳  北美留学生论坛

本站QQ群:前端 618073944 | Java 606181507 | Python 626812652 | C/C++ 612253063 | 微信 634508462 | 苹果 692586424 | C#/.net 182808419 | PHP 305140648 | 运维 608723728

W3xue 的所有内容仅供测试,对任何法律问题及风险不承担任何责任。通过使用本站内容随之而来的风险与本站无关。
关于我们  |  意见建议  |  捐助我们  |  报错有奖  |  广告合作、友情链接(目前9元/月)请联系QQ:27243702 沸活量
皖ICP备17017327号-2 皖公网安备34020702000426号