MySQL && hive环境搭建详谈

 1、hive不支持多个客户端窗口启动，否则会产生java.sql.SQLException
    
    2、MySQL安装（二进制，cmake编译安装，rpm安装,yum）。个人喜欢二进制和cmake
             查看：rpm -qa | grep mysql
             卸载：rpm -e --nodeps ...
             解压：tar zxf mysql-5.7.26-linux-glibc2.12-x86_64.tar.gz -C opt/modules
             重命名：mv mysql-5.7.26-linux-glibc2.12-x86_64/ mysql　
             建立MySQL用户账号：useradd -s sbin/nologin -M mysql
             查看建立的用户：id mysql
             创建数据目录，修改MySQL文件所属主及所属组
                 cd mysql
                 mkdir mysql_data
                 chown -R mysql.mysql opt/modules/mysql/
          
           3、初始化数据库
                 bin/mysqld --initialize --user=mysql --basedir=/opt/modules/mysql --datadir=/opt/modules/mysql_data　
                
                4、编辑配置文件    
 [root@hadoop.localhost131 modules]# cat etc/my.cnf
 [mysqld]
 user=mysql
 basedir=/opt/modules/mysql
 datadir=/opt/modules/mysql_data
 pid-file=/tmp/mysqld.pid
 server_id=6
 port=3306
 socket=/tmp/mysql.sock
 [mysql]
 socket=/tmp/mysql.sock
 prompt=3306 [\\d]>


5、配置环境变量 vim etc/profile,并刷新
 #mysql
 export PATH=/opt/modules/mysql/bin:$PATH

6、生成启动脚本并启动MySQL

 [root@hadoop.localhost131 mysql]# cp support-files/mysql.server etc/init.d/mysqld
 [root@hadoop.localhost131 mysql]# chmod +x etc/init.d/mysqld
 [root@hadoop.localhost131 mysql]# vim etc/init.d/mysqld
 basedir=/opt/modules/mysql　　//在第46~47行
 datadir=/opt/modules/mysql_data
 [root@hadoop.localhost131 mysql]# etc/init.d/mysqld start
 Starting MySQL. SUCCESS!

7、启动MySQL并修改密码
 [root@hadoop.localhost131 mysql]# mysql -uroot -p'初始化时产生的密码'
 mysql> set password for root@localhost=password('root');
 Query OK, 0 rows affected, 1 warning (0.00 sec)
 
 mysql> show variables like 'validate_password%';　　//可以看到没有密码复杂度插件
 Empty set (0.01 sec)
 
 mysql> exit
 Bye
 [root@hadoop.localhost131 mysql]# mysql -uroot -proot
 mysql>

8、MySQL中user表中主机配置
 mysql>show databases;
 mysql>use mysql;
 mysql>show tables;
 mysql>update user set host="%" where host="localhost"; 修改user表，将host表内容修改为%
 删除root的其他host
 刷新
 退出

9、hive元数据配置到MySQL，配置完毕后重启hive和hadoop

1）驱动拷贝
cp mysql-connector-java-5.1.27-bin.jar opt/modules/hive-1.2.1/lib/

2）配置hive-site.xml
 [root@hadoop.localhost131 conf]# cat hive-site.xml
 <?xml version="1.0" encoding="UTF-8" standalone="no"?>
 <?xml-stylesheet type="text/xsl" href="configuration.xsl"?><!--
    Licensed to the Apache Software Foundation (ASF) under one or more
    contributor license agreements.  See the NOTICE file distributed with
    this work for additional information regarding copyright ownership.
    The ASF licenses this file to You under the Apache License, Version 2.0
    (the "License"); you may not use this file except in compliance with
    the License.  You may obtain a copy of the License at

        http://www.apache.org/licenses/LICENSE-2.0

    Unless required by applicable law or agreed to in writing, software
    distributed under the License is distributed on an "AS IS" BASIS,
    WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
    See the License for the specific language governing permissions and
    limitations under the License.
  -->
 <configuration>
    <property>
             <name>javax.jdo.option.ConnectionURL</name>
             <value>jdbc:mysql://hadoop.localhost131:3306/metastore?createDatabaseIfNotExist=true</value>
             <description>JDBC connect string for a JDBC metastore</description>
       </property>
    
       <property>
         <name>javax.jdo.option.ConnectionDriverName</name>
              <value>com.mysql.jdbc.Driver</value>
             <description>Driver class name for a JDBC metastore</description>
       </property>

       <property>
             <name>javax.jdo.option.ConnectionUserName</name>
             <value>root</value>
             <description>username to use against metastore database</description>
       </property>

       <property>
             <name>javax.jdo.option.ConnectionPassword</name>
             <value>****</value>
             <description>password to use against metastore database</description>
       </property>

       <property>
             <name>hive.cli.print.header</name>
             <value>true</value>
             <description>Whether to print the names of the columns in query output.</description>
       </property>

    <property>
             <name>hive.cli.print.current.db</name>
             <value>true</value>
             <description>Whether to include the current database in the Hive prompt.</description>
       </property>

</configuration>

至此，hive可实现多客户端窗口启动
至/opt/modules/hive-1.2.1/
bin/hive----启动，在启动之前需先启动HDFS和yarn

◆ Linux Shell 编程特殊符号详解

◆ 再谈重定向

◆ 详解Linux正则

◆ Python正则知多少

◆ Linux三剑客之grep

◆ Linux三剑客之sed详解（1）

◆ linux三剑客之sed详解（2）

◆ 小白入门awk必备

◆ 你所不知道的awk内建函数