ogg veridata23c 安装体验

[TOC]

一. 安装 veridata23c server

1. 前提要求

1. 新特性：不再依赖Oracle Fusion Middleware，简化了安装步骤
2. 安装JDK version 17
3. 安装mysql 8.0.34 及以后

参考官方文档：对比12c veridata安装步骤，确实简化了很多👍️

https://docs.oracle.com/en/middleware/goldengate/veridata/23/gvdug/installing-and-running-oracle-goldengate-veridata.html#GVDUG-GUID-F70C6F17-0DED-489D-8060-F289D3360075

2. 环境准备

2.1 创建Oracle用户

-- 配置/etc/hosts  网络
[root@veridata23c ~]# cat /etc/hosts
127.0.0.1       localhost
::1     localhost ip6-localhost ip6-loopback
172.88.0.18     veridata23c

--  创建用户和组
[root@veridata23c ~]# /usr/sbin/groupadd -g 1002 dba
[root@veridata23c ~]# /usr/sbin/groupadd -g 1001 oinstall
[root@veridata23c ~]# /usr/sbin/groupadd -g 1003 oper
[root@veridata23c ~]#
[root@veridata23c ~]# useradd -u 1001 -g oinstall -G dba,oper oracle
[root@veridata23c ~]# echo "oracle" |passwd oracle --stdin
Changing password for user oracle.
passwd: all authentication tokens updated successfully.
复制

2.2 安装mysql

mysql 安装过程略。。。

-- 安装mysql 版本要求：8.0.34 及以后
[root@veridata23c ~]# mysql -uroot -pxxx
mysql: [Warning] Using a password on the command line interface can be insecure.
Welcome to the MySQL monitor.  Commands end with ; or \g.
Your MySQL connection id is 9
Server version: 8.0.34 MySQL Community Server - GPL

Copyright (c) 2000, 2023, Oracle and/or its affiliates.

Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.

Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.

mysql>
复制

2.3 安装java

[root@veridata23c ~]# tar -xzvf jdk-17.0.13_linux-x64_bin.tar.gz  -C /usr/bin/

[oracle@veridata23c ~]$ vi .bash_profile
export JAVA_HOME=/usr/bin/jdk-17.0.13
export PATH=$JAVA_HOME/bin:$PATH

[oracle@veridata23c ~]$ source .bash_profile

[oracle@veridata23c ~]$ java -version
java version "17.0.13" 2024-10-15 LTS
Java(TM) SE Runtime Environment (build 17.0.13+10-LTS-268)
Java HotSpot(TM) 64-Bit Server VM (build 17.0.13+10-LTS-268, mixed mode, sharing)
复制

2.4 安装veridata server

-- 创建安装路径
[root@veridata23c ~]# mkdir -p /ogg/soft
[root@veridata23c ~]# mkdir -p /ogg/vdt23c
[root@veridata23c ~]# chown -R oracle:oinstall /ogg
[root@veridata23c ~]# chmod -R 755 /ogg

[oracle@veridata23c soft]$ ll
total 892348
-rw-r--r-- 1 oracle oinstall 913761799 Dec 20 19:00 goldengate-veridata-23.1.0.0.0.zip
[oracle@veridata23c soft]$
[oracle@veridata23c soft]$ unzip -q goldengate-veridata-23.1.0.0.0.zip
[oracle@veridata23c soft]$ ll
total 892476
drwxr-xr-x 3 oracle oinstall        19 Oct 17 04:39 fbo_oggvdt_linux_services_shiphome
-rw-r--r-- 1 oracle oinstall 913761799 Dec 20 19:00 goldengate-veridata-23.1.0.0.0.zip
-rw-r--r-- 1 oracle oinstall    126712 Oct 17 21:39 oracle-goldengate-veridata-23.1.0.0.0-release-notes.pdf
-rw-r--r-- 1 oracle oinstall      2686 Oct 16 07:02 Veridata-23c-README.txt
[oracle@veridata23c soft]$
[oracle@veridata23c soft]$ export DISPLAY=192.168.6.101:0.0
[oracle@veridata23c soft]$ cd fbo_oggvdt_linux_services_shiphome/Disk1/
[oracle@veridata23c Disk1]$ ./runInstaller
Starting Oracle Universal Installer...

Checking Temp space: must be greater than 120 MB.   Actual 17482 MB    Passed
Checking swap space: must be greater than 150 MB.   Actual 2047 MB    Passed
Checking monitor: must be configured to display at least 256 colors.    Actual 16777216    Passed
Preparing to launch Oracle Universal Installer from /tmp/OraInstall2024-12-20_07-16-16PM. Please wait ...
复制

• 建议提前安装一个mysql。(这里也可以选择安装一个新的mysql，但是我在测试期间，vdtca.sh 配置时候，总遇到一些错误，网上没有什么参考信息，不好解决，用提前安装的mysql 就没有问题)

2.5 配置Veridata

[oracle@veridata23c Disk1]$ cd /ogg/vdt23c/bin/
[oracle@veridata23c bin]$ ls
run.sh  vdtca.sh
[oracle@veridata23c bin]$ ./vdtca.sh
复制

• 创建Veridata 用户

CREATE USER 'superuser'@'%' IDENTIFIED BY 'superpassword'; 
GRANT ALL PRIVILEGES ON *.* TO 'superuser'@'%' WITH GRANT OPTION; 
FLUSH PRIVILEGES;
SHOW GRANTS FOR 'superuser'@'%';
复制

• 登录地址： https://192.168.56.2:8831/veridata/

• 使用 创建的veridata/veridata 用户登录

• 手动启动veridata server服务：

  [oracle@veridata23c ~]$ cd /ogg/vdt23c/bin
  [oracle@veridata23c bin]$ ./run.sh
  复制

二. 安装 veridata23c agent

1. 前提条件

• 在ogg源端和目标端上安装agent。
• 安装JDK version 17

这里，我们只演示在源端操作，目标端同样的操作。

2. 安装java

[root@ora11204 ~]# tar -xzvf jdk-17.0.13_linux-x64_bin.tar.gz  -C /usr/bin/

[oracle@ora11204 ~]$ vi .bash_profile
export JAVA_HOME=/usr/bin/jdk-17.0.13
export PATH=$JAVA_HOME/bin:$PATH

[oracle@ora11204 ~]$ source .bash_profile

[oracle@ora11204 ~]$ java -version
java version "17.0.13" 2024-10-15 LTS
Java(TM) SE Runtime Environment (build 17.0.13+10-LTS-268)
Java HotSpot(TM) 64-Bit Server VM (build 17.0.13+10-LTS-268, mixed mode, sharing)
复制

3. 安装veridata agent

-- 创建安装路径
[root@ora11204 ~]# mkdir -p /ogg/soft
[root@ora11204 ~]# mkdir -p /ogg/vdt23c
[root@ora11204 ~]# chown -R oracle:oinstall /ogg
[root@ora11204 ~]# chmod -R 755 /ogg

[oracle@ora11204 soft]$ unzip -q goldengate-veridata-23.1.0.0.0.zip
[oracle@ora11204 soft]$ export DISPLAY=192.168.6.101:0.0
[oracle@ora11204 soft]$ cd fbo_oggvdt_linux_services_shiphome/Disk1/
[oracle@ora11204 Disk1]$ ./runInstaller
Starting Oracle Universal Installer...
复制

4. 创建和配置agent实例

4.1 创建agent实例

要求：实例在VERIDATA_HOME的外面，这里的VERIDATA_HOME是指：/ogg/vdt23c

[oracle@ora11204 ~]$ cd /ogg/vdt23c/agent/

-- 创建一个实例veridataagent1，true表示打开debug模式，可以看到创建的过程
[oracle@ora11204 agent]$ ./agent_config.sh /ogg/agent1 true
Dec 20, 2024 10:23:11 PM com.goldengate.veridata.util.VeridataZipUtil main
FINE: zipFIlePath = /ogg/vdt23c/agent/templates/oracle.veridata.agent.template.jar
Dec 20, 2024 10:23:11 PM com.goldengate.veridata.util.VeridataZipUtil main
FINE: unzipPath   = /ogg/agent1
Dec 20, 2024 10:23:11 PM com.goldengate.veridata.util.VeridataZipUtil unzip
FINE: Trying to Extract ... /ogg/agent1/agent.properties.sample
Dec 20, 2024 10:23:11 PM com.goldengate.veridata.util.VeridataZipUtil unzip
FINE: Extracting file to ... /ogg/agent1/agent.properties.sample
Dec 20, 2024 10:23:11 PM com.goldengate.veridata.util.VeridataZipUtil unzip
FINE: Trying to Extract ... /ogg/agent1/ReadMe.txt
Dec 20, 2024 10:23:11 PM com.goldengate.veridata.util.VeridataZipUtil unzip
FINE: Extracting file to ... /ogg/agent1/ReadMe.txt
Dec 20, 2024 10:23:11 PM com.goldengate.veridata.util.VeridataZipUtil unzip
FINE: Trying to Extract ... /ogg/agent1/config/
Dec 20, 2024 10:23:11 PM com.goldengate.veridata.util.VeridataZipUtil unzip
FINE: Creating Directory  ... /ogg/agent1/config/
Dec 20, 2024 10:23:11 PM com.goldengate.veridata.util.VeridataZipUtil unzip
FINE: Trying to Extract ... /ogg/agent1/config/agent-jps-config.xml
Dec 20, 2024 10:23:11 PM com.goldengate.veridata.util.VeridataZipUtil unzip
FINE: Extracting file to ... /ogg/agent1/config/agent-jps-config.xml
Dec 20, 2024 10:23:11 PM com.goldengate.veridata.util.VeridataZipUtil unzip
FINE: Trying to Extract ... /ogg/agent1/config/odl.xml
Dec 20, 2024 10:23:11 PM com.goldengate.veridata.util.VeridataZipUtil unzip
FINE: Extracting file to ... /ogg/agent1/config/odl.xml
Dec 20, 2024 10:23:11 PM com.goldengate.veridata.util.VeridataZipUtil unzip
FINE: Trying to Extract ... /ogg/agent1/config/certs/
Dec 20, 2024 10:23:11 PM com.goldengate.veridata.util.VeridataZipUtil unzip
FINE: Creating Directory  ... /ogg/agent1/config/certs/
Dec 20, 2024 10:23:11 PM com.goldengate.veridata.util.VeridataZipUtil unzip
FINE: Trying to Extract ... /ogg/agent1/config/certs/serverIdentity.jks
Dec 20, 2024 10:23:11 PM com.goldengate.veridata.util.VeridataZipUtil unzip
FINE: Extracting file to ... /ogg/agent1/config/certs/serverIdentity.jks
Dec 20, 2024 10:23:11 PM com.goldengate.veridata.util.VeridataZipUtil unzip
FINE: Trying to Extract ... /ogg/agent1/config/certs/serverTrust.jks
Dec 20, 2024 10:23:11 PM com.goldengate.veridata.util.VeridataZipUtil unzip
FINE: Extracting file to ... /ogg/agent1/config/certs/serverTrust.jks
Dec 20, 2024 10:23:11 PM com.goldengate.veridata.util.VeridataZipUtil unzip
FINE: Trying to Extract ... /ogg/agent1/agent.sh
Dec 20, 2024 10:23:11 PM com.goldengate.veridata.util.VeridataZipUtil unzip
FINE: Extracting file to ... /ogg/agent1/agent.sh
Dec 20, 2024 10:23:11 PM com.goldengate.veridata.util.VeridataZipUtil unzip
FINE: Adding execute permission :agent.sh
Dec 20, 2024 10:23:11 PM com.goldengate.veridata.util.VeridataZipUtil unzip
FINE: Trying to Extract ... /ogg/agent1/configure_agent_ssl.sh
Dec 20, 2024 10:23:11 PM com.goldengate.veridata.util.VeridataZipUtil unzip
FINE: Extracting file to ... /ogg/agent1/configure_agent_ssl.sh
Dec 20, 2024 10:23:11 PM com.goldengate.veridata.util.VeridataZipUtil unzip
FINE: Adding execute permission :configure_agent_ssl.sh
Successfully deployed the agent.
复制

4.2 配置agent的参数

[oracle@ora11204 ~]$  cd /ogg/agent1/
[oracle@ora11204 agent1]$ cp agent.properties.sample  agent.properties

-- 修改下面的参数
[oracle@ora11204 veridataagent1]$ vi agent.properties
# agent 监听端口
server.port=7862
# 配置agent连接database的信息，源端、目标端 根据实际填写
database.url=jdbc:oracle:thin:@localhost:1521/orcl
server.driversLocation=/ogg/vdt23c/agent/drivers
server.jdbcDriver=ojdbc11-23.2.0.0.jar

-- 查看
[oracle@ora11204 agent1]$ cat agent.properties|grep -v '^#'|grep -v '^$'
复制

4.3 启动agent

-- 启动
[oracle@ora11204 ~]$ cd /ogg/agent1
[oracle@ora11204 agent1]$ ./agent.sh start

-- 通过./agent.sh reloadLog查看agent启动是否正常
[oracle@ora11204 agent1]$ ./agent.sh reloadLog
[VERIAGT-BOOT] INFO Looking for home directory.
[VERIAGT-BOOT] INFO Found bootstrap class in file:/ogg/vdt23c/agent/JavaAgent.jar!/com/goldengate/veridata/agent/BootstrapNextGen.class.
[VERIAGT-BOOT] INFO Home directory: /ogg/vdt23c/agent
[VERIAGT-BOOT] INFO Preparing classpath.
[VERIAGT-BOOT] INFO Driver location: /ogg/vdt23c/agent/drivers
[VERIAGT-BOOT] INFO Drivers to load: ojdbc11-23.2.0.0.jar
[VERIAGT-BOOT] INFO Classpath:
[VERIAGT-BOOT] INFO     /ogg/vdt23c/agent/JavaAgent.jar
[VERIAGT-BOOT] INFO     /ogg/vdt23c/agent/drivers/ojdbc11-23.2.0.0.jar
[VERIAGT-BOOT] INFO     /ogg/vdt23c/agent/agent-manifest.jar
[VERIAGT-BOOT] INFO Initializing.
[VERIAGT-BOOT] INFO Invoking startup method: public static void com.goldengate.veridata.agent.VeridataAgentNextGen.main(java.lang.String[])
2024-12-20 22:30:55.284 NOTIFICATION OGGV-60150 Configuring logging.
2024-12-20 22:30:55.416 NOTIFICATION OGGV-60151 Config file for logger is /ogg/agent1/config/odl.xml
2024-12-20 22:30:55.699 NOTIFICATION OGGV-60162 Reset log request complete: OK
复制

三、比较数据

• 登录 https://192.168.56.2:8831/veridata

1. 创建connection

• 输入前面agent.properties中配置的端口，DB类型选择Oracle，点击验证，再点击下一步

• 同样的方式，创建目标端连接信息

• 返回查看连接信息

2. 创建组和比较对

• 这里为了方便测试，删除了因为表结构不一样的表

• 点击保存

• 注意：上面点击保存后，目标端连接自动跳成了sourcedb，也连接成了源端。😂不知道为什么，我试了几次，一点保存，就自动跳。。。 

• 所以，下面我又重新选择目标端连接，重新保存

3. 创建job

4. 运行job

• 这里，我们只比较一张表

• 结果显示不同步，我们到数据库中验证一下：

-- 源端：
SXC@orcl> select * from t5;

TNAME                                                        TABTYPE         CLUSTERID
------------------------------------------------------------ -------------- ----------
T1                                                           TABLE
T2                                                           TABLE
T3                                                           TABLE
T5                                                           TABLE
TT                                                           TABLE


--目标端：数据确实不一致
SXC@sxcdb> select * from t5;

TNAME      TABTYPE                     CLUSTERID
---------- -------------------------- ----------
T1         TABLE
T2         TABLE
TT         TABLE

复制

5. 修复不同步的表

• 到数据库中验证

-- 目标端：数据已修复
SXC@sxcdb> select * from t5;

TNAME      TABTYPE                     CLUSTERID
---------- -------------------------- ----------
T1         TABLE
T2         TABLE
TT         TABLE
T3         TABLE
T5         TABLE
复制