search
HomeDatabaseMysql Tutorial如何解决Oracle GoldenGate 没有主键的问题?

本站文章除注明转载外,均为本站原创: 转载自love wife love life —Roger 的Oracle技术博客 本文链接地址: 如何解决Oracle GoldenGate 没有主键的问题? 针对没有主键的情况,GoldenGate大概提供了3种方案,大致如下: 1、默认使用所有列当主键,通过keyco

本站文章除注明转载外,均为本站原创: 转载自love wife & love life —Roger 的Oracle技术博客

本文链接地址: 如何解决Oracle GoldenGate 没有主键的问题?

针对没有主键的情况,GoldenGate大概提供了3种方案,大致如下:

1、默认使用所有列当主键,通过keycols来实现,这种其实存在一定的问题,在这次的项目中直接否定。
2、通过在源端表中添加ogg_key_id列的方式来实现,这可能会影响应用,因此也直接否定。
3、通过在目标端的表中添加rowid类型的伪列,来实现。通过测试,发现这种相对靠谱,如下是我的测试过程.

我这里测试的ogg抽取9208 Dataguard standby,同步到10205的例子。另外,我们这里9i的环境和10g环境均在同一个主机.

1、源端

说明:这里我模拟的是9i环境超过32列的情况.

—创建测试表

SQL> conn roger/roger
Connected.
SQL> create table t_ALL_TABLES as select * from sys.ALL_TABLES where 1=2;

Table created.

—源端OGG配置

GGSCI (killdb.com) 2> view param ext_std

extract ext_std
 userid ggs@killdb,password ggs
 tranlogoptions archivedlogonly
 tranlogoptions altarchivelogdest /home/ora9/arch_s
 exttrail /home/ora9/ggs/dirdat/ra
 discardfile ./dirrpt/exta.dsc,append, megabytes 500
 fetchoptions USEROWID
 table roger.t_all_tables, tokens (TKN-ROWID = @GETENV ("RECORD", "rowid")) keycols (owner) ;
 table roger.t_buffer;

GGSCI (killdb.com) 3> view param dp1

EXTRACT dp1
RMTHOST 192.168.109.12, MGRPORT 7809 TCPBUFSIZE 5000000
PASSTHRU
RMTTRAIL  ./dirdat/r1
NUMFILES 3000

TABLE roger.*;

GGSCI (killdb.com) 5> dblogin userid ggs@killdb,password ggs
Successfully logged into database.

GGSCI (killdb.com) 6> add trandata roger.t_all_Tables cols(owner) nokey

2014-12-17 01:49:59  WARNING OGG-00869  No unique key is defined for table T_ALL_TABLES. All viable columns will be used to represent the key, but may not guarantee uniqueness.  KEYCOLS may be used to define the key.

Logging of supplemental redo data enabled for table ROGER.T_ALL_TABLES.

2. 目标端

—创建测试表

www.killdb.com>create table t_all_tables as select * from sys.all_tables where 1=2;

Table created.

www.killdb.com>alter table t_all_Tables drop column STATUS ;

Table altered.

www.killdb.com>alter table t_all_Tables drop column DROPPED;

Table altered.

www.killdb.com>alter table t_all_tables add (row_id rowid);

Table altered.

www.killdb.com> alter table roger.t_all_Tables add constraint t_all_tables_pk unique (row_id) enable;

Table altered.

—目标端OGG配置

GGSCI (killdb.com) 2> view param rep6

replicat rep6
userid  ggs@Roger,password AADAAAAAAAAAAADAKHEJYIFGVAKDPFZBGDFJNEQBBJRISJAAOCHHZEWCEFTCRIRCJDSHUHAJZBFDZEWC,encryptkey kasaur_key
reperror default, discard
discardfile ./dirrpt/rep6.dsc, append, megabytes 50
handlecollisions
assumetargetdefs
----allownoopupdates
numfiles 3000

map roger.t_buffer, target roger.t_buffer;
map roger.t_all_tables , target roger.t_all_tables colmap (usedefaults, row_id = @token ("TKN-ROWID")) keycols (row_id);

3. 启动进程

–源端

GGSCI (killdb.com) 5> info all

Program     Status      Group       Lag           Time Since Chkpt

MANAGER     RUNNING
EXTRACT     RUNNING     DP1         00:00:00      00:00:07
EXTRACT     RUNNING     EXT_STD     00:00:00      00:00:07

—目标端

GGSCI (killdb.com) 3> info all

Program     Status      Group       Lag at Chkpt  Time Since Chkpt

MANAGER     RUNNING
JAGENT      STOPPED
EXTRACT     ABENDED     DP1         00:00:00      568:19:49
EXTRACT     ABENDED     EXT1        00:00:00      309:16:06
REPLICAT    STOPPED     REP5        00:00:00      596:25:54
REPLICAT    RUNNING     REP6        00:00:00      00:00:02

4. 源端插入测试数据

模拟insert:
–源端

SQL> insert into t_all_Tables select * from sys.all_Tables where rownum  commit;

Commit complete.

SQL> alter system switch logfile;

System altered.

SQL>

—-目标端

www.killdb.com>select count(1) from t_all_Tables;

COUNT(1)
----------
 10
www.killdb.com>select owner,table_name,row_id from t_all_Tables;

OWNER                          TABLE_NAME                     ROW_ID
------------------------------ ------------------------------ ------------------
SYS                            SEG$                           AAAH3QAABAAAV0yAAA
SYS                            CLU$                           AAAH3QAABAAAV0yAAB
SYS                            OBJ$                           AAAH3QAABAAAV0yAAC
SYS                            FILE$                          AAAH3QAABAAAV0yAAD
SYS                            COL$                           AAAH3QAABAAAV0yAAE
SYS                            CON$                           AAAH3QAABAAAV0yAAF
SYS                            PROXY_DATA$                    AAAH3QAABAAAV0yAAG
SYS                            USER$                          AAAH3QAABAAAV0yAAH
SYS                            IND$                           AAAH3QAABAAAV0yAAI
SYS                            FET$                           AAAH3QAABAAAV0yAAJ

10 rows selected.

模式delete

–源端

SQL> delete from t_all_tables where rownum  commit;

Commit complete.

SQL> alter system switch logfile;

System altered.

SQL> select count(1) from t_all_tables;

COUNT(1)
----------
 6

SQL> select owner,table_name,rowid from t_all_tables;

OWNER                          TABLE_NAME                     ROWID
------------------------------ ------------------------------ ------------------
SYS                            COL$                           AAAH3QAABAAAV0yAAE
SYS                            CON$                           AAAH3QAABAAAV0yAAF
SYS                            PROXY_DATA$                    AAAH3QAABAAAV0yAAG
SYS                            USER$                          AAAH3QAABAAAV0yAAH
SYS                            IND$                           AAAH3QAABAAAV0yAAI
SYS                            FET$                           AAAH3QAABAAAV0yAAJ

6 rows selected.

—目标端:

www.killdb.com>select count(1) from t_all_Tables;

COUNT(1)
----------
 6

www.killdb.com>select owner,table_name,row_id from t_all_Tables;

OWNER                          TABLE_NAME                     ROW_ID
------------------------------ ------------------------------ ------------------
SYS                            COL$                           AAAH3QAABAAAV0yAAE
SYS                            CON$                           AAAH3QAABAAAV0yAAF
SYS                            PROXY_DATA$                    AAAH3QAABAAAV0yAAG
SYS                            USER$                          AAAH3QAABAAAV0yAAH
SYS                            IND$                           AAAH3QAABAAAV0yAAI
SYS                            FET$                           AAAH3QAABAAAV0yAAJ

6 rows selected.

www.killdb.com>

模拟update

—源端:

SQL> select owner,table_name,rowid from t_all_tables;

OWNER                          TABLE_NAME                     ROWID
------------------------------ ------------------------------ ------------------
SYS                            COL$                           AAAH3QAABAAAV0yAAE
SYS                            CON$                           AAAH3QAABAAAV0yAAF
SYS                            PROXY_DATA$                    AAAH3QAABAAAV0yAAG
SYS                            USER$                          AAAH3QAABAAAV0yAAH
SYS                            IND$                           AAAH3QAABAAAV0yAAI
SYS                            FET$                           AAAH3QAABAAAV0yAAJ

6 rows selected.

SQL> update t_all_tables set owner='killdb.com' where table_name='COL$';

1 row updated.

SQL> update t_all_tables set owner='killdb.com' where rowid='AAAH3QAABAAAV0yAAF';

1 row updated.

SQL> commit;

Commit complete.

SQL> alter system switch logfile;

System altered.

SQL> select owner,table_name,rowid from t_all_tables;

OWNER                          TABLE_NAME                     ROWID
------------------------------ ------------------------------ ------------------
killdb.com                     COL$                           AAAH3QAABAAAV0yAAE
killdb.com                     CON$                           AAAH3QAABAAAV0yAAF
SYS                            PROXY_DATA$                    AAAH3QAABAAAV0yAAG
SYS                            USER$                          AAAH3QAABAAAV0yAAH
SYS                            IND$                           AAAH3QAABAAAV0yAAI
SYS                            FET$                           AAAH3QAABAAAV0yAAJ

6 rows selected.

–目标端:

www.killdb.com> select owner,table_name,row_id from t_all_Tables;

OWNER                          TABLE_NAME                     ROW_ID
------------------------------ ------------------------------ ------------------
killdb.com                     COL$                           AAAH3QAABAAAV0yAAE
killdb.com                     CON$                           AAAH3QAABAAAV0yAAF
SYS                            PROXY_DATA$                    AAAH3QAABAAAV0yAAG
SYS                            USER$                          AAAH3QAABAAAV0yAAH
SYS                            IND$                           AAAH3QAABAAAV0yAAI
SYS                            FET$                           AAAH3QAABAAAV0yAAJ

6 rows selected.

www.killdb.com>

我们可以看到ogg完全是可以支持利用构造rowid伪列的方式来解决没有主键的问题。 然而这种方法
也有一个很大的问题:迁移之后,新环境中的row_id 伪列需要进行drop,这个drop的动作是非常坑爹的。

例如我们客户这里的系统,均为2.5TB以上的,最大12TB的库,那么drop column就疯掉了。

Related posts:

  1. 解密dbms_rowid -for 10g
  2. goldengate 学习系列1–10gasm to 11gR2 asm 单向复制(DDL支持)
  3. goldengate 学习系列2–相关配置说明
  4. goldengate 学习系列3–一对多的复制配置
  5. Goldengate monitor v11.1 Configure for Linux X86
Statement
The content of this article is voluntarily contributed by netizens, and the copyright belongs to the original author. This site does not assume corresponding legal responsibility. If you find any content suspected of plagiarism or infringement, please contact admin@php.cn
MySQL: An Introduction to the World's Most Popular DatabaseMySQL: An Introduction to the World's Most Popular DatabaseApr 12, 2025 am 12:18 AM

MySQL is an open source relational database management system, mainly used to store and retrieve data quickly and reliably. Its working principle includes client requests, query resolution, execution of queries and return results. Examples of usage include creating tables, inserting and querying data, and advanced features such as JOIN operations. Common errors involve SQL syntax, data types, and permissions, and optimization suggestions include the use of indexes, optimized queries, and partitioning of tables.

The Importance of MySQL: Data Storage and ManagementThe Importance of MySQL: Data Storage and ManagementApr 12, 2025 am 12:18 AM

MySQL is an open source relational database management system suitable for data storage, management, query and security. 1. It supports a variety of operating systems and is widely used in Web applications and other fields. 2. Through the client-server architecture and different storage engines, MySQL processes data efficiently. 3. Basic usage includes creating databases and tables, inserting, querying and updating data. 4. Advanced usage involves complex queries and stored procedures. 5. Common errors can be debugged through the EXPLAIN statement. 6. Performance optimization includes the rational use of indexes and optimized query statements.

Why Use MySQL? Benefits and AdvantagesWhy Use MySQL? Benefits and AdvantagesApr 12, 2025 am 12:17 AM

MySQL is chosen for its performance, reliability, ease of use, and community support. 1.MySQL provides efficient data storage and retrieval functions, supporting multiple data types and advanced query operations. 2. Adopt client-server architecture and multiple storage engines to support transaction and query optimization. 3. Easy to use, supports a variety of operating systems and programming languages. 4. Have strong community support and provide rich resources and solutions.

Describe InnoDB locking mechanisms (shared locks, exclusive locks, intention locks, record locks, gap locks, next-key locks).Describe InnoDB locking mechanisms (shared locks, exclusive locks, intention locks, record locks, gap locks, next-key locks).Apr 12, 2025 am 12:16 AM

InnoDB's lock mechanisms include shared locks, exclusive locks, intention locks, record locks, gap locks and next key locks. 1. Shared lock allows transactions to read data without preventing other transactions from reading. 2. Exclusive lock prevents other transactions from reading and modifying data. 3. Intention lock optimizes lock efficiency. 4. Record lock lock index record. 5. Gap lock locks index recording gap. 6. The next key lock is a combination of record lock and gap lock to ensure data consistency.

What are common causes of poor MySQL query performance?What are common causes of poor MySQL query performance?Apr 12, 2025 am 12:11 AM

The main reasons for poor MySQL query performance include not using indexes, wrong execution plan selection by the query optimizer, unreasonable table design, excessive data volume and lock competition. 1. No index causes slow querying, and adding indexes can significantly improve performance. 2. Use the EXPLAIN command to analyze the query plan and find out the optimizer error. 3. Reconstructing the table structure and optimizing JOIN conditions can improve table design problems. 4. When the data volume is large, partitioning and table division strategies are adopted. 5. In a high concurrency environment, optimizing transactions and locking strategies can reduce lock competition.

When should you use a composite index versus multiple single-column indexes?When should you use a composite index versus multiple single-column indexes?Apr 11, 2025 am 12:06 AM

In database optimization, indexing strategies should be selected according to query requirements: 1. When the query involves multiple columns and the order of conditions is fixed, use composite indexes; 2. When the query involves multiple columns but the order of conditions is not fixed, use multiple single-column indexes. Composite indexes are suitable for optimizing multi-column queries, while single-column indexes are suitable for single-column queries.

How to identify and optimize slow queries in MySQL? (slow query log, performance_schema)How to identify and optimize slow queries in MySQL? (slow query log, performance_schema)Apr 10, 2025 am 09:36 AM

To optimize MySQL slow query, slowquerylog and performance_schema need to be used: 1. Enable slowquerylog and set thresholds to record slow query; 2. Use performance_schema to analyze query execution details, find out performance bottlenecks and optimize.

MySQL and SQL: Essential Skills for DevelopersMySQL and SQL: Essential Skills for DevelopersApr 10, 2025 am 09:30 AM

MySQL and SQL are essential skills for developers. 1.MySQL is an open source relational database management system, and SQL is the standard language used to manage and operate databases. 2.MySQL supports multiple storage engines through efficient data storage and retrieval functions, and SQL completes complex data operations through simple statements. 3. Examples of usage include basic queries and advanced queries, such as filtering and sorting by condition. 4. Common errors include syntax errors and performance issues, which can be optimized by checking SQL statements and using EXPLAIN commands. 5. Performance optimization techniques include using indexes, avoiding full table scanning, optimizing JOIN operations and improving code readability.

See all articles

Hot AI Tools

Undresser.AI Undress

Undresser.AI Undress

AI-powered app for creating realistic nude photos

AI Clothes Remover

AI Clothes Remover

Online AI tool for removing clothes from photos.

Undress AI Tool

Undress AI Tool

Undress images for free

Clothoff.io

Clothoff.io

AI clothes remover

AI Hentai Generator

AI Hentai Generator

Generate AI Hentai for free.

Hot Article

R.E.P.O. Energy Crystals Explained and What They Do (Yellow Crystal)
3 weeks agoBy尊渡假赌尊渡假赌尊渡假赌
R.E.P.O. Best Graphic Settings
3 weeks agoBy尊渡假赌尊渡假赌尊渡假赌
R.E.P.O. How to Fix Audio if You Can't Hear Anyone
3 weeks agoBy尊渡假赌尊渡假赌尊渡假赌
WWE 2K25: How To Unlock Everything In MyRise
3 weeks agoBy尊渡假赌尊渡假赌尊渡假赌

Hot Tools

MantisBT

MantisBT

Mantis is an easy-to-deploy web-based defect tracking tool designed to aid in product defect tracking. It requires PHP, MySQL and a web server. Check out our demo and hosting services.

Dreamweaver Mac version

Dreamweaver Mac version

Visual web development tools

ZendStudio 13.5.1 Mac

ZendStudio 13.5.1 Mac

Powerful PHP integrated development environment

MinGW - Minimalist GNU for Windows

MinGW - Minimalist GNU for Windows

This project is in the process of being migrated to osdn.net/projects/mingw, you can continue to follow us there. MinGW: A native Windows port of the GNU Compiler Collection (GCC), freely distributable import libraries and header files for building native Windows applications; includes extensions to the MSVC runtime to support C99 functionality. All MinGW software can run on 64-bit Windows platforms.

SublimeText3 Chinese version

SublimeText3 Chinese version

Chinese version, very easy to use