Monday, 7 November 2016

Oracle GoldenGate 12c New Features – Part 1

The Oracle GoldenGate software package delivers low-impact, real-time data integration and transactional data replication across heterogeneous systems for continuous availability, zero-downtime migration, and business intelligence.

Oracle GoldenGate 12c empowers organizations to capture, route, transform, and deliver transactional data between heterogeneous databases in real time with minimal overhead.  In 12c, it is now available with new features for all major operating systems and databases.

Oracle GoldenGate 12c New Features – Part 1

In this article I will cover:
  • Expanded heterogeneous Support
  • Multitenant Container Database (CDB) Support
  • Oracle Universal Installer (OUI) Support
  • Support for Public and Private Clouds
  • Integrated Replicat

Expanded heterogeneous Support

Oracle Golden Gate 12c R1 has many enhancements for existing supported platforms such as Oracle, MySQL, Sybase, Microsoft SQL Server, IBM DB2 and Teradata and has added support to include Extrace and Replicat for MySQL version 5.6 and Sybase Version 15.7, SQL/MX 3.2, IBM DB2 (LUW) 10.1, and Teradata 14.10.

Oracle Golden Gate 12c R1 also offers improvements for supported features such as:
  • Oracle Golden Gate supports  SQL Server 2012 beginning with GoldenGate
  • UNITEXT data type support for Sybase
  • Oracle Golden Gate supports native compressed transaction log backup for SQL Server
  • Oracle Golden Gate for SQL Server can send and receive real-time data to  heterogeneous databases
Multitenant Container Database (CDB) Support

Oracle GoldenGate 12c supports the capture from, and delivery to, the Multitenant Container Database feature of Oracle 12c database. You can use parallel integrated capture or single integrated capture process.

When using single integrated process you can write changes from multiple Pluggable Databases (PDBs) into a single trail or multiple trails.  In this case, you are Extracting the changed data at the container level instead of individual PDB, which reduces the overhead on the PDBs.

You can use multiple Replicat processes to read one trail and apply changes to different target pluggable databases, or multiple trails read by different Replicat processes, with each trail assigned to a specific target pluggable database.

Oracle GoldenGate 12c New Features – Part 1

Oracle Universal Installer (OUI) Support
Oracle GoldenGate 12c now supports Oracle Universal Installer (OUI), but the following requirements must be satisfied.
  • The host must be JAVA-enabled, the required JRE is automatically installed by OUI
  • If installing for first time, then OUI prompts to create an Oracle central inventory and creates a subdirectory for GoldenGate (the disk space requirement for directory is 150 KB).

As many users are familiar with Oracle universal Installer, it makes installation easy. When installing using OUI, you have the option to choose either 11g or 12c Database for Oracle GoldenGate Installation.

Support for Public and Private Clouds

Oracle Database 12c offers multitenant architecture, which simplifies consolidating databases onto the cloud and managing many databases as one.

Refer to my article for benefits of managing many databases as ONE:

GoldenGate is now SOCKS5 compliant, which is important for replication data to and from cloud databases.

Now a days, many companies are running their applications on cloud, and being able to replicate data between the cloud and on-premise systems is a necessary part of that. When it comes to replication between hybrid systems the concerns are availability, latency, security, heterogeneity, reliability, flexibility, topology, minimally invasive and low impact, efficient network usage, globalization, and ease of use.

Availability – Data must be accessible 24×7 without any interruption, data inconsistency or performance degradation.

Latency – Data should remain up to date.

Security – Data should be secure when replicating between environments

Heterogeneity – Data should be able to distribute across diverse IT system

Reliability – Consistency must be maintained between the systems even during connectivity or system issues.

Flexibility – Solutions must be flexible with Infrastructure and policies for security and compliance

Topology – Should support wide variety of topologies to meet customer requirements

Oracle GoldenGate 12c New Features – Part 1

Minimally invasive and low impact – Should be minimally invasive and low impact on resources such as software, hardware, database, and network.

Efficient network usage – Should be able to route transactions over LAN, WAN and internet and able to handle large data volumes with minimal band width.

Globalization – Should be able to handle globalization aspects of heterogeneous environments

Ease of use – The solution should be easy to understand, configure, deploy, diagnose and easy to use.

Using Oracle GoldenGate you should be able to address all these requirements and be able to perform real-time data replication between private cloud, public cloud and on-premise systems.

When it comes to replication, security is a big concern when replicating data between cloud and on-premises databases. You have three options available:
  • Restricted network established between the cloud and on-premises – In restricted network only certain ports are enabled and white lists the IP addresses of the cloud and on-premise instances.
  • Restricted network access from on-premises and cloud through HTTP proxy – In restricted network access, if opening certain ports and white listing IP are not allowed then HTTP proxy is only the option.
  • Secured network established between the cloud and on-premises – A secured network between on-premises and cloud enables seamless connectivity of applications.

Oracle GoldenGate 12c New Features – Part 1

If you need to move the data in bulk between cloud and on-premise systems then users can use Oracle Data Integrator with Oracle GoldenGate.

Integrated Replicat

This new feature helps to improve performance, scalability and load balancing when replicating data to Oracle or higher Oracle Databases, and users using databases prior can still use Classic mode (also known as non-integrated mode in Oracle environments). With this feature users do not need to manually split the Replicat process into multiple threads and also do not need to manage multiple parameter files.

Prior to 12c, high-volume replication could not be handled by single delivery (Replicat) processes, we used several Replicate processes to handle the load, and there was no coordination between individual process and foreign key awareness. The new integrated Replicat process avoids multiple configurations and delivers high throughput. This new feature simplifies deployment and provides at least twice the performance.

The process reads the trail file and constructs Logical Change Records (LCR) and transmits them to the target server using a lightweight streaming API. The LCRs then go through a Receiver, Preparer, Coordinator, and Applier database apply processes.
  • Receiver – Responsible receiving and  reading LCRs
  • Preparer – Computes the dependencies between the transactions, grouping and sorting the transactions
  • Coordinator – Coordinates transactions, transaction groups and assigns them to Appliers
  • Applier – Responsible for applying changes for the assigned transactions, including conflict detection and error handling.

Oracle GoldenGate 12c New Features – Part 1

The main advantage of Integrated Replicat is automatic dependency awareness and dynamic load balancing (auto tuning), based upon the load and LCRs the additional processes added and removed.  The main parameters that control this process are PARALLELISM and MAX_PARALLELISM.

PARALLELISM – sets a minimum number of apply servers, setting this value to 1 disables apply parallelism and the default value is 4.

MAX_PARALLELISM – Limits the number of apply servers that can be used during load.  This parameter is effective only if PARALLELISM is greater than 1 and also MAX_PARALLELISM is greater than the PARALLELISM parameter.  The default value is 50.

You can turn on this integrated mode by using the INTEGRATED option with the ADD REPLICAT command. You can add additional options to the parameter file using “DBOPTIONS INTEGRATEDPARAMS<OPTIONS>”

This new feature also support for Multitenant Container Database at the pluggable Database level.  Also it can be used to process Non-Oracle Databases Trail files.