CERNGGMonitoringAndTroubleshooting

GoldenGate
Monitoring and Troubleshooting
Lorena Lobato Pardavila - CERN
Replication Technology Evolution for ATLAS Data Workshop
Outline
•
Oracle GoldenGate Director and Oracle
GoldenGate Enterprise Manager Plug-in
•
Database level Monitoring
•
GoldenGate Troubleshooting
•
Questions
Replication Technology Evolution for ATLAS Data Workshop
3
Outline
•
Oracle GoldenGate Director and Oracle
GoldenGate Enterprise Manager Plug-in
•
Database level Monitoring
•
GoldenGate Troubleshooting
•
Questions
Replication Technology Evolution for ATLAS Data Workshop
4
Oracle GG Director: Overview

Multi-tiered, client-server application that enables the configuration and management of
Oracle GoldenGate instances from a remote client
OGG Director Server Domain
OGG Director
Web
OGG Director Server
Application
GGSCI
OGG Director
Client
GGSCI
OGG Director
Administrator
GGSCI
Monitor Agent
Clients
OGG Instances
OGG DIRECTOR DATABASE
Replication Technology Evolution for ATLAS Data Workshop
5
System Requirements

Oracle GoldenGate Director Server
o
1 GB of RAM up to 1.5 GB (recommended) of free disk space.
Dedicated http port (default port is 7001)
DYNAMICPORTLIST in each Manager process
Oracle WebLogic Server 11g Standard Edition
o
o
o


Oracle GoldenGate Director Web
o
o

10.3.1, 10.3.2, 10.3.3, 10.3.4, or 10.3.5 or 12c (12.1.1)
Supports Microsoft Internet Explorer v6.0 or later and Mozilla Firefox v2.0 or
later
No software is installed on the client system for the OGG Web
Oracle Director Desktop Client
o
o
Same version as that Oracle GoldenGate Director Server
Install Java Runtime Environment (JRE) on each cliente host
Replication Technology Evolution for ATLAS Data Workshop
6
Oracle GG Director: Overview

OGG Director Administrator Tool
Replication Technology Evolution for ATLAS Data Workshop
7
Oracle GG Director: Overview

OGG Director Desktop Client
Replication Technology Evolution for ATLAS Data Workshop
8
Oracle GG Director: Overview

OGG log
Replication Technology Evolution for ATLAS Data Workshop
9
Oracle GG Director: Overview
 Alerts configuration
Replication Technology Evolution for ATLAS Data Workshop
10
Oracle GG Director: Web
 Server_domain/acon
Replication Technology Evolution for ATLAS Data Workshop
11
OGG Enterprise Manager Plug-in (Live)

For installing the plug-in:
o
o

Enterprise Manager Cloud Control 12c Bundle Patch 1 (12.1.0.1) and later
Oracle GoldenGate 11g Release 2 (11.2.1.0.1) and later
Management features:
o
o
o
o
Monitor Oracle GoldenGate instances.
Gather configuration data and track configuration changes for Oracle
GoldenGate instances.
Raise alerts and violations based on thresholds set on monitored targets
and configuration data.
Support monitoring by a remote Agent. A Local Agent is an agent running on
the same host as the Oracle GoldenGate instance.
Replication Technology Evolution for ATLAS Data Workshop 12
OGG Enterprise Manager Plug-in

Summary
Replication Technology Evolution for ATLAS Data Workshop 13
OGG Enterprise Manager Plug-in (Live Demo)
https://oem-test.cern.ch/
Replication Technology Evolution for ATLAS Data Workshop 14
Outline
•
Oracle GoldenGate Director and Oracle
GoldenGate Enterprise Manager Plug-in
•
Database level Monitoring
•
GoldenGate Troubleshooting
•
Questions
Replication Technology Evolution for ATLAS Data Workshop
15
Outline
•
Oracle GoldenGate Director and Oracle
GoldenGate Enterprise Manager Plug-in
•
Database level Monitoring
•
GoldenGate Troubleshooting
•
Questions
Replication Technology Evolution for ATLAS Data Workshop
16
Troubleshooting
Network
Hardware
Database
Operating System
Application
Server
Storage/Disk
OGG REPORTS
ORACLE DATABASES
LOGDUMP
Replication Technology Evolution for ATLAS Data Workshop 17
OGG Reports
 Oracle GoldenGate Process Failures
o GGSCI>
o GGSCI>
o GGSCI>
info all
info <process_name>, detail
view report <process_name>
 Oracle GoldenGate Trail Files Problems
o Trail files that don’t roll over: info exttrail *
o Trail files purging issues: PURGEOLDEXTRACTS
Replication Technology Evolution for ATLAS Data Workshop 18
OGG Reports
 Oracle GoldenGate Error Log Analysis : ggserr.log
o GGSCI> view ggsevt
 Configuration issues
• Incorrect sofware version installed for OGG
• Database configuration issues on the source and/or target with
OGG
• OGG parameter file configuration issues
• Operating system configuration issues
• Network configuration issues
Replication Technology Evolution for ATLAS Data Workshop 19
Oracle Database issues with GoldenGate
• Extract errors = logminer problems
• Replicat issues = streams apply problems
• Data-synchronization issues
• Missing column and rows errors
Procedures the same like for Streams!
Replication Technology Evolution for ATLAS Data Workshop 20
LogDump
GroupID
Trail Info
Tokens
Signature, Compatibility, Character Set, Creation Time, URI, URI History, File Name, Multipart, Trail Sequence Number, File Size, First CSN, Last CSN, First IO Time, Last IO Time,
Log BSN
Machine Info
Operating System Name, Node Name, Release, Version, Hardware
Database Info
Vendor, Name, Character Set, Major Version, Minor Version, Version String, Client Character
Set, Client Version String, Client NCharacter Set, Db Locale, Db NCharacter Set, Db Object
Metadata, Db Time Zone
Producer Info
Name, Data Source, Major Version, Minor Version, Maintenance Level, Bug Fix Level, Build
Number, Version String
Continuity Info
Recovery Mode
Replication Technology Evolution for ATLAS Data Workshop 21
LogDump
1. ./logdump
2. Open /trail_file_full_path
3. count
• Standard utility that comes with Oracle GoldenGate
• Enables to the user to view and scan for transactions and
records
• Obtains transaction statistics and save data contained within
OGG Trails
• Identify missing transactions
• Troubleshoot replication issues
Replication Technology Evolution for ATLAS Data Workshop 22
THANK YOU!
lorena.lobato@cern.ch
Replication Technology Evolution for ATLAS Data Workshop