Copyright © 2013, Oracle and/or its affiliates. All rights reserved.

1
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
CON1647: Administration
and Management Essentials
for Oracle SOA Suite 11g
Rajesh Raheja
Senior Director, Product Management
Prasen Palvankar
Director, Product Management
Krishnaprem Bhatia
Principal Product Manager
The following is intended to outline our general product direction. It is
intended for information purposes only, and may not be incorporated
into any contract. It is not a commitment to deliver any material,
code, or functionality, and should not be relied upon in making
purchasing decisions. The development, release, and timing of any
features or functionality described for Oracle’s products remains at
the sole discretion of Oracle.
3
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
Program Agenda
 Overview
 Provisioning and Configuration Management
 Managing a System in Production
 Transactions and Fault Handling
 Troubleshooting
 Q&A
4
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
Overview
Mediation
BPEL
Rules
Human
Task
BPEL
orchestration
Human
Tasks
Business Rules
Web
services
and
adapters
SCA Composite
SOA Composite Editor
Policy
Management
Optimized
Service & Eventing
Infrastructure
BPMN
Common Connectivity
Infrastructure
5
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
BPEL
Human
Task
…
Policy Manager
Service Infrastructure
SOAP
B2B
HTTP
JCA
EJB
…
Program Agenda
 Overview
 Provisioning and Configuration Management
 Managing a System in Production
 Transactions and Fault Handling
 Troubleshooting
 Q&A
6
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
SOA Domain
Overview
 Overview
EM
SOA
Domain home
(configuration)
Typical SOA HA install
Administration
Server
Managed
Server
Managed
Server
Managed
Server
EM
SOA
BAM
Oracle home
(binaries)
Administration
Server
BAM
7
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Cluster_Domain
Insert Information Protection Policy Classification from Slide 12
Managed
Server
Cluster 1: SOA
Managed
Server
Cluster 2: BAM
SOA_Domain
…
…
Managed
Server
SOA Configuration
3 Types of Properties
 WLS Properties
– Persisted in domain configuration files, changes are propagated across the cluster by the Admin
Server.
 Service Infrastructure (soa-infra) Properties
– Properties are persisted in MDS (database), changes are automatically propagated across a
cluster.
 Composite Properties
– Meta-data associated with a composite is stored in MDS (database)
– These properties can be customized using a “Configuration Plan” at the time of deployment.
– Composite properties are automatically propagated across a cluster as part of the composite
deployment process.
8
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
SOA Domain
Directory Structure
domain home
start/stop & env scripts
 Configuration:
– Stored under “config” directory
– The config directory contains a file called config.xml which is
the primary source of all configuration information within a
domain.
– SOA configuration is stored in MDS since PS1.
 Scripts:
– Stored under “bin” directory.
– Start / stop Admin & Managed server
– Set environment and JVM properties
 Logs:
– Server logs are placed under servers/<server_name>/logs
9
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
configuration root
local cache of deployed
composites
sub-directory for each
managed server (logs /
cache)
SOA 11g MDS Store
 Runtime Store
– Composite meta-data
– Security policies
– Error policies
– B2B Agreements
– Shared WSDLs and XSDs
– ADF / Human Workflow
 Can be accessed from JDeveloper
and Ant.
 Configuration customization is stored
in MDS.
10
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
Configuration Propagation in a Cluster
WLS + Coherence Clusters
SOA 1
SOA Cluster
Admin
WLS Configuration
SOA 2
MDS
SOA Configuration
WLS Configuration
SOA Configuration
 File based
 DB (MDS) based.
 AdminServer has “gold” copy
 Database has “gold” copy
 Configuration propagated by WLS JMX
 Configuration propagated by soa-infra
framework.
using the Coherence cluster.
 During startup, a Managed Server copies
configuration from AdminServer and
overwrites local copy.
11
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
 During startup, a SOA server loads its
configuration from MDS.
Insert Information Protection Policy Classification from Slide 12
SOA 11g HA Architecture
2 Levels of Clustering
 WLS Cluster
– Defined in config.xml
– Can be viewed from WLS Console and
EM
 SOA Cluster
– Coherence based cluster
– Defined as system parameters in
startup scripts
– Can be validated through deployment /
configuration changes.
12
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
Tools for Configuring SOA Applications
 SOA container configuration done through EM console /
WLST
 Endpoint properties modified during deployment through a
Configuration Plan
– Created
– Adapter properties
 WLS Console / WLST for managing WLS configuration
– Domain creation, adding / changing resources within a domain.
13
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
Test to Production (T2P) Utility
Minimize Manual Steps
 What is moved?
–
Installed binaries and patches
–
Configuration and metadata
–
Security config e.g. OPSS policies
 Supports MDS meta-data, JCA
connection factories
 MovePlan – Rewiring external
references to match target
–
14
Data-sources, endpoint addresses
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
Program Agenda
 Overview
 Provisioning and Configuration Management
 Managing a System in Production
 Transactions and Fault Handling
 Troubleshooting
 Q&A
15
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
Production Readiness
The Readiness Checklist
Sign off on Qualifying Pre-Production Tests
Clearly defined and documented processes
Trained personnel lined up for Go-live and Post-Production
Availability of a Production Replica Environment
Identify SLAs and Key Transactions
16
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
Tools for Middleware Management
EM FMW Control
EM Grid Control
11g
WLS Admin
Console
JR Mission Control
Extends FMW Control for multiple farms. SOA/WLS Management Pack. Historical data, Alerts and
Notifications
Monitor and manage the WLS domain and Managed Servers. Configure JDBC, JMS, JTA, Security, Deploy
Applications etc.
JVM monitoring and management. Flight recorder for troubleshooting and diagnosis.
WLDF
Generate and Analyze diagnostic data from WLS instances and your applications. Watches and
Notifications. Integrate with JFR for troubleshooting.
WLST
Create/manage/monitor WLS Domains via Jython based WLI. WLS Admin Console/Configuration Wizard
on a command line.
BAM
17
For Farm with a single WLS Domain. Composite lifecycle management, Instance Tracking, Performance
Metrics, Fault and Message Recovery
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Real-Time Business dashboards. Correlate Business Indicators with System Metrics by integrating
with EM GC 11g
Insert Information Protection Policy Classification from Slide 12
EM FMW Control
•SOA Composite Lifecycle
Management
•Transaction Search and Drill Down
• Fault and Message Recovery
• Service Engine Configuration
•Live In-flight DMS Performance
Metrics
BPEL
18
Ext
Hu
ern
ma
al
Rou
n
Ser
Bus
ting
Wo
vic
ine
rkfl
e
ss
ow
Rul
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Drill-down
into
component
s
•System MBean Browser for
advanced configuration and metrics
•Use FMW Control for searching and
tracking your composite instances
Insert Information Protection Policy Classification from Slide 12
FMW Control - Key Performance Tuning Tasks
 Configure SOA-Infra Properties
• Audit/Instance Tracking(CPU,DB),
Payload Validation (CPU)
 Configuring Service Engine threads
• BPEL - Threads(Concurrency), Audit
(DB), Validation (CPU)
•
Mediator - Parallel/Resequencer Threads
(Concurrency), Audit (DB), Sleep
Intervals/Metrics Level (CPU)
 Configure Adapter Properties
• MaxRaise/TxnSize(DB), Number of
Threads (Concurrency)
 All this Accessible as MBeans - Update
via WLST
19
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
SOA Management Pack Enterprise Edition
 Business Transaction Management
–
Discovery of transaction flows across the enterprise
–
Leverages transaction content/payload for business visibility
–
Exception Management
 Performance & Diagnostics
–
Enterprise scale multi-domain management
–
Specific framework/metadata knowledge
–
SOA 10g (BPEL/ESB), SOA 11g (BPEL/Mediator/DS/HW)
–
OSB (Business/Proxy Svc, Pipelines)
 Lifecycle Management
20
–
Configuration Management: SOA infrastructure and applications
–
SOA domain and application provisioning
–
SOA Patching support
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
Development
Business
Transaction
Management
Performance
& Diagnostics
Production
Test
Lifecycle
Management
JRockit Mission Control
 Negligible performance overhead.
 Comprised of three toolkits.
– Management Console - for managing and
monitoring one or more JVMs.
– Runtime Analyzer – Application and VM
Profiler. Record and Playback for Rootcause analysis.

Analyze patterns around GC, CPU, Latency, Locks etc
– Memory Leak Detector
 Integrates with WLDF for analysis of
diagnostic dumps
 Use JRMC to root-cause performance
issues by analyzing memory, CPU, thread
contention, locks etc via Flight
Recordings. (Use for Support
engagements)
21
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
WLDF and DFW
 Enable Just-in-time Proactive diagnostics
 Reduce time and effort for collecting diagnostic information.
 Support for SOA Suite Diagnostic dumps adf.ADFConfigDiagnosticDump,soa.composite, soa.composite.trail, soa.config, soa.db
soa.edn, soa.env, soa.wsdl
 SOA specific DMS Metrics – Message Processing metrics
 Manually trigger dumps
22
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
WLST
.Jython based CLI
Create, monitor and manage WLS
Domains
 Runs in Interactive,Batch or
Embedded Mode
WLST
Online
Server
Lifecycle
Composite
Deployment
and
Lifecycle
DomainMBean
Offline
MBean
access and
Updates
DomainRunti
meMBean
WLDF
Integration to
export Diagnostic
Data
ServerRunti
meMBean
Custom(For
SOA)
Create
Domain
Templates/
Domains
from
Templates,
Extend
Domains etc
• Command line automation .
• Hierarchical navigation via domain and server Mbeans:
• retrieve and set domain metrics and properties
• start/stop servers etc
• WLST recording available
23
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
Capacity Planning
 Hardware Resources (Memory, CPU)
 Database Capacity
 HA Requirements (Shared Storage)
 Methodology
 Retention policy
 Data Archival
24
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
Purging
Via EM Console [For Targeted Deletion], or via Purge Scripts and/or dropping Partitions[For Bulk]
Scripts located at RCU_HOME/rcu/integration/soainfra/sql/soa_purge
 Looping
 Parallel
 Partitioning
 Dropping partitions is the fastest way
to purge.
 Time-Range Partitioning Done at the
component level.
 Decide time-range based on
 Useful for small installations [~100k
rows]
 Resource intensive – hence run during
 Loops and runs until max_runtime
loop parameter is exceeded.
off hours.DOP indicates number of
parallel threads.
 Not resource intensive, but slow
performance.
 All purgeable instances are deleted.
25
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
 Useful for medium [ ~500 GB total to ~10
GB daily] to large installations
 For large installs [>~500 GB total or >
~10 GB daily], recommended to run a
hybrid of parallel purging + dropping
partitions, using optimal thread counts.
Insert Information Protection Policy Classification from Slide 12
average and max composite lifetime.
 Run this in conjunction with parallel
purging for a mixed load.
Program Agenda
 Overview
 Provisioning and Configuration Management
 Managing a System in Production
 Transactions and Fault Handling
 Troubleshooting
 Q&A
26
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
Fault Handling – Key Factors
 Handled Faults
– Handled programmatically – Component / Policy
– Can specify manual intervention through EM
– Principal transaction not rolled back
 Un-handled Faults
– Not handled programmatically
– Typically leads to transaction rollback
– Messages can be re-tried when they are retrievable
 JMS queue, DB table, Dehydration storeetc.
27
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
BPEL – Threads, Transactions and Faults
Client
Receive
Services
Client
Receive
Receive
Commit
Commit
Invoke
Services
Client
Invoke
Invoke
Commit
Commit
Reply
Partner
Commit
Receive
Commit
Invoke
Synchronous
Process
28
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Asynchronous
Process
Insert Information Protection Policy Classification from Slide 12
Asynchronous
Durable
Process
Commit
BPEL – Threads, Transactions and Faults
Invoke
Services
Client
Receive
Commit
Services
Client
Receive
Commit
Rollback
Receive
Rollback
Client Fault
Invoke
Invoke
Commit
Commit
Reply
Partner
Type
Receive
Commit
Rollback
Commit
Invoke, Callback, Activity
Invoke
Synchron
ous
Process
29
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Asynchro
Action
nous
Process
Recover, Mark Cancelled, Reset
Insert Information Protection Policy Classification from Slide 12
Asynchrono
us Durable
Process
Commit
Manual / Scripted Fault Handling - Recovery
Faults &
exceptions
 Recovery Options for
Administrators:
– Human intervention actions
defined by fault policies
Recovery
screen
– BPEL message recovery for
unhandled faults
 Auto-recovery configured via
MBean
 Manual Recovery from BPEL
recovery console.
– Rejected messages from
inbound adapters
34
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
Action
Edit payload
log
Program Agenda
 Overview
 Provisioning and Configuration Management
 Managing a System in Production
 Transactions and Fault Handling
 Troubleshooting
 Q&A
35
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
Troubleshoot SOA
 Oracle Fusion Middleware Diagnostic
– WebLogic monitoring
– Diagnostic Framework
– Selective Tracing
– SOA Service engine statistics
 JDK monitoring
 Operating System monitoring
 Database and external resources
36
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
Troubleshooting SOA
Oracle Fusion Middleware Diagnostic Framework
Diagnostic
data
Log
Files
Thread
Dumps
WLDF
kill -3 pid
WLST
Weblogic Admin Utilility
Command Line
Utilities
Automatic Diagnostic Repository
37
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
Configuring WLDF Watches in WLS Console
 In-built mapping between Watch code
and dumps to create in ADR
38
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
Troubleshooting SOA
Viewing Log Files in EM
Message Pane
40
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
Troubleshooting SOA
Editing Log Configuration
42
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
Troubleshooting SOA
Setting Logging Levels
Active Loggers
Saved
Loggers
Logger for SOA
Adapters
Logger for BPEL
43
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
Logging Levels
Troubleshooting SOA
Selective Tracing
Increase log levels for
chosen context,
loggers, and servers
Context: Composite Name, Client Address etc
Trace Level
Loggers
Under
WebLogic
Domain
44
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
Trouble Shooting SOA
BPEL Engine Statistics
 Requests: pending and
active
Requests
 Threads
 Request break down show
BPEL activities
Threads
Request
Breakdown
45
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
56
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
57
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
58
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
EM Grid Control - SOA Management Pack EE
 Central management of multiple SOA domains
 Historical data and trend analysis of SOA
metrics
 Configure thresholds with alerts
–
Integrated with SNMP traps
 Scale monitoring and alert configuration using
templates.
 Correlated view between system metrics and
SOA composite instances.
 Extensible through shell / SQL scripts.
 Monitor custom groups [apps, DBs] in one
place.
 Use GC11g to track your composite execution
flows ,monitor your application and system
metrics, alert Ops or perform corrective action
on critical issues.
59
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12
Detected SOA
component name
Link to
correlate
d JVM
Diagnosti
cs
Troubleshoot SOA
Operating System Monitoring
60
OS
Tools
Linux
top, netstat, iostat
Solaris
prstat, vmstat, mpstat, netstat,
iostat
AIX, Linux
nmon
Windows
Task Manager, Resource
Monitor
Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Insert Information Protection Policy Classification from Slide 12