Accelerate Migration to Cloud Infrastructure with Oracle Data Integration Platform_部分2

2020-03-04 155浏览

1.Real-Time Data Warehouse SaaS Apps ML & Predictive Analytics Real-time Real-time Oracle Cloud Data Integration Platform BI & Data Visualization Exadata DBCS DB Big Data CS Cloud Service on Compute Real-time • Lower the costs of your EDW running on PaaS or IaaS offering • Fastest data movement in realtime or batch • Maximize performance for your Data Integration and Data Warehouse processes with cloud computing • Consolidate all your data into one place for cross LOB analytics • Innovate with the latest technologies in database and big data for faster and greater insight Copyright © 2017, Oracle and/or its affiliates. All rights reserved.
2.Business Continuity & Heterogeneous Cloud DIPC DIPC Data Integration DIPC Platform Oracle Cloud • Fully realize a multi-cloud vendor strategy with Data Integration Platform Cloud Service • Move data easily between Oracle Cloud and other clouds • Move data in real-time to ensure high availability and zero downtime migrations • Supports data integration across heterogeneous environments with core GoldenGate • Integrated with HA solutions Copyright © 2017, Oracle and/or its affiliates. All rights reserved.
3.Easily Move to Cloud with Oracle Data Integration Platform Oracle Data Integration Platform Same Architecture Same 9S0oftware Same SkillsComplete:Everything You Need for Data Integration and Data Governance 100% Compatible with existing on-premises deployments Full portability across Hybrid Clouds CoCpoypriygrhigt h©t ©2021071, 7O,rOacrlaeclaenadn/odr/oitrsiatsffailfifaitlieast.eAs.llArlilgrhigtshtrsesrersveerdve. d . 22
5.Migration To Cloud Infrastructure Kalyan Villuri
8.Introduction • Who we are : Veritas Technologies LLC is a data management company with more than 8200 employees, partners with the largest technology leaders, including Amazon, Cisco, Fujitsu, Google, Hitachi, HP, IBM, Microsoft, NetApp, Open Stack, Symantec, and many more • What wedo:Veritas Technologies empowers businesses of all sizes to discover the truth in information— their most important digital asset. Using the Veritas platform, customers can accelerate their digital transformation and solve pressing IT and business challenges including multi-cloud data management, data protection, storage optimization, compliance readiness and workload portability—with no cloud vendor lock-in. 86% percent of Fortune 500 companies rely on Veritas today to reveal data insights that drive competitive advantage. 27 Copyright © 2017 Veritas Technologies
11.Veritas Ecosystem GG Oracle ERP Rev Pro Virtual GG Trader Sabrix Public Cloud Vendors OBAW Replicated Stg. Replicated Stg. ODI Stagin g Replicated Stg. GG GG OBAW Schema S T A G I N G GG R E P O R T S GG GG Licensing BI/ OBIEE OBIA 80+ Replication pairs 6000+ Tables in replication 500GB+ data replication daily GMS GG Customer DataHUB DB/TCA 30 Copyright © 2017 Veritas Technologies LLC 30
12.Accomplishments Datacenter Migration • Data Center Migration • 129 DBs/200+ servers • 45+ GG replication pairs between cloud databases • DBs migrated to new Data center using Dataguard and GoldenGate GG Upgrade • 80+ GG pairs • 6000+ tables • Data flow 500+ GB per day • Used integrated PARALLELISM to Improve GG performance Bi directional replication • GG replications from Licensing to ERP • GG Bi directional replication setup GG Heartbeat Implementation • Configured GG Heartbeat table setup for all environments • Developed real time Dashboard Displaying Latency with most accurate timestamp along with “Data As Of” and Hosted on WebLogic server • Upgraded Heartbeat table configuration to GoldenGate 12.2 31 Copyright © 2017 Veritas Technologies. Veridata Installation • Configured GoldenGate Veridata 12.1.3 for Out of sync Data comparison and repair. • Automated OOS Report in HTML notification • Configured 6000+ tables in 144 Veridata Jobs • Veridata monitors 80+ GG pairs GoldenGate Event Capture • Golden Gate delete event capture • Golden Gate replication from EBS to OBIEE
14.VERITAS GoldenGate Replication - Current Setup • Oracle GoldenGate Version 12.2.0.1 along with Oracle 12c and 11.2.0.4 • Separate GoldenGate homes for oracle 11g and 12c databases • All GoldenGate processes are using integrated mode with parallelism enabled • Total 80 GoldenGate pairs and 6000+ tables in replication between cloud databases. • Approximately 500+ GB real time being replicated between cloud databases • Minus Query based monitoring scripts were used earlier for comparing tables on source and target databases. • Oracle GoldenGate Veridata tool replaced the manual scripts for the tables in replication comparison and fixing out of sync issues. • GG Heartbeat table for GoldenGate process status and lag monitoring • All GoldenGate pairs configured using Conflict Detection and Resolution ERP GG GG OBIEE GG DataHub GG GG GG GG GG Licensing TCA GMS M7 Superclu ster 33 Copyright © 2017 Veritas Technologies LLC
15.GG Replication Setup between cloud databases Why itsimportant:As per the recent data survey, more than 50% of total data will be stored in Public and Private cloud systems by the year 2020 MinimumRequirements:• Systems - Do ensure the source and target systems are defined • Network - it can be either P2P, internet or MPLS circuit, do ensure sufficient bandwidth is in place for the volume of the data being replicated • Security - Do ensure the source and target system IP Addresses are Natted/Masked to ensure the security • Channel Encryption - Do ensure GG data being replicated is encrypted 34 Copyright © 2017 Veritas Technologies LLC
16.Datacenter Migration Migration to cloud Infrastructure • 129 DBs/200+ servers • 45+ GG replication pairs • Total 129 Applications • 800+ total application and database servers • DBs migrated to new Data center using Dataguard • Without the need for GG rebuild • Not a single transaction was lost 35 Copyright © 2017 Veritas Technologies. TUCSON – M6 NON-PROD DEV QA UAT PROD PROD Oracle Data Guard DALLAS – M7 NON-PROD DEV QA UAT PROD PROD Oracle Net
17.Migration to Cloud Switch Over The Database TUCSON Data Center – M6 Supercluster SPtraimndabry Database Test Table GG OMCS Cloud GG Data Guard Is Running Dallas Data Center – M7 Supercluster SPtraimndabry Database Test Table 36 Copyright © 2017 Veritas Technologies.
18.Licensing GG replication IBM Cloud Licensing Database Oracle GoldenGate GG Setup ORACLE Cloud ERP Database GG Setup • Bi-Directional replication is set between IBM cloud and ORACLE cloud environment in VERITAS • Bi-Directional Replication also known as Active-Active Replication • Applications perform DML/DDL activities on both Databases 37 Copyright © 2017 Veritas Technologies.
19.Revpro Delete Event Capture Using GG Event Capture Extract Parameters. TABLE REVPRO.RPRO_RI_PS_WF_DET,TOKENS(CSCN = @GETENV('TRANSACTION','CSN'), RSID = @GETENV('RECORD','RSN')), GETBEFORECOLS(ON UPDATE ALL); OMCS Environment Event Capture Replicat Parameters. MAP REVPRO.RPRO_RI_PS_WF_DET, TARGET STAGE_EBSR12.RPRO_RI_PS_WF_DET_HIST ,& COLMAP (LINK_TRANS_ID=LINK_TRANS_ID,PERIOD_NAME=PERIOD_NAME,RUN_SEQ=RUN_SEQ, LAST_UPDATE = @GETENV ('GGHEADER', 'COMMITTIMESTAMP'), & TRAN_TYPE=@GETENV ('GGHEADER', 'OPTYPE'), & BEFORE_AFTER=@GETENV('GGHEADER','BEFOREAFTERINDICATOR'), & RSID=@TOKEN('RSID'), & CSCN=@TOKEN('CSCN')),INSERTALLRECORDS,FILTER (@STREQ (@GETENV ('GGHEADER', 'OPTYPE'), 'DELETE')); OMCS Environment ERP Source Database GG Setup Source Table DML Extract Replicat OBIEE Target Database GG Setup Target Table Event Capture Table 38 Copyright © 2017 Veritas Technologies.
20.Automatic Heartbeat Table Single Click Golden Gate Latency Dashboard Using Heartbeat Table 39 Copyright © 2017 Veritas Technologies LLC • Intelligent Functionality • Automatically discovers replication topology • Unidirectional, bi-directional, N-way... • Automatically propagates heartbeats along replication paths • Shows incoming and outgoing lags in replication paths in each database for active scenarios • Easy to configure and create dashboard • Execute GGSCI command ADD HEARTBEATTABLE at each database
21.Goldengate Veridata Implementation • Goldengate Veridata 12.1.3 is a high-speed data comparison solution that identifies and reports data discrepancies between two databases • Out-Of-SyncData:• Facilitates the repair of out-of sync data in live database environments • Ability to select which tables and rows should be repaired and when • No disruption to business systems while repair operations. • Architecture consist of Veridata Server along with Veridata Repository database for storing configuration information Veridata Repository DB • Veridata agents needs to be deployed on the targets those we want to monitor • Veridata Web User Interface is browser based graphical user interface which will allows us to review status and output of comparisons • Customized the Out-Of-Sync report to html file email notification 40 Copyright © 2017 Veritas Technologies LLC Veridata Web Client WebLogic Server Domain Veridata Server Veridata Commandline tool Source DB Server Veridata Agent Source Database GG Replication Target DB Server Veridata Agent Target Database
22.Veridata Configuration 41 Copyright © 2017 Veritas Technologies. Veridata Configuration Summary Veridata Agents 28 GG Pairs 80 GG Tables 6000+ Veridata Group Configurations 148 Veridata Jobs Configuration 144 Daily Data replication 500+ GB
23.GoldenGate Version Upgrade to 12.2 Take Extract information with Below command -INFO EXTRACT,SHOWCH and -info,detail Take Replicate information with Below Command -lag-stopOnce All processes are stopped -ddl_disable.sql,ddl_remove.sql,marker_remove.sql Copy all parameter files and dircrd (Credential store) file to new 12.2 home & Run below scripts from New OGG 12.2 home -marker_setup.sql,ddl_setup.sql,role_setup,ddl_enable,ulg.sql,ddl_pin start manager process and add extract/pump process in new 12.2 home. ADD extract with SCN (Lower SCN which we took it from Old GG info) ADD EXTRACT E01OBIEP, INTEGRATED TRANLOG,SCNADD EXTTRAIL ./dirdat/MP, EXTRACT E01OBIEP, megabytes 2000 OGG 12.1 Home Stop MGR Start MGR OGG 12.2 Home Stop Extract Stop Pump Stop Replicat Start Extract Start Pump Start Replicat 42 Copyright © 2017 Veritas Technologies.
25.Thank you! Kalyan Villuri Kalyan.villuri@veritas.com Copyright © 2017 Veritas Technologies. All rights reserved. Veritas and the Veritas Logo are trademarks or registered trademarks of Veritas Technologies or its affiliates in the U.S. and other countries. Other names may be trademarks of their respective owners. This document is provided for informational purposes only and is not intended as advertising. All warranties relating to the information in this document, either express or implied, are disclaimed to the maximum extent allowed by law. The information in this document is subject to change without notice.
26.Get a sneak peek at cutting-edge data integration designs and receive a free gift! • Oracle is constantly developing new software and features that will make your work easier, and Oracle's User Experience team would love to get your feedback on new data integration designs. • Feedback sessions will take place at a date and time of your own choice. • You can take part via webconference, from the comfort and convenience of your own office. • If you’re interested, please fill out the 1-page form athttp://bit.ly/2vIHlSguppercase I lowercase l • To show our appreciation, we will post all participants their choice from a wide selection of thank-you gifts. Copyright © 2017, Oracle and/or its affiliates. All rights reserved. Oracle Confidential – Highly Restricted 45
27.Data Integration Programming – FOCUS ON DOC LINK Presentationson:Oracle Data Integration Platform Cloud Oracle Data Integrator Oracle GoldenGate Oracle Enterprise Data Quality Oracle Enterprise Metadata Management Hands- Oracle GoldenGate Real-Time Data Replication onLabs:in the Cloud HOL7715 Oracle Enterprise Data Quality HOL7653 ODI and OGG for Big Data HOL7708 Oracle Data Integration Platform Cloud HOL7673 DemoStations:The EXchange Integration Area - Moscone West The EXchange Data Management Area - Moscone West The EXchange Analytics & Big Data Area - Moscone West Copyright © 2017, Oracle and/or its affiliates. All rights reserved. Oracle Confidential 46
28.Data Integration Programming – FOCUS ON DOC LINK Sunday, October 1 Tuesday, October 3 • Lift and Shift Workloads to Cloud with Oracle Data Integration Platform Cloud [SUN6653] • Data Movement between On-Prem, Fusion ERP Cloud, Fusion HCM Cloud and Salesforce [SUN7286] • Accelerate Migration to Cloud Infrastructure with Data Integration Platform [SUN6896] • Oracle Data Integrator Product Update and Strategy [CON6654] • Oracle Enterprise DataQuality:Product Overview and Roadmap [CON6656] • Accelerate Cloud On-Boarding Using Oracle GoldenGate Cloud Service [CON6894] • Oracle Enterprise Data Quality for All Types of Data [HOL7653] • Oracle Data IntegrationPlatform:'>Platform: