Transcript Here We Go Again! Upgrading to 11.5.10

Here We Go Again!
Upgrading to 11.5.10
Jeff Slavitz
Computer Creations Inc.
[email protected]
03/07/05 NorCal OAUG Training
Day Paper v2.0
Jeff Slavitz, Computer Creations Inc.
1
Question:
What Unix command will eliminate all
performance problems with your Oracle
Financials database?
03/07/05 NorCal OAUG Training
Day Paper v2.0
Jeff Slavitz, Computer Creations Inc.
2
Answer:
rm –rf $ORACLE_HOME
03/07/05 NorCal OAUG Training
Day Paper v2.0
Jeff Slavitz, Computer Creations Inc.
3
•
•
•
•
•
•
•
•
Introduction
Upgrade experiences
Ask questions!
Feel free to contact me
Who has already upgraded to 11.5.10?
Who is in process of upgrading?
Any functional users?
Any cell phones?
03/07/05 NorCal OAUG Training
Day Paper v2.0
Jeff Slavitz, Computer Creations Inc.
4
Agenda
•
•
•
•
•
•
Planning an upgrade
Staging Rapid Install
Installing the Vision database
Upgrading using the Maintenance Pack
Lessons learned and general tips
Questions and Answers
03/07/05 NorCal OAUG Training
Day Paper v2.0
Jeff Slavitz, Computer Creations Inc.
5
Planning the Upgrade
• This isn’t Character Mode any more!
• Review Maintenance Pack Installation
instructions, Metalink note 259484.1
• Check required operating system patches
• Develop upgrade and problem blog
• Request LOTS of disk space for
intermediate backups
03/07/05 NorCal OAUG Training
Day Paper v2.0
Jeff Slavitz, Computer Creations Inc.
6
Plan the Upgrade Timetable
•
•
•
•
Plan on a minimum of three test upgrades
Testing – Manual and Automated
How long will it take?
Determine the best Production downtime
window
• Plan major milestone dates
• Document customizations
03/07/05 NorCal OAUG Training
Day Paper v2.0
Jeff Slavitz, Computer Creations Inc.
7
Technology Stack Decisions
Minimum for
Maintenance Pack
Rapid Install
Oracle 9.2.0.4
Oracle 9.2.0.5
9iAS 1.0.2.2.2
9iAS 1.0.2.2.2
JDK 1.3.1
JDK 1.4.2
JInitiator 1.1.8.16
JInitiator 1.3.1.18
Discoverer 4.1.46
Discoverer 4.1.48
Developer 6.0.8.24
Developer 6.0.8.24
03/07/05 NorCal OAUG Training
Day Paper v2.0
Jeff Slavitz, Computer Creations Inc.
8
Stage Rapid Install
•
•
•
Rapid Install stage area requires 24 GB
Three ways to stage Rapid Install:
Rapid Install manual – use adautostg.pl
–
•
Verify ulimit parameters, Metalink note 294932.1
OR manually copy from 11.5.10 media
–
–
–
–
–
Copy Start Here – Disk 1 to stage/startCD
Copy APPL_TOP Disk 1 – 2 to stage/oraApps
Copy RDBMS – Disk 1 to stage/oraDB
Copy Tools – Disk 1 to stage/oraiAS
Copy Databases – Disk 1-3 to stage/oraAppsDB
03/07/05 NorCal OAUG Training
Day Paper v2.0
Jeff Slavitz, Computer Creations Inc.
9
Stage Rapid Install
• OR use electric download, Metalink note
287281.1
– Download multi-part zip files
– Unzip files as for manual copy
• Apply latest Rapid Install patch, currently
4132885
03/07/05 NorCal OAUG Training
Day Paper v2.0
Jeff Slavitz, Computer Creations Inc.
10
Installing the Vision Database
• Follow Oracle Applications Installation manual
• Disk space requirement: 86 gig
9.2.0.5 Oracle Home
3 gig
APPL_TOP
COMMON_TOP
8.0.6 Oracle Home
iAS Oracle Home
26 gig
Datafiles
57 gig
03/07/05 NorCal OAUG Training
Day Paper v2.0
Jeff Slavitz, Computer Creations Inc.
11
Installing the Vision Database
• Enable X-windows on your PC
• In Rapid Install stage area:
cd startCD/Disk1/rapidwiz
• Start Rapid Install: rapidwiz
03/07/05 NorCal OAUG Training
Day Paper v2.0
Jeff Slavitz, Computer Creations Inc.
12
Installing the Vision Database
• When prompted to select database, choose Vision
• Rapid Install does the rest!
03/07/05 NorCal OAUG Training
Day Paper v2.0
Jeff Slavitz, Computer Creations Inc.
13
The 11.5.10 Maintenance Pack
• Rapid Install used to install:
– Vision
– New database and technology stack
– Upgrade 10.x or 11.0 database
• 11.5.10 Maintenance Pack, patch 3140000
– Used to upgrade an existing 11i instance
– 11.5.10 Install media or download from
Metalink
03/07/05 NorCal OAUG Training
Day Paper v2.0
Jeff Slavitz, Computer Creations Inc.
14
Maintenance Pack Overview
• Maintenance Pack instructions, note 259484.1
• Pre-Upgrade steps
–
–
–
–
–
AD minipack I.1
Latest AutoConfig template
Configure database for new products and tablespaces
Technology stack upgrade
Many smaller patches
• Apply patch 3140000
• Post-upgrade steps
03/07/05 NorCal OAUG Training
Day Paper v2.0
Jeff Slavitz, Computer Creations Inc.
15
Technology Stack Upgrade
• Install new technology stack:
– Manually
– Rapid Install techstack option
• Technology Stack Validation Utility
– Run on database and all application tiers
– Should pass all checks before upgrading
03/07/05 NorCal OAUG Training
Day Paper v2.0
Jeff Slavitz, Computer Creations Inc.
16
Rapid Install Tech Stack
• From stage area: rapidwiz –techstack
• For details, Rapid Install manual chapter 5
03/07/05 NorCal OAUG Training
Day Paper v2.0
Jeff Slavitz, Computer Creations Inc.
17
Rapid Install Tech Stack
• Installs 9.2.0.5 Oracle Home
• Installs 8.0.6 Oracle Home along with
9iAS 1.0.2.2.2 Oracle Home
• You must manually do necessary product
upgrade steps
• Are you already patched higher?
• Will not install JDK 1.4.2
03/07/05 NorCal OAUG Training
Day Paper v2.0
Jeff Slavitz, Computer Creations Inc.
18
Rapid Install Tech Stack
• New tech stack code installed to new path
• To retain existing tech stack path install it twice.
For example:
– Original 8.0.6 and iAS ORACLE_HOME at
/ora01/PROD/…
– Install new tech stack to /ora01/PRODupg
– Use new OUI to remove Oracle Home at /ora01/PROD
– Install new tech stack again to /ora01/PROD
– Use OUI to remove tech stack at /ora01/PRODupg
03/07/05 NorCal OAUG Training
Day Paper v2.0
Jeff Slavitz, Computer Creations Inc.
19
Upgrading JDK and JInitiator
• Oracle recommends using JDK 1.4.2 with
11.5.10
• Download JDK 1.4.2 for your operating
system, Metalink note 130091.1
• Upgrade to JInitiator 1.3.1 using Metalink
note 124606.1
• Requires users to download new JInitiator
03/07/05 NorCal OAUG Training
Day Paper v2.0
Jeff Slavitz, Computer Creations Inc.
20
Tips for Applying Maintenance Pack
• Correct errors found by pre-upgrade
validation scripts
• Turn off custom triggers and applications
before applying patch 3140000
• Save time and apply custom AutoConfig
changes after upgrade is complete
• Work in parallel with Oracle Support
03/07/05 NorCal OAUG Training
Day Paper v2.0
Jeff Slavitz, Computer Creations Inc.
21
Tips for Applying Maintenance Pack
• Skip adpatch workers that fail for
applications you are not using
• Open a tar to confirm no cross-application
issues
• Manually re-run script that failed when
problem resolved
03/07/05 NorCal OAUG Training
Day Paper v2.0
Jeff Slavitz, Computer Creations Inc.
22
Skipping Adpatch Workers
• Select option 8 on adctrl menu to skip
adpatch workers
03/07/05 NorCal OAUG Training
Day Paper v2.0
Jeff Slavitz, Computer Creations Inc.
23
Hung Adpatch Workers
• Most workers end in a few minutes. If one
runs abnormally long it may be hung.
• Confirm with ‘top’
• Use adctrl option 3 to shutdown all workers
• Hung workers will not shutdown
• kill -9 `ps –ef | grep adwork | cut –c 9-14`
• You may also need to kill adpatch job
03/07/05 NorCal OAUG Training
Day Paper v2.0
Jeff Slavitz, Computer Creations Inc.
24
Hung Adpatch Workers
•
•
•
•
Hung workers still show status of ‘Running’
Use adctrl option 4 to fail all jobs
Then adctrl option 2 to restart all failed jobs
Restart adpatch
03/07/05 NorCal OAUG Training
Day Paper v2.0
Jeff Slavitz, Computer Creations Inc.
25
Maintenance Pack Problems
•
Adpatch.log:
•
FAILED: file MTL_COPY_ORG_REPORT_TEMP.xdf
•
Adworker.log:
Error in executing statement ALTER TABLE
INV.MTL_COPY_ORG_REPORT_TEMP MODIFY ...
ORA-00600: internal error code, arguments: [25012],
[68], [0], [], [], [], [], []
•
Work-around is to set
"_disable_multiple_block_sizes" = true
in the database init.ora
03/07/05 NorCal OAUG Training
Day Paper v2.0
Jeff Slavitz, Computer Creations Inc.
26
Maintenance Pack Problems
•
Adpatch.log:
FAILED: file aftcm049.sql
•
Adworker.log:
ORA-20000: Oracle Error Mkr4= -904
ORA-00904: "RULESET_NAME": invalid identifier
•
Problem caused by Advanced Queue corruption
that occurs when upgrading to 9.2.0.x from
8.1.7.x. Follow note 231074.1 and run the three
patch scripts provided.
03/07/05 NorCal OAUG Training
Day Paper v2.0
Jeff Slavitz, Computer Creations Inc.
27
Maintenance Pack Problems
•
•
For errors uploading .ldt files, upload
manually using adodfcmp:
adodfcmp userid=jtf/xxx touser=apps/xxx
priv_schema=system/xxx changedb=yes
mode=tables odffile=xxx.odf logfile=xxx
Specifying ‘changedb=no’ will show
changes without making them
03/07/05 NorCal OAUG Training
Day Paper v2.0
Jeff Slavitz, Computer Creations Inc.
28
Maintenance Mode
•
•
•
New feature with 11.5.10/AD.I
Adpatch requires maintenance mode
Use adadmin option 5
03/07/05 NorCal OAUG Training
Day Paper v2.0
Jeff Slavitz, Computer Creations Inc.
29
Maintenance Mode
03/07/05 NorCal OAUG Training
Day Paper v2.0
Jeff Slavitz, Computer Creations Inc.
30
Maintenance Mode
• Be sure to disable Maintenance Mode or
users cannot login to Financials
03/07/05 NorCal OAUG Training
Day Paper v2.0
Jeff Slavitz, Computer Creations Inc.
31
Adpatch Hotpatch
• If you want to apply a patch without
enabling maintenance mode and disabling
user access:
adpatch options=hotpatch
• The Maintenance Utilities manual indicates
this causes severe performance degradation
03/07/05 NorCal OAUG Training
Day Paper v2.0
Jeff Slavitz, Computer Creations Inc.
32
Helpful Tips
• Transfer setups between instances using
FNDLOAD, Metalink note 274667.1
–
–
–
–
–
–
Concurrent program definitions
Responsibilities
Menus
Profile Options
Value Sets
And more!
03/07/05 NorCal OAUG Training
Day Paper v2.0
Jeff Slavitz, Computer Creations Inc.
33
Pre-Compiling JSPs
• Java Server Pages (JSP) compiled when
user first accesses a page
• May result in noticeable delay
• Perceived as ‘performance’ problem
• Pre-compile all or first used JSPs
03/07/05 NorCal OAUG Training
Day Paper v2.0
Jeff Slavitz, Computer Creations Inc.
34
Pre-Compiling JSPs
• Compiled JSPs normally stored on web tier
at $OA_HTML/_pages/_oa__html
• $IAS_ORACLE_HOME/Apache/Jserv/etc/
zone.properties
• Unix command ‘ls –ltr’ shows:
– Pages used
– Order pages were last compiled
• Use ojspCompile.sh as explained in
Metalink note 215268.1
03/07/05 NorCal OAUG Training
Day Paper v2.0
Jeff Slavitz, Computer Creations Inc.
35
Pre-Compiling JSPs
• Compile JSPs using a regular expression
$JTF_TOP/admin/scripts/ojspCompile.pl --compile -s \
'%' -log $LOGFILE --flush
$JTF_TOP/admin/scripts/ojspCompile.pl --compile -s \
'Apps%' -log $LOGFILE --flush
• Compile an individual JSP
$JTF_TOP/admin/scripts/ojspCompile.pl --compile -s \
'jtflogin.jsp' -log $LOGFILE --flush
03/07/05 NorCal OAUG Training
Day Paper v2.0
Jeff Slavitz, Computer Creations Inc.
36
Managing AutoConfig
•
AutoConfig re-writes:
–
–
•
Oracle 9i init.ora, tnsnames.ora, listener.ora,
sqlnet.ora
Oracle 8.0.6 listener.ora, tnsnames.ora
Make your system AutoConfig
independent using ifiles:
–
–
ifile last line in above files
ifile name defined in context file
03/07/05 NorCal OAUG Training
Day Paper v2.0
Jeff Slavitz, Computer Creations Inc.
37
OATM
•
Convert database to Oracle Application
Tablespace Model. See Metalink note
248857.1
–
–
–
–
–
Reduces over 300 datafiles to 12
Saves a lot of disk space!
Easier to manage
Migrate tablespaces incrementally
Large tablespaces can take a LONG time to
migrate
03/07/05 NorCal OAUG Training
Day Paper v2.0
Jeff Slavitz, Computer Creations Inc.
38
Question:
What has all the excitement of Fear Factor,
but you can do it in the comfort of your own
office?
03/07/05 NorCal OAUG Training
Day Paper v2.0
Jeff Slavitz, Computer Creations Inc.
39
Answer: Upgrading to 11.5.10!
• Spend the time to plan your upgrade before
starting it
• Long for the days of \ Row Erase?
• Keep careful notes of what you’ve done
• Use the tools Oracle provides to make your
system easier to upgrade and maintain
03/07/05 NorCal OAUG Training
Day Paper v2.0
Jeff Slavitz, Computer Creations Inc.
40
Questions?
Other tips and techniques?
Want a copy of this presentation?
Feel free to email or call me …
Jeff Slavitz
[email protected]
(415) 388 - 3003
03/07/05 NorCal OAUG Training
Day Paper v2.0
Jeff Slavitz, Computer Creations Inc.
41