Transcript Upgrade Considerations for TSM V6 IBM Advanced Technical Support Randy Larson

IBM Advanced Technical Support
Upgrade Considerations for
TSM V6
Randy Larson
IBM Advanced Technical Support
[email protected]
© 2009 IBM Corporation
IBM Advanced Technical Support
Introduction
 We will not be discussing features and functions
– Future sessions will cover added function
 The intent here is to put into perspective the
resources, time, and effort that are required to
upgrade to TSM V6 using DB2
Refer to announcement material or IBM marketing
for specific details on supported environments,
software levels, and new function
Page 2
© 2009 IBM Corporation
IBM Advanced Technical Support
Topics
 The Basics
 Preparation
 Upgrade Considerations
– Upgrade complicating factors
– Example upgrade
 Scripting Considerations
Page 3
© 2009 IBM Corporation
IBM Advanced Technical Support
The Basics
 Major restructuring of the TSM database
 Why do this ?
– Current DB is reaching its limits in terms of size, performance, and
function
– Position for long term growth
– Position for future additional function
– Free TSM development resources DB maintenance
 Performance goal is to provide “equivalent performance”
– Compared to Version 5.5
– “Port” to DB2 has some side effects
 Yes, there will be new function
– Not part of this discussion
 !! Not the solution to every problem !!
Page 4
© 2009 IBM Corporation
IBM Advanced Technical Support
The Basics
 Increase in real memory recommendations
– 4X increase to accommodate DB2
 Increase in TSM DB size possible / probable
– DB2 space will expand and contract based on workload
 Increase in overall recovery log size
– Only support for roll-forward mode
 DB Upgrade process includes:
– Prepare current TSM server Database
– Extract all DB entries from current TSM DB
– Insert all DB entries into DB2 via TSM
– Time consuming upgrade when compared to previous TSM software
upgrades
 Fall back is re-install of previous code and DB
– Potentially more complex than previously experienced
– No exposure to data loss if you plan ahead
Page 5
© 2009 IBM Corporation
IBM Advanced Technical Support
What you get and what you do not get
 New database
– DB2 is external to TSM, installed with TSM package
– Must use the DB2 image that is installed with TSM
– Don’t install on a system with DB2 already installed
 One-to-One relationship between TSM instance and
database instance
– No merge of multiple TSM instances into one database
– Can run multiple TSM / database instances on same OS
image
 No Cross platform upgrade
– For instance, you cannot upgrade from TSM on Windows to
TSM on AIX
Page 6
© 2009 IBM Corporation
IBM Advanced Technical Support
What you get and what you do not get
 Theoretical DB size will increase, BUT ...
– Recommended maximum DB size will be limited initially
– Plan for equivalent number of objects
– New function will add to DB growth
 New Recovery Log mechanism
– DB2 logs may require more disk space
– Size depends on activity and DB Backup frequency
 Can NOT run multiple versions of TSM on same OS
instance
– Same restriction as prior releases
Page 7
© 2009 IBM Corporation
IBM Advanced Technical Support
Upgrade Utility

Upgrade utility is a separate install package
–
Can coexist with existing TSM versions
–
Must use currently supported version of TSM
 Upgrade process:
1. Upgrades existing DB to V5.5.x
2. Extracts from existing V5.5.x database
3. Inserts into DB2 using TSM server (not the utility itself)

Page 8
Source server is down during extract process
–
If TSM V5.5.x, existing TSM server can restart afterwards
–
If prior to V5.5.x, the DB needs to be restored first
© 2009 IBM Corporation
IBM Advanced Technical Support
New DB Backup Process

Utilizes existing DB2 to TSM implementation
– Built into DB2, no separate product

Setup (documented in Installation Guide)
1. Install 64bit API (installed with server install)
2. Configure environment variables
3. Update configuration files (AIX example)
•
•
•
Dsm.sys
/home/tsminst1/sqllib/userprofile
tsmdbmgr.opt
4. Set password (must be “TSMDBMGR”)
•
/home/tsminst1/sqllib/adsm/dsmapipw
5. Logoff/Logon and restart TSM to pick up new environment
6. Configure device class (instance owner needs write access)
7. Issue TSM commands:
•
•
Page 9
SET DBRECOVERY devclass
BACKUP DB DEVC=devclass TYPE=full
© 2009 IBM Corporation
IBM Advanced Technical Support
Preparation
 OS Levels
– Be current – check web and documentation
 TSM Levels
– Recommended starting point is TSM V5.5.2
 Preparation could include:
– DB unload/load might help extract process
– DB audit
 Consider 24X7 requirements for TSM availability
– Applications such as CDP, Content Manager, and Space Manager
assume TSM server is always available
– Customer DBs may need to backup logs hourly
Page 10
© 2009 IBM Corporation
IBM Advanced Technical Support
Preparation
 Disk space planning
– Upgrade process creates new database
– Determine and configure DB2 space before starting the
upgrade
 Time
– How long can your TSM server be down ?
– Estimate the extract and insert processes
– 5GB/hr to 10GB/hr is current goal for upgrade process
• But that assumes a “normal” TSM workload
• Content Manager DBs have more objects per GB, so they may be
considerably slower when using GB/hr estimate
 Verify your monitoring applications support TSM V6
Page 11
© 2009 IBM Corporation
IBM Advanced Technical Support
Preparation - Estimating Disk Requirements
Item
Type
Same system
Media
Same system
Network
New system
Media
New system
Network
Active Log
Disk
2GB (Min)
2GB (Min)
2GB (Min)
2GB (Min)
Log Mirror
Disk
Log Size
Log Size
Log Size
Log Size
Archive Log (1)
Disk
Log Size +
Log Size +
Log Size +
Log Size +
V5 DB
Disk
Current DB
Current DB
0
0
V5 Rcvylog
Disk
Current Log
Current Log
0
0
DB2 DB (2)
Disk
DB Util%
+ 50%
DB Util%
+ 50%
DB Util%
+ 50%
DB Util%
+ 50%
DB Backup (2)
Seq Media
DB Util%
DB Util%
DB Util%
DB Util%
Extract(2)
Seq Media
DB Util%
0
DB Util%
0
Total Disk
Disk
Total Seq
Seq Media
Note 1: Archive log is a function of daily activity
Note 2: V6 DB, DBB, and Extract are a function of current DB utilization
Page 12
© 2009 IBM Corporation
IBM Advanced Technical Support
Preparation – Sample for 100GB database 80% Utilized
Same system
Media
Same system
Network
New system
Media
New system
Network
Disk
2GB
2GB
2GB
2GB
Log Mirror
Disk
0
0
0
0
Archive Log
Disk
80GB
80GB
80GB
80GB
V5 DB
Disk
100GB
100GB
0
0
V5 Rcvylog
Disk
13GB
13GB
0
0
DB2 DB
Disk
145GB
145GB
145GB
145GB
DB Backup
Seq Media
200GB
200GB
120GB
120GB
Extract
Seq Media
80GB
0
80GB
0
Total Disk
Disk
340GB
340GB
227GB
227GB
Total Seq
Seq Media
280GB
200GB
200GB
120GB
Item
Type
Active Log
Page 13
© 2009 IBM Corporation
IBM Advanced Technical Support
Preparation
 Picking the first TSM to upgrade
– Ideal first candidate is small, stand-alone TSM
– Do you use Library Sharing ?
• Library Manager must be at a higher level that Library Clients
• Library Clients must be at a supported level
– Do you use LANFree ?
• Storage Agents must be at a supported level
 Test, test, test
– Have a real test system
– Test the upgrade process
• Test upgrade with a large DB to make your own estimate of time
– Test the back-out procedure
– Test the upgraded database
Page 14
© 2009 IBM Corporation
IBM Advanced Technical Support
Considerations Summary
 Resources
– DB/LOG disk requirement will grow
– Recommended memory per TSM instance increases
– Plan for same database I/O performance as before
 Time
– Estimate upgrade time and plan your TSM downtime
 Integrated solutions (ex. Content Manager)
 Multiple TSM instances
– How many upgrades can you do in a weekend ?
– IP Address concerns
– Interconnectivity concerns
– If upgrade in place, must upgrade all TSM instances
 Consider the various upgrade options
Page 15
© 2009 IBM Corporation
IBM Advanced Technical Support
Upgrade Utility Performance – One Example
 System configuration
– 4-way P570 LPAR with 32GB
– 4 ESS800 LUNs with dual paths for 8 database volumes
– 1 ESS800 LUN for recovery log
– TSM V5.5.2.0
 40 GB database at 50% utilization
– Pristine database
Page 16
– dsmserv unloaddb
54 Min 38 Sec
– dsmserv loadformat
2 Min 55 Sec
– dsmserv loaddb
1 Hr 6Min 28 Sec
– dsmserv auditdb
5 Hr 40 Min 51 Sec
– Extract
9 Min 30 Sec
– dsmserv insertdb
3 Hr 8 Min
© 2009 IBM Corporation
IBM Advanced Technical Support
Upgrade Planning - Options
Extract to Media
Extract to Network

Two step process:
Extract then Insert


Fall back is re-install

Same System 
Duplicate DB space
required
 Duplicate DB space
required

New System
Fall back is re-install
Sequential media
space required

Two step process:
extract then insert

 V5.5.2 server can
restart after extract
completes
 Requires network
bandwidth
 Sequential media
space required
Page 17
One step process:
Extract and Insert
One step process:
Extract and insert
 V5.5.2 server can restart
after extract completes
© 2009 IBM Corporation
IBM Advanced Technical Support
Upgrade Process: Media - Same server
 Install the upgrade tool
 Prepare V5.5 database
 Shutdown TSM V5.5
 Install New TSM Product
 Prepare New TSM database
 Two steps to upgrade
– Extract V5.5 DB objects to media (disk or tape)
– Insert DB objects from media into New TSM DB
 Start New TSM
– Configure TSM DB Backup and take backup
Page 18
© 2009 IBM Corporation
IBM Advanced Technical Support
Upgrade Process: Network - Same server
 Install upgrade tool
 Prepare V5.5 database
 Shutdown TSM V5.5
 Install New TSM Product
 Prepare New TSM database
 Single step to upgrade
– Insert DB objects from network into New TSM DB
– Extract V5.5 DB objects to network
 Start New TSM
– Configure TSM DB Backup and take backup
Page 19
© 2009 IBM Corporation
IBM Advanced Technical Support
Upgrade Process: Media - New server
 On V5.5 system
– Install upgrade tool
– Prepare V5.5 database
– Shutdown TSM V5.5
– Extract V5.5 DB objects to media (disk or tape)
– Restart TSM V5.5 (optional)
 On New TSM system
– Verify Hardware Configuration
– Install New TSM Product
– Prepare New TSM database
– Insert DB objects from media into New TSM DB
 Stop TSM V5.5 (if running)
 Start New TSM
– Configure TSM DB Backup and take backup
 Synchronize database contents if necessary
Page 20
© 2009 IBM Corporation
IBM Advanced Technical Support
Upgrade Process: Network - New server
 On New TSM system
– Verify Hardware Configuration
– Install New TSM product
– Prepare New TSM database
 On V5.5 system
– Install upgrade tool
– Prepare V5.5 database
– Shutdown TSM V5.5
 Single step to upgrade
– Insert DB objects from network into New TSM server
– Extract V5.5 DB objects from V5.5 server to network
– TSM V5.5 can be restarted when extract portion completes
 Start New TSM
– Configure TSM DB Backup and take backup
 Synchronize database contents if necessary
Page 21
© 2009 IBM Corporation
IBM Advanced Technical Support
Complicating Factors
 Multiple TSM instances on single OS
 Library Manager configurations
 LANFree configurations
 New host system
 24X7 Availability Requirements
Page 22
© 2009 IBM Corporation
IBM Advanced Technical Support
Multiple TSM instances on single OS
 Only 1 version of TSM code can be installed at a time
– Same as prior upgrades
 If upgrade in place (either media or network)
– All instances must upgraded at same time
 If upgrade to new system (either media or network)
– Need to update network address on clients
– Need to update network address on storage agents
Page 23
© 2009 IBM Corporation
IBM Advanced Technical Support
Library Manager configurations (Libr Mgr)
 Library Manager must upgrade first
 Library Manager moves to new server:
– Move V5.5 Library Manager to new system
– Update connectivity, paths, etc
– Validate Library Manager configuration works with existing
V5.5 code
– Upgrade Library Manager to New TSM in place
 Library Manager remains on existing server
– What else is on that OS instance ?
Page 24
© 2009 IBM Corporation
IBM Advanced Technical Support
Library Manager configurations (Libr Clients)
 Library Manager must be New TSM first
 If Library Client moves to new server:
– Move V5.5 Library Client to new system
– Update connectivity, paths, etc
– Validate Library Client configuration works with existing V5.5
code
– Upgrade Library Client to New TSM
 If Library Client remains on existing server
– What else is on that OS instance ?
Page 25
© 2009 IBM Corporation
IBM Advanced Technical Support
LANFree configurations
 Storage Agents need to be compatible with New TSM
server
 How is TSM Server being upgraded
– Same or new system ?
 Is this also part of a Library sharing environment ?
Page 26
© 2009 IBM Corporation
IBM Advanced Technical Support
New OS Instance
 IP address changes
– Clients, Library sharing, Storage Agents
– DNS can be helpful
 Hardware changes
– Disk space and connectivity
– Tape and/or other device support
 SAN changes
– Zoning changes
– LUN Masking changes
Page 27
© 2009 IBM Corporation
IBM Advanced Technical Support
24X7 Requirements
 TSM V5.5 down for the extract
– How will the application deal with TSM unavailability ?
 Possibility:
– Install V5.5 product on new system
– Build V5.5 DB using database backup
– Upgrade in place to New TSM
– Point application to New TSM server
– Synchronize application with New TSM server
– Export / Import using date/time from V5.5 to New TSM server
Page 28
© 2009 IBM Corporation
IBM Advanced Technical Support
Upgrade Example
 Library Sharing Environment
– 2 OS Instances
– Library Manager with a shared tape library
– 2 Library Clients
 LANFree
– 2 Storage Agents using 1 Library Client
 Preparation
– Upgrade Servers and Storage Agents to minimum supported
levels to work with New TSM
– Install / Upgrade OS and Hardware as appropriate
– Update SAN Zoning to include new paths
Page 29
© 2009 IBM Corporation
IBM Advanced Technical Support
Example: Starting Configuration
OS2
OS1
LIBR CLIENT 1
LIBR MGR
Server to Server
V5
V5
LIBR CLIENT 2
Server to Server
V5
SAN Paths
Storage Agents
Shared Library
Page 30
© 2009 IBM Corporation
IBM Advanced Technical Support
Example Upgrade Scenario – Library Manager
!! This is not the only way to upgrade !!
1. Move Libr Mgr to new OS instance (OS3)
 Update SAN Zoning
 Update Libr Mgr Paths
 Update Libr Client connections
 Validate configuration / paths / connectivity
2. Upgrade Libr Clients and Storage Agents to compatible levels
3. Upgrade Libr Mgr to V5.5.2
 Validate configuration / paths / connectivity
4. Upgrade Libr Mgr to New TSM in place
 Small DB, should be fairly easy and fast
 Validate configuration / paths / connectivity
Page 31
© 2009 IBM Corporation
IBM Advanced Technical Support
Example: Library Manager Upgraded
OS1
OS2
OS3
LIBR CLIENT 1
LIBR CLIENT 2
LIBR MGR
Server to Server
Server to Server
V5
New
Paths
V5
Upgraded
Storage Agents
Shared Library
Page 32
© 2009 IBM Corporation
IBM Advanced Technical Support
Example Upgrade Scenario – Library Client 1
!! This is not the only way to upgrade !!
1. Build Libr Client 1 Instance on OS3
2. Upgrade Libr Client 1 using Media Method

Shutdown Libr Client 1

Extract Database

Start Libr Client 1
3. Create Libr Client 3 on OS3

Insert DB into Libr Client 3 (from Libr Client1 extract)
4. At this point Libr Client 3 is identical to Libr Client1

Page 33
Rename new Libr Client1 to Libr Client3
© 2009 IBM Corporation
IBM Advanced Technical Support
Example Upgrade Scenario – Library Client 1 ...
!! This is not the only way to upgrade !!
4. Update Connectivity

Add Libr Mgr Paths for Libr Client 3

Update Libr Client 3 connections

Validate configuration / paths / connectivity
5. Define connectivity between Libr Client 1 and Libr
Client 3
6. Update B/A client connectivity

Either update clients or update TSM Server and host OS
7. Export / Import from Libr Client 1 to Libr Client 3
using date/time
8. Shutdown Libr Client 1
Page 34
© 2009 IBM Corporation
IBM Advanced Technical Support
Example: Library Client 1 Upgraded
OS2
OS3
LIBR CLIENT 3
LIBR MGR
Server to Server
LIBR CLIENT 2
Server to Server
V5
New
New
Paths
Upgraded
Storage Agents
Shared Library
Page 35
© 2009 IBM Corporation
IBM Advanced Technical Support
Example Upgrade Scenario – Library Client 2
!! This is not the only way to upgrade !!
1. Install Upgrade utility on OS2
2. Shutdown Libr Client 2
3. Install New TSM on OS2
4. Create Libr Client 2 DB instance
5. Upgrade Libr Client 2 in place using network method
6. Start Libr Client 2
7. Validate configuration / paths / connectivity
 Libr Mgr
 Storage Agents
 B/A Clients
Page 36
© 2009 IBM Corporation
IBM Advanced Technical Support
Example: Library Client 2 Upgraded
OS2
OS3
LIBR CLIENT 3
LIBR MGR
Server to Server
New
LIBR CLIENT 2
Server to Server
New
New
Paths
Upgraded
Storage Agents
Shared Library
Page 37
© 2009 IBM Corporation
IBM Advanced Technical Support
Scripting / Reporting
 SQL syntax more strictly enforced
– Exceptions will be documented
 Existing customer scripts and reports
– New / changed commands and output
 Can directly access DB2 database (read-only mode)
– TSM DB2 database is exposed but not documented
– Schema is proprietary and may change in the future
 Check compatibility of third party reporting tools
– Do they work with TSM V6
Page 38
© 2009 IBM Corporation
IBM Advanced Technical Support
SQL Syntax enforcement examples
1. The LIKE predicate is not supported for a nested SELECT statement.
For example, you receive an error if you use the LIKE predicate as in
this statement:
– select * from volumeusage where volume_name like (select distinct
volume_name from volumeusage where node_name='node1')
 Replace such usage with the = operator, as in this statement:
– select * from volumeusage where volume_name=(select distinct
volume_name from volumeusage where node_name='node1')
2. Labeled duration cannot be compared in a SELECT statement. For
example, the following statement results in an SQL error:
– select * from actlog where (current_time-date_time) seconds <= 60
seconds
 The following statement is an example of correct usage:
– select * from actlog where second(current_time-date_time) <= 60
 From Upgrade Guide, it has more for more examples
Page 39
© 2009 IBM Corporation
IBM Advanced Technical Support
SQL Example
 select node_name,count(*) as Number_of_Objects,
sum(file_size) as Bytes_of_WKLD from contents where
node_name='61SOURCE18' and filespace_id=1 and
file_name like '\WKLD%' group by node_name
 Performance:
– TSM V5.5.2
5hr 50min 32.53sec
– TSM V6.1 beta
27min 29.92sec
– DB2 command line
23min 39.42sec
 This is an example of a “select” command that creates
temporary workspace within DB2
Page 40
© 2009 IBM Corporation
IBM Advanced Technical Support
Example of how to find Centera “ClipID” through DB2
 db2 "select TSMDB1.AS_SEGMENTS.PVRPOS as ClipID from
TSMDB1.AS_SEGMENTS,TSMDB1.AF_SEGMENTS where
TSMDB1.AF_SEGMENTS.BFID=‘42803004’ and
TSMDB1.AS_SEGMENTS.VOLID=TSMDB1.AF_SEGMENTS.VOLID and
TSMDB1.AS_SEGMENTS.START=TSMDB1.AF_SEGMENTS.START"
 db2 "select tsmdb1.AF_SEGMENTS.BFID as ObjID from
tsmdb1.AF_SEGMENTS,tsmdb1.AS_SEGMENTS where
tsmdb1.AS_SEGMENTS.PVRPOS=x'37 ... 542’ and
tsmdb1.AS_SEGMENTS.VOLID=tsmdb1.AF_SEGMENTS.VOLID and
tsmdb1.AS_SEGMENTS.START=tsmdb1.AF_SEGMENTS.START“
Page 41
© 2009 IBM Corporation
IBM Advanced Technical Support
Summary
 Major change to TSM DB
 Resource intensive upgrade process
 Time consuming upgrade process
 Increase in memory and disk space requirements
 SQL syntax considerations
Refer to announcement material (when it becomes
available) for specific details on supported
environments, software levels, and new function
Page 42
© 2009 IBM Corporation