Transcript Upgrade week FNAL 20111108 M. Hansen, CERN

System issues for the
Upgrade Project
Magnus Hansen
20111110
Current Standards in CMS



CMS systems comply with a number of agreed
standards for good reasons
 Common infrastructure
 Common maintenance organization
 Common problems and solutions
For different reasons not all subsystems comply
with all possible standards
 E.g. standard not stable in time
To my understanding there is no significant
advantage NOT to comply with the agreed
standards
Upgrade week FNAL 20111108
M. Hansen, CERN. [email protected]
Current Standards in CMS

Register access (Slow control)
 VME64x PnP compatible VME interface
Numerous flavours, ~ 1 per fw designer
 We could have done better here


HAL Register description file format and
associated software
Centrally developed and maintained
 Not adopted by all systems but most

Upgrade week FNAL 20111108
M. Hansen, CERN. [email protected]
Current Standards in CMS

VME crates
 WIENER VME crates
Standard 9U and 6U card cages
 Standard VME64x backplane

 Except ECAL, GCT

Custom J0 for power

Standard CAN bus controlled fan tray
 Three flavours: 6U, 9U with/without transition module coverage
Large number of different spec power supplies
 Under CERN supported maintenance contract
 Few exceptions, e.g. RCT


VME controller
 CAEN PCI-VME bridges

“Simple” PC upgrade path
 Except for PCI bus running out of fashion

Under CERN supported maintenance contract
Upgrade week FNAL 20111108
M. Hansen, CERN. [email protected]
Standards in CMS

LVPS
 CAEN EASY 3000


WIENER MARATON


Preshower, DT, RPC
ECAL, CSC, CASTOR
LHVPS
 CAEN EASY 4000

Pixels, Strips
Upgrade week FNAL 20111108
M. Hansen, CERN. [email protected]
Standards in CMS

HVPS
 CAEN


ECAL, DT, RPC, CSC ME1/1
Other

HCAL (custom), CSC (Commercial and custom)
Upgrade week FNAL 20111108
M. Hansen, CERN. [email protected]
Standards in CMS




CAEN and WIENER power supply equipment is Standard
from a software (DCS) point of view but basically all
hardware modules are custom, customized or unique for
the user
CAEN and WIENER equipment bought for CMS is
covered by maintenance contracts
 Runs until December 2019
 Logistics supported by CERN
WIENER equipment can be bought through a CERN
supported purchase contract until 2019
CAEN equipment can be bought through a CERN
supported purchase contract
 Limitations apply
Upgrade week FNAL 20111108
M. Hansen, CERN. [email protected]
Upgrades




Maintain or Improve performance
 For physics
Maintain or Improve reliability
 For CMS availability
Maintain or improve maintainability
 For total cost of ownership
Maintain compatibility with CMS interfaces or
agree on evolution
 TTC, TTS, DAQ, DCS, etc.
Upgrade week FNAL 20111108
M. Hansen, CERN. [email protected]
What we want




Integration in the existing infrastructure
 E.g. crate cooling with vertical air-flow
Limit the number of families of crates and power
system
System control
 Common control and monitoring software
 Common system management hardware
Purchasing and maintenance contracts
 Preferably analogous to the CAEN and
WIENER frameworks currently in place.
Upgrade week FNAL 20111108
M. Hansen, CERN. [email protected]
What we want to avoid

Skimping on any part of upgraded system such that it is
marginal in terms of reliability or performance
 Power supplies

On board / on detector
 Can any firmware build cause overload and subsequent shutdown of the power
supply?
 Can you get out of this situation?

Off detector
 Re-use of power supplies may seem economically justified but does it meet
reliability goals? Is the performance marginal?

Cooling


We construct for 10 years of solid operation. Industry 3 years.
Mechanical elegance
Mezzanine cards with scattered connectors, i.e. mechanically overconstrained
 Bulky cables with tiny and fragile connectors


ETC.
Upgrade week FNAL 20111108
M. Hansen, CERN. [email protected]
CMS Reviews

I claim the established CMS review process is
effective but the follow-up is sometimes difficult
 Many current reliability issues were pointed
out during reviews but were contested and/or
ignored


To be fair: many recommendations were contested and/or ignored
and have not caused any problem. Yet.
Some of the issues lead to upgrades earlier
than expected
Upgrade week FNAL 20111108
M. Hansen, CERN. [email protected]
Large number of Electronics System
Reviews (ESRs) contributing to the
success of CMS


Example: November 2003 Electronics Week

Monday, 3 November 2003 10:30 ->12:45 Review of the Preshower LV Power System

Monday, 3 November 2003 13:30 ->17:50 ESR for the Muon DT Mini Crate System

Tuesday, 4 November 2003 09:30 ->18:00 Review of the CMS Low Voltage System (In
parallel with Trigger Review)

Tuesday, 4 November 2003 09:00 ->12:50 Calorimeter Triggers (40-5-A01)

Tuesday, 4 November 2003 14:00 ->17:45 Muon and Global Triggers (40-5-A01)

Wednesday, 5 November 2003 09:00 ->14:00 ESR of the CMS Tracker Electronics

Wednesday, 5 November 2003 14:00 ->18:45 ESR of the CMS Pixel Electronics

Thursday, 6 November 2003 09:00 ->14:00 Meeting of the Electronics System Steering
Committee

Thursday, 6 November 2003 14:00 ->18:30 ESR of the Muon CSC Electronics

Friday, 7 November 2003 08:30 ->09:30 CPT Plenary Session on the CMS Trigger

Friday, 7 November 2003 09:30 ->14:00 Review of CMS FEC and USC Cabling Plans

Friday, 7 November 2003 14:00 ->18:15 ESR of the HCAL Electronics
One full day and 11 half day ESRs in five days all chaired by Peter!
Upgrade week FNAL 20111108
M. Hansen, CERN. [email protected]
Standardization of new equipment

xTCA
 Selected microTCA in addition to VME for stage 1
upgrade back end systems
 Standardize:

Shelf perhaps including backplane
 Calorimeter trigger may require customization of the un-used backplane
connections. Customization by vendor, thus still commercial

MicroTCA Carrier Hub
 Meant to be multi-vendor compatible but beware…

Power modules
 Multi-vendor compatibility

Bulk power supplies
 In principal multi-vendor BUT: Vertical air flow 48V modular ipmi controllable
supplies are rare but exist.

Shelf management software
Upgrade week FNAL 20111108
M. Hansen, CERN. [email protected]
Example: Future HCAL Backend Crate
TTC/Fast Controls
Central DAQ/FMM
FE Data Links
DAQ
Timing
uHTR
uHTR
uHTR
uHTR
uHTR
uHTR
Upgrade week FNAL 20111108
Control
MCH
(commercial
)
uHTR
uHTR
uHTR
uHTR
uHTR
uHTR
Trigger Links
(DTC/
AMC13)
Configuration/ Slow
Controls (Ethernet)
M. Hansen, CERN. [email protected]
J. Mans
uTCA Workshop planned
Jan/Feb 2012






CMS rack integration
CMS cDCS integration
CMS common shelf specification
DAQ interface evolution in view of the upcoming
DAQ upgrade
 Applies to uTCA systems only; legacy (soon
vintage ) Slink sender cards supported for
legacy systems
TTC distribution (maintenance) upgrade
 Under discussion
ETC.
Upgrade week FNAL 20111108
M. Hansen, CERN. [email protected]
End


Electronics week in January/February
 Invitation will be distributed at least to hn-cmselectronics
 Upgrade reviews and workshops
 Common spares review
 Etc.
Electronics twiki under construction under CMS
technical coordination
 Collection of docs and links. Please contribute.
Upgrade week FNAL 20111108
M. Hansen, CERN. [email protected]