Transcript 130424_Instruments-C..

Instrument requirements
to the DAQ/Control/Scientific
Computing system
Controls/software session
European XFEL collaboration meeting Apr 24, 2013
Thomas Tschentscher
on behalf of the European XFEL scientific instruments
[email protected]
Science instruments requiremens to DAQ/control/scientific computing
Outline
 short description of elements of European XFEL user facility
 a ‚prototypical‘ experiment
 requirements to DAQ/Control/Scientific Computing
Thomas Tschentscher, European XFEL,
21 Mar 2010
2
Science instruments requiremens to DAQ/control/scientific computing
User facility and its operation
3
Mission
 Provision of x-ray FEL radiation and instrumentation
 User facility based on peer-review
 Support of users by tools and facility staff


Enable efficient conduct of experiments
Enable successful completion of proposed science work
Some numbers
 ~4200-4800 hrs accelerator operation in x-ray delivery user mode

No distinction here between external users & internal usage
 Current operation mode is 12+12 for two instruments at one source


typically 3 instruments take beam (simultaneous/quasi-simultaneous)
other 3 instruments prepare/set-up (but are basically also operating/online)
 Each proposal typically receives 3-8 12hr-shifts (36-96 hrs) per experiment
 ~1000 user visits per year
 Extend in future (5 beamlines, 10 instruments, higher rate of sim. operation)
Thomas Tschentscher, European XFEL,
21 Mar 2010
Science instruments requiremens to DAQ/control/scientific computing
Layout x-ray facility
4
 2 e--beamlines
 3 (5) undulators
 6 (10-15) instruments
MID
HED
SPB
FXE
-
e
-
e
SQS SCS
Boxes only placeholders !
Thomas Tschentscher, European XFEL,
21 Mar 2010
Science instruments requiremens to DAQ/control/scientific computing
XTDs - X-ray optics and transport
 offset mirrors  surpression of bremsstrahlung & higher harmonics
 deflection mirrors  distribution to 3 instruments in XHEXP
 Monochromators & focusing optics
 X-ray beam diagnostics
 Others (pulse picker, split&delay, …)
Thomas Tschentscher, European XFEL,
17 Apr 2012
5
Science instruments requiremens to DAQ/control/scientific computing
XHEXP – Scientific Instruments & Optical lasers
Each instrument will have its devices to be interfaced
 Several optics (mirrors, CRL, monochromators, …)
 X-ray beam delivery (slits, attenuators, …)
 X-ray diagnostics (Io monitor, time-diagnostics, …)
 Optical laser beam delivery & diagnostics
 Sample manipulation & sample environment
 Detector(s) and spectrometers
 Vacuum system & devices
SPB instrument
Thomas Tschentscher, European XFEL,
17 Apr 2012
6
Science instruments requiremens to DAQ/control/scientific computing
Differentiation
Users are …
 6 unique science instruments


Instrument staff
External users
 Specific teams with need to control and readout their systems




Beam transport
Optical lasers
Detectors
…
The different ‚systems‘ will likely require specific and somewhat different
implementation based on platform KARABO.
Thomas Tschentscher, European XFEL,
24 Apr 2013
7
Science instruments requiremens to DAQ/control/scientific computing
Expert users
8
Some ‚access‘ restriction may be needed
 Complex instrumentation and completed alignment/adjustment
 Danger of damaging instrumentation
Access limitation
 Only ‚experts‘ are allowed to operate these devices (to be identified)


Instrument/facility staff
Specific staff, trained in use of specific devices
 ‚General users‘ may initiate action if needed for experiment


Buffered request: undulator gap change, …
24/7 or on-call people to execute
 However: this classification is not unique and adaption/configuration needed
However, most ‘access’ with the aim of manipulating the experiment will
happen from one, maybe two specific working places in the ctrl hutch
(surrounded by screens, phone, tools, ...).
Unique control application
Access limitation cannot be achieved by login or similar fundamental ways
SR: limit access to critical devices by passwd or similar

Thomas Tschentscher, European XFEL,
24 Apr 2013
Science instruments requiremens to DAQ/control/scientific computing
Outline
 short description of elements of European XFEL user facility
 a ‚prototypical‘ experiment
 requirements to DAQ/Control/Scientific Computing
Thomas Tschentscher, European XFEL,
24 Apr 2013
9
Science instruments requiremens to DAQ/control/scientific computing
A prototypical experiment
Preparation
phase
Setup
phase
Data taking
phase
Data analysis
phase
 Detailed proposal  define parameters, check feasibility
 Pre-experiments; preparation of experimental setup
 Setup at European XFEL instrument (without beam)







Set & verify x-ray parameters according to requirements
Alignment of sample and additional/secondary diagnostics
Verify optical laser beam settings and performance
Verify detection systems settings and performance
Search for signal
Time fraction : significant (days) for non-standard exps.
Time fraction : moderate (hrs) for standard exps.
 Collect data according to experiment protocol
 Modification of variables and switching of samples
 Apply on-line data analysis & reduction
 Pre-analysis on-site up to preliminary results
 Full analysis off-site up to final results
Thomas Tschentscher, European XFEL,
24 Apr 2013
10
Science instruments requiremens to DAQ/control/scientific computing
Operation modes of instruments
Preparation phase
 Before experiment period



Clarify setup, required instrumentation, ctrl tools, data analysis tools
Integrate & test new components
Expect that something (10-20%) comes up only at start of experiment
 This phase is mostly off-line.
 Experiment coordinator with DAQ/Ctrl/SciComp group(s)
Thomas Tschentscher, European XFEL,
24 Apr 2013
11
Science instruments requiremens to DAQ/control/scientific computing
Operation modes of instruments
Setting up and adjustment
 Setup & adjust hardware
 Setup & trim software & initial data analysis tools

Examples of such tools
 Data selection/restriction/reduction
 Time or parameter sorting methods
 ‚Hit‘ finding
 Correlation analysis
 FFT transformations
 Fully on-line (occupies instrument to large percentage)
 Primary user:

Instrument/facility staff
 Secondary user:

Scientist performing experiment (external/internal)
 Need to use Ctrl/DAQ from several comp‘s (hutch, tunnel, external, ...)
Thomas Tschentscher, European XFEL,
24 Apr 2013
12
Science instruments requiremens to DAQ/control/scientific computing
Operation modes of instruments
Data taking
 Collect data according to experiment protocol
 Modification of variables and switching of samples
 Apply on-line data analysis & reduction

Absolute crucial component for experiments ! Needs to be considered part
of experiment. This task is different to SR experiments.
 ‚Semi-continuously‘ verification of instrument performance

Facility staff
 Fully on-line
 Primary user:

Scientist performing experiment (external/internal)
 Secondary user:

Instrument/facility staff
Thomas Tschentscher, European XFEL,
24 Apr 2013
13
Science instruments requiremens to DAQ/control/scientific computing
Operation modes of instruments
14
Data analysis
 On-line (during data taking). See above
 Off-line (during data taking): Preliminary data checks


In order to ensure we get not swamped with data and to ensure high data
quality standards this may become a requirement to the users, but will need
resources to be established
During this phase proximity to instrument is very helpful
 Off-line (after experiment): Complete preliminary analysis


Directly after experiment a preliminary data analysis should occur.
Probably at xfel.eu, but should be remote from instrument
 Off-line (after experiment): Full analysis


Occurs after experiment and will require time
Access to data from home institute or short visits to xfel.eu
Thomas Tschentscher, European XFEL,
24 Apr 2013
Science instruments requiremens to DAQ/control/scientific computing
Example: HED-CTR room layout
1
Version: 04/12/2012
Data analysis 2/3
Table
Access to hutch
Instrument ctrl 1/2/3
Data analysis 1
Access to hutch
PSS/Interlock
7m
PSS/Interlock
4m
1m
Science instruments requiremens to DAQ/control/scientific computing
Example: HED-CTR room layout
1
Version: 04/12/2012
•
Table
PLUS:
Overflow space for more people working on
data analysis (ideally close to instrument to
enable exchange & feedback)
Space for data analysis (not the same people)
Data analysis 2/3
•
Access to hutch
Instrument ctrl 1/2/3
Data analysis 1
Access to hutch
PSS/Interlock
7m
PSS/Interlock
4m
1m
Science instruments requiremens to DAQ/control/scientific computing
Data analysis areas in XHQ
17
2nd floor, XHQ
Thomas Tschentscher, European XFEL,
24 Apr 2013
Science instruments requiremens to DAQ/control/scientific computing
Outline
 short description of elements of European XFEL user facility
 a ‚prototypical‘ experiment
 requirements to DAQ/Control/Scientific Computing
Thomas Tschentscher, European XFEL,
24 Apr 2013
18
Science instruments requiremens to DAQ/control/scientific computing
User requirements to DAQ/Ctrl/SciComp
Entry point
 Unique entry point  login – selection panel – various functionalities

DAQ – ctrl – data analysis/scientific computing – others
 Very clear and structured appearance (at all levels ?)




Clear identification of function of application
Unique usage of certain functionalities (start, exit, update, …)
Not too many buttons and too small text/features in GUIs
Update of window  „live view“
 Configurable (and saveable)
 Possibly identifiable by Exp ID (or similar)


Ideally have only one ‚session‘ open
Issue of how to deal with expert vs. user mode (!)
Thomas Tschentscher, European XFEL,
24 Apr 2013
19
Science instruments requiremens to DAQ/control/scientific computing
Functionalities
DAQ/Ctrl
 Motors  control/status/display
 Signals/detectors  control/status/display
 External devices display/Interface-to-access








Electron beam delivery (pulse sequence, others tbd)
Undulator control (set photon energy, define scan of photon energy)
X-ray beam transport, vacuum & diagnostics
Equipment protection system
X-ray interlock system / shutter control
Optical laser
Data (intermediate & long-term)
…
 operation



GUIs
Command line
Macro capability
Thomas Tschentscher, European XFEL,
24 Apr 2013
20
Science instruments requiremens to DAQ/control/scientific computing
Functionalities
DAQ/Ctrl operation
 Single device access



Display status/value
Configure settings
Operate: move, readout, …
 Multiple device access

Scan capability
 Synchronized with 10 Hz pulse delivery
 1D-, 2D-, 3D-, nested scans
 Any real or virtual motor or value
 Read any signal/detector as function of motor position
 Display/plotting of signal (real or calculated)
 Time optimized (no overhead)
 Easy (clear) command language/configuration of scans
 Plotting/display of signals


1D, 2D, several signals in one plot, different scale; easy configurable
‚quasi-online‘ verification of data streaming
Thomas Tschentscher, European XFEL,
24 Apr 2013
21
Science instruments requiremens to DAQ/control/scientific computing
Functionalities
Data analysis – on-line
 Immediate access to all data (no transfer times; x-ray & e--beam)
 Tool-kit to on-line data analysis

extract, manipulate, display, store ‚real experimental data‘ from complex
data-files
 2D image treatment & analysis:
» Fourier transform, Element-wise matrix multiplication, Matrix subtraction
(addition), Thresholding utility, Definition of sub arrays (e.g., regions of interest),
Sum of all/selected pixels, Crystal peak identification, and more …

 Manipulations: select, compare, fit, math-functions, …
 Immediate access (during data accumulation ?)
Define new ‚virtual‘ signals
 Possibility to make available at experiment control ???
 Tool-kit on-line data reduction


Verify signals with/without ‚Veto‘ signal
 Comparison: visual, some tbd calculated qualifier
 Select Veto signal: real, virtual
Storage of ‚reduced‘ data
Thomas Tschentscher, European XFEL,
24 Apr 2013
22
Science instruments requiremens to DAQ/control/scientific computing
Functionalities
23
Data analysis – off-line
 Preliminary analysis (during exp., on-site)


… (all you can/cannot imagine)
Script development tools for internal & external usage
 Final analysis (off-site)

Access similar to that from instrument (ease of operation)
General data treatment; tool kits
Specific data pipelines
User defined scripts/packages
Thomas Tschentscher, European XFEL,
24 Apr 2013
 e.g. bio-imaging (SPB)
Science instruments requiremens to DAQ/control/scientific computing
24
Thank you for your attention
The end.
Thomas Tschentscher, European XFEL,
24 Apr 2013
Science instruments requiremens to DAQ/control/scientific computing
Add. slides
Thomas Tschentscher, European XFEL,
24 Apr 2013
25
Science instruments requiremens to DAQ/control/scientific computing
Interaction of acc. operators & experimenters
Diffraction
pattern
Reconstruction
Instrument operation
Accelerator operation
As close as
possible
interaction
Thomas Tschentscher, European XFEL,
17 Apr 2012
26