PosterBookkeeping

Download Report

Transcript PosterBookkeeping

The LHCb Bookkeeping
System
The LHCb Bookkeeping is a system for the storage and retrieval of meta data associated with LHCb datasets. The meta data are stored in an Oracle
database which is interrogated using services provided by the LHCb DIRAC infrastructure. The Bookkeeping GUI(“feicim” meaning “ I see” in gaelic) allows the users
browsing through the LHCb datasets as if they were in a Virtual File System, and get the desired set of files.
HOW DO LHCb PHYSICISTS USE THE
BOOKKEEPING?
1. A user makes a query through the GUI.
2. The Bookkeeping returns a set of files
3. The user runs an analysis job on these files through
Ganga/Dirac infrastructure.
LHCb bookkeeping
1- User interface to make queries: the Feicim GUI
2- The Bookkeeping returns a set of files
Feicim file dialog allows the users to save the
selected datasets with different file formats, in
particular as a Gaudi configuration file. This
window provides a short description of the
selected datasets.
The Feicim LHCb Bookkeeping
main window displays files and
folders. The user can browse the
folders by selecting their meta data.
The folders group consistent
datasets. Double clicking on the
dataset a new window appears
which contains the selected files.
THE NEW IMPLEMENTATION OF THE BOOKKEEPING
JUST RELEASED ALLOWS:
1. Much more flexible queries though a tree like browsing
system.
2. New criteria to query the files, both for simulated and real data.
3. A much more stable service
4. Queries fulfilled in short time.
HOW DOES THE BOOKKEEPING STORE LHCb
DATASETS AND THEIR META DATA?
1. Any time some new files are produced (MC production, data
reprocessing, real data from the pit), their meta data are uploaded
into the Bookkeeping database.
2. The Bookkeeping stores all relevant information about files and
jobs in a relational structure.
3. The files to be reprocessed can be retrieved by the production
system, querying the Bookkeeping on the basis of their meta data
Bookkeeping Manager
Oracle DB client
3- Users submit jobs with
Ganga/DIRAC:
Once users have selected a set of files, they
can submit their jobs to the Grid through
Ganga/DIRAC infrastructure.
MORE ADVANTAGES OF THE
INTEGRATION INTO THE DIRAC
FRAMEWORK:
1. The monitoring system of DIRAC gives
information about the performance of the
Bookkeeping
2. The DIRAC framework provides security (user
authentication and authorization)
3. All the services integrated into the same
DIRAC framework: easier to manage and to
maintain .
Bookkeeping Database Schema
File[s]
File[s]
Job
File[s]
Job
File
Job
File
File
Production
Configuration
SubConfig
Input
Processing
Pass
Processing
Pass
Conditions
E.Lanciotti and Z.Mathe on behalf of the LHCb DIRAC team