Transcript Слайд 1 - Indico

Tools for job definition support
Dmitri Golubkov
[email protected]
Introduction
• There is no framework to support job
definition development
• Existing code is inflexible and has no web user
interface for production
• A lot of unbrowserable objects
• Unmaintainable difficult source code of
existing solution, there is no class
architecture, difficult support and expensive
modification
Prototyping – first step
• Django Framework based web application
• Started with ProdMon by Maxim Potekhin
• Trying with different use cases:
– Task information: general, CPU usage
– Task verification: parent id verification,
input files verification, partnr verification
– Search of tasks
– Simple CPU statistics
Task information
Verification of Parent ID
Verification of Input files
and Partnr
CPU usage
Verifications
• Verification of Parent ID:
– Lists all Job objects in given Task (Ejobdefbig
model)
– Extracts from Jobpars field input file list and tid
attribute value
– Builds the list of IDs for all jobs and checks it
Verifications
• Verification of input files and Partnr:
– Lists all Job objects in given Task (Ejobdefbig
model)
– Extracts from Jobpars field input file list
– Сhecks that list is consistent
– Lists Partnr values for all jobs and checks that the
list does not contain repeating elements
Search
Task group statistics
CPUCOUNT per job of task group
Plans
• Develop infrastructure to re-engeneer job
definition (Django Framework based web
application)
• Keep coherence with others ProdDb
applications (prodmon, db browser), study a
possibility to have a common framework
(ESB – Enterprise Service Bus ?)
• Coming soon:
– Test tool:
• http://voatlas23.cern.ch:8000
• Bug reports to [email protected]