Transcript Downlink Segment Status - California Institute of Technology

Downlink Segment Test Status (S12.0)
Russ Laher and Mehrdad Moshir
March 8, 2005
S12.0 Test Readiness Review, March 8, 2005
Russ Laher and Merhdad Moshir (1)
Summary





D/L-group software changes implemented for S12.0
 105 pipeline-related CRs
 67 database-related CRs/AIs
 31 ARs
D/L segment-testing to check specific CR/AR/AI changes
 Small cluster of 12 pipeline-drones (mini “ops-like” environment)
 SODB (fresh S11 database via EdJackson)
 Archiver run on pipeline results for end-2-end verification
ISTs doing science verification of pipeline products and testing of SPICE
QA team verification of QA sub-system upgrades
Test plan documents written by CogEs to help I&T
S12.0 Test Readiness Review, March 8, 2005
Russ Laher and Merhdad Moshir (2)
What’s New for S12.0















Functionality/infrastructure to process MIPS-24 SUR-mode TPM data
Processing of MIPS-24 flatfield AORS through both flatfield and science pipelines
New MIPS-24 automated “spot” and scan-mirror-dependent flatfield picking
New MIPS-24 scan-leg pointing-refinement pipeline
MIPS:Ge calibration products are now being archived!
New IRAC and MIPS-24 sky median product
Post-BCD IRAC position-refinement pipeline now generates warning, not error, when number of input
images < 5 Pipeline-picker upgrade to handle IRS PeakupImage data
Improved and more flexible ensemble creation
New database functionality

new vBest’ing machinery for telemetryFiles records

getCalProducts now returns files with specified releaseLevel range

12 new QA diagnostics are now being populated in Qa_ptg-xfer table
Ingest now populates SCLK, Frametime, and exposuretime for IRAC in DCEs DB table, to be used for
simplifying IRAC first-frame-correction DB query
Updated the following software modules: irs_tune, droopop, profile, basecal, ridge, extract, qaloader,
darkest, slremov, snestimator
Various updates to wrappers, cal files, CDFs
New off-line superboresight pipeline: refines original boresight pointing-history file by mapping the
IRAC pointing-refinement results back to the original pointing-history data; aim is to use for reprocessing; more testing is needed before it can be used in operations
SPICE upgrades for picking version-dependent calibration files, selecting input files via HTTP, and
using a remote server for processing
QA sub-system upgrades to SDAT, database functionality, and other web-based tools
S12.0 Test Readiness Review, March 8, 2005
Russ Laher and Merhdad Moshir (3)
Tests Under S12.0

IRS
All Sci (BCD&BQD), DarkCal, DarkEns pipelines; used fallback cal; all data run through archiver

Details in IRS S12 Test Plan Document
MIPS-Ge

Sci (scanmap, photometry, sed, tpm), darks, flats; used fallback cal; all data run through archiver

Details in MIPS-Ge S12 Test Plan Document
MIPS-24

SUR-mode sci scanmap (slow, med, fast cases); SUR- and RAW-mode photometry; SUR- and
RAW-mode TPM; flat-field cal w/ pointing transfer, non-linearity cal w/ pointing transfer; SUR &
RAW dark cal w/ pointing transfer ; used fallback cal; all data run through archiver

Details in MIPS-24 S12 Test Plan Document
IRAC

sub-, full-array science and cal pipelines for all exposure modes, frame times, and combinations
of internal and external repeats; product records and file system contents checked for data run
thru each pipeline; used metadata and fallback cal; all data run through archiver

Details in IRAC S12 Test Plan Document
Post-BCD

FIFcreation; pointing refinement;single_frame_pnt_src_ext;multi-frame pnt-src_ext; mosaic pntsrc_ext; overlap correction; image_interp, outlier; image_reinterp; mosaic_coadd for IRAC,
MIPS24, 70 &160; all data run through archiver

Details in PostBCD S12 Test Plan Document
QA, SDAT

Loader run for all tested pipelines, SDAT tool run, qa pages and statistics pages brought up

Details in QA/Infrastructure S12 Test Plan Document






S12.0 Test Readiness Review, March 8, 2005
Russ Laher and Merhdad Moshir (4)
S12.0 Functions/Test Data Flows
S12.0 Test Readiness Review, March 8, 2005
Russ Laher and Merhdad Moshir (5)
S12.0 Capabilities
Sub-system
Capability
Ingest
Supports DCEs, Pntng, ECSV, Rpt files, Mem Dmps.
Sped up, SigEvents, FEIdelete, ReRun, Archiver
naming, HK compression
Pipeline Exec
real-time data reduction; reprocessing
Instrument pipelines
All three instruments science and calibration
Calibration Transfer
Fall-back rules (incl NIT) for all three instruments, three
nearest in time rules for all three instruments, blessed
status flag, asymmetric discriminant selection,
interpolation rule
Instrument Performance Monitoring
Create/Populate HK tables in the HK DB; web-based
viewing and data retrieval; updated menus
Quality Assessment
Creation and populating of QA tables; SDAT web-based
QA inspection; analysis and display functions; support
archive release
CDF
Populating of version controlled CDF files on the pipeline
drones; retrieve CDF in pipelines, version tracking in the
SODB
Imaging post-BCD pipeline
Point source extraction, pointing refinement (w/ & w/out
2MASS, USNO, UCAC, FIRST), tiling, overlap
correction, outlier identification and mosaic coadding,
bandmerging
S12.0 Test Readiness Review, March 8, 2005
Russ Laher and Merhdad Moshir (6)
S12.0 Success Criteria















Run, re-run requests that failed on OPS
Interact with the SODB via perl & c-APIs
Deposit raw data into the archive file system
Create pipeline manifests & ensembles
Run manifests through APES
Run multiple jobbers on 12 pipeline drones
Use CDF to get configuration files
Use CalTransfer to get calibration data (NIT and/or fallbacks)
Execute post-BCD pipelines including pointing refinemnet
Put QA statistics into QA tables
Put processing results in sandbox and set file pointers in DB
Use SDAT to access and view results on segment test
Get “better” BCDs & post-BCD prods
IST sci verification of seg test data & buy off (incremental from IOC)
Pass the running of archiver
S12.0 Test Readiness Review, March 8, 2005















Russ Laher and Merhdad Moshir (7)
Applicable SISs
Calibration

SOSDL-SIS-CL-3000 : darkcal output FITS file, dark image

SOSDL-SIS-CL-3001 : lincal output FITS file, linearity model cube

SOSDL-SIS-CL-3002 : lincal output table file, pixel cal data

SOSDL-SIS-CL-3003 : lincal output cmask image

SOSDL-SIS-CL-3004 : darkcal output cmask image

SOSDL-SIS-CL-3005 : pmask definitions

SOSDL-SIS-CL-3006 : Electronic Nonlinearity Calibration File

SOSDL-SIS-CL-3007 : MIPS-Ge stim_latent

SOSDL-SIS-CL-3008 : function loadcalkeywords

SOSDL-SIS-CL-3009 : IRAC-loadcalkeywords version-1 SODB Table

SOSDL-SIS-CL-3010 : darkest cmask

SOSDL-SIS-CL-3011 : CalTrans Rule List

SOSDL-SIS-CL-3012 : IRS Umask

SOSDL-SIS-CL-3013 : IRS Lmask

SOSDL-SIS-CL-3014 : IRAC flatcal data cube

SOSDL-SIS-CL-3015 : IRAC flatcal cmask

SOSDL-SIS-CL-3016 : IRS flatcal cmask

SOSDL-SIS-CL-3017 : IRS Omask

SOSDL-SIS-CL-3018 : IRS Flux Conversion Table

SOSDL-SIS-CL-3019 : IRS FOV PSF Table

SOSDL-SIS-CL-3020 : IRS COADD2D AMASK

SOSDL-SIS-CL-3021 : IRS COADD2D FMASK

SOSDL-SIS-CL-3022 : IRS WAVSAMP TABLE

SOSDL-SIS-CL-3023 : MIPS-Ge cmask


























Data Tools

SOSDL-SIS-DT-3004 : profile.tbl (IRS BQD)

SOSDL-SIS-DT-3005 : ridge.tbl (IRS BQD)

SOSDL-SIS-DT-3006 : extract.tbl (IRS BQD)

SOSDL-SIS-DT-3007 : irs_tune.tbl (IRS BQD)

Executive

SOSDL-SIS-EX-3000 : plinexyz.cdf

SOSDL-SIS-EX-3001 : run time environment variables








Quality Assessment

SOSDL-SIS-QA-3000 : QA file (*.qa) format



S12.0 Test Readiness Review, March 8, 2005
Products
SOSDL-SIS-PD-3000 : cvti2r4 output FITS file, 32-bit real data
SOSDL-SIS-PD-3001 : cvti2r4 output FITS file, dmask
SOSDL-SIS-PD-3002 : muxbleedcorr output DCE FITS file
SOSDL-SIS-PD-3003 : imfliprot output FITS file
SOSDL-SIS-PD-3004 : MIPS Ge bmask
SOSDL-SIS-PD-3005 : imagest output bmask
SOSDL-SIS-PD-3006 : tranhead keyword-translate-only list
SOSDL-SIS-PD-3007 : Tile/BCD association files
SOSDL-SIS-PD-3008 : Mosaic-geometry interface
SOSDL-SIS-PD-3009 : BCD delta file
SOSDL-SIS-PD-3010 : PREDICTSAT s-mask
SOSDL-SIS-PD-3011 : dldeltafile library
SOSDL-SIS-PD-3012 : PRF/PSF map
SOSDL-SIS-PD-3013 : Point source extraction table
SOSDL-SIS-PD-3014 : Detection/Tile/BCD Association File
SOSDL-SIS-PD-3015 : imagest output slope image
SOSDL-SIS-PD-3016 : latimflag l-mask
SOSDL-SIS-PD-3017 : fiducial frame definition parameters
SOSDL-SIS-PD-3018 : mosaic_interpolation table
SOSDL-SIS-PD-3019 : matched-point-source refined position table
SOSDL-SIS-PD-3020 : fiducial frame input parameters
SOSDL-SIS-PD-3021 : bandmerged point source output file
SOSDL-SIS-PD-3022 : bandmerger pointer dump file
SOSDL-SIS-PD-3023 : band-pair registration uncertainties
SOSDL-SIS-PD-3024 : bandmerge statistics
SOSDL-SIS-PD-3025 : MIPS24 bmask
SOSDL-SIS-PD-3026 : FPGen Command Line Input
SOSDL-SIS-PD-3027 : FPGen SODB Entries file (input)
SOSDL-SIS-PD-3028 : FPGen Template Input file
SOSDL-SIS-PD-3029 : Bandmerge (QA) spectral combination counts
Pointing Transfer
SOSDL-SIS-PT-3000 : pixel-scale table file
SOSDL-SIS-PT-3001 : Ptg Refinement Absolute Source List Input Fmt
SOSDL-SIS-PT-3002 : MIPS Scan Mirror Parameters Table
SOSDL-SIS-PT-3003 : Instrument FOV Table
SOSDL-SIS-PT-3004 : Super Boresight Pointing History File
SOSDL-SIS-PT-3005 : Refined DCE Position Table File
Russ Laher and Merhdad Moshir (8)
Pipeline-Related CRs (105)
PR
6473
6471
6470
6469
6461
6454
6453
6451
6450
6449
6447
6446
6444
6436
6430
6425
6423
6415
6413
6406
6405
6394
6383
6382
6378
6371
6370
6368
6367
6361
6358
6352
6351
6342
6330
6317
6316
6309
6308
6307
6306
6300
6299
6280
6275
6271
6270
6261
6260
6259
Category
downlink-mips-24
downlink-pipeline-exec
downlink-pipeline-exec
downlink
downlink-pipeline-prod
downlink-pipeline-exec
downlink-analysis
downlink-pipeline-exec
downlink-pipeline-prod
downlink-pipeline-ptg
downlink-mips-ge
downlink-pipeline-exec
downlink-pipeline-prod
downlink
downlink-irs
downlink-pipeline-qa
downlink-pipeline-prod
downlink-pipeline-prod
downlink-pipeline-ptg
downlink-pipeline-exec
downlink-irs
downlink-pipeline-qa
downlink-pipeline-prod
downlink-pipeline-prod
downlink-pipeline-ptg
downlink-pipeline-ptg
downlink-pipeline-ptg
downlink-mips-24
downlink-pipeline-ptg
downlink-mips-ge
downlink-pipeline-exec
downlink-pipeline-prod
downlink-pipeline-prod
downlink-pipeline-prod
downlink-irac
downlink-pipeline-qa
downlink-irac
downlink-pipeline-ptg
downlink-pipeline-cal
downlink-mips-24
downlink-pipeline-qa
downlink-pipeline-ptg
downlink-mips-24
downlink-pipeline-exec
downlink-pipeline-ing
downlink-pipeline-prod
downlink-pipeline-exec
downlink-mips-ge
downlink-mips-ge
downlink-mips-ge
Responsible
Masci_Frank
Laher_Russ
Beck_Ron
Laher_Russ
Masci_Frank
Masci_Frank
Laher_Russ
Laher_Russ
Fowler_John
Masci_Frank
Pesenson_Meyer
Laher_Russ
Fowler_John
Laher_Russ
Narron_Bob
Laher_Russ
Laher_Russ
Fowler_John
Masci_Frank
Makovoz_David
Fang_Fan
Hesselroth_Ted
Masci_Frank
Laher_Russ
Masci_Frank
Masci_Frank
Jacobson_Jeff
Jacobson_Jeff
Jacobson_Jeff
Henderson_David
Laher_Russ
Makovoz_David
Laher_Russ
Makovoz_David
Lee_Wen-Piao
Laher_Russ
Laher_Russ
Masci_Frank
Lee_Wen-Piao
Jacobson_Jeff
Laher_Russ
Masci_Frank
Masci_Frank
Beck_Ron
Laher_Russ
Masci_Frank
Laher_Russ
Henderson_David
Pesenson_Meyer
Lee_Wen-Piao
Synopsis
Execute science/post-BCD threads following initial processing of dedicated flatfield data thru flat pipeline
Update ensemble creation rules for MIPS-Si ...
Update entries for initplscriptIds: 1031, 1033 in $SIRTF_OPS/thread_order* ...
Update ensemble rules for MIPS-Ge scan mode
Update detect_exec.cpp to write more significant figures to detection table output..
Update operator.csh to include pgplot specific environment variables..
Please add "./teplot" to ..../downlink/datools/Makefile, check into CVS and tag for S12.0...
Modify APES-static y-priorities for IRAC
Basecal should optionally accept a umask and use it in the baseline averaging
Abort gracefully in pointing history query s/w if input BPHF is truncated before nominal EndSclk.
change mips flatfield module from flat_field to mipsflat
Update to ensemble creation rules for MIPS-24..
New remask module
Just so we don't forget: please add "./superboresight" to .../downlink/pipeline/b-s/src/Makefile
Use BASECAL module to improve Poisson noise estimates in IRS pipelines
changes on SDAT left frame display
Make tranhead sclk calculation based on telemetry only
Make RSSing baseline uncertainty with DCE uncertainty optional, default no; add separate baseline uncertainty image to go with optional baseline image.
Update pointing transfer to compute PTGDIFFX, PTGDIFFY for all IRS slits
in pipeline 35 downgrade the error to warning if there is not enough images to do overlap corrections
slremov needs to not subtract pedestal
SDAT: remove version ID from login page
Update latimflag module according to changes suggested in code walk-through...
Add command-line option to flatfield module to override EXPTIME consistency checking..
Compute PTGDIFFX, PTGDIFFY in native pixel frame for insertion into product headers and QA_ptg_xfer table..
Update pointing transfer thread to allow insertion of values into new "QA_ptg_Xfer" fields.
Update stored procedure "addQA_ptg_xfer" to add the additional fields as outlined in CR6367
Update database stored procedure which loads mips1fallback..
Update schema for "QA_ptg_xfer" table to allow additional fields as per this CR..
insert namelist CVS version ID into fits keyword
Add new MakeMedianBCDstack() to WrapperUtils.pl
Add call to subroutine "MakeMedianBCDstack" in w_bqd_run_mopex.pl for MIPS-24
Modify flatfield module to read EXPTIME as T_INT alternate keyword.
Make post-BCD bandmerger software package buildable by I&T for Solaris for release to community
New AOT mode of multi-exposures
cvs remove setQaStatusForCampaignAndPid.cgi
Modifications to tranhead for CR #6275
Update w_pointinghistory.pl to write WCS info. to full 128x128 array headers for peakup exposuretypes sp, pkc and pks..
Update calkeywords _library_ and "OFFSET" include files to support two new column fields in mips1fallback..
Schema update for mips1fallback in ops and sodb_it databases
launch a new browser window for pointing angle page
Update "getPH_online" to exercise SDM's new v-besting scheme for the telemetryfiles table...
Create an unnormalized median of all BCDs per science AOR as part of ensemble processing..
Please update "$SIRTF_OPS/thread_order" for mips24 (S12.0)...
modify INGEST to add ATIMEEND to database and compute new r_sclk
Update pointingrefinement module to propagate new information to output tables for use by MIPS superboresight ptgXfer...
Update createEnsembles.pl, supporting DB stored procedures and documentation to support new MIPS ptg refinement pipeline.
Implement SED passband calibration file
mipsflat qsort key-compare-routine upgrade
mipsdark qsort key-compare-routine upgrade
S12.0 Test Readiness Review, March 8, 2005
Russ Laher and Merhdad Moshir (9)
Pipeline-Related CRs (105)…
6258
6256
6254
6253
6250
6248
6245
6243
6242
6241
6240
6216
6215
6214
6193
6177
6175
6172
6168
6167
6166
6161
6159
6157
6125
6123
6113
6108
6102
6101
6099
6098
6097
6089
6087
6085
6083
6071
6070
6061
6060
6012
5939
5938
5931
5930
5913
5858
5828
5706
5640
5614
5506
5497
5092
downlink-pipeline-prod
downlink-pipeline-qa
downlink-irac
downlink-pipeline-qa
downlink
downlink-pipeline-cal
downlink-irac
downlink
downlink-pipeline-exec
downlink-irs
downlink-pipeline-ing
downlink-pipeline-qa
downlink-pipeline-exec
downlink-pipeline-exec
downlink-pipeline-qa
downlink-mips-ge
downlink-pipeline-prod
downlink-pipeline-exec
downlink-mips-ge
downlink-mips-ge
downlink-mips-ge
downlink-mips-ge
downlink-pipeline-exec
downlink-irs
downlink-pipeline-prod
downlink-pipeline-prod
downlink-mips-ge
downlink-pipeline-prod
downlink-mips-24
downlink-pipeline-ptg
downlink-pipeline-ptg
downlink-pipeline-ptg
downlink-pipeline-ptg
downlink-pipeline-prod
downlink-pipeline-qa
downlink-pipeline-qa
downlink-pipeline-qa
downlink-mips-ge
downlink-mips-ge
downlink-mips-ge
downlink-mips-ge
downlink-pipeline-cal
downlink-pipeline-prod
downlink-pipeline-prod
downlink-pipeline-prod
downlink-pipeline-prod
downlink-pipeline-exec
downlink-pipeline-exec
downlink-irs
downlink-pipeline-qa
downlink-irac
downlink-pipeline-exec
downlink-pipeline-qa
downlink-mips-24
downlink-pipeline-qa
Henderson_David
Laher_Russ
Lee_Wen-Piao
Laher_Russ
Laher_Russ
Laher_Russ
Lee_Wen-Piao
Masci_Frank
Laher_Russ
Narron_Bob
Laher_Russ
Hesselroth_Ted
Laher_Russ
Laher_Russ
Laher_Russ
Henderson_David
Pesenson_Meyer
Laher_Russ
Pesenson_Meyer
Lee_Wen-Piao
Henderson_David
Henderson_David
Laher_Russ
Khan_Iffat
Lee_Wen-Piao
Jacobson_Jeff
Henderson_David
Makovoz_David
Masci_Frank
Masci_Frank
Masci_Frank
Masci_Frank
Masci_Frank
Khan_Iffat
Laher_Russ
Laher_Russ
Laher_Russ
Henderson_David
Henderson_David
Makovoz_David
Henderson_David
Laher_Russ
Khan_Iffat
Makovoz_David
Fowler_John
Fowler_John
Laher_Russ
Laher_Russ
Narron_Bob
Laher_Russ
Lee_Wen-Piao
Jacobson_Jeff
Laher_Russ
Laher_Russ
Jacobson_Jeff
New qsort key-compare library
More S12.0 improvements to showDcesSodbInfo.cgi
Creation of imask, final product mask file
allow QA adminstrator to use the stand alone tool to set status
vBest'ing machinery for ensembleSets
Modify 'flatfield' module to add a new keyword 'FLANORM' to the headers of 2 output FITS files
Placing the median Skydark value in the BCD header
Update makefile macro "TOP.mk" under .../downlink/env to enable builds across different subnets..
New option for createEnsembles.pl
qaloader change for S12.0
ingest tweak for S12
fix "Frame" button in SDAT
Update APES workshop perl scripts to enable big-endian I/O on a little-endian machine.
Update jrdb.c to enable big-endian I/O on a little-endian machine.
change AOR status for a given request key
update dmask, pmask, bmask bits for Ge pipelines
MIPS:Ge flat_field upgrade
Modify updateCalProductStatus.pl to have unlock/lock options
various changes to mips flat_field
mipsdark to produce coverage map
allow more than 6000 DCE's for hipass filter
MIPS-Ge filtering
Add plScriptIds 1550 & 1650 to APES static tables
Update SPICE modules for LINUX
ffcorr action items from code walk-through
add plscriptId=1550 and 1650 with exptype=ffl
Update interp module to ignore RADHITBCD
MIPS and IRAC mosaic coverage maps need correct value for BUNIT in header
Update mips24 science threads to (optionally) use automated scan-mirror dependent flatfield picking..
Update existing getPH_online (get Pointing History) s/w to enable byte-order independent read capability
Write new pipeline thread to generate "super-boresight" pointing history files
Write new pipeline thread to perform refinement of MIPS scan-legs.
Create module to transfer refinement corrections in mips24 scan-leg pointing to BCDs,
new module to apply offsets for overlap corrections
add options for standard and free-form comments in setQaStatusForCampaignAndPid.cgi
add a button to display current statuses in setQaStatusForCampaignAndPid.cgi
S12.0 improvements to showDcesSodbInfo.cgi
rearrange primary product/ancil product for MIPS Ge
add new MIPS Ge exposure type - ffl for "fine flat"
Mask location of sources in rmask for two pass MIPS-Ge processing
Update Ge pipelines to make sci bcds from cal pipelines
flatfield module NaN creation should be controlled by namelist
in mosaic_outlier change the defaults for BOTTOM_THRESHOLD and TOP_THRESHOLD
modify mosaic_outlier to make median coadd
update dmask definitions for MIPS-24 in the pick utility
make basecal robust against radhits
Mod. to ensemble-creation ruleId=110
Faster job-manifest sorting
Add error propagation to IRS_TUNE
SDAT should write error log file to logs directory
Load metadata with a "blessed" status value
Database stored functions for unlocking vBest
SDAT: display PID on AOR page
*** "Please have R. Laher update the ensemble creation document with mips24 updates attached below"***
schema update for QA_irsflatcalprep
S12.0 Test Readiness Review, March 8, 2005
Russ Laher and Merhdad Moshir (10)
Database-Related CRs/AIs (67)
AI #1469 - Change in product types table needed
AI #1449 - Ensemble-creation rule changes for MIPS:Si
AI #1421 - Change release level from 99 to 100 for a few archive Pids
AI #1402 - Data content for new ensRules DB table (set make='f' for ruleId=350)
AI #1388 - Add "bcd_median.fits" and "bcd_median_uncert.fits" to ProductTypes
AI #1364 - Backfill externalName fields in S12.0 database
AI #1363 - Data content changes to productTypes database table (S12.0 DB only)
AI #1338 - Remove ruleId=226 from ensRules and ensplScripts DB tables, etc.
AI #1212 - Backfill vBest in telemetryFiles database table
AI #1219 - New data contents for calExposureTypes database table
AI #1215 - New operations-TFS fileType "calexposuretypes"
AI #1212 - Backfill vBest in telemetryFiles database table
AI #1201 - Update DB productTypes table with comments
AI #1191 - Data content for new ensRules and ensPlScripts DB tables
AI #1172 - update the product types table per CR 6073
CR #6419 - getCalPRoducts SP needs two release levels min and max
CR #6374 - Update instrumentId in runPipelinePicker DB stored-functions
CR #6370 - dnlProc_CR6370.sql, addQA_ptg_xfer_CR6370.pm
CR #6368 - dnlProc_CR6368.sql (loading mips1fallback)
CR #6367 - QA_ptg_xfer_CR6367.sql
CR #6363 - Modify pipeline picker to handle new IrsPeakupImage mode
CR #6360 - New overloaded updateDce DB stored procedure for Ingest
CR #6328 - New S12.0 database capabilities for QA subsystem
CR #6327 - New database role qaSuperUserRole
CR #6325 - New database table QA_superUsers
CR #6324 - New perl-API function getQaAnalystsAndSuperUsers
CR #6323 - New DB stored-function getQaAnalystsAndSuperUsers()
CR #6318 - New overloaded setDceTimeParameters DB stored procedure - REJECTED
CR #6307 - Schema update for mips1fallback in ops and sodb_it databases
CR #6284 - New Ingest C-API for populating Dces database table for IRAC
CR #6283 - New Dces.atimeend field in database (integer) - REJECTED
CR #6282 - Update PlScripts.plscriptnum for plscriptid=1042
CR #6281 - Make plScripts.comment more precise for plScriptId=33
CR #6270 - Remove ruleId=226 and update ensemble-creation document.
CR #6250 - vBest'ing machinery for ensembleSets
CR #6242 - Modify createEnsembles.pl to have -u option
CR #6223 - New database stored function getQaStatusForRequest
CR #6224 - New database stored procedure setQaStatusForRequest
CR #6225 - New perl-API function getQaStatusForRequest
CR #6226 - New perl-API function setQaStatusForRequest
CR #6212 - PlScripts-table data-content changes to undo AI #1183
CR #6210 - New DB stored-function getBestTelemetryFilesForCampaign
CR #6188 - New perl-API function getRefinedPointingFilesForCampaign
CR #6187 - New DB stored-function getRefinedPointingFilesForCampaign
S12.0 Test Readiness Review, March 8, 2005
CR #6180
CR #6179
CR #6173
CR #6148
CR #6136
CR #6123
CR #6120
CR #6106
CR #6105
CR #6104
CR #6093
CR #6092
CR #6077
CR #6076
CR #5913
CR #5827
CR #5818
CR #5816
CR #5815
CR #5738
CR #5614
CR #5092
CR #1209
- Upgrade perl-API function lockEnsembleProductsVBest
- Upgrade DB stored-function lockEnsembleProductsVBest
- New perl-API function unlockEnsembleProductsVBest
- Add vBest'ing machinery to DB SP registerTelemetryFile
- Upgrade database stored-function getDceIdsForRequest
- add plscriptId=1550 and 1650 with exptype=ffl
- Upgraded perl-API function setQaStatusForCampaignAndPid
- New perl-API function getQaStdComments
- New database stored-function getQaStdComments
- Upgrade stored-procedure setQaStatusForCampaignAndPid
- New perl-API function getQaStatusForCampaignAndPid
- New DB stored-function getQaStatusForCampaignAndPid
- New perl API getLatestEnsembleProduct
- New DB stored-function getLatestEnsembleProduct
- Mod. to ensemble-creation ruleId=110
- Overloaded addEnsemble and addEnsembleNTC DB stored functions
- New perl-API functions for ensemble creation
- New DB stored procedures for ensemble creation
- New database tables for ensemble creation
- New "ruleId" field in Ensembles tables
- Stored functions for unlocking vBest
- Schema update for QA_irsflatcalprep
- Define and implement database procedures for ensemble processing
Russ Laher and Merhdad Moshir (11)
ARs (31)
PR
6466
6458
6445
6441
6440
6418
6417
6414
6400
6375
6362
6353
6347
6344
6338
6304
6298
6263
6255
6222
6221
6165
6152
6121
6107
5966
5943
5891
5708
5526
5847
Category
downlink-mips-ge
downlink-pipeline-exec
downlink-mips-ge
downlink-pipeline-qa
downlink-pipeline-exec
downlink-irs
downlink-pipeline-prod
downlink-pipeline-prod
downlink-irs
downlink-pipeline-qa
downlink
downlink-mips-ge
downlink-irs
downlink-pipeline-exec
downlink-pipeline-exec
downlink-pipeline-qa
downlink-pipeline-ptg
downlink-mips-ge
downlink-pipeline-qa
downlink-mips-ge
downlink-mips-ge
downlink-irac
downlink-mips-ge
downlink-mips-ge
downlink-pipeline-prod
downlink-irs
downlink-analysis
downlink-pipeline-prod
downlink-mips-ge
downlink-pipeline-prod
Archive
Responsible
Henderson_David
Makovoz_David
Pesenson_Meyer
Laher_Russ
Laher_Russ
Fang_Fan
Fowler_John
Masci_Frank
Fang_Fan
Laher_Russ
Laher_Russ
Henderson_David
Narron_Bob
Laher_Russ
Laher_Russ
Laher_Russ
Masci_Frank
Lee_Wen-Piao
Laher_Russ
Pesenson_Meyer
Pesenson_Meyer
Lee_Wen-Piao
Pesenson_Meyer
Henderson_David
Lee_Wen-Piao
Fang_Fan
Hesselroth_Ted
Laher_Russ
Henderson_David
Makovoz_David
Synopsis
calproduct database table not made for cal products
in createFifTable.pl erroneous statement $crpix2 = $naxis1/2;
mipsflat apparently hangs doing mips-70 AOR 12055552
SDAT's qapage.pl doesn't handle IrsPeakupImage (reqMode=111)
APES single-side-shared-memory version with race condition fixed
wrong entries in header of droopop_unc.fits files
hdrupd8 module has memory access/allocation problems under Linux..
cropfits module has problems for non-square input images.
Darkest module incorrectly updates Dmasks in inputlists
correction for RA difference calculation in QA tools
setup_manifest.auto creates strange MIPS Ge results for AOR 12073216
calibration product uncertainty files not copied to sandbox
Log files not being archived
Benign uninitialized-variable error
jobdispatcher.c bugs
S11 qa2uplink.pl in ops net has an incorrect version
BPHF paths incorrectly assigned by getPH_online when DCE straddles a "month" boundary...
mipsdark code change for system qsort usage
qapage.pl bugs
duplicate copies of mips_ge_bmask.h files with wrong values
old bmask.h file definitions still around
SubArray Flat made from best FullArray flat instead of latest
mips_flatfield sort compare routine compares floats
MIPS GE filtering bug produces huge uncertainties
flatap changes from code walk-through
DROOPOP module issues warning that NAMELIST parameters Saturation_Bit and Saturation_Val are ignored
SPICE Image display shows artifacts in Solaris
tranhead created SCLK_OBS of 0.5 seconds for MIPS-2 FID= 8762624
Archiving files from MIPS:Ge 1600- and 1800-series threads
IRAC BQD Bandmerge & Mosaic threads (32/34) fail for Ch4
Laher_Russ Archive system does not find fallback calibration files for MIPS-Ge
S12.0 Test Readiness Review, March 8, 2005
Russ Laher and Merhdad Moshir (12)
Issues to be tackled in S13







SDAT fully functioning under Apache proxy server
Improvement of MOPEX documentation for March 22 Observers’ Support
Workshop and more extensive improvements over the next few months
Port post-BCD tools to Max OS 10 (goal is by August Observers’ Support
Workshop
Database Query of IRSPeakUpImage database table for Final Product
Generation – is this needed?
Simplified time-delay calculations for IRAC first-frame correction
MOPEX GUI development
Bandmerge upgrade
S12.0 Test Readiness Review, March 8, 2005
Russ Laher and Merhdad Moshir (13)
Lines of code
Build
S3.5
Total Lines of Code
(excludes comments)
102,823
S4
140,991
S5
283,344
S5.5
294,439
S6.0
335,447
S6.1
368,048
S6.2
450,398
S6.3
510,561
S7.0
582,492
S8.0
585,944
S9.0
617,674
S9.5
627,809
S10.0
632,480
S11.0
688,129
S12.0
773,366
S12.0 Test Readiness Review, March 8, 2005
Russ Laher and Merhdad Moshir (14)
Lines of Code
DL LOC
S3.5
S4.0
S5.0
S5.5
S6.0
S6.1
S6.2
S6.3
S7.0
S8.0
S9.0
S9.5
S10
.0
S11
.0
S12
.0
900000
800000
700000
600000
500000
400000
300000
200000
100000
0
S12.0 Test Readiness Review, March 8, 2005
Russ Laher and Merhdad Moshir (15)
S12.0 LOC breakdown
Language
LOC
C
404,898
C-Shell
1,642
C++
37,287
Fortran
25,977
IDL
2,966
Java
141,966
Makefile
23,203
Namelist
3,117
Perl
116,475
SQL
15,916
S12.0 Test Readiness Review, March 8, 2005
Russ Laher and Merhdad Moshir (16)
Sample of new tool for setting QA status
S12.0 Test Readiness Review, March 8, 2005
Russ Laher and Merhdad Moshir (17)
Sample of new ptg diff Q/A statistics
S12.0 Test Readiness Review, March 8, 2005
Russ Laher and Merhdad Moshir (18)
Sample of new ptg diff Q/A statistics
S12.0 Test Readiness Review, March 8, 2005
Russ Laher and Merhdad Moshir (19)