Transcript Databases, Web Pages and Archives

Databases, Web Pages and Archives
Inseok Song and Marshall Perrin
Goals
1. Support distributed collaboration efficiently
2. Target selection and proposal writing
Near term
Merge observational data from many teams
Allow cross-referencing, querying, sorting, etc.
3. Enable an organized & effective campaign
Track target priorities, observation & reduction status
Share reduced datasets across the team for scientific analysis
Long term
4. Help advance scientific analysis
Statistical studies of planet properties, astrometric orbit fitting,
etc.
In the style of (or merged into?) exoplanets.org site
System
MySQL database
hosted at Georgia, replicated to Berkeley, HIA, STScI
Raw data archived in CADC at HIA
Central computer cluster for pipeline reductions & reduced data archive
(at HIA?)
Can store multiple reductions for any given dataset
(e.g. default pipeline parameters, vs. optimized or alternate
parameters  see the draft DB schema)
Web interface (TBD - what features are desired?)
Interfaces
SQL command line (powerful and flexible, steeper learning curve)
Graphical SQL clients (several available, spreadsheet-like table
viewers)
Goal: Virtual Observatory compliant interface (ADQL protocol)
Use standard VO tools like TopCat, etc
(learning curve for us to implement)
Web Page interface.
Everyone should check out exoplanets.org
Issues
Data rights, NDA
Data entry & maintenence - a large task especially at first
Hardware resources: CPU cores and disk space
Full campaign probably only ~5 TB?
ADI & LOCI reductions are CPU intensive
Programming staff: expertise with web devel & VO interfaces in
particular
Flexibility vs. consistency & standardization
Draft GPI Database Schema
GPI database schema (PDF file on KT)
Detailed description of DB tables (TXT file on KT)
These files are also accessible from
http://cosmos.physast.uga.edu/GPI
Exoplanets.org
http://exoplanets.org
Harvard Time Series Center
http://timemachine.iic.harvard.edu/search/
RV planets website (G. Marcy)
Example Database with Web-interface
Spitzer Exploration Science: Young Stellar Objects VARiability
http://cosmos.physast.uga.edu/YSOVAR
Password protected…
YSOVAR
YSOVAR
YSOVAR
Example Database with Web-interface
Spitzer Exploration Science: Young Stellar Objects VARiability
http://cosmos.physast.uga.edu/YSOVAR
Password protected…
** Porting this to GPI will take ~2 weeks of full time.
** GPI specific capabilities ? May require ~3 months FTE
Discussion Questions
What are the fundamental features you would want to see?
near-term and long term wish lists
What do you need to support campaign planning?
What existing resources can we take advantage of?