Transcript ppt

Actionable Intelligence
from Multisourced Events
Roy Williams
Caltech
with S.G.Djorgovski, C. Donalek, A. Drake,
M. Graham, A. Mahabal, R. Seaman (NOAO).
• VOEvent
please pray for
VAO
• VORapid
• Skyalert Infrastructure
• Decision = Human + Archive + Machine
What is VOEvent
• XML document according to VO-standard
• Who, Wherewhen, Why, Params
• Each event belongs to a Stream
– key-value-semantic records
• Author, Subscriber, Broker functions
• Information not Imperative
• Follow-ups are other VOEvents
• Connected in citation graph to form Portfolio
Microlensing event (OGLE)
Global Event Authors and Followup
AAVSO
GCN
@ NASA/GSFC
LCOGT
Liverpool Telescope
SWIFT
Fermi
Integral
AGILE
La Palma
Faulkes
Hawaii/Australia
PannSTARRS
eStar
Exeter
Caltech
UKIRT
OGLE III
NOAO
Tucson
Palomar P60
Pairitel
Caltech
Hawaii
Poland
Berkeley
CTIO/KPNO
MOA
Catalina RTS
UAriz
Stream Author
Publisher
Repository
Relay
Followup Subscriber
VORapid
please pray for
VAO
Virtual Observatory Rapid Transients Facility
• Content
– VOEvent
– Consume
• Browse, Query,
Subscribe, Decision
– Author
• Streams, Alerts,
Automation
– Portfolio
• Annotation, Mining
– Brokering
• Transport
– Tier 1
– Broker, Forward
– Tier 2
– Applications
Tier1 and Tier2 Event Nodes
please pray for
VAO
Repository (Tier2)
Author (Tier2)
Broker (Tier1)
Jabber/XMPP
or custom TCP?
• Tier1:
• Immediate forwarding, standard & capable protocols
• Tier2:
• Subscription service, Repository, Query, Archive,
Machine Learning, etc etc
International
GCN Broker
skyalert.org
Annotation
from
archives
Astronomers
Amateurs
Students
Microlensing
Optical transients
Radio transients
X-ray transients
Gamma transients
Grav. waves
Neutrinos
Events and
annotation
disseminated to
subscribers in
real time with
intelligence
Followup
Scheduler
Telescope
Telescope
Telescope
Event Authors
Event Subscribers
Stream as Event Template
Taming Multisourced Data
stream
made by
person in daytime
event
made by
robot system at night
skyalert.org
skyalert.org
Future ....
ASKAP,
IceCube
LIGO/Virgo,
MWA,
SkyMapper,
Veritas TeV
secondary
streams
Portfolio of One
First Discovery VOEvent
skyalert.org
Rich portfolio: Supernova 2007sr in Antennae
Ground
based
telescop
e
skyalert.org
DSS
1967
Hubble
WFPC2
Astronomer’
s
Telegram
Lightcurve
Spectru
m
Discovery
Image
Event-Action-Event Cycle
subscribers
Events
Triggers
(event template)
(template
instance)
(for action)
Catalina Sky Survey
mag1
mag2
mag3
asteroidness
stellarity
cutoutURL
Archive
follow-up
SDSS archive
Archive
follow-up
Berkeley lightcurves
Telescope
follow-up
Palomar 60” follow-up
uMag
gMag
uCutoutURL
gCutoutURL
lightcurveURL
probSN
probCV
gmag
rmag
ipmag
zpmag
datapackageURL
19.34
19.32
19.39
1%
97%
http://.....
21.42
20.96
http://.....
http://.....
http://......
87%
12%
19.07
18.03
18.57
18.94
http://.....
joint
rule
Original
detection
Streams
skyalert.org
Annotation
(linked data)
Google Sky has VOEvents
skyalert.org
Thanks to Ryan Scranton
WWT Realtime Event Display
skyalert.org
Thanks to Jonathan Fay
Bayesian Learning
•
•
•
•
Feature Vectors
Best Recommendation
Combine with Human judgment
Error bars, upper limits, and missing values
• All are part of the prior
• Summing opinions of multiple experts
• Some not experts!
• Relevance Vector Machine
• Best of training set (most learning)
• Tutorial
• Escalation to real expert
Building Feature Vector
Mahabal et al
arXiv:0810.4527 [astro-ph]
Recommendation for Follow-Up
Mahabal et al
arXiv:0802.3199 [astro-ph]
Sparse data
 Ambiguous classification
 best follow-up strategy to reduce confusion
Example: optical light curve with a particular time cadence would
discriminate between a Supernova and a quasar,
Example: particular color measurement would discriminate between a
cataclysmic variable eruption and a gravitational microlensing event,
Human Volunteers
• Science Layer
– Describe what you see in image
– Each person has level of expertise
– How to use data most effectively
• Game Layer
– Makes people come back
– Top 10 ranking etc
– Anonymous partner a la gwap.com
Human Computing
• Ask humans to *describe*
– not *interpret*
Automated Decision through Tripod of Data
• Archive
• nearby radio source escalates p(blazar)
• nearby galaxy escalates p(supernova)
• Human
• Crowded field? Artifact present?
• Can make follow-up observation
• Machine
• Fuzzy center escalates p(host galaxy)
• Moving source escalates p(asteroid)
• Bobotic follow-up observation
decision
• Please try skyalert.org
• register, then set an alert
• Do you have a stream of astronomical events?
(and can I have them)
• Who knows how to make a scalable push network?
(can we talk?)
skyalert.org