Transcript EGOWS, June 2007, Dublin

What is it?
EGOWS, June 2007, Dublin
Implementation details
Programming language:
ANSI/ISO C++
Self-documented sources:
Doxygen (web searchable developer’s documentation)
Team programming:
Concurrent Version System (CVS)
Continuous integration:
Autobuild system (e-mailing, night build, lunch build)
now BAMBOO (fancy web interface)
Automated packaging:
Linux & Windows installations, nightly builds for testing
Problem/project tracking:
JIRA – TTS portal for users and developers
EGOWS, June 2007, Dublin
System portability
Programming language:
ANSI/ISO C++ (system independent programming)
gains true portability, equivalent performance
3rd party libraries:
Qt (Unix/Windows GUI), STL, Boost
True system portability:Windows, majority of UNIX (incl. Linux),
most cost effective: Intel EM64T (Windows/Linux)
Server
Linux
Unix
Windows
Majority Linux systems
(binary distribution)
Solaris (UltraSPARC, AMD64, IA32),
HPUX (PA-RISC, IA64),
AIX (POWERx, AMD64),
IRIX (MIPS, IA64), ...
MS Windows NT-based
(2000, XP, 2003+)
MS Windows NT-based
(2000, XP, 2003+)
All MS Windows systems
(X11, Remote
Desktop/TSCAL)
IA32, IA64, EM64T, AMD64, ...
RedHat, Fedora, MDK, SuSE, Debian, ...
Client
Majority Linux systems
(binary distribution)
Solaris (UltraSPARC, AMD64, IA32),
HPUX (PA-RISC, IA64),
AIX (POWERx, AMD64),
IRIX (MIPS, IA64), ...
Remote desktop
All Linux systems
(X11)
All Graphical Unix systems
(X11)
EGOWS, June 2007, Dublin
System’s Layered Model
Applications / Daemons
Map Toolkit
Math
Kernel
Core
Toolkit
Message
Switching
Database Access &
Abstraction Layers
Graphical Painter
Native
DB
Remote
DB
Qt
SQL
User
DB
Configuration
OS Abstraction Layer
GUI
Printer
drivers
Display
Printers
EGOWS, June 2007, Dublin
Operating System
Network
Storage
Other
Resources
Scalability
The Visual Weather is designed to be flexible and scalable and provide
portable solutions as well. The system can also run on off-the-shelf industry
standard PC-based hardware.
Standard operational schemes include:
•
Stand-alone workstation:
Running on a single computer or notebook (i.e. small monolithic
system)
•
Server and client systems:
Running on server; sharing database with separate independent clients;
Allows clustering – High Availability and Load Balancing
•
Heterogeneous environment:
Multi-system mixed architecture with dedicated data distribution,
LAN/WAN mixture, cross-platform interoperability
EGOWS, June 2007, Dublin
Generations
• Software is being developed for 9 years now
• Architecture changes are being natural to development process,
therefore keeps it “young” for going towards future requirements
1st Generation – “Early beginnings” – simple visualization tool, with math
calculations.
2nd Generation – Product customization, math, productivity oriented,
client-server, turns into “Robust” system.
3rd Generation – turns robust system into “Integration platform” for other
applications and modules
– Re-using/integrating other applications, even in native code (such as
Fortran and OSFM (UK))
– Python + PyQt for high-level forecaster’s tools/gadgets (such as
interactive thermodiagram/normand-point)
– Algorithm reusing (such as OSA (UK))
– Data provider (API, remote calls, WMS) to other applications (such as
TDA)
EGOWS, June 2007, Dublin
Python scripting & Integration
Provides Rapid integration & Development platform –
allows to develop high-level functionality quickly and
efficiently.
• PyQt performs GUI binding
• There are binding in VW to access core
functions (which are time-critical) as well
as objects
• Access to full framework – e.g. on-screen
modification of thermodiagram is a Python
script
• Ideal for applets, diagnostic tools, advising
& decision aid
EGOWS, June 2007, Dublin
Re-using & data provider
• Integrating computation methods
on math-kernel level
• Re-using of know-how: On Screen
Analysis
• Re-using of code (even Fortran):
FSU Streams, COMPAC, On Screen
Field Modification
• Remote/local call API, batch
tools, automation already in-build
EGOWS, June 2007, Dublin
Data Input
Visual Weather has flexible capabilities for data reception and
transmission (Message Switch functionality),
including:
• Satellite broadcast reception
• Message Switching Systems
• Surface observation network
• Remote-sensing portable
instruments
• SADIS, RETIM, DWDSAT,
ISCS systems
• TCP/IP WMO stream protocol
• Highly variable File-transfer (FTP
protocol, incl. secure SFTP)
EGOWS, June 2007, Dublin
Database Access Layered Model
Database supports:
Applications / Daemons
•
•
•
•
Database Access Layer
Database Abstraction Layer
Local Database
“Native”
Remote Database
Direct (non-cached)
User Database
User’s local files
Database Proxy
LAN / WAN
Database files
Remote database
EGOWS, June 2007, Dublin
aging of the data & expiration
holding case studies
replaying of data
temporary/testing data (user)
Inter-process communication (ICOP RPC)
System talks to its other components through RPC (but not SOAP or CORBA),
in order to allow orchestration of all its components & background
processing.
Graphical
Application 1
Structure allows real
remote calls, i.e. creating
client-server architecture
and different deployment
schemas, if needed.
Calling serv.
User
Application 2
Request
ICOP Server
Remote Client
Application 3
EGOWS, June 2007, Dublin
Service 1
Reply
TCP Socket
4021
Registering
Request
Network
Service 2
Server
System
Client
System
Request
Proxy diver
Abstraction Layer
Access Layer
Remote and Proxy Database
Request
Request
Retrieve
Store to cache
Database Proxy
Retrieve cached items
Remote
database
TCP Socket
Check for data or index
Retrieve
LAN / WAN
Proxy cache
storage
EGOWS, June 2007, Dublin
Application 2
Request
Proxy diver
Abstraction Layer
Access Layer
Request
Proxy diver
Abstraction Layer
Access Layer
Application 1
Daemon 1
Mathematic Kernel Overview
• Token (structure)-driven Stack Machine for strong Math
• Class oriented system of computations, unit-type transparent/checks
• Functions in pCode or Dynamic Libraries
• Array/Grid-transparent processing
• pluggable decoders
Applications
• TDCF interpreter engine
• scalar/vector operators
Mathematic Kernel Interface
• token-formatting features
• micro-renderers / AnyT /
Token Stack-Machine Processor
Conversion
Unit
XML / XSLT
Atomic Cache Unit
Dynamic Kernel Libraries
pCode functions
TAC
TAC
Decoder 1 Decoder 2
EGOWS, June 2007, Dublin
TDCF
Decoder
Thermo
Dynamics
User
Libraries
Mathematic Kernel Example
–
Take( , “temperature”)
[C]
Synop(station, time)
[Class Synop]
Grid(EGRR, temperature, 2m,
station, time)
[K]
Interpolation
Unit
[GRIB]
FM-12 SYNOP
TAC Decoder Library
Database
EGOWS, June 2007, Dublin
GRIB
Decoder Library
Database
User privileges
System Users
VW Users
ACL Manager
Applications
Alice
Alice
Access
Control
List
Bob
Bob
Report retrieval
Request for authorisation
Grant / Deny
Database retrieval
Maps
Carol
Editing
Shared configurations
Configuration
Dave
Dave
Office
common
pre-sets
Eve
EGOWS, June 2007, Dublin
Usergroup
pre-sets
User’s
own
pre-sets
Graphic Painter Overview
• Entirely vector-based (not
a hard-copy oriented)
Applications
Graphic/Geo toolkit
• Full Unicode support,
layout engine, font
smoothing, TTF/OTF
Font Abstraction subsystem
Layout engine
Graphic Painter Abstraction (primitives)
• Internal painter software
based (no HW limits, nonblocking), fully 32bit RGBA,
anti-aliasing, sub-pixel
precision, ASM (IA32&64)
Image Painter
PostScript
Painter
Qt
X11
PDF Painter
SVG Painter
SW-RGBA
GDI
EGOWS, June 2007, Dublin
ASM
Printers
e-Doc
Web
• e-documents standard PDF
(model 1.4), print-quality
delivery
WMO Information Systems (WIS)
Moving towards WIS, will put very soon more requirements on Visualization
workstations, not just Metadata extraction from original data, but also from
forecaster’s products
• WMS (Web Map Service) – already implemented
(1.1.1, 1.2, 1.3 – incl. multi-dimensions).
WMS will take crucial place in UK’s production
chain.
• WCS (Web Coverage Service) – providing
forecaster-modified fields
• WFS (Web Feature Service) – providing
depicted weather features
WMS is not only about exposing data for GIS
and decision making process (although being
important there!), but is about WIS!
EGOWS, June 2007, Dublin
Depiction of Meteorological Objects
Besides WMS (already implemented, test system operational), other
“components” are on the way:
• Field cutter to be
available soon
• Meteorological features
are already available
for sharing for integration
with production chain;
also allows collaboration,
etc.
EGOWS, June 2007, Dublin
Message Editing
Message editing is based on pre-configured message templates for automated,
and semi-automated message editing.
•
The forecaster uses an interactive form where various input-boxes, listboxes, and check-boxes help the forecaster to fill in the message.
•
Messages can contain automatically calculated data, including values from
observations, binary forecasts, values interpolated from NWP.
•
Messages can be transmitted on demand or at scheduled times.
EGOWS, June 2007, Dublin
Tables & Alerts
Comprehensive tables where values are automatically substituted from
the selected data type (SYNOP, METAR, TEMP, BUOY, NWP models,
lightning detection system, etc).
• Tables can include values and
graphical symbols.
EGOWS, June 2007, Dublin
• Limits for parameters and places
are used for monitoring and
automatic issuing of alerts.
Detailed Geographical Data
In-build geographical data with world-wide coverage, high-resolution,
incl.: shorelines, countries, airports, rivers, Digital Elevation Model –
allowing chart production for any area of the world.
Special geographical data
can be added for the
detailed tactical display of
map background. A ESRI
shape file with vector
orography can be imported
from industry-standard GIS
mapping software. The
shape file can include
information about
districts, operation area,
infrastructure, etc.
EGOWS, June 2007, Dublin
Observations
Visualization of SYNOP, METAR, TEMP, BUOY data in various forms:
•
Station models with customizable
size, look, and density
•
Colour status symbols
•
Discrete numbers placed at station
position
•
Automatic weather icons
•
Objective analysis
Information tooltip showing values at
the selected point
EGOWS, June 2007, Dublin
Objective Analysis
Objective analysis using Barnes or Akima method, featuring unique tools:
• Model-based
initialization
(multi-pass differential
analysis)
• Median and Model-based
quality control
• Manual report
corrections
EGOWS, June 2007, Dublin
Satellite and NowCasting Data
Visualisation of satellite images
in native formats.
•
Easy integration of satellite
images into all maps and
real-time reprojection to
selected area.
•
Support of low-orbit and
geo-stationary satellites,
including MSG.
•
False colouring and RGB
composites available.
•
Support of NowCasting data
integration.
EGOWS, June 2007, Dublin
Radar and Lightning Data
• Multiple radar sites can be
combined into a single map.
EGOWS, June 2007, Dublin
• Display of information about
lightning discharges from SFERICS,
Vaisala, SAFIR, etc.
Forecast Model Parameters
Map Editor displays parameters from forecast models decoded from GRIB
and GRID messages. All models, including UKMO, ECMWF, MM5, HRM,
HIRLAM, ETA, WAVE are supported.
Model output visualized as:
•
Isolines and isosurfaces
•
Wind barbs or arrows
•
Numerical grids
•
Stream-lines
•
Trajectories
EGOWS, June 2007, Dublin
Model Comparisons
Visual Weather enables to visualize various types of models:
• Parameters from various models can • Parameters from various
models can be mathematically
be displayed simultaneously on the
combined into a single
same background (different models or
parameter.
ensembles).
EGOWS, June 2007, Dublin
Advanced Computations
Visual Weather thanks to powerful mathematical kernel provides several
efficient mathematical features for decoding and computing parameters
using editable equations.
It also enables to create value-added maps based on user’s equations, e.g.:
• Corrected model temperature by previous forecast-error;
• Cross-model operations and validations;
• Thermal Wind, Icing Probability, Stability Indexes , etc.
EGOWS, June 2007, Dublin
Significant Weather Charts
Significant Weather charts (SIGWX) charts are automatically generated
from BUFR messages for any selected area of the world.
• Certified for data from both
WAFC centers Exeter and
Washington.
• High level charts (SWH).
• Medium level charts (SWM).
EGOWS, June 2007, Dublin
Map Editing
Generated maps can be manually edited with:
• Various significant weather
elements
• Texts and icons
Edited elements can be
automatically encoded and
distributes within information
network to be available for other
users
EGOWS, June 2007, Dublin
Cross-sections & Meteograms
• Route- and time- cross-sections
combining different type of
observations, models, and
objective analysis at once.
• Route cross-sections can be also
created by simply clicking the
desired route on map.
EGOWS, June 2007, Dublin
Thermodiagrams
Thermodiagrams can be created on the basis of TEMP, PILOT or model data.
The following types are supported:
• Skew-T
•
•
•
•
Stuvegrams
Tephigrams
Aerograms
Hodograms
The look of coordinate system and
adiabats is fully configurable.
All significant stability indexes are
automatically computed.
Overlay of various thermodiagrams
and model-based pseudo-temps
EGOWS, June 2007, Dublin
Output
Product output can be obtained in various forms:
• Regular image files in JPG, PNG, GIF,
TIFF, BMP, T4 or PDF format
• Web Map Service (OpenGIS WMS)
allows instant integration with
GIS tools
• GTS image files with standard
headings allowing GTS distribution
• High-quality printout using vectorbased processing, enabling output on
large scale plotters
• Batch processing/scheduler for
background operation
EGOWS, June 2007, Dublin