Transcript NCSA is the Leading Edge Site for the National

Coupling the Leading Edge Site
with the Alliance Partners
• Talk given to First Annual ITEA
Workshop on High Performance
Computing in Support of Test and
Evaluation at Aberdeen, MD
• July 15, 1998
National Computational Science Alliance
NCSA is the Leading Edge Site for the
National Computational Science Alliance
www.ncsa.uiuc.edu
National Computational Science Alliance
The Grid Links People with
Distributed Resources on a National Scale
Source: NASA http://science.nas.nasa.gov/Groups/Tools/IPG
National Computational Science Alliance
Assembling the Links in the Grid
with NSF’s vBNS Connections Program
NCSA Distributed Applications Support Team for vBNS
27 Alliance sites running...
StarTAP
NCSA
…16 more in progress.
vBNS Backbone Node
1999: Expansion via Internet2 -- Abilene
vBNS & Abilene at 2.4 Gbit/s
vBNS Connected Alliance Site
vBNS Alliance Site Scheduled for Connection
Source: Charlie Catlett, Randy Butler, NCSA Grid Team
National Computational Science Alliance
The Grid Enables Caterpillar’s Collaborative
Virtual Prototyping in a Virtual Proving Ground
CAD to VR, Live Rocks, Texture Mapped Terrain
Real Time Linked-VR and Audio-Video
Between NCSA and Germany
Source: Caterpillar, NCSA Industrial Partners Program
National Computational Science Alliance
HPC and Visualization Supporting Anti-Terrorism
Explosive Tests
CEWES MSRC PET Program
DOD Grand Challenge, Raju Namburu, CEWES, PI
Visualization Tool Kit (VTK)-From GE Corp. R&D
C++ classes for data I/O and mapping data to graphics.
Handles unstructured grids as well as rectilinear and structured
Polly Baker, Randy Heiland and Dave Bock, NCSA; Raju Namburu, Tommy Bevins, Byron Armstrong,
Photios Papados, CEWES; Mike Stephens, AHPCRC; Kent Eschenberg, Nichols Research Corp
National Computational Science Alliance
Interactive Visualization for Validation of Sensors
Data Then Validates HPC Modeling, Simulation, & Visualization for T&E
Participants:
ARL T&E Command
Aberdeen Test Center
TACOM, TARDEC
ARL MSRC-PET
NCSA Sci Viz
UMN AHPCRC
Clark Atlanta University
West Virginia University
Georgia Tech
68 Sensors Attached
to Truck to
Define Dynamics
HPC Simulation to Match
Sensor Readings
Visualization Kelly Kirk, NCSA PET www.arl.hpc.mil/VS/
National Computational Science Alliance
The Grid Links Remote Sensors With Supercomputers,
Controls, & Digital Archives in Realtime
Starburst Galaxy M82
• Alliance Scientific Instrument Team
– Real Time Control and Steering
– Collaborative Web Interface
– Radio Astronomy and Biomedicine
Alliance Scientific Instrument Applications Team
National Computational Science Alliance
Goal - Realtime Linking of Sensors with
Modeling, Simulation, and Control
Measurements and
Experimental Design
Process
Control
Signals
Grid Coupling:
Sensors
Networks
Data
HPC Models
Controls
Plant-wide Control
Alliance Chemical Engineering Applications Team
Process
Data
Parameter
Estimation
Process
Model
National Computational Science Alliance
The Grid Links Multiple Investigators With
Sensors, Modeling, Simulation, and Controls
Status of
Simulation
Interactive
Discussion
Detailed
Visualization
Current
parameters
in solution
Reactor
Simulation
Ken Bishop, U Kansas Using NCSA Habanero
National Computational Science Alliance
Modeling and Simulation Challenges The Problem of Coupling Multiple Scales
O(km)
O(m)
O(cm)
O(nm)
But: What Are the Effects of Uncertainties
on Performance?
National Computational Science Alliance
The Alliance Chemical Engineer’s
Workbench
• Web Interface with Collaboration Software
• Provides an Integrated Environment for:
– Process Modeling
– Data Analysis
– Control
– Optimization
• Links
– Multiple Scales
– Software Tools From Different Vendors
• Utilizes “Best” Computing and Software Tools
to Help Solve Practical Applications
National Computational Science Alliance
The
Chemical
Engineer’s
WorkbenchCHEMICAL ENGINEER”S WORKBENCH (Collaborative, web-based modeling environment)
Web Interface to Science and Engineering
Microscopic Computational Chemistry
Molecular
Modeling
Experimental Data on
Mechanisms
and Rates
Quantum Chemistry
Computations of
Thermochemistry
Uncertainty
Analysis
Chemical Mechanism
Formulation
Transition State Theory
Estimates of Rates
File Transfer
Reaction
Modeling
Algorithmic Scale Matching
Macroscopic Transport and Reaction Processes
Reactor Design
Specifications
CFD
Simulation
Momentum,
Energy and Mass
Conservation Models
Macroscopic Chemical
Process Models
Uncertainty
Analysis
Predicted
Performance
Experimental
Data & Validation
Process
Simulation
National Computational Science Alliance
The NCSA Information Workbench An Architecture for Web-Based Computing
User Input
User Web Browser
Output to User
User
Instructions
and queries
Workbench
Application
Programs Instructions
(May have varying
interfaces and be
written in different
languages)
Results
to User
Server
Information
Queries Sources
(May be of
Format Translator,
varying formats)
Query Engine and
Program Driver
Results
Information
NCSA Computational Biology Group
National Computational Science Alliance
Bringing Advanced Data Mining
Models and Methods to Massive Data Sets
Predictive
Modeling
Database
Segmentation
 Classification
 Demographic clustering
 Value prediction
 Neural clustering
Link
Analysis
Deviation
Detection
 Associations discovery
 Visualization
 Sequential pattern discovery
 Statistics
 Similar time sequence discovery
National Computational Science Alliance
NCSA / Allstate
NT Cluster Data Refinery
•Data Management Engine
Compaq
NT Server
• CORBA/Java Orbs
• High-Speed Interconnect
•Terabyte File System
Compaq
NT Server
Visualization
Stations
•Query Capability
External Networks
•Visualization Tools
•Parallel Rule Construction
Source: Allstate & Tilt Thompkins, NCSA
National Computational Science Alliance
The University of Illinois NT Supercluster 256 Intel Pentium II Processors
“Supercomputer performance at mail-order prices”-- Jim Gray, Microsoft
• Andrew Chien, Computer Science UIUC
• Rob Pennington, NCSA
192 Hewlett Packard
300 MHz
64 Compaq 333 MHz
National Computational Science Alliance
NCSA Information Visualization Laboratory
Databases
In3D™ for C++ and Java
VizIt/In3D™
Immersa
Desk™
Graphics
Workstations
MineSet
S-PLUS
Cave™
Flat Panel Wall
National Computational Science Alliance
Sears Pioneers Massive Data Mining and
Information Visualization at NCSA
• 1998 VLDB Survey Program Grand Prize Winner
– Largest Database
– 4.7 Terabytes of Data
– 10 Terabyte Total Disk Space Capacity
– Storage Provided by EMC
Image Courtesy of Michael Welge, NCSA and Sears
National Computational Science Alliance
Data Mining NCSA Industrial Partner Projects
• Caterpillar
–
–
–
–
Effluent Quality Control
Smart Selling
Warranty Claims Analysis
Customer Value Analysis
• Ford
• Sears
– Transaction Management
• Boeing
– Post-Flight Diagnostics
– Image Databases
• Allstate
– Product Compatibility
– Harshness, Noise, Vibration
– Marketing
– Medical Claims
• Financial Impact May Be Greater Than $30 Million
National Computational Science Alliance
NCSA Prognostics Working Group
Is Being Organized
• Technology for Leveraging Information Assets
• Public/Private Sector Issues Similar
–
–
–
–
–
Data Collection: Prior and Real-Time
Dynamic Modeling of Components and Vehicles
Real-Time Analysis
Vehicle and Logistics Chain Models
System Optimization
• Cooperative Technology Development
–
–
–
–
–
NCSA
Caterpillar
Ford
ARL
ASC
National Computational Science Alliance
The Continuing Exponential
Agent of Change
1985
Cray X-MP
Cost: $8,000,000
60,000 watts of power
No Built in Graphics
56 kbps NSFnet Backbone
1997 Nintendo 64
Cost: $149
5 watts of power
Interactive 3D Graphics
64 kbps ISDN to Home
National Computational Science Alliance
Growth Rate of the NSF Supercomputer Capacity
is 70% Compounded Per Year!
1,000,000,000
Total NU
Normalized CPU Hours
70% Annual Growth
This Year
100,000,000
10,000,000
1000 x 1985
1,000,000
100,000
2002
2000
1998
1996
1994
1992
1990
1988
1986
10,000
Fiscal Year
Source: Quantum Research; Lex Lane, NCSA
National Computational Science Alliance
The Evolution of
Shared Memory Parallel Computing
Vector SMPs
to
Microprocessor SMPs
to
Microprocessor DSMs
to
Clustered Microprocessor DSMs
National Computational Science Alliance
Large Origin Arrays Give NCSA and
DOD Mod Common Computing Environment
NCSA has 6 x 128 processors
ASC has 4 x 128
ARL has 3 x 128
CEWES has 1 x 128
NAVO has 1 x 128
Los Alamos Will Have
48 x 128!
National Computational Science Alliance
Alliance / DOD Mod
Origin2000 Repository
Kadin Tseng, BU, Gary Jensen, NCSA, Chuck Swanson, SGI
http://scv.bu.edu/SCV/Origin2000/
National Computational Science Alliance
How to Find Out More About the Alliance
See also http://alliance.ncsa.uiuc.edu
National Computational Science Alliance