Transcript ppt - Calit2

Scaling-Up the BIRN
“Building on the BIRN” Workshop
National Institutes of Health
Bethesda, MD
March 22, 2004
Dr. Larry Smarr
Director, California Institute for Telecommunications and
Information Technologies
Harry E. Gruber Professor,
Dept. of Computer Science and Engineering
Jacobs School of Engineering, UCSD
BIRN is a BISTI Leadership Project for the
National Institutes of Health
• Biomedical Information Science and Technology Initiative
– BISTI Report to NIH Director: June 1999
• Interdisciplinary Teams
– Collaborating to Develop Mathematical Models, Write Software and
Adapt Systems
• Cooperation with Computer Science in:
– Algorithm, Software, Database and System Development
• Improved Access to Computing
– Shared PC Clusters in Biomedical Laboratories to High-Performance
Systems in National Centers
• Workforce Development to Encompasses Every Level
– Technician to Ph.D.
• New Centers for Research and Teaching
– People Competent in Biomedicine and Computation & Mathematics
Botstein-Smarr Report June 1999
www.nih.gov/about/director/060399.htm
Cal-(IT)2--An Integrated Approach
the Future of the Internet
220 UC San Diego & UC Irvine Faculty
Working in Multidisciplinary Teams
With Students, Industry, and the Community
BIRN Driven
www.calit2.net
BIRN Cyberinfrastrucure Must Evolve
Riding Multiple Exponentials
Performance per Dollar Spent
Optical Fiber
(bits per second)
(Doubling time 9 Months)
Silicon Computer Chips
(Number of Transistors)
(Doubling time 18 Months)
0
1
2
3
Number of Years
Scientific American, January 2001
Data Storage
(bits per square inch)
(Doubling time 12 Months)
4
5
Data Intensive e-Science Will Require
Common Cross-Agency Cyberinfrastructure
The OptIPuter Project –
Removing Bandwidth as an Obstacle In Data Intensive Sciences
• NSF Large Information Technology Research Proposal
– Cal-(IT)2 and UIC Lead Campuses—Larry Smarr PI
– Co-PIs Mark Ellisman, Phil Papadopoulos, Tom DeFanti, Jason Leigh
– USC, SDSU, NW, Texas A&M, Univ. Amsterdam Partnering Campuses
• Industrial Partners
– IBM, Sun, Telcordia/SAIC, Chiaro Networks, Calient, Glimmerglass
• $13.5 Million Over Five Years
• Optical IP Streams From Lab Clusters to Large Data Objects
NIH Biomedical Informatics
Research Network
NSF EarthScope
and ORION
http://ncmir.ucsd.edu/gallery.html
siovizcenter.ucsd.edu/library/gallery/shoot1/index.shtml
What is the OptIPuter?
Next Generation Cyberinfrastructure
• Applications Drivers  Interactive Large Data Objects
• OptIPuter Nodes  Scalable PC Cluster LambdaGrid “Browser”
• IP over Lambda Connectivity Predictable Network
• Open Source LambdaGrid Middleware Can Reserve Network
• Data Retrieval and Mining  Global Virtual Disk Drives
• High Def Visualization, Collaboration  “UltraReality TV”
See Nov 2003 CACM
For Articles on OptIPuter Technologies
BIRN
OptIPuter Driver: On-Line Microscopes Creating
Very Large Biological Montage Images
• 2-Photon Laser
Confocal Microscope
IBM 9M Pixels
– High Speed On-line
Capability
• Montage Image Sizes
Exceed 16x Highest
Resolution Monitors
– ~150 Million Pixels!
• Use Graphics Cluster
with Multiple GigEs to
Drive Tiled Displays
Source: David Lee, NCMIR, UCSD
Ultra-Resolution Displays Driven by
Graphics Clusters Scaling to 100 Million Pixels
• JuxtaView (UIC EVL) on
Tiled LCD GeoWall2
– Digital Montage Viewer
– 8000x3600 Pixel
Resolution~30M Pixels Now
– Building a 75M Pixel Wall
• Display Is Powered By:
– 16 PCs with Graphics Cards
– 2 Gigabit Networking per PC
• Linked by Dedicated MultiGigabit Light Pipes
Brain Microscopy
– Research on Adding Stereo
HD Collaboration
Source: Jason Leigh, EVL, UIC; USGS EROS
Exploring High Performance
LambdaGrid Collaboration
Falko Kuester, Cal-(IT)2@UCI,
Collaboration Laboratory
with Smart Boards and
Optically Connected Large Screens
With UCI Potkin and UCSD Ellisman
BIRN Laboratories
OptIPuter Driver: Gigabit Fibers on the Ocean Floor
NSF’s ORION-Ocean Research Interactive Ocean Network
www.neptune.washington.edu
Based on BIRN
Cyberinfrastructure
Cyberinfrastructure in
Design Phase-Fiber Optic Cables
Satellite
Wireless
UCSD is Prototyping
The UCSD OptIPuter Deployment
a Campus-Scale OptIPuter
0.320 Tbps
Backplane
Bandwidth
Juniper
T320
To CENIC
Dedicated Fibers
Between Sites Link
Linux Clusters
SDSC
SDSC
JSOE
Engineering
20X
SOM
6.4 Tbps
Backplane
Bandwidth
Medicine
Phys. Sci Keck
SDSC
Annex
SDSC Preuss
Annex
High School
CRCA
6th
College
Collocation
Node M
Earth
Sciences
SIO
Chiaro
Estara
½ Mile
Source: Phil Papadopoulos, SDSC;
Greg Hidley, Cal-(IT)2
NCMIR and
BIRN CC
The 30-Year Old TCP/IP Model
of Sharing the Internet Has Its Penalties
Similar Results
for BIRN
Shared Internet2
Speed Limit
~50 Mbps
On a 10,000 Mbps
Backbone!
(½ of 1% Efficiency)
14
The OptIPuter Will Become a
National-Scale Collaboratory in 2004
“National Lambda Rail” Partnership
NEPTUNE Serves Very High-End Experimental and Research Applications
4 x 10Gb Wavelengths Initially
Capable of 40 x 10Gb wavelengths at Buildout
Chicago
OptIPuter
NASA
Ames
StarLight
NU, UIC
In
Discussion
USC, UCI
UCSD, SDSU
SoCal
OptIPuter
Paves the Way
for “BIRN II”
Source: Tom West, CEO, NLR
NASA
Goddard
OptIPuter Infrastructure Is International:
Global Lambda Integrated Facility: GLIF
10 Gbit/s
New York
MANLAN
Stockholm
NorthernLight
IEEAF
10 Gbit/s
2.5 Gbit/s
10 Gbit/s
2.5 Gbit/s
10 Gbit/s
CA*net4
Tokyo
WIDE
10
Gbit/s
IEEAF
10 Gbit/s
Chicago
StarLight
SURFnet
10 Gbit/s
Amsterdam
NetherLight
NSF
10 Gbit/s
10 Gbit/s
DWDM
SURFnet
Dwingeloo
ASTRON/JIVE
10
Gbit/s
2.5 Gbit/s
SURFnet
10 Gbit/s
Tokyo
APAN
10 Gbit/s
London
UKLight
Source: Kees Neggers,
SURFnet
2.5 Gbit/s
Geneva
CERN
Prague
CzechLight