Transcript Verify model

Scientific Collaboration Cyberspace
for China State Key Labs
TieJian Luo Ph.D
[email protected]
Graduate University of Chinese Academy of Sciences
Agenda
•
Research Models
•
Challenges & Collaboration Services
•
Scientific research Projects
•
Lessons from the SCC development
2
New Science Paradigms
•
Thousand years ago:
Experimental Science
- description of natural phenomena
•
Last few hundred years:
Theoretical Science
- Newton’s Laws, Maxwell’s Equations …
•
Last few decades:
Computational Science
2
 . 
4G
c2
a
 a   3   a 2
 
- simulation of complex phenomena
•
Today:
e-Science or Data-centric Science
- unify theory, experiment, and simulation
- using data exploration and data mining
– Data captured by instruments
– Data generated by simulations
– Processed by software
– Scientist analyzes databases/files
(Credit to Jim Gray)
3
The Problem for the e-Scientist
Experiments &
Instruments
Other Archives
Literature
questions
facts
facts
?
answers
Simulations
•
•
•
•
•
•
•
Data ingest
Managing a petabyte
•
Common schema
How to organize it?
•
How to reorganize it?
How to coexist & cooperate with others?
Data Query and Visualization
tools
Support/training
Performance
– Execute queries in a minute
– Batch (big) query scheduling
4
Basic Research Paradigm
data
Verify model
（1）problem model
Deduce natural law
extract
（2）experiment,simulation
data collection
information
（1）identify problem domain
result
（2）experiment, data collection
（3）get computing resource
（3）get computing resource
modelmodel
（4）computing, verify
（4）analyze data , deduce law
Data mining
deduce
idea
Scientific
computing
5
Scenario
2
4
Site C：Raw data
Site D：Storage
7
8
6
3
5
Site E：Computer
（simulation, data
mining）
1
Site F: Sechedule
9
10
Site A user
Site B user
6
Collaboration Interactive Model
Collaboration Interactive Model and its Service
• People to People
– Communication
– Groupware Service
• Access to Facilities
– Interaction with the
Physical World
– Access to Instrument
online
– Access to Applications
• Access to Information
– Digital Libraries, E-Pub
– Search Service
7
What is a scientific Collaboration ?
• Definition
• Two or more people work together to create or achieve the same
thing.
• Key points
•
•
•
•
•
•
•
Different or same discipline scientists
Form a Virtual Team
Need a agreement
Have a common research theme
Divide task into several works
Discuss problems, use instruments and share information
Goal: create new knowledge
8
Collaboration Technologies
• Access to
• People
• Instruments
• Stored information
• Synchronous vs asynchronous
•
•
•
•
Chat, video conferencing, audio streaming
Shared objects of conversation (like data)
Threaded discussions
Electronic notebooks
• Transitions between them
• They are limited to address users’ problems!
9
Primary services for SCC
• Virtual Team
• Access Instrument
• Sharing Data / Expertise
• Activity Management
• Online Discuss
10
Overview of China State Key Labs
SKL disciplines coverage
Total number is 162
-----------------------------------------
Disciplines
Number
---------------------------------Chemistry
22
Math and Physics 15
Geognosy
18
Biology
38
Information
26
Material
18
Engineering
25
----------------------------------


Target users more than 100k
Potential connected large instruments more than 6k
11
Physical Resources and Virtual Team
SKL B
SKL A
Know
how
Know
how
device
people
Info
Virtual
team C
data
people
info
Virtual
team B
SKL D
device
Know
how
people
Info
data
Virtual
team A
SKL C
Know
how
device
device
people
data
Info
data
12
Strategy to Create the SCC
• State of the art ---Some efforts of science communities
•
•
•
•
•
UK：e-Science
EuroGrid
USA: Cyberinfrastructure---Globus Toolkits
Japan：ITBL（IT Based Laborarory）
China Grid initiative
• IT and commercial product
•
•
•
•
Netmeeting Polycom WebEx
Middleware: Workplace、 SharePoint、WebLogic
Platform: .NET，J2EE
Forum and whiteboard , etc.
• Strategy: Choose the mature and simpler technology to
address users’ problem.
13
Domain
Scientific Collaboration
Cyberspace
Management
Bio
Che
Joint
Phy
Mat
Resources
Sites
Services
Know How
Team
Geo
……
Auth
Expert
Metrics
Task
Project
Instrument Acc
Network
Math
Collaboration ‘game rules’
Pub/Search
Services
Eng
Semantic Data
LDAP
ACL
Network com
SSL
……
Network Infrastructure
Data Resource
Instruments
Physical
Computing
Instrument
Archie
Data
Multimedia
Raw data
14
Virtual Team management
SCC Portal
Project1
Project2
Set up Project
Set up Project
Form a team
Form a team
Collaboration actions
Collaboration actions
……
Attributes
name
goal
domain
PI info
Resource
planning
……
Project n
Set up Project
Form a team
Collaboration actions
Optimize team
Optimize team
Optimize team
Task assignment
Task assignment
Task assignment
Know how
Know how
Know how
Information share
Information share
Information share
Instrument using
Instrument using
Instrument using
Online discuss
Online discuss
Online discuss
Support management
Support management
Support management
……
15
Virtual team
Registration
Apply create project
space
verify PH
Apply form a team
Verify member
Assign task
Set up permit
Manage task
[no pass]
[pass]
set up PH permit
[pass]
Team set up
Got space
system
user
PI: Primary
Investigator
PH
Project Head
16
Support Roles
• SSC
• Project
•
•
•
•
•
•
PI
Team member
Team leader（adm）：
Web Site adm（adm）：
Web site designer
…
• visitors
• experts
• Roles：
•
Visitors, members、discuss participant 、web design、adm、content adm
17
Virtual Team management
• Problems
• Compromise the free and restrict jointing
• Contradiction on distribution and centre control
• Trust
• solutions
• AAA technology (Authentication Authorization
Accounting)
• Online registration
• Trust metrics
• Portal
18
Access to instruments
system
Logon SSC
registration
apply
user
[no pass]
verify
[pass]
Instrument owner
success
[pass]
Assign adm
using
Project Head
Schedule
Instrument adm
Accounting log
Instrument user
19
Access to Instruments
• Problems
• Instrument description, registration, publishing,
finding and using
• Accounting and Fee
• Solutions
• Web Service
• LDAP and light weigh instrument access protocol
20
Data sharing
Logon SKLCRE
Data registration
[link]
find
[pull]
Up load data
system
[push]
DownLoad data
UpLoad data
Using data
Capture result
publish
user
Data owner
Accounting log
Data user
21
Data Sharing
• Problems
• Large scale scientific data two-way transfer
• Accounting and Fee
• solutions
• DBMS support data publish on Internet
• Fast FTP automatic re-transfer
22
Online Discuss
Logon SKLCRE
Set up conf.
Invite conf.
Enter conf.
reservation
Text message
Connect to
monitor
reply
Conf mem
Conf bro
Audio/vedio
Conf mem
Pub conf notice
collabortion
participating
End of conf
Exit conf
Record process
system
user
Conf. host
participant
member
Exp. participant
23
Online Discuss
• Problems
• Multi-group’s participants joint the meeting at
same time
• Co-laboratory environment
• solutions
•
•
•
•
Software based video and audio tech.
Light weigh desktop sharing tech.
Wiki
Forum
24
Activity management
Logon SSC
achivement
tasks
progress
user
activity
Personal achivement
PI
Project head
Device usage
Pub info
Data usage
member
Instrument adm
Personal time
Personal usage
Data onwer
25
Activity management
• Problems
• Global monitor the whole process
• Contents index and statistic
• Individual performance assessment
• solutions
• Access control and monitor
• DBMS and Data mining
• Rating model
26
SSC Applications
• Project1：Soil Carbon recycle mechanism database (CNSF,973,863-- grant)
• 100+research units
• Distribute data across mainland of China
• More than 1K scientists
• Project2：FACE（Free Air CO2 Enrichment ）(CNSF,973--grant)
• Experiment site and office at different place
• Raw data, model software share
• Many Sub tasks
• Project3： China neutron experiment center (973,863,MoST -- grant)
• Protect the staff from radiation
• Monitor the experiment process
• Inter-discipline field
• Project4： Collaboration for Bio-Safety Level 3( MoST – grant)
• 6+ institutes
• Monitor the experiment process
• Inter-discipline field
• Project5：Collaboration for large scale instruments center (MoST – grant)
• 10+ large scientific instruments
• Data and expertise sharing
• Remote control instruments
27
SCC Network Architecture
SKL 1
SKL 162
10M backup
10M
Internet
MOST
CSTNet
ChinaNet
科技部网络
CERNet
100M
1G
2.5 G
10 G
IPv6
GUCAS/ZGC--Server Farm
GUCAS/YQL---Distance Backup
28
Web Architecture

Benefits
Adaptable
More
than 10
different science
subjects templates
Scalability
 Dynamic
growing VT does
not affect platform
performance
Extensibility
Easy plug in the
a new service to
the platform
29
SSC for China Key Labs
30
Requirement of FACE project
• FACE（Free Air CO2 Enrichment）
• Find out the mechanism for the rice growing
when the CO2 climate change
• 15 Collaboration org.
• 9 national orgs（3SKLs），7 international ,
100+ research staff.
• Invest 100m RMB, only one in China
• 30 mini projects
31
Contribution to the FACE science research
• Monitor the farm site by video
• Automatic upload the raw data
• Real time display control pane by Browser
32
FACE Project deployment
33
FACE Project
• Old
• Only one function
• Info pub
• New
• 5 collaborations use case
• Run more than one year
• English version is ongoing
34
Remote monitor in Browser
Neutron emission facility
35
Neutron diffraction remote control interface in Browse
Data analysis software
36
Deployment of neutron diffraction
remote access
·ÅÖÃ
ʵÑéÑùÆ·
Set sample
Ô¶³Ì ¼à¿Ø·þ Îñ Æ÷
M onitor Server
Êý¾Ý
²É¼¯
Benefit
1 staff are isolated from experiment site
2 remote real time monitor the process
3 scientists online discuss
Êý¾Ý²É¼¯
ÖÐ×ÓÊø
Beam of neutron
Êý¾Ý²É¼¯
ºË ·´ Ó¦¶Ñ
nuclear reactor
Êý¾Ý
²É¼¯
ʵÑéÊÒLab
ʵÑéÔËÐмà¿Ø»ú
computer for monitor experiment status
ÑùÆ·Ð ýת ÒÇ
sample circumgyrate device
ʵÑé¹ý ³Ì ¼à¿Ø»ú
computer for monitor experiment process
Æ×
ÒÇ
pedigree device
ÉãÏñ Í·
camera
Internet
ʵÑé¼à¿Ø´ú Àí»ú
monitor proxy
.......
¼à¿ØʵÑéÔËÐÐ
monitor experiment status
¼à¿ØʵÑé¹ý ³Ì
monitor experiment process
37 ÔËÐÐ
¼à¿ØʵÑé
monitor experiment status
Collaboration for Bio-Safety Level 3
38
Collaboration for Bio-Safety Level 3
39
Collaboration for large instruments center
40
Collaboration for large instruments center
41
BSL3 Lab of FUDAN University
42
BSL3 setting
实验室
Mini
Camera
C
C
C
控制及演播室
带云台的
摄像头
摄像机
麦克
风
操控服务器
视频服务器
监控视频服务器
控制输入
2M带宽
到互联网
生物安全柜
交换机
倒置显微镜
防火墙
43
办公区
Portal model

user
Benefits:
Trust access path
Single sign-on
Delegate permits and Proxy
Interoperate
SSC Portal
Org.A
Org.B
Org.F
Org.C
Org.D
Org.E
44
Expertise Share Model
Ensure a fair collaboration game !
Legend
Participant
Management
Agency
3
Members
Affiliate org
Labs
(1,m)
(1,n)
Agreement
E-community
Instrument
2
1
Buy rule
2
1
Data storage
Platform
2
2
Collaboration
Cyberspace
｛活动描述｝
Behavior
｛规则名称｝
Constraints
Info flow
Capital flow
Outside labs
(1,q)
(1,p)
Extra members
Data Flow
Communicate
1.contribution 2.get Knowledge
3.oversee
Management
45
Video and audio interactive component
Benefits
1. Multi node access
2. Plug in SSC
3. Security and efficiency
46
Lessons Learned
• How to address the user’s application simpler?
• System development is less and less about coding than
about using things and gluing them together.
• Create a flexible enough architecture to allow for
changes.
• Customers will not be able to elucidate at the start what
they want; only by using the system will they be able to
tell you what you should have done. (Semantic gaps)
• SSC 1.0 rely on MS SharePoint ; SSC 2.0 open source
• Individual performance assessment model and fair
agreements (win-win business model).
• Future concerns should be e-community trust metrics.
47
Acknowledge
• Dec.2005--Dec.2007, China Bio-Safe Level 3 Labs
Collaborative Cyberspace, Grant from MOST of China
• Dec.2005--Dec.2007, China Large Scientific
Instruments Collaborative Cyberspace, Grant from
MOST of China
• Jul.2005--Jul.2008, EU-Asia Link Programme HPC-Grid
Computing Course Model, Grant from EU
48
• URL:
•
•
•
•
http://crewiki.gucas.ac.cn/
http://cec.gucas.cn/
http://cbl.gucas.cn/
http://co-lab.chinalab.gov.cn/
• Questions?
• Comments?
49