Transcript Going from Node to Flow

Going from Node to Flow
Presented by
Guy Outred
Introducing…
Sponsored by Mentoring
States and ECOS
Based on input from
States of varying
geography, technology
and Network maturity
Introducing…
The intended audience for this
document includes:
 Partners who are yet to
implement a Node
 Partners who have
implemented a Node, but
are interested in alternative
approaches
 Partners looking to advance
their Node implementation
Got Node?
Need
Exchanges?
Definition
‘Exchange’: the sharing of a specific type
of data between two or more Partners;
for example, sharing of water quality
data. This is often also referred to as a
‘flow’.
Example exchanges
Partner
Internet
Reporter
NODE
Internet
NODE
NODE
Internet
State
System
NODE
Partner
Example exchanges
Hazardous
Waste
Reporter
Internet
NODE
Washington
TurboWaste
Example exchanges
Hazardous
Waste
Reporter
Internet
NODE
NODE
Internet
Washington
TurboWaste
CDX
EPA’s
RCRAInfo
Example exchanges
Oregon DEQ
Inter-state
waste
shipments
Hazardous
Waste
Reporter
Internet
NODE
Internet
NODE
NODE
Internet
Washington
TurboWaste
CDX
EPA’s
RCRAInfo
Behind the Scenes
Requestor (EPA)
Provider (STATE)
Data Request
•Authenticate
Node Management
CDX
NODE
AGENCY
NODE
•Perform Query
•Request received
•Account/Service Authorized
•Request logged
Data Transformation
Query
Processor
Program
Database
•Relational data retrieved
•XML transformation
•Schema validation
Node Management
Data Received
•Response logged
CDX
NODE
Data Processed
•Data loaded
•Request results logged
•XML payload returned
•Payload staged
•Payload validated
AGENCY
NODE
Program
Database
Planning your Exchanges
Factors affecting exchange
selection
• Priorities for data sharing with Partners
• The data management authority
• The exchanges that are currently supported
• The status of agency information systems
F/S
Identific’n
XML
Haz. Waste Gen and Mgmt
XML
Toxics Release Inventory
XML
Chemical Inventories
XML
NPDES Permitting (IDEF)
XML
Grants Administration
XML
Permitting, Compliance
XML
Haz. Waste Activities
AQ SIS
?
`
blue sky
AGBAR
C&G
XML
Payable
Agency
x
y
z
x
y
z
Business
HWTRIn
fo
EPCRA
XML
TIER II
x
y
x
y
Node
TurboWaste
Facility Identfication
XML
Air Ambient Monitoring
XML
Air Quality Permitting
WPLCS
XML
Air Emission Inventory
XML
Discharge Monitoring
EIM
XML
Water Quality
XML
Beaches Monitoring
XML
Beaches Notification
XML
Drinking Water Reporting
DOH DB
DOH DB
x
y
z
x
y
z
EPA
Implementing an Exchange
Design
Network Exchange
Develop
Exchange Services
Test Exchange
Deploy Network Exchange
Develop TPA
Implementing an Exchange
Design
Network Exchange
Develop
Exchange Services
Test Exchange
 Compile Reference Materials
 Determine Data Services to be supported
Deploy Network Exchange
 Map agency databases and identify
potential issues
 Resolve Issues with Trading Partner(s)
 Prepare team
Develop TPA
 Compile Reference Materials
 Compile Reference Materials
Reference Materials
• Documents
–
–
–
–
–
Flow Configuration Document (incl. schema user guide)
Step by Step Guide
Data Exchange Template
Example XML Instance document
Template Trading Partner Agreement
• Technical Files
– XML Schema
– Data Services XML File
 Compile Reference Materials
The Alternative
• For a new exchange one must develop:
– Flow Configuration Document
• Identify data services
• Explain processing required
– XML Schema
• Use XML Design guidance documentation
• Reconcile with Core Reference Model II
• Official review
 Compile Reference Materials
Implementing an Exchange
Design
Network Exchange
Develop
Exchange Services
Test Exchange
 Compile Reference Materials
 Determine Data Services to be supported
Deploy Network Exchange
 Map agency databases and identify
potential issues
 Resolve Issues with Trading Partner(s)
 Prepare team
Develop TPA
 Map agency databases and identify
potential issues
 Map agency databases and identify
potential issues
XML Schema
Source System
Data Element
Desciption
XML Tag
Requ'd
(Y/N)
InformationSystemA
N
cronymName
Data Table
Type
A(20)
Column
Name
Comments or Join
Information
Always 'FIS'
Environmental
Information
System Abbreviate
Name
The abbreviated name that
represents the name of an
information management system for
an environmental program.
Example Values :
TRIS
RCRAInfo
PCS
Environmental
Information
System
Identification
Number
The identification number, such as
InformationSystemI
the permit number, assigned by an
dentifier
information management system that
represents a facility site, waste site,
operable unit, or other feature
tracked by that Environmental
Information System.
N
A(30) authorization prog id / prog
s / program district
district
identifier
identifier
max(prog id) from
authorizations where auth
status code in ('2', '3', '4', '5',
'7', 'd')
Environmental
Interest Type
The environmental permit or
EnvironmentalIntere
regulatory program that applies to the stTypeText
facility site.
Example Values :
TRI Reporter
NPDES Major
Air Synthetic Minor
Air Minor
TSD
LQG
N
A(60) authorization prog district
type /
type desc
program
district type
for authorization: if article > ''
then auth type desc + ' under '
+ article + ' ' + title else auth
type desc
 Map agency databases and identify
potential issues
Implementing an Exchange
Design
Network Exchange
Develop
Exchange Services
Test Exchange
 Compile Reference Materials
 Determine data services to be supported
Deploy Network Exchange
 Map agency databases and identify
potential issues
 Resolve issues with trading Partner(s)
 Prepare team
Develop TPA
Implementing an Exchange
Design
Network Exchange
Develop
Exchange Services
Test Exchange
 Develop exchange services
Deploy Network Exchange
 Develop the data extraction process
 Modify source system(s)
Develop TPA
 Develop the data extraction process
 Develop the data extraction process
Fully Disconnected Model
Extraction & Transformation
(1)
Source
System
Database
Data
transformed
Query Processing
(n)
Staging
Database
Node
Incoming
Query
 Develop the data extraction process
Real-time Data Model
Extraction, Transformation & Query
Processing (n)
Source
System
Database
Data
transformed
Node
Incoming
Query
 Develop the data extraction process
Implementing an Exchange
Design
Network Exchange
Develop
Exchange Services
Test Exchange
 Develop exchange services
Deploy Network Exchange
 Develop the data extraction process
 Modify source system(s)
Develop TPA
Implementing an Exchange
Design
Network Exchange
Develop
Exchange Services
Test Exchange
 Prepare an e.g. XML document first
 Stress test exchanges early if:
Deploy Network Exchange
 High volume, or
 Large payload
 Test with more than one partner if
possible
Develop TPA
Implementing an Exchange
Design
Network Exchange
Develop
Exchange Services
Test Exchange
Deploy Network Exchange
NODE
Develop TPA
Implementing an Exchange
Design
Network Exchange
Develop
Exchange Services
Test Exchange
Deploy Network Exchange
NODE
Develop TPA
Implementing an Exchange
Design
Network Exchange
Develop
Exchange Services
 Trading Partner Agreement
Test Exchange
Deploy Network Exchange
 Unilateral
 Between partners
 Use example if available
 Use TPA Guidelines
Develop TPA
Exchange Reuse?
• Exchange =
– Data transformation +
– XML formulation +
– Data services
• Some commonality across Partners
• Some recycling is occurring
Network Expansion
9
16
14
7
12
10
5
8
6
3
4
2
1
0
1
11
21
31
41
Number of partners
51
61
Number if exchanges
Potential exchange volume
(thousands)
18
Questions…