Transcript May 2013 - VIEWS - Visibility Information Exchange Web System

3SAQS Technical Committee Workshop
Status of Technical Work
October 2012- May 2013
May 29, 2013
Shawn McClure (CIRA)
Zac Adelman (UNC-IE)
3SAQS
3SAQS and 3SDW Activities
CO, UT, WY
state
meetings
3SDW
January
Develop
design
document
and use
case
scenario
Emissions
data
collection
February
Emissions
data
processing
and prep
March
2008 3SAQS
Base 2008
version A
SMOKE
modeling
Merging
WestJump
Base08a
and 3SAQS
Base08a
emissions
3SAQS
SMOKE and
CAMx
Base08a
April
May
June
Use case
testing and
feedback
Populate
warehouse
with 3SAQS
data
Warehouse prototype and Data
tool development
warehouse
use case
and testing
Three State Air Quality Study
2
3SAQS and 3SDW Activities
October 2012 – June 2013
• Project administration and operations
– 1st use case design document
– Operational and modeling protocol outlines
• Emissions and air quality modeling
– Find and implement improvements to ancillary data in 2008 WJAQS to
create specific 2008 3SAQS products
– Develop and prepare 3SAQS base case 2008 emissions version A
(Base08a)
• 3SDW Website and database
– Metadata schema definition and Python generator
– WestJump inventory database and web-enabled query tool
– Website and database design, development, and launch
Three State Air Quality Study
3
3SAQS and 3SDW Activities
October 2012 – June 2013
• First use case
– NPS and EPA participated in a beta test of the 3SDW registration and
data distribution functions
– Currently ongoing and nearing completion
– Feedback from this process will be used to improve/tweak the 3SDW
interface and operation
• Staffing and project team
– CIRA difficulties in hiring a developer
– UNC began to provide developer support to the project
– ENVIRON being brought on to the project team as a subcontractor on
the UNC cooperative agreement
Three State Air Quality Study
4
Review of the 3SDW Overall System Ecosystem and Architecture
Guidance, Requirements, Feedback, Funding
NPS
WGA
CIRA
Architecture, Design, Implementation, Management, and Operation
Monitored
Aerosol
Deposition
Raw Data
Gaseous
Modelers
AQS, VIEWS
Tools
Modeled
Emissions
Planners
Met
Air Quality
Documents
3SDW
WestJump,
future
modeling, etc
Results
Managers
Acquisition
Integration
Management
Distribution
Presentation
Identification, Acquisition, Pre- and Postprocessing, Extraction
Verification, Validation, QA/QC,
Mapping, Flagging, Tranformation
Storage, Backup, Restore, Security,
Summarizing, Statistics
Searching, Querying, Filtering,
Aggregating, Formatting, Packaging
Charting, Graphing,
Mapping, Analyzing
Summary of Past Quarter Activities
• Continued to refine the database, software, and website
infrastructure supporting the data warehouse
• Refined various pre-processing components
•
XML Generator for metadata
•
SQL scripts for importing modeled emissions data
• Extended portions of the data import system
•
SQL scripts for importing modeled emissions data
•
Integration layer for the Emissions Management Framework (EMF)
• Refined the logical and physical file system design
• Refined the data verification and validation system
• Refined the system for acquiring and managing emissions data
Summary of Past Quarter Activities (cont’d)
• Interviewed several applicants for the TSDW software
developer position
• Offered the position to the best candidate and received a
verbal acceptance
• Candidate reneged on their acceptance the week before
starting the appointment
• Designed an alternate plan for continuing the work plan with
minimal impacts via an increased involvement by UNC
• Populated the data warehouse with the full complement of
WestJump Base08b CAMx Input/Output data for June/July ‘08
• Refined the modeled emissions review tool
• Conducted the First Use Case Beta Test
Operational Website Components
• User Login Form
• User Registration/Modification Form
• User Profile/Account Form
• User Feedback Form
• Dataset Request Form
• Database Query Wizard
• Raw Data Download
• Interactive Charts
• Dynamic Contour Maps
• Site Metadata Reports
• Monitoring Site Metadata Browser
• File Explorer
Authentication and
Authorization System
Future Website Components
• Modeled Emissions Summary Tool
• Modeled-to-Observed Data Comparison Tool
• Air Quality Summary Reports
o Visibility
o Deposition
o Ozone
o Other
• Model Data Mapping Tool
• Source Apportionment Tool
• Various Unpublished Monitoring Data Tools
• Backend Web Services and Processing Components
User Login Form
User Registration/Modification Form
User Profile/Account Form
User Feedback Form
Dataset Request Form
Raw Data Download (Query Wizard)
Time Series Charts (Query Wizard)
Dynamic Contour Maps (Query Wizard)
Site Metadata Report (Query Wizard)
Monitoring Site Browser
21
Modeled Emissions Summary Tool
Modeled-to-Obs Comparison Tool
Air Quality Summary Reports
Model Data Mapping Tool
Future Online Visualization Tools
3SAQS Technical Committee Workshop
3SDW First Use Case Report and
Results
May 29, 2013
Shawn McClure (CIRA)
Zac Adelman (UNC-IE)
3SDW First Use Case
• Use Cases
-
Conceptualizations of how a software system will be used
Aid project managers and developers in compartmentalizing a
problem into workable components/deliverables
• 3SDW Use Case
– Launch of the 3SDW website and beta testing of the functionality
– Test the 3SDW in registering users, distributing data, and receiving
results back into the system
– Subset (2 months) of WestJump AQMS modeling data
– Participants: NPS (Mike Barna) and EPA (Gail Tonnessen)
• Feedback from the use case testing will be used to improve
the operational and technical components of the 3SDW
Three State Air Quality Study
28
First Use Case - Beta Test Steps
• Testers visited the TSDW website and registered with the system to create
an account
• Testers visited the Data Request web page and entered their requests for
the WestJump Base08b dataset
• Each request was stored in the database
• The system determined whether or not each request could be
automatically filled or had to be manually assembled
• The system sent emails to the appropriate TSDW team members to notify
them of the data requests
• TSDW team members assembled the dataset requests (copied the relevant
data files onto hard drives)
• The datasets (hard drives) were delivered to the beta testers
• The system updated the dataset requests to reflect their “filled” status
First Use Case - Beta Test Steps (cont’d)
• Using the delivered datasets, testers ran the models and
generated results
• Testers returned the model output results to the 3SDW
• The test results were assessed by TSDW team members
• Testing outcomes were summarized for the May 3SAQS
Technical Workshop
• The TSDW team refines the dataset ordering, download,
packaging, and delivery system according to lessons learned
• The TSDW team develops the next Use Case testing scenario(s)
WJAQMS
Emissions,
meteorology,
& AQM data
WestJumpAQMS
Metadata
3SAQS First Use Case
Database
AQM postprocessed
data
3SDW
Data
request
IC/BC
development
Model
analysis
3SDW Web Interface
USFS &
NPS
Modelers
Evaluation
graphics and
statistics
Post
processing
IC/BC data
3SAQS
Emissions &
meteorology
data
Air quality
modeling
Three State Air Quality Study
31
WJAQMS
Emissions,
meteorology,
& AQM data
WestJumpAQMS
Metadata
3SAQS First Use Case
Database
AQM postprocessed
data
3SDW
Data
request
IC/BC
development
Model
analysis
3SDW Web Interface
USFS &
NPS
Modelers
Evaluation
graphics and
statistics
Post
processing
IC/BC data
3SAQS
Emissions &
meteorology
data
Air quality
modeling
Three State Air Quality Study
32
3SAQS Technical Committee Workshop
Status of 3SAQS Base08a Emissions
Improvement and Modeling
Activities
May 29, 2013
Zac Adelman (UNC-IE)
WestJumpAQMS Emissions Data and
3SDW Improvement Priorities
Meteorology
Inventory Data
Temporal Allocation
Spatial Allocation
Chemical Speciation
AQM-Ready Emissions
Emissions processing schematic
Three State Air Quality Study
34
WestJumpAQMS Emissions Data and
3SDW Improvement Priorities
Meteorology
Inventory Data
Temporal Allocation
Spatial Allocation
Chemical Speciation
AQM-Ready Emissions
Initial 3SAQS work focused on improving the noninventory emissions data from WJAQMS
Three State Air Quality Study
35
Emissions Improvements Summary
• Made obvious improvements identified during screening
of WestJumpAQMS modeling
• Gathered all available data
– What data were available at the states/agencies that we can
use for emissions processing?
– Stack testing data for VOCs and PM speciation
– Shapefiles for oil and gas sources, agricultural sources,
industrial sources
– Temporal profiles and chemical speciation data
• Prioritized inventory sources and target potential
improvements
Three State Air Quality Study
36
High profile/high impact anthropogenic emissions
sources in CO, WY, UT 3-state counties
• NOx
–
–
–
–
–
Oil and gas sources (drill rigs, compressor engines, heaters)
On-road mobile
Rail (diesel class 1 locomotives)
Industrial and residential natural gas combustion
EGUs
• VOC
–
–
–
–
Oil and gas sources (venting, fugitives, and dehydrators)
On-road mobile
Recreational vehicles and pleasure craft
Chemical manufacturing
• NH3
– Agriculture (livestock)
Three State Air Quality Study
37
3SAQS Spatial Allocation Data Updates
• New Surrogates
– Replaced NLCD 2001 with NCLD 2006 landuse/landcover
surrogates
– Replaced 1999 FEMA building square footage surrogates with
2010 FEMA-HAZUSv2.1 building square footage surrogates
– Replaced TIGER line rail mileage surrogates with 2012 NTAD rail
density surrogate
– New ERTAC rail yard surrogate
– Updated CO livestock surrogates with swine CAFOs
– New WY livestock surrogate with CAFO point locations
– New VMT-weighted roadway surrogates for CO on-road sources
• Updated assignments/cross-referencing
– Changed allocation of ATV/ORV/snowmobiles from rural to forest
land
– Reassigned livestock sources from total ag to pasture land
– Reassigned fertilizer sources from total ag to crop land (except
animal waste spreading)
Three State Air Quality Study
38
3SAQS Temporal Allocation Data Updates
• Calculated 2008 temperature-dependent monthly
and daily profiles for residential wood combustion
(RWC) sources
• Updated diurnal profile for RWC sources
• Calculated 2008 temperature and wind speeddependent daily profiles for livestock NH3 sources
• Computed monthly profiles for residential natural gas
combustion
• Updated the diurnal profile assignments for off-road
recreational vehicles (to decrease overnight
emissions)
Three State Air Quality Study
39
3SAQS Other Emissions Data Updates
• Reassigned sources from the non-point inventory as
fugitive dust in order to apply transport fractions
• Converted the on-road mobile inventory data to a
format that works with standard SMOKE
• Corrections for double counting of some oil and gas
sources in the South San Juan and Permian basins
and Southern Ute tribal land
Three State Air Quality Study
40
CO Roadway Layers
2008 CDPHE VMT
2010 TIGER Line
•
•
•
Urban/Rural + Primary/Secondary
Weighting by urban/rural areas of a county
Includes only Interstates, arterials, and
collectors
•
•
•
VMT by road segment for highways and major
roads
Weighting by VMT
Includes an additional layer of major roads
(local)
Three State Air Quality Study
41
CO Roadway Layers
TIGER data don’t have
enough information to
represent that some
sections of the county have
higher traffic volume on the
primary roads
CDPHE VMT Shapefile distinguishes
areas with higher traffic flow. Without
the VMT weighting, the emissions will
be allocated uniformly across all cells
that intersect with roads.
More of the on-road emissions
should go here, than here.
VMT
• Current Approach/WestJump:
– Onroad inventory SCC codes distinguish between urban and rural sources, which
allows for spatial allocation to urban/rural roads
– Local road SCCs are using population as a spatial surrogate
Three State Air Quality Study
42
CO Roadway Layers
TIGER data don’t have
enough information to
represent that some
sections of the county have
higher traffic volume on the
primary roads
CDPHE VMT Shapefile distinguishes
areas with higher traffic flow. Without
the VMT weighting, the emissions will
be allocated uniformly across all cells
that intersect with roads.
More of the on-road emissions
should go here, than here.
VMT
• Update for 3SAQS:
– Ignore urban/rural distinction in the SCC code and instead weight the roadway
surrogates by VMT to take advantage of the better resolution in road segment
activity in the CDPHE data
– Allocate local roads using the major road Shapefile from CDPHE, weighted by VMT
Three State Air Quality Study
43
WY CAFO Shapefile
• DWQ permitting
database includes mostly
CAFOs and a few swine
operations
• Locations are provided in
the database but not
types of animals
Three State Air Quality Study
44
WY CAFO Shapefile
Several WY counties only
have a single CAFO in this
database
If these data are used for spatial allocation, need to
limit which SCCs in these counties will be allocated
to these single point locations
Three State Air Quality Study
45
Case Study: Fremont County, WY CAFO
GIS Shapefile
Tier3
SCC
2805001
2805002
2805003
2805007
2805008
2805009
2805010
2805018
2805019
2805021
2805022
2805023
2805030
2805035
2805039
2805040
2805045

Google Earth Imagery
Tier 3 SCC Description
NH3 (TPY)
Beef cattle - finishing operations on feedlots (drylots)
Beef cattle production composite
Beef cattle - finishing operations on pasture/range
Poultry production - layers with dry manure management systems
Poultry production - layers with wet manure management systems
Poultry production - broilers
Poultry production - turkeys
Dairy cattle composite
Dairy cattle - flush dairy
Dairy cattle - scrape dairy
Dairy cattle - deep pit dairy
Dairy cattle - drylot/pasture dairy
Poultry Waste Emissions
Horses and Ponies Waste Emissions
Swine production - operations with lagoons (unspecified animal age)
Sheep and Lambs Waste Emissions
Three State Air Quality Study
Goats Waste Emissions
13.72
221.76
360.36
0.98
0.20
0.07
0.10
0.15
0.11
0.65
0.05
0.15
0.46
172.92
0.96
79.46
9.21
Largest sources of the
Fremont County NEI08
NH3 inventory are cattle.
Other sources are
probably not associated
with the CAFO
46
WY CAFOs Summary
• Shapefile can be used to allocate livestock emissions to
modeling grids
– Two categories of CAFO identified in the Shapefile: “CAFO” and
“Swine”
– CAFO category will be used for cattle (except for finishing operations
on range/pasture SCCs)
– Swine category will be used for swine
• Underlying assumption in using these CAFO point data is that
they represent all locations of cattle and swine sources in a
county
• In the absence of CAFO information, we will use the pasture
land surrogate for other animal types (horses, poultry,
turkeys, etc)
Three State Air Quality Study
47
EIA Monthly Residential Energy Use Database
Three State Air Quality Study
48
3SAQS Technical Committee Workshop
Technical Work Plan
June – October, 2013
May 29, 2013
Shawn McClure
Zac Adelman (UNC-IE)
3SAQS June-October Workplan
• Base 2008 version A – complete SMOKE and CAMx modeling
– Base simulation and performance evaluation (June/July)
– Pilot cumulative impacts CAMx simulation with source apportionment
(August/September)
• Base 2011 version A
– Collect 2011 NEI data from CO, UT, WY and prepare for SMOKE
(June/July)
– Develop 2011 oil and gas inventories from existing data (JulySeptember)
– SMOKE and CAMx modeling (October-December)
• Inventory development and analysis
– Future year projection curves (October-November)
– Inventory reactivity analysis (July)
Three State Air Quality Study
50
3SDW June-October Workplan
• Implement the collaborative components of the
warehouse
• Implement the ongoing news and updates section
• 3SDW on-line for NEPA air quality analysis projects by end
of October
• Out-bound data delivery and in-bound data ingestion for
NEPA and other air quality studies
• Data warehouse operations (hosting, data analysis and
processing, maintenance, et cetera)
• Plans for storage/access/visualization for modeling results
and evaluation tools
• Store UT BLM ARMS and other studies’ data in 3SDW after
evaluation using protocols
3SDW
3SAQS
Upcoming 3SAQS and 3SDW Activities
3SAQS SMOKE
and CAMx
Base08a
CO, UT, WY
2011 inventory
data collection;
emissions
reactivity
analysis
Complete WRF
2011 modeling
and MPE; O3
network
technical
analysis
Year 2011
inventories for
base
simulation;
2008 pilot
cumulative
impacts run
3SAQS SMOKE
Base2011a;
develop future
projections
inventories off
2011
June
July
August
September
October
Implement
online analysis,
collaboration
components,
news and
updates
Development
and testing of
online large file
transfers
Populate
warehouse
with 3SAQS
data
Store UT BLM
ARMS and
other study
data
Three State Air Quality Study
Warehouse
online for
NEPA projects
52
Testing and Refinement Help
• All users, collaborators, and partners can help with testing
• Please report bugs – don’t endure them
• Use the website Feedback form
• Send direct email to team members
• Provide as much information as possible up-front
• Stay abreast of ongoing additions and updates
• Be an active part of the design process - make suggestions
for features and refinements
• Don’t assume it can’t be done
• Don’t assume it can be done
Thanks.