D.I.R.T. Training
Download
Report
Transcript D.I.R.T. Training
D.I.R.T. Training, Module 2
Universal Front-End Loader
(UFEL)
Houston, TX, 3/31-4/1/05
DIRT Development Team
Training Goals
Understand when/where to use
UFEL
Installation and Running
Data Source Configuration
Mapping source to DIRT format
Data Generation and Validation
Upload and management in Web
tool
2
Introduction - What does it do?
Diverse Data Sources
– CSV, etc. from spreadsheets/db’s
– Databases: Oracle/SQL Server
Data Mapping
– Constant and cross-reference values
Automatic Updates
– New columns, pick-list values,
validation rules auto-updated
3
When to use Web or UFEL?
Web:
– registration
– small org. damage reporting
– ADL for bulk data already in DIRT
format
UFEL:
– Existing/historical data sets
– Orgs with existing damage report
infrastructure
4
Startup
Install Java: http://java.com/
Start from UFEL page, linked from
damagereporting.org site
Choose Data Directory
Login & Proxy Configuration
5
Data Source Configuration
CSV: choose file, delims, 1st
row settings
Database: enter URL,
username, password
Connect
Test
Disconnect to change source
6
Data Source - Lab Exercise A.
Visit http://sandbox.damagereporting.org/train/
Download your user’s *.tsv file
In UFEL, Open File…, pick delimiter
as *Comma*, set 1st line is *Start
of Data*.
Click Connect, then Test. Note data
errors. Click Disconnect.
Fix errors, click Connect, then Test
Note data appears to be clean
7
Mapping
Basic Concepts
Suggested Process
– Excel: open data set for viewing
– Browser: open File Upload Spec
Mapping Types
–
–
–
–
Null/Empty
Constant Value - freeform or choose
Source Column - for 1:1 agreement
Pick List - for values that differ
between source and DIRT spec
8
Mapping - Lab Exercise B.
Click Mapping button in UFEL, after
lab exercise A.
Look for pink-highlights, correct by
choosing & configuring mapping
– Refer to File Upload Spec web page
Review all Null/Empty mappings
Review all Pick List Mapping values
– Use Spreadsheet for distinct data
values
– Use “*” for wildcard match
– Use vertical bar (|) for alternates
9
Generate & Validate
Reviewing validation errors
Correcting errors in Mapping
Re-running Generate &
Validate
10
Upload Data
Upload button
Login to Web site
– Browse File Uploads
– Browse Damage Reports
11
Troubleshooting
Proxy Servers
– Different types of proxy servers
– Demonstration of checking
Firefox settings
Log File:
– Under Data Directory
– “dirtfe.log”
– May need to zip before emailing
12
Wrap-Up
Questions?
13