Transcript A test of your knowledge of decision analysis

VistA
Needs
Vendor
Role of
Assessment Selection Information
ROI
100
100
100
100
100
200
200
200
200
200
300
300
300
300
300
400
400
400
400
400
500
500
500
500
500
VistA for 100 Points
VistA stands for?
Veterans Health Information System
and Technology Architecture
VistA for 200
When did work on VistA began?
Work on the laboratory system
began in 1968
Personal Health Records for 300
Auto-population
What is the name for the automatic
insertion of reusable content into personal
health records?
EHR Use for 400
EHR Use for 500
Needs Assessment for 100
1.
2.
3.
4.
Which of the following should be followed in assessing
information needs for strategic decisions?
Focus on future decisions
Involve more than the decision maker
Check importance of information within specific
decisions
Numerically rate relative importance of information
items
All of these principles should be
followed
Needs Assessment for 200
What is the relationship between essential
information, rapid data collection and
periodic data collection. Describe this
relationship in terms of range and average of
ratings?
Needs Assessment for 300
Use Case
What term is used to describe the
behavior of an information system
under a particular scenario?
Needs Assessment for 400
How is an EHR for pediatric department
different from EHR for other purposes?
What are 5 unique needs of a pediatric
clinic?
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
Growth data.
Multiple patient identifier.
Special terminology and information
Age-based normal ranges
Time of birth
Prescribing of medications
Immunizations
Alerts for contraindications
Parents' special documentation requirements
Reporting
Derived from consensus of Pediatric Association’s Committee
Needs Assessment for 500
Which information is essential and
which needs rapid data collection?
Decisions
Information items
Well visit
Cold
diabetes
Demographics
2
4
1
Patient symptoms
2
7
7
Patient risks
7
1
7
History
3
4
5
Insurance
6
5
4
Decisions
Well
visit
Cold
diabetes
Range
Average
Demographics
2
4
1
3
2.33
Patient symptoms
2
7
7
5
5.33
Yes
Patient risks
7
1
7
6
5.00
Yes
History
3
4
5
2
4.00
Insurance
6
5
4
2
5.00
Median
3
5
Information items
Essential
Yes
Rapid
collection
Vendor Selection for 100
Why meet before the meeting?
To postpone evaluation of ideas of
group members
Vendor Selection for 200
In Eden's 2002 survey of practices, what
attributes were identified as important when
selecting a vendor
1. The software appeared easy to use
2. Software appeared to improve one or more of the business processes
3. The software provided the most value for cost
4. The software would help long term business strategy
5. The vendor was responsive to practice information needs
6. There were strong testimonies from prior users
7. The software was already in use by other sites affiliated with this practice
8. Software was compatible with existing systems in the practice
Vendor Selection for 300
In the attribute “Ease of use” three levels were identified:
Less than 2 minutes, 2-4 minutes and more than 4 minutes
to enter a standard case. These levels were rated as 60, 90
and 100. Put these scores in standardized format ranging
from 0 to 100.
• Less than 2 minutes, 0
• 2-4 minutes, 100*(90-60)/(100-60)=75
• More than 4 minutes, 100
Vendor Selection for 400
The decision maker believes that impact on
business processes is 5 times more important than
compatibility with existing systems and
compatibility with existing systems is 3 times
more important than cost, what are the relative
weights of the three attributes for evaluating
vendors
Business process improvement
Weights as
multiples of
least
important
attribute
150
Compatibility with existing systems
Cost
30
10
Sum
190
Relative
Weights
0.79
0.16
0.05
1
Vendor Selection for 500
What are three ways of assessing
performance of a vendor?
Rating Performance
1. Expert ratings: Current users of the system or people
familiar with the systems are asked to rate all of the
vendors on each of the attribute levels.
2. Standard cases and objective measures: Vendors are
provided standardized cases and asked to use their
information systems to enter the relevant data.
3. Subjective ratings of the vendor selection committee:
Vendors are invited to demonstrate their systems.
Members of the vendor selection committee use the system
and watch the operations of the system and rate the
performance of the vendors on each attribute/criteria.
Role of Information for 100
Known beyond random chance
predictions
What was Shannon’s
definition of information?
Role of Information for 200
What are five ways in which people distort
information?
1. Plunging in before full examination
2. Solving wrong problems
3. Narrow view
4. Overconfidence
5. Shortsighted shortcuts
6. Shooting from the hip
7. Equating popularity with accuracy
8. Fooling yourself
9. Not keeping track
10.Not checking
Role of Information
for 600
Daily
Double
Reduction of number of viable
alternatives
What is the definition of
information? How do we know if a
person is informed?
Role of Information for 400
What are five steps that data go through before it becomes
information?
Steps in Processing Data
1.
2.
3.
4.
5.
6.
acquisition of data
classification of data
storage of data
retrieval of data
editing of data
quality control of
process that produced
the data;
7. aggregation of data
8. hypothesis generation
9. description of data
10. test of analysis
assumptions
11. Analysis
12. extrapolation of
implications of findings
13. presentation of data
14. distribution of reports
15. evaluation of
effectiveness of reports
Role of Information for 500
What happened to the cost of information
processing in different decades?
Costs went down
•
•
•
•
•
•
Processing costs in 1950s
Storage costs in 1960s
Transmission costs in 1970s.
Input/output costs, 1980s
Internet marketing costs, 1990s
Broadband costs, 2000s
ROI for 100
What are traditional areas were EHRs are
assumed to reduce costs?
Materials (paper, etc.), Personnel
Time, Transcription and Space
ROI for 200
What advantages the proposed method of
calculating business value of IT has over
the traditional method?
A. Analysis is based on objective data
B. Costs and benefits included are
comprehensive
–
–
Does not underestimate which business
processes might be affected by new IT
investments.
Does not overestimate the potential future
benefits.
C. Examines causal relation between
investment and returns.
ROI for 300
After implementing EHR in a practice,
what area is the biggest contributor to
cost increase or cost savings?
Many assume that reductions in
paper and personnel is the most
likely impact. In reality, changes in
care processes and productivity are
the largest likely impact on cost.
ROI for 400
IT cost
Revenues
Start
$100,000
End of Year
1
2
3
$5,000
$5,000
$5,000
$10,000 $80,000 $100,000
ROI for 500
Can we claim that IT investment (cost) has led
to increased revenue? Why?
Revenue
EHR Investment
EHR Use
Revenues
1
EHR
investment
0.89
1
0.98
0.8
EHR use
1
No
The partial correlation of
“Invest/Cost→ Use→ Revenue”
is supported less than
“Revenue→ Invest/Cost →Use “