Transcript Larry Snow Class 11

Information In our Lives
and In the Universe
Snow College
November 13, 2015
Dr. Douglas Hansen
Data Preservation – Why?
• Why Would You Want to Preserve Data?
– Personal Information for Posterity
– Critical Data for Future Generations
• Census Data
• Financial Data
• Critical Research Results
– What do you think?
Data Preservation – What?
• What Would You Want For Decades or Longer?
–
–
–
–
–
–
Financial Records?
Genealogical Records?
Personal Images and Video?
Governmental Data (Census, etc)?
Business Records?
Research Results?
• What Do You Think?
Have you suffered from data loss?
•
31% of all PC users suffer from data loss
each year (Gartner)
•
Every week 140,000 hard drives crash in
the USA (Mozy Online Backup)
•
52% of companies reported data loss in
the past 12 months (TotalCIO)
• 93% of companies that lost their data center for 10 days or more due to a
disaster, filed for bankruptcy within one year of the disaster.
(National Archives & Records Administration in Washington)
• 94% of companies suffering from a catastrophic data loss do not survive –
43% never reopen and 51% close within two years. (University of Texas)
• 77% of those companies who do test their tape backups found back-up failures.
(Boston Computing Network, Data Loss Statistics)
• 7 out of 10 small firms that experience a major data loss go out of business within a
year. (DTI/Price Waterhouse Coopers)
The Data Storage Implosion
All users of Digital Technology (all of us) have a problem!
Data Explosion
1; 1; $
! "#"$=&+"#+6$+"=) $/+"&$$
$$$$$$$$"#$A; C $:, =&+"0+$
<?<K<?<$J $LG$@+##"5/#+0$
Data created
each year at
40%
increase
1; 3G$
1?2- 1?2$J $<?G$@+##"5/#+0$
1; ; >$
3- 3$J $2; ; $4- "5/#+0$
Source: http://storageconference.org/2013/Presentations.html
Matt Starr Spectra Logic
Hard Drives
Main Categories of Hard Drive Failure
• Physical
• Electronic
• Logical
Mechanical breakdown takes place first, on average in roughly three years.
(MicroCom)
BackBlaze Database shows hard drive failure will occur. (www.backblaze.com/blog/best-hard-drive/)
Magnetic Tape
Library of Congress
Prediction:
The Death of the LTO Tape by 2019
Carl%Watts
Information%Technology%Specialist%
Enterprise%System%
Engineering
Some of the opinions expressed during this presentation are my own and
do not necessarily represent those of the Library of Congress
This presentation was given at the Library of Congress Designing Storage Architectures Conference
in September 2014.
The title is a little dramatic, but the future of LTO tape is far from secure.
Flash Drives
The Flash Drive Failure Epidemic Is Here:
Industry Expert Offers Advice
“...widespread misuse and a nearly
universal failure to back them up has led
to thousands of people losing their
important files every month.”
Failed Flash Drive Components
capacitor
•
•
•
•
resistor
Susceptible to physical damage
Susceptible to virus
Higher capacity increases failure rate
Lower cost results in lower quality
Micro-controller
oscillator
The Cloud – Is It Safe
Is It Secure?
• What if the Cloud Company Fails?
• Can you trust any company for 50 years or more?
• Do you want to pay every year to keep your data
alive?
• Do you want to lose your data because the bill
got lost?
• Hacking?
• Legal Action - getting access to your data?
The message was engraved in rock!
Data Preservation – How?
• What are the issues?
–
–
–
–
How do I get access in the future?
Is the format going to be readable?
Is the data even going to be there?
While the hardware needed to read it be available?
• Can I afford the costs of keeping the data viable?
• What approach makes sense to you?
Choose the right technology for
mid to long term data storage
Time
Short term
Mid term
Long term
Flash
Cloud
Hard Disk
What should go here?
What is Happening In This Area?
• Hard Drives Have Advanced for 40 years
– Nothing I know of that will solve the Longevity Issue, but
drives will probably be good for about 10 years for the
foreseeable future
• Solid State Memory
– Flash Memory is going to be replaced by new technology
– Some of these options look like they could be good for 20+
years
• Optical Disc
– Good Blu-ray recordable discs are probably good for 30 – 50
years
– How do I know what is good?
What is Happening In This Area?
• Issues and Problems
– 100 years or more:
• Hardware, format, software, etc.
– Is it cost effective to move data to new formats, hardware,
etc?
• Do we need to change our basic data paradigm?
– In 1990, Computers were obsolete every 3 years.
– In 2015, Computers are good for 7 – 10 years.
– What will the situation be in 2020 or 2025?
• Will the changes in data formats, hardware,
software, etc, be as rapid in the future as it has
been in the past?