Transcript Taking the Library Back from Google

Taking the Library
Back from Google
Abe Lederman, President and CTO
Deep Web Technologies
May 12, 2010
© 2010 Deep Web Technologies, Inc.
The “Google Myth”
© 2010 Deep Web Technologies, Inc.
2
Why Do Students Like
Google and Google
Scholar?
• It’s fast
• It’s easy to use
• It’s relevant
• It’s FREE
© 2010 Deep Web Technologies, Inc.
3
Library vs. Internet
Students Looking for Information
“Nearly three-quarters (73%)
of college students say they
use the Internet more than
the library, while only 9% said
they use the library more than
the Internet for information
searching.” *Pew & Internet American
Life, 2002
© 2010 Deep Web Technologies, Inc.
4
© 2010 Deep Web Technologies, Inc.
5
© 2010 Deep Web Technologies, Inc.
6
What Students
Don’t Know
1. Links for many articles on Google
Scholar require subscriber login or
an access fee.
2. Many libraries have already paid
for subscriptions.
3. Other content may be more
relevant to the topic.
4. Google Scholar advanced search is
not very powerful.
© 2010 Deep Web Technologies, Inc.
7
So Why NOT
Google Scholar?
•
•
•
•
•
© 2010 Deep Web Technologies, Inc.
“Scholarly content” intermixed with
“non-scholarly” content
Spotty coverage, requires publisher
cooperation
Poor relevance (citation counts
don’t seem to help)
Unable to limit searching to specific
sources
Difficult to find the needles in the
haystack
8
Bringing Relevance
Back to the Library
Checking the Library Website…
–Reference Libraries
–Deep Web Databases
–Specialized Search Directories
–Specialized Search Engines
–Subscription Databases
–Library Catalogs
“Ask A Librarian!”
© 2010 Deep Web Technologies, Inc.
9
Federated Search…
© 2010 Deep Web Technologies, Inc.
10
In Other Words…
One Search, Many Sources
IP
Authenticated
Library
Catalog
OPACS
Wikis
Journals
Enter Your Search…
Begin Search
Advanced Search
News Sources
Small
Publishers
Public Web
Sources
Blogs
Intranet
© 2010 Deep Web Technologies, Inc.
11
eBooks
Tennant’s Tenets
• Only librarians like to
search, everyone else
likes to find.
Roy Tennant:
Internationally
known speaker and
writer on library and
information
technology issues.
© 2010 Deep Web Technologies, Inc.
• All things being equal,
one place to search is
better than two or more.
•
Services should be
placed as close to the
user as possible.
12
Tennant’s Tenets (cont.)
• “Good enough” is often just that.
• Our ability to create effective onestop searching is dependent on our
ability to appropriately target user
needs.
• The size of the result set doesn’t
matter as much as how the results
are presented. (‘the Google
Lesson’)
© 2010 Deep Web Technologies, Inc.
13
How can Federated Search
Help Your Users?
© 2010 Deep Web Technologies, Inc.
14
Benefits of Federated
Search
• One-Stop Access
• Support of More Efficient
Research
• Consolidated, Formatted
Results
• Authentication and Access
Control
© 2010 Deep Web Technologies, Inc.
15
One-Stop Access
Single query search across
multiple disparate sources in realtime:
–Subscription services (journals,
bibliographic databases, etc.)
–In-house databases
–Unstructured data (white papers, theses,
reports, etc.)
–Catalogs (web-based OPAC)
–Publicly available databases
Information Discovery
© 2010 Deep Web Technologies, Inc.
16
Support of More
Efficient Research
Results across all
selected sources are:
–Merged
–Presented in relevanceranked order
–Sorted
–Clustered
© 2010 Deep Web Technologies, Inc.
17
Consolidated,
Formatted Results
• Filter and remove duplicates
• Rank by relevance
• Display results by source
• Permit results to be
– Downloaded
– Printed
– Automatically emailed using Alerts
© 2010 Deep Web Technologies, Inc.
18
Authentication and
Access Control
• Authorization based on:
– IP address
– User ID and password
• Implementation using:
– Proxy server
– Link resolver
– Management of session cookies
• Different access levels for different
user groups
– Search Builder
© 2010 Deep Web Technologies, Inc.
19
#1 Benefit to Libraries
© 2010 Deep Web Technologies, Inc.
20
What does Federated
Search look like?
wastewater treatment
© 2010 Deep Web Technologies, Inc.
21
Automatic Alerts
© 2010 Deep Web Technologies, Inc.
22
Filter and Sort Results
Smart Clustering
© 2010 Deep Web Technologies, Inc.
23
© 2010 Deep Web Technologies, Inc.
24
© 2010 Deep Web Technologies, Inc.
25
© 2010 Deep Web Technologies, Inc.
26
© 2010 Deep Web Technologies, Inc.
27
© 2010 Deep Web Technologies, Inc.
28
Bringing Federated Search
to Your Users
• Search box on:
–Library web pages
–Department websites
–Course web page
–Subject guides
–Blogs
–Facebook
© 2010 Deep Web Technologies, Inc.
29
Search Builder
• Create custom search boxes and
search pages easily
• Enable/disable collections and search
fields
• Automatically generate search
widget HTML
© 2010 Deep Web Technologies, Inc.
30
© 2010 Deep Web Technologies, Inc.
31
© 2010 Deep Web Technologies, Inc.
32
© 2010 Deep Web Technologies, Inc.
33
Not All Federated Search
Engines Are Created Equal
• Easy-to-Use, Customizable Interface
• Complete Source Coverage
• Incremental display of real-time and
indexed results
• Clustering
• Relevance ranking of results on-the-fly
• Support Boolean and fielded searching
• Access sources via multiple protocols
(XML gateway, HTTP, Web Services, Z39.50)
© 2010 Deep Web Technologies, Inc.
34
The Future of
Federated Search
• Multi-Lingual Searching
• Personal Libraries
• Automated Source Selection
• Integration with Social
Networks
© 2010 Deep Web Technologies, Inc.
35
Conclusion
• Help Users to…
–Improve their search
–Find what they need
–Access scholarly
sources
–Return to your library
for information
© 2010 Deep Web Technologies, Inc.
36
Further Reading
Federated Search Blog
http://www.federatedsearchblog.com
© 2010 Deep Web Technologies, Inc.
37
Thank You!
Marieke Heins
[email protected]
Abe Lederman
[email protected]
© 2010 Deep Web Technologies, Inc.
38