Transcript FitzGerald-McFarland

Usability Report
for
FamilyConnections
Presentation by Amy FitzGerald and
Stephanie McFarland
April 21, 2005
Overview
•
•
•
•
•
•
•
Background
Test Plan
Test Session
Findings
Recommendations
Summary
Questions and Answers
Background
FamilyConnections’ mission is to improve the quality of
early education and care for our community’s children
by providing information, education and resources to
those individuals who have the greatest influence on
children during the critically important formative years
— parents, caregivers, teachers and community
leaders.
Test Plan
•
•
•
•
•
Pre-test Questionnaire
Assigned Tasks
Post-task Interview
Post-test Interview
Post-test Questionnaire
Participants
Participant #
Gender
Age
Parent?
FamilyConnections
Experience?
1
F
35
No
No
2
M
45
Yes
No
3
F
25
No
No
4
F
26
Yes
No
5
F
24
No
No
6
M
25
Yes
No
Pre-test Questionnaire
1.
2.
3.
4.
Do you use the Internet?
What is your primary reason for using the Internet?
How often do you use the Internet?
How important is it to you that you are able to get information over the
Internet? (How much a part of your life is it?)
5. What types of information do you access (e.g. weather, travel, news)?
6. What are the last three topics you researched?
7. What are the top three sites you consult when using the Internet?
8. How often do you use them?
9. What makes them stand out?
10. What do you like about them?
11. What do you dislike about them?
12. What Web site presents the most reputable and dependable
information?
Task Scenarios
1. Go to the FamilyConnections homepage and provide
some initial impressions of the Web site.
2. Freely explore the site for five minutes.
3. Locate information about dealing with a specific
aspect of child behavior and discipline.
4. Locate general information about a service
FamilyConnections provides.
Performance Data
Task
Correct actions –
“Y”
Reasonable other
actions – “(Y)”
Wrong actions –
“N”
1 – Go to the homepage and
provide initial impressions of
the Web site.
n/a
n/a
n/a
2 – Freely explore the Web
site.
n/a
n/a
n/a
3 – Find resources on how to
deal with a child who bites.
2
4
0
4 – Find information about
FamilyConnections’
Parent/Child Workshops.
3
0
3
Post-test Interview
1. What is your impression of this site overall? Please give it a grade from A
to F.
2. Grade: _______
3. Why?
4. Name three words or characteristics that describe this Web site.
5. What were the 3 things you liked best about this Web site?
6. What were the 3 things you liked least about this Web site?
7. Would you return to this Web site on your own in the future?
8. What would entice you to return?
9. Would you recommend this site to a friend or family member?
10. Are the materials on the Web site relevant to you?
11. How might they be more relevant?
12. Are there materials you would like added to the Web site? Which ones?
Satisfaction Data
Strongly disagree 1. . . . .2. . . . .3. . . . .4. . . . .5. . . . .6. . . . .7 Strongly agree
Question
Median
1 – The homepage is attractive.
5
2 – The overall site is attractive.
5
3 – The site’s graphics are pleasing.
4.5
4 – The site has a good balance of graphics vs. text.
4
5 – The colors used throughout the site are attractive.
6
6 – The typography (lettering, headings, titles) is attractive.
5.5
7 – The homepage’s content makes me want to explore the site further.
5.5
8 – It is easy to find one’s way around the site.
3
9 – You can get to information quickly.
3
10 – It is fun to explore the site.
3.5
11 – It is easy to remember where to find things.
3
12 – Information is layered effectively on different screens.
3
13 – The homepage is attention-getting.
4.5
14 – Information is easy to read.
4.5
15 – Information is written in a style that suits me.
5
Satisfaction Data (cont’d.)
Strongly disagree 1. . . . .2. . . . .3. . . . .4. . . . .5. . . . .6. . . . .7 Strongly agree
16 – Screens have the right amount of information.
4.5
17 – The site effectively communicates the FamilyConnections image.
5.5
18 – Information is relevant.
6
19 – The site is designed with me in mind.
2.5
20 – The site’s contents interest me.
4
21 – The site’s content would keep me coming back.
4
22 – The site has characteristics that make it especially appealing.
4.5
23 – The site reflects progressive, leading edge design.
3.5
24 – The site is exciting.
3
25 – The site is well suited to first-time visitors.
3
26 – The site is well suited to repeat visitors.
4.5
27 – The site has a clear purpose.
5
28 – It is always clear what to do next.
3
29 – It is clear how screen elements (e.g., pop-ups, scrolling lists, menu
options, etc.) work.
3.5
30 – Mistakes are easy to correct.
4
Positive Findings
• Finding: Users had no trouble locating and using the
“search” feature on the homepage.
• Finding: The Web site’s color scheme is warm and
inviting.
• Finding: The Web site provides a great deal of
information for parents and those curious about
childcare.
Positive Findings
• Finding: The contact information for FamilyConnections
staff members is thorough and easy to find.
• Finding: The site advertised community events
effectively.
• Finding: Options to read the site and its resources in
Spanish help FamilyConnections serve a wider
population.
Areas for Improvement
Ps were unclear about the site’s terminology.
The homepage’s flashing photographic images distracted Ps.
The site does not follow standard Web site design rules as they pertain to the
use of colored and underlined text.
The Spanish site option is not very noticeable, nor does it have functionality.
Search function is only available on the homepage.
The amount of text and length of pages is overwhelming. It is difficult to
distinguish between headings and supporting information.
Parent/Child Workshops are not easily found.
Ps felt lost in the Web site after leaving the homepage.
Some material within the Web site either is not up-to-date or it is difficult to tell
whether it is current.
Ps must download large PDF files in order to gain access to resources.
The site does not facilitate user participation or user independence.
The “Map/Directions” page is incomplete.
Significant Finding 1
Finding: Ps were unclear about the site’s terminology.
Description: Most of the Ps remarked that the menu option “Providers” was
unclear. Even after clicking on that option, it was commonly the case that the
P would still not have a good idea of whom the “Providers” section of the Web
site addressed. One P attempted to launch the Family Library option, and was
surprised to discover that it did not contain a library of articles and
publications relating to parenting.
Recommendation: Include terminology that is intuitive to a wide range of
users. For example, “Providers” might be changed to “Childcare Providers.”
Also, include short explanations that pop up when users hover over each
navigation bar heading. This will more effectively distinguish what each option
means and help the user decide if they have chosen the right heading for
their needs.
Significant Finding 2
Finding: The homepage’s flashing photographic images distracted Ps.
FamilyConnections Homepage
Description: Ps remarked that the homepage’s photographic images
changed too quickly and noticeably, making it difficult for them to focus
on other areas of the site. While the images are professional and the
quotations effective, it was common that Ps were distracted by the
limited number of scrolling images. For users with slow connections, the
download time may be significant. When using the drop-down menus at
the top of the homepage, a P using a Mac noticed that the pull-down
options disappeared when the images changed.
Recommendation: Slow down the turnover rate for the homepage
photos, and include a greater number of images. Test the homepage in
various browsers (Mac and PC) to ensure that the drop-down menu is
not affected when the images scroll.
Significant Finding 3
Finding: The site does not follow standard Web site design rules
as they pertain to the use of colored and underlined text.
FamilyConnections Homepage
Description: While the color scheme was seen as mostly
welcoming and appropriate, an abundance of Ps remarked about
underlined blue text that erroneously indicated links. Ps found it
frustrating to find underlined blue text that they thought would lead
to more in-depth explanation about particular resources (i.e., the
homepage calendar). Because of the lack of linkable text on the
homepage, one P found it inconsistent that other areas of the site
contained underlined blue text that were links.
Recommendation: Do not use underlined blue text unless it is
intended as a link. In the case of the calendar, consider making this
section capable of linking to additional information.
Significant Finding 4
Finding: The Spanish site option is not very noticeable, nor does
it have functionality.
Description: Ps did not immediately discover the link to the
Spanish-language version of the site, as it was hidden at the top of
the homepage in a small, light-colored menu. When clicked, it
appeared as though the Spanish version was loading, but an
English-language navigation bar was still present. The Spanish
site never loaded.
Recommendation: Make the Spanish site option more obvious
through the use of a larger font and a bolder color. Repair the
Spanish version of the site so that more users can access it.
Significant Finding 5
Finding: Search function is only available on the homepage.
FamilyConnections Homepage
Description: When Ps were attempting to complete assigned tasks and
wanted to use the Search function, either they did not realize that there
was a Search function (because it only appears on the homepage), or
they had to go back to the homepage to use it. Ps found this inefficient,
even though the Search function worked well once they found it.
Recommendation: Carry the Search function throughout the site, and
place it in a prominent area of the page.
Significant Finding 6
Finding: The amount of text and length of pages is overwhelming. It is
difficult to distinguish between headings and supporting information.
Description: While rich in resources and information, Ps found the site
itself very complex to navigate. When presented with information, many
Ps remarked about the abundance of small text buried in long paragraphs
lacking bold headings and bullet points. For example, the “History” page
contained an enormous amount of text that did not efficiently provide an
overview of the organization. It took a long time for Ps to scan material on
the Web site.
Recommendation: Shorten pages by offering click-through options such
as “Next Page” if text is lengthy. Break out major points, and separate
paragraphs by using bullet points and/or clear headings that appear in
larger, bolder fonts.
Significant Finding 7
Finding: Parent/Child Workshops are not easily found.
Description: The Parent/Child Workshops are found under the “Family
Place Library” heading, which does not seem like a logical place to
retrieve this information. When attempting to find the workshops, Ps had
to use the Search function and looked in all areas of the site including
“Events,” and “Parents,” but never under “Family Place Library,” even
though many had hovered over that heading (which reveals the
Parent/Child Workshops) during the free exploration task.
Recommendation: Since the Parent/Child Workshops are a major
service provided by FamilyConnections, it would be beneficial if this
information were prominently displayed on the homepage. Also, it could
be added under the “Parents” heading in the main navigation bar.
Significant Finding 8
Finding 8: Ps felt lost in the Web site after leaving the homepage.
Description: When performing assigned tasks, Ps were confused about
where they were or how they got there. This was especially true when a
separate window would open with the information they needed, preventing
them from going back from that page. When asked if they knew where they
were after completing tasks, all Ps replied, “No.”
Recommendation: Provide “breadcrumbs” so that users can see where they
are within the site and retrace their steps, if needed. Shorten URLs for pages
in order to help users more clearly understand each page’s relationship to
other pages. For example, the URL for “Storytime,” a section of the “Family
Place Library” is:
http://www.familyconnectionsonline.org:8080/FamilyConnections/FamilyConne
ctions/fc/fpl_storytime.html?id=6&uid=75.
Significant Finding 9
Finding: Some material within the Web site either is not up-to-date or it is
difficult to tell whether it is current.
Celebration of Families
Description: The copyright on the homepage reads 2004, leading one P to
believe the site had not been updated since that year. The Family
Celebration is featured on the homepage, even though, as of this report, it
took place over two weeks ago. Dates throughout the site do not include a
year, confusing Ps about when these events occur. One P clicked on the
Family Celebration to find that it was already over and remarked that
perhaps FamilyConnections is not committed to its Web site.
Recommendation: Update the site regularly, and include a “Last Updated”
note at the bottom of the homepage. Add the year to every date on the site,
and remove events that have already passed.
Significant Finding 10
Finding: Ps must download large PDF files in order to gain access to
resources.
FamilyConnections Homepage
Description: To view the homepage calendar, Ps had to download a PDF.
This is problematic, due to the fact that the calendar merely says “Click
Here for April Flyer” without indicating PDF format or the necessity for a
PDF reader. In addition, the “Publications” section requires PDF
downloads.
Recommendation: Make the monthly calendar available as a clickable
html document. Also, prepare users for PDF downloads with labels such as
“Requires a PDF Reader,” and include a link to a download for free PDFreading software.
Significant Finding 11
Finding: The site does not facilitate user participation or user
independence.
Description: Ps were disappointed to discover that they were
unable to register online for workshops or classes offered by
FamilyConnections. It was also common that Ps could not get
substantive information about a topic without having to call
FamilyConnections. This led Ps to express confusion about the
purpose of the Web site.
Recommendation: Include online registration capabilities for
classes and workshops. Also include more in-depth information
regarding offerings so that users can make an informed decision
without having to contact FamilyConnections.
Significant Finding 12
Finding: The Map/Directions page is incomplete.
Description: Ps noticed that the “Map/Directions” page lacks a
map and a physical address. The directions themselves only
mention how to get to FamilyConnections from North and South
regions of Austin using only one major thoroughfare, and there
are no directions for visitors who use public transportation.
Recommendation: Include a map. Offer alternative driving
directions and information regarding public transportation (e.g.,
the closest bus stop).
Summary
•
•
•
•
Six participants with above average Internet/computer skills
Assigned Tasks
Interviews and Questionnaires
Findings
– Participants found the Web site visually pleasing and rich in
resources.
– The site could use a few improvements if FamilyConnections hopes
to reach a wider audience.
• Ensure functionality of the Spanish site.
• Make site more user-friendly (improve navigation and add interactive
elements).
• Make terminology more intuitive.