SlideShare a Scribd company logo
1 of 23
Usability testing
Making it fast, good, and cheap
Whitney Quesenbery
Center for Civic Design
@civicdesign | @whitneyq
#DotGovDesignConf
27 March 2015
What can you learn
from a usability test?
And how you can make it a
useful part of your work.
Do you think this is usability testing?
Photo: www.unic.com
Usability testing can also look like this
Photos: UXBlog.com
What makes it a
usability test?
We observe people's behavior
Quietly
And use the results to inform
design
What do you want to learn?
Do people understand
how to fill in a form?
Qualitative
 relationship
 mental models
 context of use
but also
 how many people have
different understandings
Which design helps people
fill in the form accurately?
Quantitative
 how many like each
 number of errors
 severity of errors
but also
 insights into the source and
nature of the errors
The recipe for a usability test
Location and context formal informal
Participants defined opportunistic
Technology yours theirs
Activities instructed tasks free tasks
Goals usable useful
Results quantitative qualitative
Location:
Go where the people are
Participants:
How will you find them
Convenience
Purposeful
Quota
Participants:
Not just demographics
Attitude
(motivation, emotion, persistence,
optimism, tolerance for frustration)
Aptitude
(knowledge, expertise, habits, skills)
Ability
(physical and cognitive attributes)
http://www.slideshare.net/danachisnell/character-creator
Asssistive Technology: Refreshable Braille, mouth stick, screen
reader, magnifier, iPad (Glenda Watson Hyatt
Technology:
Diversity of devices
Tasks:
Think about the 5 Es
Effective
Efficient
Engaging
Error-tolerant
Easy to learn
and don't forget delight
Let's talk
What are you working on?
What do you want to learn
about usability?
Planning a
usability program
Look for balance
Look for balance
Think about cadence
Seeing the Elephant: Defragmenting User Research by Lou Rosenfeld
http://alistapart.com/article/seeing-the-elephant-defragmenting-user-research
Rocket Surgery
First Fridays @ DigitalGov
 3 participants; 35 minute sessions
 Debrief over lunch to identify the 3
most serious problems
 Site stakeholders agree in advance
to work on recommendations
within one month.
www.digitalgov.gov/resources/digitalgov-user-experience-program/
www.sensible.com/rsme.html
What about the Paperwork Reduction Act?
https://www.digitalgov.gov/files/2014/01/PRAPrimer_04072010-2.pdf
Fast Track Clearance for PRA
When the data collection
 Is focus on improving services
 Is voluntary
 Does not require statical rigor
 Does not put high burden on
participants
 Will not be published as quantitative,
generalizable data
http://www.digitalgov.gov/resources/digitalgov-user-experience-program/digitalgov-user-
experience-program-usability-starter-kit/
Take any opportunity for a quick
usability observation
The next time someone asks you
a question about your site, ask
them to use it instead.
Watch as they try to find the
information.
Just do it
Fast – small, frequent
Good – insights you need
Cheap –informal methods
Get in touch!
Whitney Quesenbery
whitneyq@civicdesign.org
@whitneyq
civicdesign.org
@civicdesign

More Related Content

What's hot

UXPA2019 UX fundamentals for adapting science-based interfaces for non-techni...
UXPA2019 UX fundamentals for adapting science-based interfaces for non-techni...UXPA2019 UX fundamentals for adapting science-based interfaces for non-techni...
UXPA2019 UX fundamentals for adapting science-based interfaces for non-techni...UXPA International
 
UXPA2019 Enhancing the User Experience for People with Disabilities: Top 10 ...
UXPA2019  Enhancing the User Experience for People with Disabilities: Top 10 ...UXPA2019  Enhancing the User Experience for People with Disabilities: Top 10 ...
UXPA2019 Enhancing the User Experience for People with Disabilities: Top 10 ...UXPA International
 
FXD 2019 Keynote: Andy Vitale, SunTrust Bank
FXD 2019 Keynote: Andy Vitale, SunTrust BankFXD 2019 Keynote: Andy Vitale, SunTrust Bank
FXD 2019 Keynote: Andy Vitale, SunTrust BankMad*Pow
 
Cognitive walkthroughs - CSUN 2018
Cognitive walkthroughs - CSUN 2018Cognitive walkthroughs - CSUN 2018
Cognitive walkthroughs - CSUN 2018Intopia
 
FXD 2019 Keynote: Marti Gold, SiriusXM
FXD 2019 Keynote: Marti Gold, SiriusXMFXD 2019 Keynote: Marti Gold, SiriusXM
FXD 2019 Keynote: Marti Gold, SiriusXMMad*Pow
 
From Empathy to Research with People with Disability
From Empathy to Research with People with DisabilityFrom Empathy to Research with People with Disability
From Empathy to Research with People with DisabilityIntopia
 
Tips About Accessibility for Online Learning Instructors
Tips About Accessibility for Online Learning InstructorsTips About Accessibility for Online Learning Instructors
Tips About Accessibility for Online Learning Instructors3Play Media
 
UXPA2019 I am the LAAW! The Lean Accessibility Audit Workshop
UXPA2019  I am the LAAW!   The Lean Accessibility Audit WorkshopUXPA2019  I am the LAAW!   The Lean Accessibility Audit Workshop
UXPA2019 I am the LAAW! The Lean Accessibility Audit WorkshopUXPA International
 
Accessibility Empathy - SXSW 2017 Proposal
Accessibility Empathy - SXSW 2017 ProposalAccessibility Empathy - SXSW 2017 Proposal
Accessibility Empathy - SXSW 2017 ProposalYvonne So
 
How Deep Is Your Accessibility Empathy SXSW Workshop 2017
How Deep Is Your Accessibility Empathy SXSW Workshop 2017How Deep Is Your Accessibility Empathy SXSW Workshop 2017
How Deep Is Your Accessibility Empathy SXSW Workshop 2017Yvonne So
 
UXPA2019 Designing Technology for an Aging Population
UXPA2019  Designing Technology for an Aging PopulationUXPA2019  Designing Technology for an Aging Population
UXPA2019 Designing Technology for an Aging PopulationUXPA International
 
2009: User experience in action
2009: User experience in action2009: User experience in action
2009: User experience in actionJonathan Hassell
 
Design for accessibility
Design for accessibilityDesign for accessibility
Design for accessibilityYogeshDaphane
 
Accessible Design Presentation
Accessible Design PresentationAccessible Design Presentation
Accessible Design PresentationTopher Kanyuga
 
UXPA2019 - Unconference: Basics of Building Blockchain Interfaces
UXPA2019 - Unconference: Basics of Building Blockchain InterfacesUXPA2019 - Unconference: Basics of Building Blockchain Interfaces
UXPA2019 - Unconference: Basics of Building Blockchain InterfacesUXPA International
 
No one wants to SUX: A focus on inclusive user experience techniques
No one wants to SUX: A focus on inclusive user experience techniquesNo one wants to SUX: A focus on inclusive user experience techniques
No one wants to SUX: A focus on inclusive user experience techniquesIntopia
 
Accessibility & Universal Design
Accessibility & Universal DesignAccessibility & Universal Design
Accessibility & Universal DesignSrutiVijaykumar
 
7 colors of the accessibility rainbow
7 colors of the accessibility rainbow7 colors of the accessibility rainbow
7 colors of the accessibility rainbowSrutiVijaykumar
 
Designing for Stress Cases - Baltimore Design Week 2016 - Kelly Driver and An...
Designing for Stress Cases - Baltimore Design Week 2016 - Kelly Driver and An...Designing for Stress Cases - Baltimore Design Week 2016 - Kelly Driver and An...
Designing for Stress Cases - Baltimore Design Week 2016 - Kelly Driver and An...Anthony D. Paul
 
Accessibility for content designers
Accessibility for content designersAccessibility for content designers
Accessibility for content designersAlistair Duggin
 

What's hot (20)

UXPA2019 UX fundamentals for adapting science-based interfaces for non-techni...
UXPA2019 UX fundamentals for adapting science-based interfaces for non-techni...UXPA2019 UX fundamentals for adapting science-based interfaces for non-techni...
UXPA2019 UX fundamentals for adapting science-based interfaces for non-techni...
 
UXPA2019 Enhancing the User Experience for People with Disabilities: Top 10 ...
UXPA2019  Enhancing the User Experience for People with Disabilities: Top 10 ...UXPA2019  Enhancing the User Experience for People with Disabilities: Top 10 ...
UXPA2019 Enhancing the User Experience for People with Disabilities: Top 10 ...
 
FXD 2019 Keynote: Andy Vitale, SunTrust Bank
FXD 2019 Keynote: Andy Vitale, SunTrust BankFXD 2019 Keynote: Andy Vitale, SunTrust Bank
FXD 2019 Keynote: Andy Vitale, SunTrust Bank
 
Cognitive walkthroughs - CSUN 2018
Cognitive walkthroughs - CSUN 2018Cognitive walkthroughs - CSUN 2018
Cognitive walkthroughs - CSUN 2018
 
FXD 2019 Keynote: Marti Gold, SiriusXM
FXD 2019 Keynote: Marti Gold, SiriusXMFXD 2019 Keynote: Marti Gold, SiriusXM
FXD 2019 Keynote: Marti Gold, SiriusXM
 
From Empathy to Research with People with Disability
From Empathy to Research with People with DisabilityFrom Empathy to Research with People with Disability
From Empathy to Research with People with Disability
 
Tips About Accessibility for Online Learning Instructors
Tips About Accessibility for Online Learning InstructorsTips About Accessibility for Online Learning Instructors
Tips About Accessibility for Online Learning Instructors
 
UXPA2019 I am the LAAW! The Lean Accessibility Audit Workshop
UXPA2019  I am the LAAW!   The Lean Accessibility Audit WorkshopUXPA2019  I am the LAAW!   The Lean Accessibility Audit Workshop
UXPA2019 I am the LAAW! The Lean Accessibility Audit Workshop
 
Accessibility Empathy - SXSW 2017 Proposal
Accessibility Empathy - SXSW 2017 ProposalAccessibility Empathy - SXSW 2017 Proposal
Accessibility Empathy - SXSW 2017 Proposal
 
How Deep Is Your Accessibility Empathy SXSW Workshop 2017
How Deep Is Your Accessibility Empathy SXSW Workshop 2017How Deep Is Your Accessibility Empathy SXSW Workshop 2017
How Deep Is Your Accessibility Empathy SXSW Workshop 2017
 
UXPA2019 Designing Technology for an Aging Population
UXPA2019  Designing Technology for an Aging PopulationUXPA2019  Designing Technology for an Aging Population
UXPA2019 Designing Technology for an Aging Population
 
2009: User experience in action
2009: User experience in action2009: User experience in action
2009: User experience in action
 
Design for accessibility
Design for accessibilityDesign for accessibility
Design for accessibility
 
Accessible Design Presentation
Accessible Design PresentationAccessible Design Presentation
Accessible Design Presentation
 
UXPA2019 - Unconference: Basics of Building Blockchain Interfaces
UXPA2019 - Unconference: Basics of Building Blockchain InterfacesUXPA2019 - Unconference: Basics of Building Blockchain Interfaces
UXPA2019 - Unconference: Basics of Building Blockchain Interfaces
 
No one wants to SUX: A focus on inclusive user experience techniques
No one wants to SUX: A focus on inclusive user experience techniquesNo one wants to SUX: A focus on inclusive user experience techniques
No one wants to SUX: A focus on inclusive user experience techniques
 
Accessibility & Universal Design
Accessibility & Universal DesignAccessibility & Universal Design
Accessibility & Universal Design
 
7 colors of the accessibility rainbow
7 colors of the accessibility rainbow7 colors of the accessibility rainbow
7 colors of the accessibility rainbow
 
Designing for Stress Cases - Baltimore Design Week 2016 - Kelly Driver and An...
Designing for Stress Cases - Baltimore Design Week 2016 - Kelly Driver and An...Designing for Stress Cases - Baltimore Design Week 2016 - Kelly Driver and An...
Designing for Stress Cases - Baltimore Design Week 2016 - Kelly Driver and An...
 
Accessibility for content designers
Accessibility for content designersAccessibility for content designers
Accessibility for content designers
 

Similar to Usability Testing: Making it fast, good, and cheap

Requirements Engineering for the Humanities
Requirements Engineering for the HumanitiesRequirements Engineering for the Humanities
Requirements Engineering for the HumanitiesShawn Day
 
Ucd Techniques - Shad MUN 2008
Ucd Techniques - Shad MUN 2008Ucd Techniques - Shad MUN 2008
Ucd Techniques - Shad MUN 2008Patañjali Chary
 
UCD Workshop - Shad MUN 2008
UCD Workshop - Shad MUN 2008UCD Workshop - Shad MUN 2008
UCD Workshop - Shad MUN 2008guest63c15b
 
Optimizing Mobile UX Design Webinar Presentation Slides
Optimizing Mobile UX Design Webinar Presentation SlidesOptimizing Mobile UX Design Webinar Presentation Slides
Optimizing Mobile UX Design Webinar Presentation SlidesUserZoom
 
Brightfind world usability day 2016 full deck final
Brightfind world usability day 2016   full deck finalBrightfind world usability day 2016   full deck final
Brightfind world usability day 2016 full deck finalBrightfind
 
Usability Testing and QA 12 11-15
Usability Testing and QA 12 11-15Usability Testing and QA 12 11-15
Usability Testing and QA 12 11-15Shilpa Thanawala
 
Ten Lessons Learnt to Drive and Transform Open Source Software User Experienc...
Ten Lessons Learnt to Drive and Transform Open Source Software User Experienc...Ten Lessons Learnt to Drive and Transform Open Source Software User Experienc...
Ten Lessons Learnt to Drive and Transform Open Source Software User Experienc...All Things Open
 
Ten Lessons Learnt to Drive and Transform Open Source Software User Experienc...
Ten Lessons Learnt to Drive and Transform Open Source Software User Experienc...Ten Lessons Learnt to Drive and Transform Open Source Software User Experienc...
Ten Lessons Learnt to Drive and Transform Open Source Software User Experienc...Ju Lim
 
Usability Techniques for Startups
Usability Techniques for StartupsUsability Techniques for Startups
Usability Techniques for StartupsPerfetti Media
 
Mobile Age: Open Data Mobile Apps to Support Independent Living
Mobile Age: Open Data Mobile Apps to Support Independent LivingMobile Age: Open Data Mobile Apps to Support Independent Living
Mobile Age: Open Data Mobile Apps to Support Independent LivingMobile Age Project
 
Engaging users in digital strategy development
Engaging users in digital strategy developmentEngaging users in digital strategy development
Engaging users in digital strategy developmentEndeavor Management
 
First Things First: Fix the Tasks!
First Things First: Fix the Tasks!First Things First: Fix the Tasks!
First Things First: Fix the Tasks!Neo Insight
 
Enterprise User Experience in Higher Education
Enterprise User Experience in Higher EducationEnterprise User Experience in Higher Education
Enterprise User Experience in Higher EducationTarik (Rick) Dzekman
 
Sandy Williams Hilfiker - Involving People with Limited Literacy Skills in Co...
Sandy Williams Hilfiker - Involving People with Limited Literacy Skills in Co...Sandy Williams Hilfiker - Involving People with Limited Literacy Skills in Co...
Sandy Williams Hilfiker - Involving People with Limited Literacy Skills in Co...Plain Talk 2015
 
User Experience Design: an Overview
User Experience Design: an OverviewUser Experience Design: an Overview
User Experience Design: an OverviewJulie Grundy
 

Similar to Usability Testing: Making it fast, good, and cheap (20)

Requirements Engineering for the Humanities
Requirements Engineering for the HumanitiesRequirements Engineering for the Humanities
Requirements Engineering for the Humanities
 
Ucd Techniques - Shad MUN 2008
Ucd Techniques - Shad MUN 2008Ucd Techniques - Shad MUN 2008
Ucd Techniques - Shad MUN 2008
 
UCD Workshop - Shad MUN 2008
UCD Workshop - Shad MUN 2008UCD Workshop - Shad MUN 2008
UCD Workshop - Shad MUN 2008
 
Optimizing Mobile UX Design Webinar Presentation Slides
Optimizing Mobile UX Design Webinar Presentation SlidesOptimizing Mobile UX Design Webinar Presentation Slides
Optimizing Mobile UX Design Webinar Presentation Slides
 
Brightfind world usability day 2016 full deck final
Brightfind world usability day 2016   full deck finalBrightfind world usability day 2016   full deck final
Brightfind world usability day 2016 full deck final
 
Usability Testing and QA 12 11-15
Usability Testing and QA 12 11-15Usability Testing and QA 12 11-15
Usability Testing and QA 12 11-15
 
Ten Lessons Learnt to Drive and Transform Open Source Software User Experienc...
Ten Lessons Learnt to Drive and Transform Open Source Software User Experienc...Ten Lessons Learnt to Drive and Transform Open Source Software User Experienc...
Ten Lessons Learnt to Drive and Transform Open Source Software User Experienc...
 
Ten Lessons Learnt to Drive and Transform Open Source Software User Experienc...
Ten Lessons Learnt to Drive and Transform Open Source Software User Experienc...Ten Lessons Learnt to Drive and Transform Open Source Software User Experienc...
Ten Lessons Learnt to Drive and Transform Open Source Software User Experienc...
 
Usability Techniques for Startups
Usability Techniques for StartupsUsability Techniques for Startups
Usability Techniques for Startups
 
UX Research Methodologies
UX Research MethodologiesUX Research Methodologies
UX Research Methodologies
 
Mobile Age: Open Data Mobile Apps to Support Independent Living
Mobile Age: Open Data Mobile Apps to Support Independent LivingMobile Age: Open Data Mobile Apps to Support Independent Living
Mobile Age: Open Data Mobile Apps to Support Independent Living
 
User experience
User experienceUser experience
User experience
 
Engaging users in digital strategy development
Engaging users in digital strategy developmentEngaging users in digital strategy development
Engaging users in digital strategy development
 
First Things First: Fix the Tasks!
First Things First: Fix the Tasks!First Things First: Fix the Tasks!
First Things First: Fix the Tasks!
 
Lean User Testing Intro
Lean User Testing IntroLean User Testing Intro
Lean User Testing Intro
 
Enterprise User Experience in Higher Education
Enterprise User Experience in Higher EducationEnterprise User Experience in Higher Education
Enterprise User Experience in Higher Education
 
Why Usability Testing Should be Part of your Accessibility Testing Strategy
Why Usability Testing Should be Part of your Accessibility Testing StrategyWhy Usability Testing Should be Part of your Accessibility Testing Strategy
Why Usability Testing Should be Part of your Accessibility Testing Strategy
 
Sandy Williams Hilfiker - Involving People with Limited Literacy Skills in Co...
Sandy Williams Hilfiker - Involving People with Limited Literacy Skills in Co...Sandy Williams Hilfiker - Involving People with Limited Literacy Skills in Co...
Sandy Williams Hilfiker - Involving People with Limited Literacy Skills in Co...
 
Scale2014
Scale2014Scale2014
Scale2014
 
User Experience Design: an Overview
User Experience Design: an OverviewUser Experience Design: an Overview
User Experience Design: an Overview
 

More from Whitney Quesenbery

Designing for difference: Are you failing at the most important design challenge
Designing for difference: Are you failing at the most important design challengeDesigning for difference: Are you failing at the most important design challenge
Designing for difference: Are you failing at the most important design challengeWhitney Quesenbery
 
Storytelling: Finding the insights in research data
Storytelling: Finding the insights in research data Storytelling: Finding the insights in research data
Storytelling: Finding the insights in research data Whitney Quesenbery
 
Storytelling makes research data come to life
Storytelling makes research data come to lifeStorytelling makes research data come to life
Storytelling makes research data come to lifeWhitney Quesenbery
 
From barrier-free to delightful
From barrier-free to delightfulFrom barrier-free to delightful
From barrier-free to delightfulWhitney Quesenbery
 
Security insights & issues for poll workers
Security insights & issues for poll workersSecurity insights & issues for poll workers
Security insights & issues for poll workersWhitney Quesenbery
 
Plain language (accessibility for content)
Plain language (accessibility for content)Plain language (accessibility for content)
Plain language (accessibility for content)Whitney Quesenbery
 
The power of stories: creating empathy and connection
The power of stories: creating empathy and connectionThe power of stories: creating empathy and connection
The power of stories: creating empathy and connectionWhitney Quesenbery
 
What you can learn from usability testing
What you can learn from usability testingWhat you can learn from usability testing
What you can learn from usability testingWhitney Quesenbery
 
Accessibility as Innovation: Creating accessible user experiences
Accessibility as Innovation: Creating accessible user experiencesAccessibility as Innovation: Creating accessible user experiences
Accessibility as Innovation: Creating accessible user experiencesWhitney Quesenbery
 
Using Personas and Stories Effectively - Workshop for TriUXPA
Using Personas and Stories Effectively - Workshop for TriUXPAUsing Personas and Stories Effectively - Workshop for TriUXPA
Using Personas and Stories Effectively - Workshop for TriUXPAWhitney Quesenbery
 
Persona Stories: Weaving together quant & qual for a richer picture
Persona Stories: Weaving together quant & qual for a richer picturePersona Stories: Weaving together quant & qual for a richer picture
Persona Stories: Weaving together quant & qual for a richer pictureWhitney Quesenbery
 
A Web for Everyone: Accessibility as a design challenge
A Web for Everyone: Accessibility as a design challengeA Web for Everyone: Accessibility as a design challenge
A Web for Everyone: Accessibility as a design challengeWhitney Quesenbery
 
6 Awesomely Practical Tips: Making content better for everyone
6 Awesomely Practical Tips: Making content better for everyone6 Awesomely Practical Tips: Making content better for everyone
6 Awesomely Practical Tips: Making content better for everyoneWhitney Quesenbery
 

More from Whitney Quesenbery (20)

Designing for difference: Are you failing at the most important design challenge
Designing for difference: Are you failing at the most important design challengeDesigning for difference: Are you failing at the most important design challenge
Designing for difference: Are you failing at the most important design challenge
 
Storytelling: Finding the insights in research data
Storytelling: Finding the insights in research data Storytelling: Finding the insights in research data
Storytelling: Finding the insights in research data
 
Storytelling makes research data come to life
Storytelling makes research data come to lifeStorytelling makes research data come to life
Storytelling makes research data come to life
 
From barrier-free to delightful
From barrier-free to delightfulFrom barrier-free to delightful
From barrier-free to delightful
 
Writing Great Alt Text
Writing Great Alt TextWriting Great Alt Text
Writing Great Alt Text
 
Security insights & issues for poll workers
Security insights & issues for poll workersSecurity insights & issues for poll workers
Security insights & issues for poll workers
 
Writing Great Alt Text
Writing Great Alt TextWriting Great Alt Text
Writing Great Alt Text
 
Don't Make Me Read
Don't Make Me ReadDon't Make Me Read
Don't Make Me Read
 
Plain language (accessibility for content)
Plain language (accessibility for content)Plain language (accessibility for content)
Plain language (accessibility for content)
 
The power of stories: creating empathy and connection
The power of stories: creating empathy and connectionThe power of stories: creating empathy and connection
The power of stories: creating empathy and connection
 
Personas for Accessible UX
Personas for Accessible UXPersonas for Accessible UX
Personas for Accessible UX
 
What you can learn from usability testing
What you can learn from usability testingWhat you can learn from usability testing
What you can learn from usability testing
 
Accessibility as Innovation: Creating accessible user experiences
Accessibility as Innovation: Creating accessible user experiencesAccessibility as Innovation: Creating accessible user experiences
Accessibility as Innovation: Creating accessible user experiences
 
Usability meets accessibility
Usability meets accessibilityUsability meets accessibility
Usability meets accessibility
 
Using Personas and Stories Effectively - Workshop for TriUXPA
Using Personas and Stories Effectively - Workshop for TriUXPAUsing Personas and Stories Effectively - Workshop for TriUXPA
Using Personas and Stories Effectively - Workshop for TriUXPA
 
Persona Stories: Weaving together quant & qual for a richer picture
Persona Stories: Weaving together quant & qual for a richer picturePersona Stories: Weaving together quant & qual for a richer picture
Persona Stories: Weaving together quant & qual for a richer picture
 
Notetaking workshop
Notetaking workshopNotetaking workshop
Notetaking workshop
 
A Place at the Table
A Place at the TableA Place at the Table
A Place at the Table
 
A Web for Everyone: Accessibility as a design challenge
A Web for Everyone: Accessibility as a design challengeA Web for Everyone: Accessibility as a design challenge
A Web for Everyone: Accessibility as a design challenge
 
6 Awesomely Practical Tips: Making content better for everyone
6 Awesomely Practical Tips: Making content better for everyone6 Awesomely Practical Tips: Making content better for everyone
6 Awesomely Practical Tips: Making content better for everyone
 

Recently uploaded

西北大学毕业证学位证成绩单-怎么样办伪造
西北大学毕业证学位证成绩单-怎么样办伪造西北大学毕业证学位证成绩单-怎么样办伪造
西北大学毕业证学位证成绩单-怎么样办伪造kbdhl05e
 
Passbook project document_april_21__.pdf
Passbook project document_april_21__.pdfPassbook project document_april_21__.pdf
Passbook project document_april_21__.pdfvaibhavkanaujia
 
办理卡尔顿大学毕业证成绩单|购买加拿大文凭证书
办理卡尔顿大学毕业证成绩单|购买加拿大文凭证书办理卡尔顿大学毕业证成绩单|购买加拿大文凭证书
办理卡尔顿大学毕业证成绩单|购买加拿大文凭证书zdzoqco
 
306MTAMount UCLA University Bachelor's Diploma in Social Media
306MTAMount UCLA University Bachelor's Diploma in Social Media306MTAMount UCLA University Bachelor's Diploma in Social Media
306MTAMount UCLA University Bachelor's Diploma in Social MediaD SSS
 
Top 10 Modern Web Design Trends for 2025
Top 10 Modern Web Design Trends for 2025Top 10 Modern Web Design Trends for 2025
Top 10 Modern Web Design Trends for 2025Rndexperts
 
Call Us ✡️97111⇛47426⇛Call In girls Vasant Vihar༒(Delhi)
Call Us ✡️97111⇛47426⇛Call In girls Vasant Vihar༒(Delhi)Call Us ✡️97111⇛47426⇛Call In girls Vasant Vihar༒(Delhi)
Call Us ✡️97111⇛47426⇛Call In girls Vasant Vihar༒(Delhi)jennyeacort
 
在线办理ohio毕业证俄亥俄大学毕业证成绩单留信学历认证
在线办理ohio毕业证俄亥俄大学毕业证成绩单留信学历认证在线办理ohio毕业证俄亥俄大学毕业证成绩单留信学历认证
在线办理ohio毕业证俄亥俄大学毕业证成绩单留信学历认证nhjeo1gg
 
8377877756 Full Enjoy @24/7 Call Girls in Nirman Vihar Delhi NCR
8377877756 Full Enjoy @24/7 Call Girls in Nirman Vihar Delhi NCR8377877756 Full Enjoy @24/7 Call Girls in Nirman Vihar Delhi NCR
8377877756 Full Enjoy @24/7 Call Girls in Nirman Vihar Delhi NCRdollysharma2066
 
原版美国亚利桑那州立大学毕业证成绩单pdf电子版制作修改#毕业文凭制作#回国入职#diploma#degree
原版美国亚利桑那州立大学毕业证成绩单pdf电子版制作修改#毕业文凭制作#回国入职#diploma#degree原版美国亚利桑那州立大学毕业证成绩单pdf电子版制作修改#毕业文凭制作#回国入职#diploma#degree
原版美国亚利桑那州立大学毕业证成绩单pdf电子版制作修改#毕业文凭制作#回国入职#diploma#degreeyuu sss
 
group_15_empirya_p1projectIndustrial.pdf
group_15_empirya_p1projectIndustrial.pdfgroup_15_empirya_p1projectIndustrial.pdf
group_15_empirya_p1projectIndustrial.pdfneelspinoy
 
Business research proposal mcdo.pptxBusiness research proposal mcdo.pptxBusin...
Business research proposal mcdo.pptxBusiness research proposal mcdo.pptxBusin...Business research proposal mcdo.pptxBusiness research proposal mcdo.pptxBusin...
Business research proposal mcdo.pptxBusiness research proposal mcdo.pptxBusin...mrchrns005
 
Pharmaceutical Packaging for the elderly.pdf
Pharmaceutical Packaging for the elderly.pdfPharmaceutical Packaging for the elderly.pdf
Pharmaceutical Packaging for the elderly.pdfAayushChavan5
 
cda.pptx critical discourse analysis ppt
cda.pptx critical discourse analysis pptcda.pptx critical discourse analysis ppt
cda.pptx critical discourse analysis pptMaryamAfzal41
 
shot list for my tv series two steps back
shot list for my tv series two steps backshot list for my tv series two steps back
shot list for my tv series two steps back17lcow074
 
PORTAFOLIO 2024_ ANASTASIYA KUDINOVA
PORTAFOLIO   2024_  ANASTASIYA  KUDINOVAPORTAFOLIO   2024_  ANASTASIYA  KUDINOVA
PORTAFOLIO 2024_ ANASTASIYA KUDINOVAAnastasiya Kudinova
 
Unveiling the Future: Columbus, Ohio Condominiums Through the Lens of 3D Arch...
Unveiling the Future: Columbus, Ohio Condominiums Through the Lens of 3D Arch...Unveiling the Future: Columbus, Ohio Condominiums Through the Lens of 3D Arch...
Unveiling the Future: Columbus, Ohio Condominiums Through the Lens of 3D Arch...Yantram Animation Studio Corporation
 
How to Be Famous in your Field just visit our Site
How to Be Famous in your Field just visit our SiteHow to Be Famous in your Field just visit our Site
How to Be Famous in your Field just visit our Sitegalleryaagency
 
Call Girls in Ashok Nagar Delhi ✡️9711147426✡️ Escorts Service
Call Girls in Ashok Nagar Delhi ✡️9711147426✡️ Escorts ServiceCall Girls in Ashok Nagar Delhi ✡️9711147426✡️ Escorts Service
Call Girls in Ashok Nagar Delhi ✡️9711147426✡️ Escorts Servicejennyeacort
 
办理学位证(NTU证书)新加坡南洋理工大学毕业证成绩单原版一比一
办理学位证(NTU证书)新加坡南洋理工大学毕业证成绩单原版一比一办理学位证(NTU证书)新加坡南洋理工大学毕业证成绩单原版一比一
办理学位证(NTU证书)新加坡南洋理工大学毕业证成绩单原版一比一A SSS
 

Recently uploaded (20)

西北大学毕业证学位证成绩单-怎么样办伪造
西北大学毕业证学位证成绩单-怎么样办伪造西北大学毕业证学位证成绩单-怎么样办伪造
西北大学毕业证学位证成绩单-怎么样办伪造
 
Passbook project document_april_21__.pdf
Passbook project document_april_21__.pdfPassbook project document_april_21__.pdf
Passbook project document_april_21__.pdf
 
办理卡尔顿大学毕业证成绩单|购买加拿大文凭证书
办理卡尔顿大学毕业证成绩单|购买加拿大文凭证书办理卡尔顿大学毕业证成绩单|购买加拿大文凭证书
办理卡尔顿大学毕业证成绩单|购买加拿大文凭证书
 
306MTAMount UCLA University Bachelor's Diploma in Social Media
306MTAMount UCLA University Bachelor's Diploma in Social Media306MTAMount UCLA University Bachelor's Diploma in Social Media
306MTAMount UCLA University Bachelor's Diploma in Social Media
 
Top 10 Modern Web Design Trends for 2025
Top 10 Modern Web Design Trends for 2025Top 10 Modern Web Design Trends for 2025
Top 10 Modern Web Design Trends for 2025
 
Call Us ✡️97111⇛47426⇛Call In girls Vasant Vihar༒(Delhi)
Call Us ✡️97111⇛47426⇛Call In girls Vasant Vihar༒(Delhi)Call Us ✡️97111⇛47426⇛Call In girls Vasant Vihar༒(Delhi)
Call Us ✡️97111⇛47426⇛Call In girls Vasant Vihar༒(Delhi)
 
在线办理ohio毕业证俄亥俄大学毕业证成绩单留信学历认证
在线办理ohio毕业证俄亥俄大学毕业证成绩单留信学历认证在线办理ohio毕业证俄亥俄大学毕业证成绩单留信学历认证
在线办理ohio毕业证俄亥俄大学毕业证成绩单留信学历认证
 
8377877756 Full Enjoy @24/7 Call Girls in Nirman Vihar Delhi NCR
8377877756 Full Enjoy @24/7 Call Girls in Nirman Vihar Delhi NCR8377877756 Full Enjoy @24/7 Call Girls in Nirman Vihar Delhi NCR
8377877756 Full Enjoy @24/7 Call Girls in Nirman Vihar Delhi NCR
 
原版美国亚利桑那州立大学毕业证成绩单pdf电子版制作修改#毕业文凭制作#回国入职#diploma#degree
原版美国亚利桑那州立大学毕业证成绩单pdf电子版制作修改#毕业文凭制作#回国入职#diploma#degree原版美国亚利桑那州立大学毕业证成绩单pdf电子版制作修改#毕业文凭制作#回国入职#diploma#degree
原版美国亚利桑那州立大学毕业证成绩单pdf电子版制作修改#毕业文凭制作#回国入职#diploma#degree
 
group_15_empirya_p1projectIndustrial.pdf
group_15_empirya_p1projectIndustrial.pdfgroup_15_empirya_p1projectIndustrial.pdf
group_15_empirya_p1projectIndustrial.pdf
 
Business research proposal mcdo.pptxBusiness research proposal mcdo.pptxBusin...
Business research proposal mcdo.pptxBusiness research proposal mcdo.pptxBusin...Business research proposal mcdo.pptxBusiness research proposal mcdo.pptxBusin...
Business research proposal mcdo.pptxBusiness research proposal mcdo.pptxBusin...
 
Pharmaceutical Packaging for the elderly.pdf
Pharmaceutical Packaging for the elderly.pdfPharmaceutical Packaging for the elderly.pdf
Pharmaceutical Packaging for the elderly.pdf
 
Call Girls in Pratap Nagar, 9953056974 Escort Service
Call Girls in Pratap Nagar,  9953056974 Escort ServiceCall Girls in Pratap Nagar,  9953056974 Escort Service
Call Girls in Pratap Nagar, 9953056974 Escort Service
 
cda.pptx critical discourse analysis ppt
cda.pptx critical discourse analysis pptcda.pptx critical discourse analysis ppt
cda.pptx critical discourse analysis ppt
 
shot list for my tv series two steps back
shot list for my tv series two steps backshot list for my tv series two steps back
shot list for my tv series two steps back
 
PORTAFOLIO 2024_ ANASTASIYA KUDINOVA
PORTAFOLIO   2024_  ANASTASIYA  KUDINOVAPORTAFOLIO   2024_  ANASTASIYA  KUDINOVA
PORTAFOLIO 2024_ ANASTASIYA KUDINOVA
 
Unveiling the Future: Columbus, Ohio Condominiums Through the Lens of 3D Arch...
Unveiling the Future: Columbus, Ohio Condominiums Through the Lens of 3D Arch...Unveiling the Future: Columbus, Ohio Condominiums Through the Lens of 3D Arch...
Unveiling the Future: Columbus, Ohio Condominiums Through the Lens of 3D Arch...
 
How to Be Famous in your Field just visit our Site
How to Be Famous in your Field just visit our SiteHow to Be Famous in your Field just visit our Site
How to Be Famous in your Field just visit our Site
 
Call Girls in Ashok Nagar Delhi ✡️9711147426✡️ Escorts Service
Call Girls in Ashok Nagar Delhi ✡️9711147426✡️ Escorts ServiceCall Girls in Ashok Nagar Delhi ✡️9711147426✡️ Escorts Service
Call Girls in Ashok Nagar Delhi ✡️9711147426✡️ Escorts Service
 
办理学位证(NTU证书)新加坡南洋理工大学毕业证成绩单原版一比一
办理学位证(NTU证书)新加坡南洋理工大学毕业证成绩单原版一比一办理学位证(NTU证书)新加坡南洋理工大学毕业证成绩单原版一比一
办理学位证(NTU证书)新加坡南洋理工大学毕业证成绩单原版一比一
 

Usability Testing: Making it fast, good, and cheap

  • 1. Usability testing Making it fast, good, and cheap Whitney Quesenbery Center for Civic Design @civicdesign | @whitneyq #DotGovDesignConf 27 March 2015
  • 2. What can you learn from a usability test? And how you can make it a useful part of your work.
  • 3. Do you think this is usability testing? Photo: www.unic.com
  • 4. Usability testing can also look like this Photos: UXBlog.com
  • 5. What makes it a usability test? We observe people's behavior Quietly And use the results to inform design
  • 6. What do you want to learn? Do people understand how to fill in a form? Qualitative  relationship  mental models  context of use but also  how many people have different understandings Which design helps people fill in the form accurately? Quantitative  how many like each  number of errors  severity of errors but also  insights into the source and nature of the errors
  • 7. The recipe for a usability test Location and context formal informal Participants defined opportunistic Technology yours theirs Activities instructed tasks free tasks Goals usable useful Results quantitative qualitative
  • 9. Participants: How will you find them Convenience Purposeful Quota
  • 10. Participants: Not just demographics Attitude (motivation, emotion, persistence, optimism, tolerance for frustration) Aptitude (knowledge, expertise, habits, skills) Ability (physical and cognitive attributes) http://www.slideshare.net/danachisnell/character-creator
  • 11. Asssistive Technology: Refreshable Braille, mouth stick, screen reader, magnifier, iPad (Glenda Watson Hyatt Technology: Diversity of devices
  • 12. Tasks: Think about the 5 Es Effective Efficient Engaging Error-tolerant Easy to learn and don't forget delight
  • 13. Let's talk What are you working on? What do you want to learn about usability?
  • 17. Think about cadence Seeing the Elephant: Defragmenting User Research by Lou Rosenfeld http://alistapart.com/article/seeing-the-elephant-defragmenting-user-research
  • 18. Rocket Surgery First Fridays @ DigitalGov  3 participants; 35 minute sessions  Debrief over lunch to identify the 3 most serious problems  Site stakeholders agree in advance to work on recommendations within one month. www.digitalgov.gov/resources/digitalgov-user-experience-program/ www.sensible.com/rsme.html
  • 19. What about the Paperwork Reduction Act? https://www.digitalgov.gov/files/2014/01/PRAPrimer_04072010-2.pdf
  • 20. Fast Track Clearance for PRA When the data collection  Is focus on improving services  Is voluntary  Does not require statical rigor  Does not put high burden on participants  Will not be published as quantitative, generalizable data http://www.digitalgov.gov/resources/digitalgov-user-experience-program/digitalgov-user- experience-program-usability-starter-kit/
  • 21. Take any opportunity for a quick usability observation The next time someone asks you a question about your site, ask them to use it instead. Watch as they try to find the information.
  • 22. Just do it Fast – small, frequent Good – insights you need Cheap –informal methods
  • 23. Get in touch! Whitney Quesenbery whitneyq@civicdesign.org @whitneyq civicdesign.org @civicdesign