Project meetings

Each project group, please sign up for a meeting with me.

Interviewing

Usability Testing Interviewing

Usability testing interviewing is simpler than ethnographic interviewing, but shares many principles.

Rubin, Jeffrey, Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests. Wiley, 1994   Chapter 7, Chapter 8.  If you have the book, read ch.9, too.

(This book is worth buying — a classic — get the new edition, 2008.)

The new edition out and  sample forms and scripts are online:

Chapter 08: Session Forms
Session Script: Example A Session Script
12.78 KB HTTPFTP
Chapter 08: Session Forms
Pre-Test Forms: Guidelines for Observers
7.56 KB HTTPFTP
Chapter 08: Session Forms
Consent Form: Recording Permission
7.13 KB HTTPFTP
Chapter 09: Test Preparation
Testing Preparation Checklists
3.94 KB HTTPFTP

Interviewing, General

Slides from Spring, 2010 — Very thorough; we’re not going to go over all this in class but you MUST know this material to be a good interviewer.

Video Getting People to Talk: An Ethnography & Interviewing Primer: very useful. Well worth the time.

Done by IIT Institute of Design.  Interviews with people who do ethnographic interviews for human-centered design.  You have to get past the intro on-the street interviews  — I can’t imagine anyone in Berkeley being willing to do these interviews, given how many people on the street here want money, signatures on petitions, and the like.

Note also the variability in sound quality and where and how they place some interviewees.  They make some pretty basic mistakes.

I don’t recommend making people sing and cry.

Irving Seidman, Interviewing as Qualitative Research: ch. 6, Technique Isn’t Everything, But It Is a Lot. This is a good reading to start with. Basics.

Robert S. Weiss, Learning from Strangers – The Art and Method of Qualitative Interview Studies, New York: The Free Press, 1994.  Readings are long because they include long excerpts from interview transcripts.

Chapter 3 – Preparation for Interviewing
Chapter 4 – Interviewing – Part 1
Chapter 4 – Interviewing – Part 2 – Examples of Interviewing
Chapter 5 – Issues in Interviewing

Ethnography and Contextual Inquiry

ETHNOGRAPHY IN INDUSTRY: OBJECTIVES? BY VICTORIA BELLOTTIPARC / JUNE 1ST 2010  UX Magazine

Forsythe, Diana E. (1999) “It’s Just a Matter of Common Sense”: Ethnography as Invisible Work. Computer Supported Cooperative Work (CSCW) 8:1,  pp.127-145

Beyer, H. and Holtzblatt, K. Contextual Design: Defining Customer-Centered Systems. San Diego: Academic Press, 1998. Chapter 1 – Introduction

We are not going to study contextual inquiry/contextual design per se, but it’s a method people talk about.  The term “contextual inquiry” has become a more generic term for field-based observation, rather than a label for Beyer and Holtzblatt’s method.

Blomberg, J., Burrell, M., Guest, G. An ethnographic approach to design. In Jacko J. A., Sears A. (eds.). The Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies and Emerging Applications. Lawrence Erlbaum Associates, Inc.: Mahwah, New Jersey, 2003.   Long, but classic overview of much of what we’re talking about.

David R. Millen. Rapid ethnography: time deepening strategies for HCI field research. Conference proceedings on Designing interactive systems : processes, practices, methods, and techniques. ACM, 2000.  The HCI world talks a lot about rapid ethnography; ethnographers are horrified.

Video Getting People to Talk: An Ethnography & Interviewing Primer: very useful.

Done by IIT Institute of Design.  Interviews with people who do ethnographic interviews for human-centered design.  You have to get past the intro on-the street interviews  — I can’t imagine anyone in Berkeley being willing to do these interviews, given how many people on the street here want money, signatures on petitions, and the like.

Note also the variability in sound quality and the way they place some interviewees.  NOT good!

Look at this also for interviewing.

Sample Videos

Bolt|Peters study of iPad vs iPhone

Bolt|Peters Best Buy Mobile UX Research

Bolt| Peters videos, many! On Vimeo.  Not all are videos of them following people around — some are their live remote web research, such as this one.

Google asks people: What is a browser?

Nielsen explains iPad failings — showing iPad functions in short video.

This site includes videos OF and ABOUT usability: 10 Must-See Usability Videos

Example of  a video of paper prototyping — note also the initial setup where they use still images to take you into the test site. Paper Prototype usability test by Corel Corporation

Assignment 2: Observation and Field Notes

Duped at Assignment 2 page.

The point of this exercise is to practice your observation and reporting skills.

  • Park yourself someplace where you can observe unobtrusively for at least half an hour, longer if possible. If you can, do something related to your project.
    • You want someplace where people are going to be doing things, so that you’ll have a lot to observe (but not so much that you can’t focus), and where you can watch without raising suspicion. .  Possibilities include: cafes, stores where people browse for a while (e.g., Amoeba Music), busy bus stops, Sproul Plaza, a window table in a café from which you can watch activity on the street.
  • Decide ahead of time whether there is something in particular that interests you about that situation.  But be prepared to change your ideas about what you find to be of interest once you start observing.
  • For the first 15 minutes or so, simply observe without making notes. Try to see this situation anew, as if you had just arrived from another planet. The term that’s sometimes used is “make the familiar strange.”
  • After this initial observation, decide what you are going to focsu on. It may be that which you had decided ahead of time, but it may be something that caught your attention in the course of the initial observation. You need to focus your attention.
  • Possibilities include:
    • -Pick someone engaged in some activity and follow them (in a sense – don’t freak them out).  What are they doing? What objects are they using or interacting with?
      • E.g., someone at Amoeba Music: which sections do they go to? Do they go straight for a particular set of disks, or do they wander? Do they read the backs of the disk covers? Are they with someone? If so, how do they interact with their companions?
    • -Pick a place and watch people move through it and see what they do there; e.g., people coming and going at a busy bus stop.  What do they do while they’re there?  How do they act when a bus comes into view? How do people decide who gets on first?
    • -Pick a task or activity involving multiple people — where different people perform different parts of the activity. You would follow the activity and not the individuals
      • E.g., in a café, follow a good order from when it is placed, through the preparation, to delivery to the customer.
  • Keep realtime fieldnotes. These are rough notes for yourself.  Keep distinct your facts and interpretations, in whatever way works for you. Some people divide the paper and put facts on one side, interpretations on the other. The point is to keep the facts separate from your interpretations, since your interpretations are only preliminary and may be erroneous; but not to lose any insights that arise while you are watching.
  • Do a complete write-up of your real-time notes as soon as you can afterward.  Fill out what you didn’t have time to write in the field. First simply describe without interpretation.
    • THEN add your interpretations (but still keep them distinct – for example, some people use different typefaces for observations vs analysis/interpretation; or use two columns, one for observations, one for interpretations).  These would be your notes to refer back to weeks, days, months, years later, so they have to make sense.

Then write up a brief but coherent narrative for me.

  • -What you did: where you went, how you set up to do your observation, and perhaps why you made those choices.
  • -A general description of the scene — this should give me enough to understand what you were seeing.  Diagrams and photos can be a big help.
  • -A summary of what you observed – of your factual observations.
  • -Then interpretations and conclusion about what you saw. This is more than just description, but doesn’t have to be earth shattering

Keep distinct (1) what you see, and (2) your interpretation of what’s going on.

You’ll have three products:

1. Rough notes made in the field

2. Your detailed write-up of your rough notes

3. A summary for me.

Turn in:

#3, above

A couple of pages from #2

Photos are a plus, but not required.

Due:  Tuesday, September 21.

Visual and Audio Media Resources

Updated 10/15/10

See also video making advice.


Photography

Photo Editing Tools

Photoshop family:

  • Photoshop Express Online Toolsfree online editor, organizer, and slideshows.  I don’t much like their online editor — it’s not flexible enough. But definitely easy.
  • Photoshop Express for iPhone and iPad
  • Adobe Photoshop Elements (Windows and Mac) Handles uploading, organizing, editing, and sharing  ($80 or so)
  • Adobe Photoshop Lightroom 3: Absolutely the best all arounbd resource for digital resource management and most development/editing, if you know what you’re doing. ($99 academic pricing; Mac and Windows; 30-day trial available. ASUC computer store carries it.)   LR3 can handle video from dSLRs.
  • Photoshop.  The most complex and most powerful.  Not easy, not cheap, but academic pricing is available.

Mac Preview function: to my surprise, has pretty good editing tools.

iPhoto, of course

Windows Live Photo Gallery

With Flickr.com, Facebook, Picasa, or from your own computer: Piknik

Photographic Rules of Thumb

Image resolution needed: 300 dpi for printing, 72 dpi for computer screen

Handholding the camera: most people can handhold no slower than 1/60th second. Some can go down to 1/30th.  Safest is 1/125th or above.  (If the shutter speed is too slow, camerashake will make the picture blurry.)

Rule of thirds: composition is more attractive if key elements are not centered, but 1/3 of the way from an edge.

When there are people in the picture, focus on their eyes.  That’s the part of the picture that people most care about.

When there are people in the picture, expose for their faces.  Ditto.

Size of image: despite the current discussion about how megapixels don’t matter, that’s only when you get to large numbers.  Larger image files = more pixels = you can  crop  and still have a good image.

Never ever ever use digital zoom, only optical.  Digital zoom just makes the pixels bigger.  (Most p&s cameras will do optical zoom up to a point, then zoom further with digital. Turn off the digital.)

Photographic Resources

(last updated 4/15/10 — needs to be verified and updated.  Let me know if you find broken links.)

Advice for point-and-shoot camera users:

Editing (adjusting the image):

Cameraphones

There are a LOT of iPhone apps for still images and for video.
The latest list comes from photography superstore, Adorama, which announced the winners of its first annual APPOS – iPhone App Awards for Photography today. What stands out about this top photo app list is that the winners were chosen from apps that avid iPhone photographers actually use. You see, Adorama also ran an iPhone photography contest that drew over 17,000 image submissions. A panel of judges then selected the top 10 iPhone apps from among the apps that were most frequently used to create the 17,000 images. The six judges included acclaimed photographers, journalists, photojournalists, and oddly, sports radio show hosts.

Audio

Free (and pretty good) audio editing software: Audacity Mac and Windows

Recording phone calls using Google Voice — the major limitations: they have to call you, doesn’t work when you call them.

Slideshows: Images and Sound

iPhoto

http://soundslides.com/ — pretty good. Windows and Mac.   Free demo.  $40 basic; $70 pro.

Video

Added 10/14/10 Free and Open-source Vertov:

As of 10/15/10 the current version of Vertov is not compatible with the current version of Zotero.

Vertov is a free media annotating plugin for Zotero, an innovative,
easy-to-use, and infinitely extendable research tool. Both are Firefox
extensions. Vertov allows you to cut video and audio files into clips,
annotate the clips, and integrate your annotations with other research
sources and notes stored in Zotero.

http://digitalhistory.concordia.ca/vertov/

iMovie

Windows Live Movie Maker

Jaycut – see Lifehacker description.  Web, free.

Class Email as of 9/2/10

Student Name Email Address
BAKER,LINDSAY ALANA lindsay_baker@berkeley.edu
CACCAVO,COURTNEY COURTNEYCACCAVO@AOL.COM
FUENZALIDA ROJAS,DENNIS SEBASTIAN SEBASTIAN.FUENZA@GMAIL.COM
FUGE,MARK DARRYL mark.fuge@berkeley.edu
HAAS,AMY JO GEMINI.AMY@GMAIL.COM
HSUEH,MICHAEL mhsueh@berkeley.edu
HUANG,KEVIN BALWEY khuang@berkeley.edu
HULL,JACKSON ROBIE jackson.hull@berkeley.edu
HUYNH,KEVIN CHRISTOPHER kevinhuynh@berkeley.edu
JINDAL,TANUSHREE tj@ischool.berkeley.edu
KO,PEI-YI peiyiko@berkeley.edu
KRISHNAMURTHI,NIRANJAN niranjan@ischool.berkeley.edu
LIAO,YUAN-YU kristy@berkeley.edu
LIM,MELISSA NICOLE melissalim@berkeley.edu
NARULA,PRAYAG prayag@ischool.berkeley.edu
PENNY,CHRISTEN JOY cpenny@berkeley.edu
REID,JASON IRA jasonreid@berkeley.edu
SEXTON,MASON mason_sexton@mba.berkeley.edu
SHANKAR,NAMITTA namitta@berkeley.edu
SHAPIRO,SCOTT AARON scott_shapiro@mba.berkeley.edu
SMITH,BAILEY RYAN BAILEY.R.SMITH@GMAIL.COM
TAMADDON,SAGHAR IRANZADEH saghar@berkeley.edu

Projects Looking for Collaborators

LiveScribe for note-taking for students with disabilities: NVH

Jason Reid – exoskeleton

Sanghar Tamaddon – green directory

Sebastián Fuenzalida  – gaming

Mason Sexton –  moonit.com

Survey Resources


Readings

Kuniavsky, ch. 11

There are lots of resources (online and published) on survey research generally. Here are some suggestions.  Most emphasize some aspects more than others — at least skim all of them, so that you can pick up from each what it covers more thoroughly than the others do:

Research Methods Knowledge Base: Survey Research.  You’ll see lots of similarities to interviews, but some important differences.

University of Reading Statistical Services Center, Guidelines for Planning Effective Surveys. This one has less on question construction than the above but more on other surveying issues.

Statnotes, Survey Research.  Especially good on design considerations and item bias.  Also good FAQs.

Questionnaires in Usability Engineering: FAQs (3rd ed)

Added 10/13:

The Pew Internet and American Life project is in many ways the gold standard of doing internet-related survey research — not online but via phone, where the sample is more controlled and they can reach non-users.  I don’t find a good discussion of their methods for this project, but this web page describes their methods for another project, The Pew Research Center for the People & the Press.

The kinds of surveys done in UX are nowhere near this elaborate, but are in some ways low-effort approximations of the more elaborate and statistically-valid surveys conducted by organizations like Pew.

Look in particular at this page on questionnaire design and this page on survey administration.

Analyzing survey results

University of Reading Statistical Services Center,  Approaches to the Analysis of Survey Data

Optional and Useful:

Free Survey Software

There are many.  Be sure you check their limits on free or trial use — not just # of questions and respondents, but what sort of data analysis they do, and/or whether you can download data to Excel.

surveymonkey.com

zoomerang.com

polldaddy.com

Questionnaires: Sources of questions and examples of questions (and data analysis)

Large-scale surveys from reputable sources can be great sources of question wording, when they ask questions you need to ask.  Presumably such a source will have done an adequate job of developing and testing questions. A survey of a population similar to yours can be a particularly source of questions on demographics.

Even when they don’t ask questions useful to you, looking at good models can help your own survey development.

Their reports may be even more helpful — showing good ways to summarize and present survey data.

Pew Internet and American Life project publishes their surveys. If they have written a question that works for you, use it!  Also, by seeing how carefully they word questions and answers you get a sense of the kinds of problems in question wording that they had to deal with (which may help you think about your questions).

A recent example of their work –  Online News Survey

UC Berkeley survey of new undergrads – unfortunately, doesn’t address technological capabilities and experience.

Smithsonian -ForeSee Survey —  You’ll see this company’s slight-customized surveys on a lot of websites.

Very simply website usability survey from Underage Drinking Enforcement Training Center – as an example

Reports

UC Berkeley survey of new undergrads The reports presented here are minimal.  They summarize findings for entire respondent pool; don’t break down by subgroups. Don’t compare years.

Pew Internet and American Life project Their reports tend to be for a popular audience, so don’t always have the detail needed, but they’re good at summarizing key findings.

« Previous Page