Diary Study

Diary

Study

Time

7-30 Days

Difficulty

🕹

Hard

Materials

📦

App or tool to record and share entries

Incentives for participants

People

🕴

1+ Researchers

5+ Users

Overview

Diary studies are a contextual research methodology used to capture user behaviors, activities and experiences over a certain length of time. A diary study offers insights into participants lives, collect intimate qualitative insights outside of a “formal” research setting, and one of the best methods to capture data in the moment and in context.

What

  • Observing the User Experience cites four main types of diary studies.
  • Usage diaries: Document specific moments of interaction with a product or service. Examples include a website, restaurant, ATM, etc. Interactions can be organic—activities the participant would normally do—or activities that you specify.
  • Spotter diaries: Identify where and how the presence of companies, products, or services matter in people’s lives. Spotter diaries map the place of these objects int he broader context of people’s lives.
  • Process/purchase diaries: Follow activities that unfold over time and space. They involve longer narratives, such as buying a car.
  • Behavior diaries: Exploratory in scope. Behavior diaries examine a range of activities or objects that comprise a specific topic. An example would be how participants deal with money—tools and activities of earning, spending, and saving.

Why

Diary studies are a “poor man’s field study,” allowing researchers to “be there” without actually having to be there. It also can minimize the bias of “over-the-shoulder” observation. Diary studies allow researchers to capture natural behavior one wouldn’t necessarily provide in a moderated study or behavior that may only present itself in certain contexts (i.e. asking a user about their finances in an interview compared to on pay day may lend an entirely different response).

When might a diary study be a good fit?

  • You’re curious about micro-moments and interactions that affect “big decision making.”
  • You want to see a diversity of experiences, and learn how behaviors or perceptions change.
  • You’re worried direct observers would influence behavior.
  • You want to know more about what motivates someone to act.
  • You want to know about behaviors that happen sporadically.
  • You want to reach more sensitive populations, where direct observation isn’t an option.
  • You are busy.
  • You don’t have a budget for an onsite field study.
  • You want a straightforward way to make an impact with your stakeholders.

When you should consider a different methodology?

  • You have a more straightforward usability question.
  • You need insights, like, yesterday.
  • You have a (very) limited budget for recruiting or won’t be able to find enough participants.

Step 1 Prepare & Refine

  • Define your research questions so they work well within a diary structure
  • Set start and end dates
  • Choose a method for logging
    • Physical diary
    • DIY a method your users are already using (Workfront, Facebook, Slack, Email, PACO, etc.)
    • Use a tool made specifically for this type of research
  • Be strict about who you recruit
  • Pick out props or stimuli (Some teams ask participants to “imagine they have a magic button” they can press every time they need something)
  • Ask participants to send more than just text artifacts such as videos, photos, screenshoots, anything that helps tell the story
  • Decide how participants will log
    • Interval-contingent protocol (i.e. every 3 hours during their workday)
    • Event-contingent protocol (i.e. when they get distracted, enter a meeting, or receive a new notification)
    • Signal-contingent protocol (i.e. some set of set alarm or notification of when they should log)

Step 2 Ready your participants

  • Schedule an onboarding session to set expectations
  • Create a cheat sheet (who to contact, when to log, etc.)
  • Share rewards structure (diary studies are a lot of work and participants should be paid for their time)

Step 3 Log and Process

  • Frequently communicate with your participants
  • Send reminders
  • Provide guidance
  • Acknowledge entries coming in

As data comes in…

  • Take notes
  • Transcribe videos or audio entries
  • Write any follow-up questions

Step 4 Follow-up and Learn More

  • Schedule follow-up interviews with your most engaged participants
  • Ask for participant feedback
  • Turn your qualitative data into quantitative data with follow-up surveys, usability tests, A/B tests, etc.

Step 5 Analyze and share

  • Synthesize the data
    • Create a summary of findings
    • Tag like-items to find patterns (i.e. “distracting” or “hard” were common terms used)
  • Share insights with stakeholders

Resources

None

Tools

Diario

Designed for daily diaries and experience sampling. Uses SMS technology to deliver links to online surveys, which they design for you. German company.

https://www.cloud-solutions.net/en/

nEMA

Mobile Ecological Momentary Assessment; designed for experience sampling research. Sophisticated platform can be integrated.

http://mobileema.com/

Survey Signal

Designed for experience sampling. Uses SMS technology to deliver links to online surveys using ESM sampling protocols. Used in combination with online survey platform such as SurveyMonkey or Qualtrics.

http://www.surveysignal.com