I’m going to use the LearnSoftware app as an example.
For this application, I may ask the test user to perform a specific action given a prototype or the application itself.
For example, I may ask them to complete one of the following:
Once I ask the scenario, I sit back and take notes. I try not to react or influence the decision at all to bias their actions. If they ask me a question, I try to deflect it and say “What do you think?”. I don’t answer, but I take notes. If they are really stuck, I note that and may help them.
You’re looking for things that work well, but more importantly you want to note the things that don’t work well.
Given the raw notes from the session (which will be long and messy!), I would then summarize them and derive learnings from them. Next, I would update my roadmap with the learnings in mind.
This can be a paper prototype, a Figma Doc, a static HTML website, or anything else. See this page
Be sure to give a copy of the prototype in as part of the assignment.
It can be useful to record the session. Obtain permission first from the participant.