Simulated Field Test
The objective of the Simulated Field Test is for the participants to gain experience with the tech, and to test its function on commonly used devices and within the social networks of the local context. For this activity you will test a technology among a collective group of people for an extended period of time.
Desired Outcomes:
Opinions on the viability of the tech in the local context
This section will teach you how to write a test plan, simulate the reality of a shutdown, and document results.
Write a Field Test Plan
Overview of steps:
Set the goal
Form a task list
Decide how to simulate an outage
Create a survey form for documentation
Prepare instructions
Onboard focus group participants
Set the Goal
Let’s learn how to write a test plan for tech you’re considering for your Go Bag. First, you will write down the goal of the person you want to empower with the tech. Answer the following questions.
Why did you choose this tech?
Who do you want to empower with this technology? What will it help them achieve? Which goal or need do they have (or will they have during an internet outage)?
What limitations might they have due to their environment (network, device, physical surrounding)?
From the simple set of questions above and the conversation it sparks, you will now be able to define the user goal for the field test.
Here's an example: I [an election monitor] want to be able to take pictures of election monitoring stations to gather evidence. I need to transmit these pictures to my team without relying on WhatsApp because it will likely be blocked.
Form a Task List
Next, you will form a task list. This is a list of ordered steps that will be required of the user, by the current technology that’s being tested, in order for the user to achieve their goal. This list will be used as an outline for testers to document their experience. It is not meant to be a prescription of steps for them to follow. You can form this list a couple of different ways.
Install the app, and with the goal of the user embodied, walk through the steps that you think would be required to accomplish the goal.
Review the latest documentation of the app to get insight into the steps that you think would be required to accomplish the goal.
To form your list, write down each step. Refer to the outline below as an example of the level of granularity to capture:
Learn about the app
Install the app
Register or setup contacts or storage
Choose privacy and security settings
Take pictures
Send pictures to relevant team members
In the Field Test plan you share with participants, you will include the goal and survey form to capture how people rate the ease of achieving their goal.
Decide How To Simulate an Outage
Next, you’ll need to decide how to simulate an internet outage and testing scenario. There is both a social and technical element to simulate. So, the simulation will vary depending on the tech being tested.
Social
For example, if you’re testing peer-to-peer solutions that require people to be within proximity of each other, your simulation will involve group meetups. If you’re testing solutions that enable communication or information exchanges outside of geographical limitations, you may encourage people to test often in day-to-day life.
Technical
To simulate the technical element of an internet blackout, simply disable the wifi and data connection on your phone. Please note that if you go into airplane mode, SMS will not work. Some tools you will be testing may rely on SMS.
In the Field Test plan you share with participants, you will include instructions on how to simulate an outage.
Prepare Materials
Prepare a Field Test plan to share with participants. In it, include:
The assignment with the goal and how to simulate the outage
A survey form with instructions for documenting feedback: Using a survey form is an easy way to collect raw information in one place. You can use this information when facilitating the discussion for the tech review. This information can also be synthesized and shared with the team behind the tech.
Sample
Participants were asked to add their notes and ratings to this form: https://blocksurvey.io/swob-first-use-RlFtnMYDSWGXja44RBeZTQ?v=o
Once your materials are ready, you're now ready to start the field test!
Deploy the Field Tests
Have the participants field test at the same time for a set time period of 1-3 weeks. If the tech being tested requires everyone to be in the same room, schedule workshop time to run the social simulation.
While they go through the initial steps of setting up the technology, ask them to rate their experience and write down notes in a survey form. After the field test is complete, your next step is to write a tech review.
Last updated