international students who don't speak English as a first language have to sort out health insurance over the phone, in real time. we designed a study to find where The New School's One Stop phone line fails them.

a phone call gives callers nothing to reread. insurance terms arrive in English, live, and the menu decides where you end up.
with two classmates, i designed a three-method study: watch real calls, survey people before and after, and break the call into steps. i wrote the recruitment, ethics, and analysis plans.
a study the center can run with 20 students, and three changes it can make right away.
1 in 3students at The New School is international. 3,750+ people from 100+ countries.
on the phone, all of this happens in English, live, with no screen to reread.
observers watch the call live from another room, and it is recorded. no one sits in with the caller. they note:
a teammate who is an international student called the line with a real question and wrote down every step. most steps are routine. the three highlighted ones depend on English. this kind of step-by-step breakdown is called a GOMS analysis.
what we expected: the harder English is for a caller, the more likely they get stuck at the last step and have to ask for the answer by email instead.
each caller rates eight things from 1 to 5:
then open questions about language on the call and how their cultural background shaped it. answers are grouped by theme.
17 pages · fall 2023 · user group, methods, the GOMS draft, recommendations, the consent form, and the survey