Using cutting-edge technology to create a remote physical therapy experience

Product design • physio24 (via Hyper Island)

project overview

Physio24, a thriving, forward-looking physical therapy practice, wanted to create an app that would:

  • impress existing and potential investors by expanding their practice to the digital dimension
  • empower patients to manage their recovery process

They wanted to explore innovative technologies like AR, voice UI, and motion capture, in features like a gamified PT program, tracking dashboards, and self-reporting.

I completed this project as a student in Hyper Island’s UX Upskill program.

results

I designed and prototyped an iOS app that allows the user to fit prescribed exercises into their schedule and context of use while building bodily awareness that can prevent future injuries.

I was one of 3 students selected to present this work to the real client, NotYourAveragePhysio.

my contributions

Product design
UI design
Design system
Advanced prototyping in ProtoPie

Timeline: 6 weeks, 2024
this should be an image of one or more of the final screens, or a link to an interactive prototype

discover & define

I started by mapping out the as-is user journey for a provided persona, Anara. Anara represented a tech worker in her mid-20s,  who had gotten a sport injury and was seeking physical therapy she could fit into her busy schedule.

I based the stages of service on my past experiences with physical therapy, remembering my high and low points and reflecting on how things would be similar or different for Anara, and giving extra attention to the areas that overlapped. The user journey map would show that I could address many of the business goals and user pain points by working with the at-home therapy session. What would it look like, and what role would advanced technologies play?

user journey map

A user journey map showing the as-is experience of in-person physical therapy, covering the first session and follow-up sessions as separate sections. Opportunities are identified in each stage and highlighted in the next section.

selected opportunities

essential feature

Focus on 1-on-1 activities (manual adjustments, teaching new techniques) or special equipment use, during intermediate sessions, and let users do the rest at home.

hard to scan

Help patients create a habit around physical therapy at home and remind them of sessions

hard to find what you're looking for

Track space and equipment required for each technique and match it to what the user has available. Allow user to filter or select alternatives

supplemental data access is clunky

List or library of assigned exercises and treatments with instructions, video, and tools to reinforce correct technique

exploring technologies

I then did some desk research. I looked into physical therapy in general: how could plans be adapted to fit into Anara's busy schedule? What makes a successful PT session? How do therapists measure progress?

I also analyzed some of the competition. I looked at apps across the fitness, health, and wellness spaces, looking at features, design patterns, level of interactivity, and approaches to XR. I also completed workouts in two apps and analyzed the successes and failures of each.

competitive analysis

this should be an image of one or more of the final screens, or a link to an interactive prototype

narrative exercise

Having analyzed the as-is experience, now I began to explore how it could be improved through technology. Some kind of AI coach? A fully voice-driven experience based on flawless natural language processing? To explore this, I created an extremely blue-sky task flow, then crafted it into a narrative dialog between Anara and the app.

This process helped me to:

  • continue to empathize with the representative user and consider her context of use
  • find opportunities to optimize the workflow, and consider what an “at-home session” entailed
  • find the drawbacks of using the most technologically advanced approach, and see where lower-tech solutions might work better
  • picture pain points to address in the next steps

defining the problem

Based on the research & narrative exercise, I began designing, eventually prototyping an app that would:

  • Offer flexible programs that fit into a user’s busy life
  • Provide a polished experience comparable with consumer-facing fitness apps
  • Use gentle gamification and integrated reflection to help users build good habits around both physical therapy and general wellness
  • Keep the user in control and in touch with their bodies through thoughtful, flexible implementation of new technologies
  • Actively consider and adapt to different contexts of use, especially around equipment and space

Depending on budget and timelines, this solution could be implemented using AI for natural language processing, or using more traditional methods.

design

user flow

I started with a higher-level task flow, as shown below, to explore how to integrate completing exercises with wellness and reflection. I expanded that to a more complete user flow, iterating as I sketched and designed screens.

Overview: completing at-home treatment

Complete user flow: at-home treatment session

selected screens

hard to scan

A dashboard tracks streaks to build habits, shows scheduled sessions, and provides a few alternate treatment options, usually quicker sessions with different focuses.

hard to scan

Session contents will automatically adjust if a user is missing equipment or lacking space to do certain techniques.

hard to scan

During a session, users can complete their treatment using their camera as a live mirror or with a looping video. They can choose to use voice commands and voiceover or to work silently.

hard to scan

The app collectes feedback after each exercise. This both provides valuable data to the PT and app and encourages the user to reflect and pay attention to how their body feels during each step.

hard to scan

At the end of a program, users are reminded of their upcoming sessions. At-home and in-person sessions are given equal weight, emphasizing that at-home treatments are just as important.

prototypes

Full at-home routine

Figma

Interactive prototype of full user flow, from notification through completing a program and booking the next session.

View prototype
(any device)

Exercises with voice command and live camera

ProtoPie

Perform a partial prescribed exercise program with live camera and voice commands.

Web
(voice-enabled, no camera)
Mobile
(requires ProtoPie player app)

takeaways

Smart customization can help provide a sense of care at scale

Allowing adaptations to schedule and context of use, like equipment and space, and simply helping users to keep track of which exercises and how to do them, can solve pain points in both the remote and onsite physical therapist relationship.

Integrating physical therapy/telehealth services with general wellness creates opportunities for the business and the user

Wellness content about subjects like breathwork is cheap to produce, and quick to do for the end-user — and studies show real physical and mental health benefits. Providing that content in a quality platform where the user has already established habits will be a great way to keep users coming back.

For hands-free and whole-body app experiences, voice UI is essential — but execution matters

I didn't start this experience expecting to come up with a VUI solution — I generally find voice-based systems incredibly annoying. But when your phone is propped up on a chair, voice is a game changer. I realized that I was thinking of VUI as Alexa, when really, it could be more like Yoga with Adriene, or your favorite fitness teacher, providing useful insights and reminders of technique when you really needed them.

AR fitness is fun, but can come at the cost of bodily awareness

I really enjoyed using the Fyter app, but in the days afterward, it was very clear I'd pushed a bit too hard. Focusing on kicking marks on screen as quickly as possible came at the expense of paying attention to how I was moving. AR fitness apps should be designed carefully, encouraging periods of reflection or helping to achieve the correct form as much as encouraging users to meet gamified goals.

AR calibration doesn't have to be complex

I was concerned that a mixed-reality solution would be complicated under real-world constraints, or confusing to set up. Based on the apps I tested, that doesn't have to be true. A chair and a water bottle are all that's needed to prop up a phone, and it seems that, if a user can make space to do an exercise video, they can likely make space for AR.

next steps

I was one of 3 students selected to present my project to the real client who inspired this brief, a physical therapist currently seeking funding in early 2025. We're awaiting the outcome of that fundraising to proceed.

If I were to proceed with this project, my next step would be to do some basic user testing with the ProtoPie prototype, updated with physio-designed content for a real 5-minute program.

I'm also very curious to explore the experience from the physical therapist's side. What data, and how much, would the physical therapist need to receive from the client? How should it be presented? Are there opportunities to use post-processing to show overlays or get metrics from user-submitted videos? I'm always interested in improving tools used for work, so there are dozens of interesting questions there, as well.