Testing with medical Students 21st Feb

[martinbagshaw]

My notes:

Testing with a medical student. Our user put himself in the shoes of an elderly user, assuming a low level of computer literacy.

Initial Actions when navigating

1. Goes to basic info form, fills it in
2. Confused by the yes / no button - consent to use data to search. Clicks no after adding data
3. Scrolls through results, takes a while to click in to a result to view it in more detail

Comments / feedback from the student:

The User

• Most likely will be old, assumed small visual things (such as button toggling not being obvious enough) will confuse them
• Dropdown filter could be more explicit - e.g. 'recruiting' or 'not recruiting'
• Some stuff is very obvious from a Doctor's perspective, but perhaps not the patient - e.g. a patient may not know about the trial phase
• Could make the FAQ more obvious - e.g. call it 'more info'. People may not know the acronym.

Menu

• Not clear this is a menu on desktop - ellipsis is unfamiliar

Back Button Functionality

• Save filters when going back to results list from a single view
• Also save position in the page

Copy Tweaks (and API result filtering)

• FAQs - shorten the summaries to make them easier and more pleasant to read
• Change title of FAQs page - not everyone knows the acronym
• Filter out unrelated keywords - e.g. 'Ovarian Cancer'
• May not know what a PDF is on the single view. 'Download Trial Information' may be more appropriate

Styling Tweaks

• Line height is a bit small on mobile for result cards - mainly due to no results labels
• Make it more obvious that the pdf download button is clickable

Other Features some dependent upon adding more information to the API

• Adding distance / time to a trial would be useful
• Recently viewed / bookmarks / flagged / wishlist would be good
• Popout to FAQs in results view could be useful - help people to understand the jargon
• Print out list of bookmarks
• Ability to search by Doctor / Consultant / PI / Investigator would be good
• Interventional Trial important to know
• Subtype would be a good filter (more for Doctors)
• Side effects could perhaps work in a dropdown on the single view (they are lengthy though)

[zurda]

User testing with James:

• Missed the consent button, and when we pointed it out said he didn't notice it. He said: "If I missed it - an elderly man would be sure to miss it. It should be clearer which is clicked (yes/no)".
• James referred to the age group the app is directed at, and said there are a few visual queues that an older person might miss:
  -- "Save as PDF" (they might not know what PDF is)
  -- Menu button is easy to miss. Should say "Menu"
  -- Recruiting trials should say "Currently recruiting"
  -- "FAQ": an elder person might not know what FAQ means, so either have the answer to the question on the card OR call the FAQ page differently
  -- Layout of information could be clearer. James referred to the about page, and the FAQ page, and said that it's important to separate into paragraph to help the patient
• When navigating to another page, it's a shame that the filter option (recruitment: any/ recruiting) isn't saved. James kept navigating back to the page, and had to change the filter every time since the data was lost in navigation
• "Male" search results shouldn't show female diseases (ovarian cancer, breast cancer)
• Consider adding the doctor name to each trial
• Consider adding a bookmark/ wish list to save selected trials to browse later
• Like the color scheme, logo, layout
• Consider adding a dropdown list of trial criteria
• Consider adding distance or just show nearby trials
• Found typo in homepage
• Would be useful to have the subtype of the disease for better results, however, not all patients have this info.
• Summary should be a few lines, since it could be filled with jargon

[susanX]

Mobile view

Splash page
likes the blue colour
Use a capital on the first letter of a sentence only.
Have an image
Likes the hover effect on buttons
Have only one button and one choice to route, not the view all trials.
Have view all trials only in the menu as it is currently.
Have an intro statement 'Help find best possible trial

Basic Info page
Start with a friendly intro
Hi, we would like to collect some basic info to match you to a trial.

Have only one question per page.

Results page
Display the basic info the user has selected

Show early or late trials
On the drop down button for more filters show Intervention (with a new drug) or none intervention.
Show Phase 1 and 2 trials have side effects

As a patient would want Intervention with a drug, if they are in the last staging of cancer and looking for hope. As patient would also want a non blinded study this is where all patients receive a drug.

Liked the tick recruiting and the x not recruiting

Would like info on what you are meant to do with the trial information.
Put the Phase and summary on the read more page.

Want to be able to order trials according to user preferences.

Keep keywords minimal, not very medical looking terms.
Have the keywords clickable to search for other trail with the same keywords.
Have a save for later facility
Put trials in a shopping cart like interface to save for later.

Other wants
Chat box help 24 hr
Map of where all the selected trials are and home address
If a trial is life saving show trails at greater distances.
Take into account the frequency of visits required to a clinic.

Output
Output a condensed list of selected trial info to print and either for the patient to follow up or to take the a doctor. Include name, contact address, phone and email of clinic contact.
Let the use select the number of trials to print details of. This could be about 10.

Q and A
Explain what is a trail
Write the questions and answers to be clearer.

Tester Feedback Summary
He found the app clear and simple
not user friendly enough
wants more customisation

[susanX]

Mobile view

Splash page
likes the blue colour
Use a capital on the first letter of a sentence only.
Have an image
Likes the hover effect on buttons
Have only one button and one choice to route, not the view all trials.
Have view all trials only in the menu as it is currently.
Have an intro statement 'Help find best possible trial

Basic Info page
Start with a friendly intro
Hi, we would like to collect some basic info to match you to a trial.

Have only one question per page.

Results page
Display the basic info the user has selected

Show early or late trials
On the drop down button for more filters show Intervention (with a new drug) or none intervention.
Show Phase 1 and 2 trials have side effects

As a patient would want Intervention with a drug, if they are in the last staging of cancer and looking for hope. As patient would also want a non blinded study this is where all patients receive a drug.

Liked the tick recruiting and the x not recruiting

Would like info on what you are meant to do with the trial information.
Put the Phase and summary on the read more page.

Want to be able to order trials according to user preferences.

Keep keywords minimal, not very medical looking terms.
Have the keywords clickable to search for other trail with the same keywords.
Have a save for later facility
Put trials in a shopping cart like interface to save for later.

Other wants
Chat box help 24 hr
Map of where all the selected trials are and home address
If a trial is life saving show trails at greater distances.
Take into account the frequency of visits required to a clinic.

Output
Output a condensed list of selected trial info to print and either for the patient to follow up or to take the a doctor. Include name, contact address, phone and email of clinic contact.
Let the use select the number of trials to print details of. This could be about 10.

Q and A
Explain what is a trail
Write the questions and answers to be clearer.

Tester Feedback Summary
He found the app clear and simple
not user friendly enough
wants more customisation