I designed four tasks and objectives for the participants to complete. Using www.random.org, each user was randomly assigned a participant number and completed the test in different orders for counter balance.
Task One: Sync Page
Objective: Do users prefer to auto or manually sync their apps with MultiManager? Can the user sync manually without difficulty?
Scenario: A classmate/co-worker recommends trying MultiManager. The user creates an account, goes through the tutorial, which opens by default for first-time users and lands them on the Sync page.
Highlights: All users clicked "skip" to bypass the tutorial, preferring to learn the UI as they go. Also, despite the recommendation for "auto sync" participants #2 and #3 preferred to sync their apps manually. A fix I made to the Manual Sync, per user feedback, was to allow users to select multiple apps rather than one at a time from the 1st iteration. Lastly, I implemented functionality suggested from expert opinion, professor Karen Doty, who suggested I enable the system to recommend apps to sync based on prior activity.