In this project to improve Pantheon's first time user experience (FTUE), we began with user research. Our primary user group are agencies developers building and maintaining sites for clients. We interviewed newly registered users to learn:
- Motivations for trying Pantheon
- Their product experience, especially where they encounter roadblocks.
During interviews, we learned users are motivated to try Pantheon to solve these common problems:
- Setting up the same infrastructure for every new project wastes time and non-billable hours. For example, users know developing a on live site is bad practice and can cause breakage, but there is high investment upfront to develop better by setting up things like staging environments. They often don't have time to make this investment, so they continue with the bad practice.
- Core updates for WordPress and Drupal can be a pain to apply to a site because something may go wrong, and rolling back updates that have gone wrong is even more of a pain. Users want to get unexciting and potentially stressful work like this off their plates.
- Users need a solution that is reliable. One user told us he doesn't want his client calling him in the middle of the night because the site doesn't work, so that he can get a full night's sleep. And practices like developing on a live site makes it more likely to cause this client-induced sleep deprivation.
In discussing their product experience, we identified a few common roadblocks encountered within the first few minutes:
- After creating their first site, users land on this dashboard. Users often know that the next step they need to do is install their chosen CMS and access the code repository. It's unclear how to do either of these.
2. Pantheon's isolated environments for Development and Testing are ready to be used out-of-the-box which is highly valuable, but users are unclear when and how to use each environment.
3. When users land on the site dashboard for the first time, it is likely they will be overwhelmed with all of the options to choose from - there are 30 interaction choices and no guidance. Users who have no particular task in mind are even more likely to be paralyzed.
With these learnings in mind, we prototyped several approaches to improve the first time experience for users and increase user retention in their first week. Below is a sample.
Prototype 1: Site development flow
We know that users who make a first code commit are more likely to stick with Pantheon as active users, and we know from our analytics that of all users who make at least 1 code commit, 56% do so in the first 4 days of registration. There is a sharp fall off after the first 4 days, so a user's first few days using the product is a critical time to demonstrate how they can work better.
Having identified the major, immediate roadblocks to starting site development, this prototype redesigns the flow to reduce these roadblocks. When users land on the dashboard after creating the site, there is no direction on what to do next. The prototype picks up after site spin-up to improve this:
In user testing this prototype, we observed large improvements in users understanding what to do by giving feedback when actions were completed successfully, suggesting next step(s), and then making it obvious how to take those next steps.
Prototype 2 - "What do you want to do?"
We learned from the research that users will try Pantheon to improve specific workflow problems. This prototype more proactively communicates how Pantheon can help with those problems by asking users what they came to Pantheon to do, and prompting them to start with an activity that will move them towards that goal.
During user testing, this prototype resonated with users because it is upfront about how the product can address workflow challenges, coupled with an action they can take right now to move them towards that desired future state.
Prototype Test Learnings:
- Moments that communicate how Pantheon solves problems resonated for new users.
- Connecting actions together in user flows helped new users start an activity and follow it through.
- When new users weren’t told what to do next, they got stuck.
From the prototype and research learnings, we synthesized our approach to implementing product improvements:
To increase return rate in Week 0, we should communicate to new users how Pantheon can solve current workflow challenges, and follow through by prompting action so users can make progress towards the problem(s) they want solved.
To teach users when and how to use each development environment, we updated the starting empty states to be more concise and focus on the benefit to the user.
Clone the site code
And now the user likely wants to clone the repo with git or connect to it via SFTP.
Results for this dropdown test show a 10% improvement for the new design in the number of users who successfully make their first code commit.