Case study · Avalere Health, then Inovalon · July 2017 to July 201917-minute read · outcomes in a minute ↓

From first UX hire to a corporate goal with headcount.

Avalere Health hired its first UX designer in July 2017. Nobody on the software team had direct access to users, so the work started with one low-risk study and grew by earning the next permission. Two years later design was a corporate goal at the Inovalon parent, with approved headcount and a plan to certify a hundred practitioners.

TeamA distributed software team, headquarters in Washington DC. A design researcher from June 2018. Product and engineering leads across four business units. LUMA Institute, Userlytics, Glean.ly.
RoleFirst UX designer at Avalere Health, then Senior Manager, Design Strategy at Inovalon and founder of the Design Center of Excellence.
TimelineJuly 2017 to July 2019. Remote, from Philadelphia and then Denver.
$687kvendor contract replaced, 2018
−26%total design spend, 2019 plan
×2delivery capacity, modeled
200+qualified applicants in 24 hours
Outline

Every piece of work in these two years was paid for by the one before it.

AVALEREINOVALON Jul 2017Oct 2017Jan 2018Jun 2018Sep 2018Mar 2019May 2019Jul 2019Oct 2019 first UX hireintranet studypromotion, parentsecond designerbusiness case, Client CongressDesign CoE kick-offsurvey, n=114departurefirst cohort, as planned
Fig. 1 · Two employers, one story. January 2018 is the move to the Inovalon parent, with a promotion. The dashed segment is the approved plan past my departure.
  1. IOne designer, no users, two allies.
  2. IIQuestions before the demo. Contracts grew.
  3. IIIDesign came in-house. Spend fell 26%.
  4. IVA tenth caught the wrong scenario.
  5. VTold not to bother. 200 applied.
  6. AfterWhat it changed after I left.
I · Avalere Health · 2017

One designer, no users, two allies.

Avalere Health is a healthcare policy and data firm headquartered in Washington, DC, owned by Inovalon since 2015. The software team had shipped a market-analytics product and was chasing feature requests. I joined in July 2017 as its first UX designer, working from a coworking space in Philadelphia. The team was spread across four states with the developers at headquarters, so nearly all of it happened over a screen share.

Nobody on the team had ever watched a user, and the objection I met was not about money. It was why anything needed to be easy to use at all, when staff could simply learn the tool. That is a fair question if you have never seen someone fail at one, and I had no recording to show anyone.

The intranet study

The team rebuilding the company intranet had no researcher, so I offered. The users were our own staff, so recruiting was easy. A Mural workshop agreed what staff needed to get done; then we watched five colleagues attempt ten tasks each.

The readout went to HR leadership as a teaching document that showed what user research is: what we did, what broke, what to fix first. It also answered the objection. Intuitive turns out to be a measurable thing. It means a screen matches what a person already expects of it, and a recording shows the second it stops matching. Finding a role inside a department failed for three of five people, so the first recommendation was to put department names on the org chart.

That also put the argument in money. The intranet existed to save staff time, so a task that does not match what staff expect gets paid for in minutes, by everyone, every week. HR became the first ally.

T1T2T3T4T5T6T7T8T9T10
Employee 1!!!!!
Employee 2!!!!
Employee 3!!!!
Employee 4!!!!
Employee 5!!!
completed5/55/52/54/55/55/55/55/55/55/5
errors1101722303431

completed!completed with errorsnot completed

  1. T1 identify the site's purpose
  2. T2 find recent announcements
  3. T3 find a role within a department
  4. T4 find a colleague by expertise
  5. T5 find contact details and location
  6. T6 find slide templates
  7. T7 find the icon library
  8. T8 find the editorial guide
  9. T9 find upcoming events
  10. T10 add an event to a calendar
Fig. 2 · The intranet study, October 2017. Five staff, ten tasks in the order they were given, coded for completion and errors. Counts are raw, because at five people a percentage or an average would imply a precision the study cannot carry. Eight recommendations followed, ranked by impact and effort.

By November I had written the job description for a second designer and walked it through HR and the practice lead. It was approved in December, which is how the researcher arrived the following June.

The triangle and the swarm

I was looking for language that would make design stick, and the co-founder who owned the brand had already done the hard part. The company's values were set, tied to the brand, and lived, so anything I could attach to them would mean something. In November 2017 HR gave me a slot in the company's lunch-and-learn series, and I built the session on Avalere's own imagery. The logo is a flock of birds, and the value behind it is the goose formation: whoever knows the route takes the point, and the rest share the burden behind them. Starlings work the other way. No bird leads. Each one follows three rules, alignment, separation and cohesion, and the flock finds its route together.

The session put the two shapes on Cynefin's map. A complicated problem has an answer, and the right expert can find it, so the triangle is the right shape. A complex problem has no answer until you try something and watch what happens. A new product for a market nobody had observed is complex, and the triangle is the wrong shape for it, because the bird at the point has no more idea of the route than the rest.

The three rules became the deck's three moves: find alignment through experimentation, facilitate collaboration among separate stakeholders, and tell a cohesive story about human needs. We tested the framing on analysts and project managers before running it on site. Marketing, who own the logo, came on as the second ally.

TRIANGLE · whoever knows the route leads Avalere's own value. One bird takes the point and the rest share the burden behind it. Right when the route is known, and only then.
SWARM · three rules, no leader Every bird reads only its neighbors. Nobody knows the route, and the flock finds it anyway.
Fig. 3 · The deck's opening slide, both formations running, with Cynefin underneath them: the triangle for complicated problems, where an expert can find the answer, and the swarm for complex ones, where nobody can until they try something. Analysts recognized the triangle at once. It is how the company already worked.
METHODS · task-based usability study · workshop facilitation · Cynefin · tame versus wicked problems · values-based framing
II · Avalere Health · late 2017

Questions before the demo. Contracts grew.

The session gave the company a way to say when an expert should lead and when a team should swarm. The product that was not selling was the first chance to use it. The market-analytics product was a year past its first release. A market study had been commissioned at the start, so the team felt the research was done. Prospects kept asking for one more feature before they would buy: the shape of a build trap.

In the deck's terms the team had picked a leader and flown in formation behind it. The market study was the expert, its answers were treated as known, and each objection from a prospect was absorbed as a feature rather than read as a signal. The problem was complex and they were working it as if it were complicated.

I joined the demos and interviewed fifteen stakeholders to surface the assumptions behind the product and its business model. The buyers were busy executives, and the company wanted a finished product in the room. I asked to try it the other way round, and to put questions before the demo. Sales let me in as the inquisitive product person. In Cynefin's terms that is probe, sense and respond. In the deck's terms it was the swarm, with the prospect inside it.

Prospects were glad to talk about their own workflows, and the way the company made products changed. Before, it paid for market research, built the product, and went out to sell it. After, it demoed a dashboard built in Looker for the prospect's own questions, worked out internally which parts kept recurring, prototyped the next product in Looker, and only then built it. Contract sizes grew, and a new group formed to find the repeatable services that could become products. Sales had let design in, and product followed, which was the work I had been hired to do in the first place.

BEFORE · solution firstAFTER · problem first Market researchBuild the productDemo“One more feature” QuestionsTheir workflow Demo a dashboardbuilt in Looker Find whatis reusable Prototype itin Looker Buildthe product
Fig. 4 · The service blueprint's top lane. The loop is the build trap: each objection became a feature. Leading with the problem moved the demo to the third step and made it a dashboard built for that prospect in Looker. Whatever kept recurring became the next prototype, and only then a product.
METHODS · customer discovery · assumption mapping · solution interviews · service blueprint
III · Inovalon · 2018

Design came in-house. Spend fell 26%.

The sales work traveled further than I expected. In January 2018 a reorganization moved me to the Inovalon parent with a promotion. In June a design researcher joined, recruited out of the Philadelphia design scene and working from the same coworking space as me while the rest of the company stayed remote. Together we set out to understand about a dozen product teams and bring the work outsourced to a design vendor back in-house.

Managers and tech leads liked the vendor: high-fidelity mockups, fast and consistent. They also said nobody was responsible for the whole client experience, or for tying it back to the measures the company ran on. Analysts wrote requirements, the vendor drew screens, and nobody in between asked why.

With each team we ran the Innovator's Compass, a one-page canvas for framing a problem before solving it. It gave us workstreams and testable hypotheses. Findings went into an atomic research repository, and every two weeks we ran two or three experiments against them.

Fig. 5 · The base that ran the practice, redrawn from the July 2019 export. Workstream names withheld. Priority is a formula over time criticality, impact, and risk. The next act follows one row of this table all the way down the chain.

The transition, in ten steps

Moving the vendor's work in-house without a gap took most of 2018. The order mattered: no business case before we knew the costs, and no costs before we knew the work.

  1. Access, onboarding, and compliance
  2. Stakeholder interviews across the products
  3. Backlog creation and prioritization
  4. Transition alignment with the vendor
  5. Design support costs and equipment list
  6. Job descriptions and compensation analysis with HR
  7. The design team business case
  8. Transfer of the design assets
  9. Component library contribution and bug guidelines
  10. Component library 1.0 release

The component library was the vendor's, built on Aurelia, and it later moved to Angular Material. Once the assets transferred we wrote the contribution and bug guidelines and documented the components in Sketch. We pinned every release to a git tag, so a product team always knew which version it had built against and could take the next one on its own schedule. A short-term and a long-term front-end governance plan, worked out with two engineering leads, decided who could change what.

Fig. 6 · The service the transition produced, redrawn from the August 2018 alignment diagram. Four phases, and a named role accountable for each. The point of drawing it was to show product owners what they would get every time, so that bringing the work in-house did not read as a downgrade from the vendor.

The business case

In September 2018 I took the case to leadership with the workbook attached. The design vendor's contract capped at $27,136 a sprint and ran to $687k across 2018, for a five-role team. Four in-house designers replaced it: total design spend fell 26% in the 2019 plan while the model's delivery capacity doubled. The team was funded. The vendor contract ended, and two more designer requisitions were approved for early 2019.

I built the budget model as eleven formula-linked sheets, so leadership could change an assumption and watch the totals move. This is the sheet they decided on.

Fig. 7 · The budget sheet from the September 2018 business case, redrawn. Staff cost is formula-linked to the compensation analysis and the vendor line to the executed contract, so an assumption changed anywhere moved the total. Velocity is the model's own estimate of delivery, not a measurement.
METHODS · Innovator's Compass · hypothesis statements and proto-personas · atomic research repository · boundary objects
IV · Inovalon · 2018

A tenth caught the wrong scenario.

This ran alongside the business case rather than after it. In April 2018 Inovalon had launched a service that reads medical records and finds conditions a chart review would miss. Prospects wanted to review the findings themselves. The product team arrived with the interface already designed: not built, but written out as a requirements document the size of a book, with a budget to match. The deadline was Client Congress, the annual client conference, at the end of September.

I pushed back. A tenth of the budget would buy a high-fidelity demo instead of production code, which we could change as fast as we learned, and it would leave room for a round of research first. Inovalon had about four hundred contract clinicians doing chart reviews, so the people we were building for were already inside the company, and we went to watch them work. We captured the team's assumptions in a business model canvas and held off on writing a scenario until the sessions had run.

What the requirements got wrong

The document had the reviewer accepting the first suggestion the system made, on the strength of a confidence score. The clinicians would not accept a finding they could not check against the chart, and said so in the first session.

Eight findings came out of the sessions. We wrote the scenarios from them, a day in the life of the reviewer we had now watched, and only then drew the screens and cut the demo. I redrew the interface around the first finding: a reviewer will not act on a model's confidence score until she can see the sentence in the chart that produced it. The score is a claim. The sentence is the evidence, and every reviewer we watched went to the chart before deciding.

BEFORE · the requirements, mid 2018red marks what the research cut

What the research cut1confidence slider · 2collapse and browse all findings · 3dismiss with no decision recorded · 4leave the page to add a code · 5mandatory reason for rejection

THE SESSIONS · what reviewers actually doeight findings; these six moved a screen
Patient
Sample patientDOB withheld
Dates of service
03/21/2016 – 04/21/2016

01She starts by confirming she has the right patient and the right dates of service. Nothing else counts until that does.

Known conditions · 3
Suggested · 6

02She reads what is already known about the patient before she looks at anything the system found.

HCC 960.94 confidence
Specified heart arrhythmias
page 4 · “Atrial fibrillation (I48.91)”

03A suggestion arrives with a confidence score. She does not act on the score. She goes into the record to find the sentence behind it.

Chartpage 4 of 20
two pages carry this condition

04She works in pages, not in highlights. Where a thing sits in the record is part of whether she believes it.

Suggested · 6
Capture a condition the model missed+

05She finds a condition the system did not. She needs somewhere to put it, in her own words, without leaving the record.

Progress3 of 6
Save and closeresume later

06Charts run long and get interrupted. She has to be able to stop in the middle and pick the same record up later.

AFTER · the research passgreen marks what it added; select a suggestion to see its evidence
Medical review · Sample Health Plan · synthetic recordprogress 0 of 6C
Chart · page 4 of 20service 03/21/2016 to 04/21/2016
Patient · sample · DOB withheld · Known conditions (3)A

Cardiology office visit note

Date of service 04/01/2016. Provider: J. White, MD. Follow-up visit; management of chronic cardiovascular conditions.

Impression and recommendations

Problem 1: Coronary artery disease (I25.10). Jaw pain with exertion; negative catheterization in 2012 in the setting of chest and jaw pain. Will get a stress test. Continue cardiac meds.

Problem 2: Essential hypertension (I10). Blood pressure elevated today; did not take medication yesterday or today. Discussed the importance of compliance.

Problem 3: Hypercholesterolemia (E78.00). On high-dose statin.

Problem 4: Atrial fibrillation (I48.91). No rhythm strip on file documenting the arrhythmia. Continue aspirin; could not tolerate beta blockers in the past.

Exam

Regular rate, no murmur. Peripheral pulses diminished bilaterally. No edema.

Current problems

COPD (J44.9) · Sleep apnea (G47.33) · Congestive heart failure (I50.9) · Type 2 diabetes with chronic kidney disease (E11.22)

Patient instructions

Schedule a follow-up in one year. Schedule the stress test. Take blood pressure medication daily and check blood pressure at home.

Suggested conditions · 6grouped by page
  • HCC 85 Congestive heart failurepage 4 · “Congestive heart failure (I50.9)”B✓ accepted✕ rejected
  • HCC 96 Specified heart arrhythmiaspage 4 · “Atrial fibrillation (I48.91)”✓ accepted✕ rejected
  • HCC 111 Chronic obstructive pulmonary diseasepage 4 · “COPD (J44.9)”✓ accepted✕ rejected
  • HCC 18 Diabetes with chronic complicationspage 4 · “Type 2 diabetes with chronic kidney disease”✓ accepted✕ rejected
  • HCC 88 Angina pectorispage 4 · “Jaw pain with exertion” · weak✓ accepted✕ rejected
  • HCC 108 Vascular diseasepage 4 · “Peripheral pulses diminished” · weak✓ accepted✕ rejected

What it addedAknown conditions first · Bevidence anchored to page and sentence · Cvisible progress, reviews can be left unfinished · Dcapture what the model missed

Fig. 8 · The build as it stood in mid 2018, what the sessions found, and the pass that followed. The middle row is the argument between the two screens, and it is the reason for every red mark above it and every green one below. The requirements had her accepting the first suggestion the system made, which turned out to be the one thing no reviewer would do. Both screens use a synthetic chart and public code sets.

What a tenth bought

The prototype cost about a tenth of what the build would have, and it changed the design before the other nine tenths were committed. Over two years the practice put every build it touched through the same tenth. By its own accounting, the rework that never had to be scoped came to an estimated $2.4M.

METHODS · minimum viable product and innovation accounting · context scenarios · sketching before building · contextual inquiry · the ironies of automation
V · Inovalon · 2019

Told not to bother. 200 applied.

One product was enough to argue with. Scale was the next problem. After the ABILITY Network acquisition in 2018, Inovalon had dozens of development teams across four business units and two designers to serve them. Hiring our way out did not pencil. The AVP who ran one of the product lines told me not to bother trying. In that view, Inovalon was not the kind of place designers would want to work, so building the capability inside was wasted effort.

The strategy became growing practitioners inside the teams instead: a Design Center of Excellence that trains, mentors, and certifies people who already do the work, and lets teams decide when to hire a designer.

One empathy map on a skeptical stakeholder set the direction. The analysts had the domain knowledge; what they lacked was method. So we would train them.

Design entered the 2019 portfolio objectives in January, and by March the chief executive had directed two of his VPs to stand the center up as a corporate initiative. We kicked off on 22 March with founding practitioners from every business unit and a design-ops canvas: what the center does, for whom, and within what limits. Then we measured where the organization stood.

Fig. 9 · The Q2 2019 maturity survey on the Design Management Institute's five levels, 114 responses across four business units. Teams could repeat what they did in delivery; almost nobody measured it. The barriers alongside were coded from the open answers.

What the survey found

The survey turned up something we could use. Product and development managers already spent about a fifth of their time on design, and thirteen of them spent more than half. Those thirteen scored far above the rest on maturity. Ranking them against every product's stage, revenue and receptiveness gave us the first cohort of twenty.

Blueprinting the program

Manager interviews said what the cohort needed: how to write a testable hypothesis, design an experiment, and recruit users. So I blueprinted the Design Center of Excellence like an internal startup, with the five measures a startup would track. They were written before the first cohort, so that a failure would show up in a number someone already watched.

↩ viral coefficient · new practitioners an existing practitioner generates
Fig. 10 · The Design Center of Excellence as a service blueprint, redrawn from the June 2019 workbook in the standard anatomy. The lane across the top is what the loop compounds to, on its own axis of quarters rather than phases: a pilot of six and a first cohort of twenty, both of which ran after I left, then the schedule toward a hundred. The manager lane came out of the manager interviews, where every one of them raised who controls a practitioner's afternoons. The bottom row is the one number leadership would see for each phase.

LUMA Institute would deliver two of the three training days and the playbook. Userlytics records and redacts protected health information, which let studies run under HIPAA. Glean.ly's alpha program gave us a research repository built for the job. With the partners settled, the schedule went in the plan.

The approved headcount went out as job postings that spring. I had worked the job descriptions over with other design managers around Philadelphia first, trying drafts on them until the scope was right and the role read as one worth wanting. More than 200 qualified people applied in the first 24 hours. The AVP was wrong about that, and I had been wrong about how hard it would be. I left in July 2019 with the core team hired and the first cohort on the calendar. The pilot ran that September and the first cohort started in October, both after I had gone.

METHODS · design maturity model · double-loop learning · communities of practice · pirate metrics · service blueprint · ladder of participation
Afterwards

What it changed after I left.

  • A new enterprise-wide discipline. The AVP of Design Strategy role I wrote was filled that November, four months after I left, and the function ran under it into 2021.
  • Design got funded from a model. The budget workbook outlasted the business case. Leadership could change an assumption and watch the total move, which is a different argument from asking for a number once a year.
  • My manager moved into design. The senior director I reported to took over design strategy at Inovalon in 2020 and led it until 2021.
  • A colleague became a client. A director from Inovalon's innovation group left in 2018 to found an AI text-analytics company. In 2023 that company hired me to design its brand and product interface.

“It is no small task to add a new enterprise-wide discipline to an organization… Thank you for initiating the movement and we'll be sure to continue the advancement.”

Chief Product Officer · Inovalon · 2019

“A strong visionary with tremendous intelligence and high EQ… Miguel had a tough job at Inovalon trying to transform an existing Agile SDLC culture by integrating the power of design.”

My manager · Senior Director, Platform Solutions · Inovalon · 2020

“A transformative force multiplier” whose team “initiated design research, performed service design, UX experiments, aligned business stakeholders, and successfully managed external design and software development resources.”

Hiring manager · VP, Software and Data Analytics · Avalere Health · 2019

Colophon · Names are withheld and quotes attributed by role. Screens are reconstructions with synthetic data, not screenshots.