Case study · Arrow Electronics, via ClientSolv · November 2019 to March 202013-minute read · outcomes in a minute ↓

Ninety days, 39 interviews, eight levers on profitability.

Arrow Electronics' enterprise computing group wanted evidence before investing in a self-service portal for its partners. Through ClientSolv I ran a 90-day research pilot: 39 interviews and more than 1,600 observations, synthesized with the team into more than 50 insights and eight ways a portal could drive profitability. The people, process, and tools for user research stayed with the team.

TeamAn eight-person project team in the enterprise computing IT group: the head of IT, two IT managers, a program manager, a digital-transformation project manager, an operations manager, a senior UX designer who also wrote front-end code, and a UI designer. Airtable, Trint, Miro.
RoleCustomer experience consultant through ClientSolv, embedded with the team as research lead, facilitator, and coach.
TimelineNinety days, 12 November 2019 to 10 February 2020, then synthesis and handoff to 5 March. On site in Colorado.
39interviews: 8 project team, 17 employees, 11 resellers, 3 suppliers
1,600+observations, coded in an Airtable repository
50+insights, on an eight-stage journey map and five personas
8profitability levers; 3 revenue, 5 cost, my reading
Outline

Ninety days to put evidence in the 2020 plan, and leave the team able to keep gathering it.

NINETY DAYSFOUR WORKSHOPS 12 Nov 201922 Nov6 Dec20 Dec3 Jan 202017 Jan10 Feb19 Feb5 Mar day onesprint 0 · the teamsprint 1 · employeessprint 2 · customerssprint 3 · story mappingjourney map, personasday 90 · executive summaryprocess documentedhandoff, 5 March
Fig. 1 · Ninety days on one line. The sprints ran on two-week due dates from the second week; the tinted band is the four workshops, and the dashed segment is synthesis and handoff after the ninety days were up.
  1. IEveryone stated the problem and left.
  2. IIEmployees first, to earn the customers.
  3. IIIFourteen customers, unfiltered, one query away.
  4. IVEight levers. A ninth: keep researching.
  5. VThe portal was half the answer.
  6. AfterWhat stayed after the ninety days.
I · Arrow Electronics, via ClientSolv · November 2019

Everyone stated the problem and left.

Arrow Electronics distributes electronic components and enterprise computing solutions. In 2019 it ranked 109th on the Fortune 500, the largest public company headquartered in Colorado. Its enterprise computing business sells IT through value-added resellers, and the IT group that serves those partners had a problem it could describe but not yet define. Tools had grown one pocket at a time. There was no single place for a partner to go, and a reseller got a different experience depending on which door it came through.

The group was trying to prioritize investments in automation and forecast its 2020 development costs. It wanted a self-service portal for partners, and past custom builds had shipped and found no users. In the team's own words, the worst outcome was to get overconfident about the value statement and boil the ocean. So they asked ClientSolv for a customer experience consultant, and I arrived on 12 November 2019 with ninety days.

The team had no brief. The people who wanted a portal had each said what the problem was and gone back to their own work, and the team wrote that down on the first canvas we filled in: Everyone said the problem statement and left. It's up to us to define the user needs. That is where research has to start, and the team had a 2020 plan to write. The first week went to the eight people on the project team: one-to-one interviews, recorded, run the way we would later run them with customers, so that everyone who would ask a customer a question had been asked one first.

A plan the team could see

Three artifacts came out of that week. An Innovators' Compass put the team's principles, observations, ideas, and experiments on one page, with the people it was for in the middle. A provisional stakeholder map drew who at Arrow talked to whom on the reseller side and the supplier side, the first picture anyone had of where the experience could break. And an experiment backlog in Airtable cut the ninety days into two-week sprints with due dates, so the research ran on the cadence of the software team it was for.

RESELLERARROWSUPPLIER ExecutiveSalesOperationsIT Key accountexecutiveSalesCredit andfinanceOperationsMarketingIT Distribution managerSalesOperations orders and quotes programs and funds communication
Fig. 2 · The provisional stakeholder map from the first week, redrawn. Each connection is a door a partner could come through, and the team's own complaint was that the experience differed by door. Roles only; the map's names are withheld.
Fig. 3 · The experiment backlog at the end of November, redrawn from the update deck. Sprint 0 was interviews with the project team itself. The sprints were on the calendar before the first customer was booked, so nothing waited for a brief.
METHODS · stakeholder interviews · Innovators' Compass · stakeholder mapping · experiment backlog
II · Arrow Electronics · November to December 2019

Employees first, to earn the customers.

Customers were the point, and the team did not yet have the standing to ask for them. Account executives owned those relationships. A consultant's request to interview a reseller's executive gets declined by default. So sprint 1 went to the people inside Arrow who already talked to partners every day. That meant seventeen interviews across executives, sales, IT, finance, operations, marketing, and engineering.

The account executives got the fullest version. We recorded each conversation, and with each one drew the partner's year on the wall in sticky notes: what happened before a sale and after it, what came around weekly and quarterly, and where the phone calls came from. The maps were rough on purpose. A paper map drawn with the person in an hour says what the person believes. The point was to collect the internal assumptions in a form the customer interviews could confirm or overturn. The provisional personas that came out of the sprint were labeled provisional for the same reason.

The same weeks doubled as training. Team members sat in on interviews, then ran their own with me in the room, then coded what they heard into the repository. By the time we went to customers, the team had watched the questions work on colleagues. That is what earned the next permission: business development, which sat on the project team, agreed to let me interview their customers directly, on Arrow's behalf, and the rest of the project stood on it.

GOODTIMEPAINIDEAS YearlyPre-salePost-saleRenewalsWeeklyQuarterly ALWAYS programchanges quotes byemail creditholds ETAs byphone invoicechasing QBRprep
Fig. 4 · A partner's year, mapped on the wall with an account executive in December and redrawn from a photograph of the session. Six columns then; the customer interviews later gave the map eight stages. The few notes with words are paraphrased.
METHODS · pilot interviews · co-created journey maps · research training · provisional personas
III · Arrow Electronics · December 2019 to January 2020

Fourteen customers, unfiltered, one query away.

Fourteen interviews with customers followed, eleven at resellers and three at suppliers, from executives and sales leads to the operations people who keyed the orders. Two of the reseller conversations happened on their premises. Each ran about an hour and was recorded. I ran every one of them, alone or with a team member observing, so the customer was talking to a researcher and not to the account executive who owned the relationship. That is why the material came back unfiltered.

Resellers described purchase orders by the thousand, keyed by hand. Invoices arrived with six decimal places, or for a single penny. Order status came by phone. A credit process slowed deals at the moment they were ready to close. Suppliers described a distributor they could not see into. There was no dashboard for the programs they funded, and no way to show their own leadership what those programs had returned. A few of them said things about how Arrow treated its partners, and the team heard them in the customer's own words.

The repository

Every recording went to transcription. Every transcript was cut into observations: one statement, one speaker, one place in the journey, tagged by role and by topic. They lived in an Airtable base built for the purpose. By the second week of January the base held more than 1,600 of them. A query could pull every observation about invoicing from every operations lead. It could pull everything a supplier had said about market development funds, the money suppliers put up for resellers' campaigns. The team could read the evidence behind a claim instead of taking my word for it.

Insights were written on top of the observations. Each insight card carried the observations behind it and its place in the journey, so anyone could get from a claim back to who said what. More than fifty insights went onto a journey map with eight stages, from campaigns to growth. They also went onto five personas: a reseller's executive, sales, operations, and IT, and a supplier's distribution manager.

Fig. 5 · Three of the 1,600 observations, paraphrased, with the tags that let a query pull every mention of a topic by role. Companies and people are withheld. The chain along the bottom is the whole project in one line.
Fig. 6 · The journey map, drawn in January and revised after the workshops, redrawn to one job, one pain, one outcome per stage. Every pain point is an insight card with the observations behind it. The bottom two rows were filled in by the workshops in Act IV.
METHODS · field visits · transcription and coding · atomic research repository · journey map · personas
IV · Arrow Electronics · January to February 2020

Eight levers. A ninth: keep researching.

The journey map and the personas were built to be argued with, so we put them on the wall and invited the arguments. Four ideation workshops ran in late January and early February, Arrow's first design-thinking workshops. They brought together people from sales, IT, finance, operations, marketing, and engineering. Each ran the same way: read the journey map, stand at the stage you know best, write what you would change on a sticky, and put it where it belongs.

About four hundred stickies came off the walls. We typed them into the repository as ideas, tagged to the same journey stages as the observations, and sorted them into twenty themes. Some were tools. Some were the same complaint from the inside, and a few of those were about how Arrow treated its own partners, which no tool would fix. The sorting was there to let twenty themes collapse into design opportunities the team could test, and they collapsed into eight.

The workshop room before the first session: eight blue stage placards over blank sheets along one wall, a facilitator at the front, participants at tables. Participants standing at the wall, backs to the camera, placing sticky notes under the stages from Leads to Grow. The finished wall, every stage lined with sticky notes along the journey line, and participants working at laptops in front of it.
Fig. 7 · Arrow's first design-thinking workshops, January and February 2020: the map on the wall before the first session, the stages filling up, and the room working from it afterwards.

Written as hypotheses

Each candidate was written as a hypothesis statement: we believe this outcome will be achieved if these people can get this done with this tool. Written that way, an idea carries its own test. The core team scored nine on a matrix of value against risk, where value meant how much it would hurt Arrow not to act, and risk meant how much could go wrong in building it. Seven came through as tools. With the self-serve platform they would all sit on, never scored because it was the ground for the rest, that made eight design opportunities, the eight levers. By my reading of their impact lines, three grow revenue and five cut cost. To price them against the rest of the 2020 backlog we used cost of delay divided by duration, so that a research experiment and a feature could be ranked on the same axis at sprint planning.

The ninth hypothesis was not a tool at all. It was the team's own capability to keep doing this research, and they scored it as the highest-value, lowest-risk thing on the board. That score is what the last act is about.

LOW RISKHIGH RISK risk · how much could go wrong in building it VALUE · HOW MUCH IT HURTS NOT TO ACT the research capabilityMDF managerquote builder fulfillment centercertification manager predictive cross-sellscredit managerCRM and ERP integrations reseller network evidence firstbigger funds · revenuespeed to quote · cost fewer work cycles · costfaster enablement · cost up-sell conversion · revenuespeed to order · costnot carried forward qualified leads · revenue

revenue, my readingcostthe capability itselfthe eighth lever, the self-serve platform, was not scored; I read it as cost

Fig. 8 · Nine hypotheses on risk against value, redrawn from the prioritization board, with each lever's intended impact under its name. The ringed one is the research capability itself, and the process in Act V is what that score bought.
METHODS · design-thinking workshops · affinity mapping · hypothesis statements · risk × value prioritization · cost of delay
V · Arrow Electronics · February to March 2020

The portal was half the answer.

The finding underneath all eight levers was that a portal could carry only part of the partner experience. The rest lived in Arrow's own workflows and policies, and the team wrote that down for leadership instead of boiling the ocean.

Day ninety fell on 10 February, and the team wanted something executives could react to in one-on-ones. So the opportunities became speculative designs: one partner portal, drawn as if it already existed, with each lever as a panel of a single dashboard. Orders tracked from quote to invoice. Credit released without a phone call. A quote builder with live pricing. Products suggested for an open quote. Campaign funds and what they returned. Vendor certifications flagged before they lapsed. Introductions to other resellers.

They were props for a conversation, and each executive was told so. The executive summary written for day ninety ended on a question, and the props were there to ask it. What evidence would the business need to be sure a problem we had found was worth solving with a self-serve tool? And which problems would be better solved by changing a workflow or a policy?

The answers became the design team's next steps. Some opportunities would go back to a panel of partner users for testing. Some would go nowhere until finance changed how it worked.

Fig. 9 · The speculative portal shown in executive one-on-ones, redrawn as one application with synthetic data. Each panel is one of the seven tools; the shell, one login and one place to go, is the eighth lever. It was a prop for one question: what evidence would justify building this?

People, process, tools

The last weeks went to making sure the research would keep running after I left. The team and I wrote its UX process as one diagram: four ceremonies from the sprint cadence it already ran, eight activities across them, and for each one an owner, the artifact it produces, and the tool it runs in. Questions and ideas come in on a canvas, get prioritized as hypotheses, and become a validation plan. Sprint planning prices the experiments. The sprint builds them, measures them with real users, and codes what it learns into the repository. The retro is where the insights get shared. The people row matters most. A process with no owner does not get run.

On 5 March I handed over the presentation for the wider team, the repository, the diagrams, and the process, and the engagement ended.

↩ at sprint planning, cost of delay ÷ duration ranks research experiments and features on one axis; discovery runs a track above delivery and feeds it at every sprint planning
Fig. 10 · The process left behind, redrawn from the February documentation. Read it left to right: questions come in, get priced against features at sprint planning, get built and measured in the sprint, and get coded and shared at the retro.
METHODS · speculative design · executive one-on-ones · hypothesis statements · process documentation
Afterwards

What stayed after the ninety days.

  • The 2020 plan had evidence in it. The enterprise computing IT group used the insights to prioritize its work and to forecast software development costs for the year, which is what it had hired the pilot for.
  • The team kept the method. What stayed at Arrow after the invoice was the repository, the process with an owner for every step, and the people who had run interviews and coded observations. The capability was the deliverable; the eight levers were what it produced first.
  • The UX team got heard. The digital strategy director said the research validated what the designers had wanted to do all along and gave them a plan to take to the head of the enterprise computing business.
  • The repository became a course. In August 2020 I taught the practice behind it publicly as FAIR UXR, a free eight-lesson course built with Alicia Holdsworth, an instructional designer. It teaches Tomer Sharon's atomic research kept to the FAIR data principles: findable, accessible, interoperable, and reusable.

“He is very engaging, approachable, and we trusted him to interview our customers on our behalf to get a true unbiased voice-of-the-customer.”

Director, Business Development · Arrow Electronics · 2020

“Having you come in allowed our UX team to break free. You validated what they wanted to do but no one was hearing them. So now if we were to go to the head of ECS we could actually showcase a plan that covers absolutely everything.”

Digital Strategy Director · Arrow Electronics · 2020

“Very skilled at taking an evidence-based approach (UX Atomic Research) to problem solving… Miguel came in day 1 and with him he brought a wealth of knowledge and expertise to the team.”

Senior UX designer on the team, later a staff product designer · 2020

Colophon · Partner companies and the people interviewed are not named, quotes are attributed by role, and interview material is paraphrased. Artifacts are redrawn and the portal is a reconstruction with synthetic data, not a screenshot; the photographs are from the workshops. The clustering in the header uses real counts and simulated positions.