Confused.com identifies nearly £60,000 in potential annual savings

Region
Business Challenge

Agility, cost control, and flexibility were the key business drivers behind Confused.com ’s decision to move to the public cloud. While the company was able to realize these benefits and more with Microsoft Azure, it also ran into some challenges from a monitoring perspective.

“We had a bit of a patchwork quilt of monitoring solutions,” says Andrew Brockway, head of infrastructure and operations at Confused. “This was fine when we were hosting on premise in a dedicated data center because we had a much smaller footprint. But since we went to Azure, we found those solutions were a bit cumbersome. They couldn’t keep up with the rate of change in terms of how the platform evolves and how the changes that we deploy evolve.”

In addition to keeping up with a dynamic environment, Confused also needed a way to keep technical and non-technical teams on the same page. Non-technical stakeholders involved in product development projects, for example, didn’t have a simple way to get answers to their questions. “They weren’t empowered to get the data for themselves, and felt left out of the overall process,” says Graham Schultz, head of product development at Confused.

The company needed a way to not only consolidate its monitoring tools, but also give non-technical teams a way to understand how technical changes are impacting what they’re trying to do from a business perspective.

End-to-end view of system health in the cloud

During Confused's migration to Azure, Microsoft recommended taking a look at New Relic for their monitoring needs. Not only did New Relic offer seamless integration with Azure, but it also met the exact criteria that Confused was looking for. Not long after an initial proof of concept, everyone was convinced that the visibility, ease of use, and knowledge-sharing capabilities that New Relic provided was their answer.

Confused solved its initial challenge of simplifying and consolidating its view of application performance with New Relic application performance monitoring (APM). “Once we got New Relic, we didn’t need to worry about hosting our own monitoring system, and we didn’t need to worry about trying to stitch together a disparate view of system health and how things are operating,” says Andrew. “Now we know we can just log into the browser, we can get a good view of the application performance and what it means in terms of a technical context.”

In addition to APM, Confused uses New Relic browser monitoring, dashboards, synthetics to get an end-to-end view into the health of its systems. Not only is the team able to see right into the line of code with APM features like transaction traces and thread profiling, but it can see greater context behind browser-side performance as well. "We now have a much better way of reacting to whether a customer is having issues on the site because of JavaScript errors or due to slow page load times,” says Says Chris Lewis, head of website development for Confused.

“I find the deployment reports feature in New Relic to be particularly useful because it allows us to evaluate the success or failure of deployments against each other in a very quick way, which can also be understood by non-technical users,” says Graham, noting that Confused typically releases new code to production up to 15 times a week. For the first time in Confused.com’s history, developers are looking at operational issues, helping shift the company forward in its DevOps transformation.

We estimate we can save around £5,000 a month in hosting costs by scaling down our instances to the right size.

MTTR is reduced to minutes

With a more simplified view into application performance, one of the immediate benefits Confused has enjoyed is faster mean time to resolution (MTTR). “Before we started using New Relic, in many cases it would take me days to diagnose an issue, whereas now that kind of exercise takes me mere minutes,” says Chris.

In addition to saving time, the Confused team is also finding ways to save money. “Using New Relic APM’s scalability analysis, we estimate we can save around £5,000 a month in hosting costs by scaling down our instances to the right size,” says Andrew.

Not only has New Relic helped Confused improve collaboration and communication between Dev and Ops, but also between technical and nontechnical, business teams. “We use New Relic dashboards when engaging with non-technical stakeholders to help explain how the changes we’re making on the product side are impacting the business,” says Graham. “The product is so easy to use, they’re creating their own dashboards, and of course loving the fact they can get answers to their questions in real time.

“We’ve now drawn a line between the lines of code and a pound sign. That’s something we’ve strived to do for a long time, and with tools like New Relic we can now make the connection," says Andrew.