Why New Relic
New Relic provides full end-to-end observability critical to winning business trust in successful software modernisation program
- New Relic instrumentation of all new advertising management applications and cloud infrastructure ensures smooth transition on crunch systems changeover weekend
- Full observability over a new platform on AWS that supports a business generating £1.7 billion ad revenues annually
- Widespread use of New Relic dashboards across the business encouraging more data-driven decision-making
The maker and broadcaster of TV hits like Coronation Street, Downton Abbey and I’m A Celebrity is ITV, the U.K.'s largest and oldest commercial broadcaster. ITV is over 60 years old, has a weekly audience of more than 38 million people, and produces over 8,900 hours of original content annually for itself and for broadcasters globally.
Advertising generates £1.7 billion of revenue for ITV annually. Andrew Duncan, Principal Engineer of ITV, works with the Airtime Sales (ATS) team to use technology to improve their management of this vital source of revenue. He explains:
“Technology underpins what we do and must especially be able to work at the scale and how we must respond very quickly especially as our business becomes more and more digital. And that means we need to use more technology and automation to support the operational side of things and augmenting our traditional human skills and capabilities.”
In alignment with how ITV relies on an end-to-end supply chain that is increasingly digital, the Airtime Sales (ATS) organisation recently completed the transition to a new software platform for managing advertising sales. Key to the success of this complex and challenging migration was full observability from New Relic, which is now a key element in how ATS is growing as a data-driven digital business.
Avoiding Digital Transformation Drama
ITV had a five-year modernisation program for the ATS department, which has been challenging because of the broadcaster’s long history. The company is the amalgamation of 12 regional broadcasters, each of which had their own advertising sales teams, systems and packages.
“There’s a lot of legacy in the systems we use and a great deal of complexity around how ads are still sold regionally. We’ve spent a great amount of time and effort in modernising, streamlining and tackling all the technical debt. The end goal is ensuring we are set up for the future with more integrated advertising across broadcast and online, and being more reactive to what happens in the market.”
Andy and his team decided on a digital transformation plan to migrate from Java-based applications running on-premise servers, to a software management platform that utilizes decomposed microservices running in the AWS public cloud.
Yet, even as the software was fully ready to launch, Andy’s team faced end user resistance to the change-over. To resolve this, New Relic was chosen to help complete the most important stage on the digital transformation journey.
“With some irony for a TV drama maker, there was the potential for the drama of the migration to overtake us. Many people in ATS had visions of that £1.7 billon revenue being put at risk by technical problems as we moved from the old to the new. There was a real need to build trust given the original proof of concept was five years old, and the migration had been postponed before. This is where New Relic and its ability to allow us to instrument everything proved so crucial.”
“Many people had visions of our £1.7 billon ad sales revenue being put at risk by technical problems as we moved from the old to the new. There was a real need to build trust. This is where New Relic and its ability to allow us to instrument everything proved so crucial.”
“By being able to trace across all of those systems and then very quickly tie down where our performance bottlenecks are with New Relic, we can get to the root of what is actually involved in serving a user request and fix it.”
Smooth Migration to the Cloud
The first critical test for using New Relic was one very tense weekend when all 300 users and air time sales activity would be moved over to the new platform. There was a real concern among the ad sales teams who need those systems to be uninterrupted because they often sell ad spots only hours before transmission.
To reassure the end users, the team instrumented New Relic for application and infrastructure performance and monitoring, as well as for the user interface in the browser so they could access end-user experience in real time. This gave full end-to-end observability of how the new applications were performing and allowed the team to rapidly pinpoint problems. New Relic was especially useful for observing how the multiple systems that comprised the new platform were constantly interacting with each other.
“Having instrumented everything with New Relic, we built dashboards that would focus purely on the go-live weekend. The dashboards were designed to answer the most important things our business owners needed to know. We shared those New Relic dashboards with everyone in the ATS department and ran them on giant TVs all around the office.”
Everyone could see how the migration was performing with no hidden secrets or problems. As Andy recalls, there was even a countdown when a legacy piece of software used to manage ad inventory was turned off, and the new applications came online.
The ability to communicate so clearly using New Relic was a major factor in how the whole process proved relatively trouble-free. New Relic enabled the team to gain that certainty of performance and show the business that the migration to the new platform and the move to public cloud wasn’t damaging performance.
As Andy says: “New Relic was capturing what we said was happening and there were no big dramas. The dashboards showed it was going very well and that was what got us across the line. I think without being able to build that trust through that visibility and observability of the software, I don't think we would have got through the launch. It also meant my team could finish earlier than planned.”
Using New Relic to Manage a Billion-Plus Ad Business
The ATS team had spent five years building towards this single moment. So, what came next?
The same end-to-end observability which proved critical during migration continues to be integral in running a digitally transformed operation. With New Relic’s support and guidance, the team embraced the disciplines of site reliability engineering to create scalable and highly reliable software systems for ATS. After the go-live, New Relic was used to build up a baseline of application and infrastructure performance to help proactively observe what’s happening.
Dashboards for business owners are also driving better internal conversations and collaboration about business application development and management.
“In the program’s last months there had been a lot of tension and it was very much a culture of us versus them. The dashboards created a common language which broke down the barriers and enabled us to discuss together what the business wants from software.”
As New Relic has promoted familiarity with data about software performance, there have been interesting changes within the organization. “We had given the business owners New Relic accounts over the go-live weekend so they could look at dashboards and run basic queries. We didn't disable the accounts, so they kept using them and even started learning more through New Relic University training. This is leading the business owners to experiment with using New Relic data to better understand and improve business processes.”
Both ATS business managers and the technology team are now using their New Relic dashboards to answer queries about how their teams are selling ad spots and how efficiently ITV is selling its airtime. The level of observability allows the technology team to spot patterns in how advertising management processes can be improved. “What excites me about New Relic is I can see what my users are doing, and I can understand why they're trying to do it. Understanding what to create is the hardest part of software development. Now we’ve got this insight that lets us see what people are doing in real-time.”
“What excites me about New Relic is I can see what my users are doing, and I can understand why they're trying to do it. Understanding what to create is the hardest part of software development. And now we’ve got this insight that lets us see what people are doing in real-time.”
As New Relic is increasingly helping ATS manage its advertising business in addition to its software operations, the team is looking at how New Relic can log more business objects about campaigns, airtime, and ad spots directly.
Summing up everything so far, Andy Duncan says:
“Software modernisation is never a finished process. What we’ve learned is that communication, visibility, and observability are absolutely key to its success. All the fear and distrust that had built up stemmed from a lack of communication between the business and the technology side of the department. Thanks to New Relic we’re now communicating much more, and working towards a shared goal. There’s a much better understanding of what we're trying to do in the organization and how technology can be adapted to meet the challenges of a rapidly changing marketplace.”