We estimate that Unomaly saves us around a day per week.
ESL was formed in 2000 when a small group of gaming fans wanted to create a league for their favorite game, Quake. The team put together a hand-coded website to record scores and rankings, manually updating as positions changed.
The organic approach to growth had created a serious problem however; with a global network of servers and infrastructure to maintain, operational overheads were becoming unmanageable.
Thomas Pöhler, Vice President of IT at ESL explains, “The operations and development teams were becoming inefficient. With over 300 hosts to monitor, it was becoming impossible to cut through the noise. We were struggling to identify problems early enough to prevent performance issues affecting our quality of service for instance.”
Speed and reliability of infrastructure are critical in the world of online gaming; any reduction in server performance could make the difference between winning and losing a tournament. Outages or poor performance reflect badly on ESL and could have a serious negative impact on their user base.
With thousands of server event logs to sort through, critical early warning information was being missed. ESL was using an Elasticsearch toolset that indexed log files, but they then had to be searched manually to identify issues. This manually-intensive process meant that the ESL team were restricted to reactive support provisions, only able to act after an event.
“We don’t have specific figures on how much time we were losing to searching through log files manually, but it was clear that important resources were being diverted away from strategic projects. The more engineers involved in basic troubleshooting and fault-finding, the fewer we had available for improving the overall service experience for our users.”
“Proving the power of community, we first heard about Unomaly from one of our players,” explains Pöhler, “figuring there was nothing to lose, we arranged a trial of their intelligent log monitoring system.”
ESL were supplied with a virtual appliance running the Unomaly application. The appliance was configured to collect log files from each ESL host and left to “train” itself for a fortnight.
The ESL operations team also configured a scoring system to output high-priority issues to a dedicated Slack channel. Unomaly’s intelligent log analysis system ensures that anomalies are flagged for attention, filtering out the day-to-day events that do not require action.
These automatic notifications have helped ESL improve the resilience and stability of their platform and anti-cheat mechanisms. Unomaly alerts not only highlight issues, but also provide the necessary context to develop effective solutions more quickly. Time and resources that would have otherwise been spent on searching logs can now be dedicated to improving the rest of the platform.
When Unomaly promised us that the system required virtually zero manual input, we were sceptical. We've heard all those promises before, and they've never been true. But this time, things were different.
“When Unomaly promised us that the system required virtually zero manual input, we were sceptical,” says Pöhler, “we’ve heard all those promises before – and they’ve never been true.”
“But this time, things were different.”
Unomaly has helped to dramatically improve the performance of both development and operations teams at ESL. In fact, Pöhler credits Unomaly with helping the IT department complete the transition to a DevOps model by automating the process of error detection within the operating environment.
“We love the product because it makes us more efficient,” explains Pöhler, “we are always short on resources, and Unomaly allows us to do more with less. From the drag-and-drop set-up, to the hands-off operation of the system, Unomaly is a major time saver.”
Unomaly now collates and monitors log files from all 300 hosts, using machine learning and automation to cut through the general “noise” created by an operating environment of this size. The Unomaly system also scales automatically as ESL’s network grows, providing exactly the same benefits, no matter how many hosts they add.
Asked to quantify just how effective Unomaly is, Pöhler estimates his team saves around one day per week, “That may not sound like the largest efficiency gain, but with a small team like ours, every hour counts.”
“Ultimately, the more time we have to focus on our product, the better the service we can offer our users – and Unomaly gives us that time.”