10 Ways to Make Your Outage Emergency Room Fun
November 03, 2017

Andrew Marshall
Cedexis

It's 3:47am. You and the rest of the Ops team have been summoned from your peaceful slumber to mitigate an application delivery outage. As you catch up on the frantic emails, Slack chats, and text messages from everyone on your international sales team (Every. Single. One.), your mind races as you switch to problem solving mode. It's time to start thinking about how to make this mitigation FUN!

1. Gently remind everyone that the SaaS-delivered automated Application Delivery strategy you proposed would have prevented this

No need to rub it in, but … if you had turned on a software-defined application delivery platform for your hybrid infrastructure, you'd all be sound asleep right now. Automated real-time delivery decisions and failover would be nice, right? Just sayin'.

2. Drop a generationally-divisive Giphy in the emergency Slack channel

Your coworkers' opinions on gaming consoles, Spiderman movies, and music are different than yours! The perfect animated GIF will remind them of your erudite tastes, while you have their attention. Extra credit if you can work in some low-key shade about not listening to your equally sophisticated opinions on optimized outage mitigation.

3. Hold an impromptu Cloud Health Dashboard page customization contest

Oh hey, look at that! Your cloud provider's health dashboard page says everything is fine…because it's powered by the services that went down. Help your team vent their creative energy (and frustration) with some fun customized MS Paint updates to the offending page. Bonus points for art that reminds everyone of the value of a multi-cloud strategy powered by a programmable application delivery platform.

4. Use health metrics to cure ills instead of just conducting another really good post-mortem

Tired of “learning lessons” from these emergency room drills? You depend on NGINX for your LLB, but don't have a way to use those LLB health metrics and data to automate global delivery. Disjointed delivery intelligence means you don't know how your apps will land with users. You need an end user-centric approach to app delivery that automates the best delivery path and ensures failover is in place at all times. Micro-outages often fly under your passive monitoring radar, but that doesn't mean your users don't notice them. An active, integrated app delivery approach re-routes automatically before you lose business. Post-mortems are fun…but so is making sure your apps survive the last mile. Arguably more so?

5. Open (and then close) some tickets for the sales team

“Sales needs to sell more stuff.” You'll feel better.

6. Build a countdown clock for when you can finally replace your old ADC hardware

Sure, your Mode1 ADC hardware was a sunk cost so you're stuck with them for a while. But you're one unnecessary emergency closer to having a fully software-defined application delivery platform for your hybrid cloud. And now you're even closer. And closer … Tick. Tock.

7. Leverage real user measurements (RUM) to foresee and fix problems before they happen

Probably best to do this during normal work hours. User experience data from around the world can detect degrading, sluggish resources in real-time, and user-centric app delivery logic powered by RUM can make quick re-routing decisions automatically. No more getting woken up after the application crashes. While you're wishing you had RUM on your side, you can look up some fun facts from the countries experiencing app outages. Did you know Luxembourgish is an official language?

8. Send an email

You too can be the weird colleague who sends emails with crazy, middle-of-the-night time stamps.

9. Do some virtual window shopping

Browse around to see what you could have purchased with the money you were just forced to spend on unplanned cloud instance provisioning in order to keep your app running. That desktop Nerf missile launcher (or 700 of them) would have been pretty nice.

10. Swear off the game of chance

You've just proven it's not that much fun after all. Don't just dump everything onto one cloud and call it done. Clouds go down for so many reasons. Use an application delivery platform control layer to build in the capability to auto-switch to an available resource, while you sleep soundly. Running on multi-cloud without an abstracted control layer removes most of the value of the cloud. Swear off the game of chance. Out loud. Right now.

Andrew Marshall is Director of Product Marketing at Cedexis
Share this

Industry News

January 26, 2023

Ubuntu Pro, Canonical’s comprehensive subscription for secure open source and compliance, is now generally available.

January 26, 2023

Mirantis, freeing developers to create their most valuable code, today announced that it has acquired the Santa Clara, California-based Shipa to add automated application discovery, operations, security, and observability to the Lens Kubernetes Platform.

January 26, 2023

Section announced it is making it easier than ever to deploy and scale a Mastodon server; in just a few clicks, developers can use Section’s global platform to ensure a superior user experience at a fraction of the cost.

January 25, 2023

SmartBear has integrated the powerful contract testing capabilities of PactFlow with SwaggerHub.

January 25, 2023

Venafi introduced TLS Protect for Kubernetes.

January 25, 2023

Tricentis announced the general availability of Tricentis Test Automation, a cloud-based test automation solution that simplifies test creation, orchestration, and scalable test execution for easier collaboration among QA teams and their business stakeholders and faster, higher-quality, and more durable releases of web-based applications and business processes.

January 24, 2023

Harness announced the acquisition of Propelo.

January 23, 2023

Couchbase announced its Couchbase Capella Database-as-a-Service (DBaaS) offering on Azure.

January 23, 2023

Mendix and Software Improvement Group (SIG) have announced the release of Mendix Quality & Security Management (QSM), a new cybersecurity solution that provides continuous deep-dive insights into security and code quality to immediately address risks and vulnerabilities.

January 23, 2023

Trunk announces the public launch of CI Analytics.

January 23, 2023

Panaya announced a new Partnership Program in response to ongoing growth within its partner network over the past year.

January 23, 2023

Cloudian closed $60 million in new funding, bringing the company’s total funding to $233 million.

January 19, 2023

Progress announced the R1 2023 release of Progress Telerik and Progress Kendo UI.

January 19, 2023

Wallarm announced the early release of the Wallarm API Leak Management solution, an enhanced API security technology designed to help organizations identify and remediate attacks exploiting leaked API keys and secrets, while providing on-going protection against hacks in the event of a leak.

January 19, 2023

ThreatModeler launched Threat Model Marketplace, a cybersecurity asset marketplace offering pre-built, field-tested threat models to be downloaded — free for a limited time — and incorporated into new and ongoing threat modeling initiatives.