Digital Accessibility Testing: How Far Can Automation Take You?
June 14, 2021

Dylan Barrell
Deque Systems

Automated software testing offers many benefits, among them speed and efficiency, wider coverage of application features, and improved accuracy and reliability of results. It's no wonder DevOps teams are moving to automated testing in droves. There's a temptation in thinking you can fully automate 100% of the process, but often the circumstance is a bit more complicated.

When it comes to digital accessibility — making sure your website, mobile site, app or content is convenient and easy to use for people with disabilities — great progress has been made with automated testing. Deque Systems recently conducted a study that found the total number of digital accessibility issues which can be identified through our automated technology is 57%. This is much higher than the widely-accepted belief that automation provides only 20-30% of coverage.

This increase can be attributed to an appropriate redefinition of "automated coverage." Measures are often based on the percentage of WCAG success criteria that can be tested using automated tools. Once you shift the definition to the total volume of issues identified — a real-world approach — the true impact of automated accessibility testing becomes clear.

Some types of issues occur much more frequently than others, which can result in a much higher percentage of total accessibility issues discovered using automated tools. It should be noted that rules library which powered the automation tools used in our study places a huge emphasis on not reporting false positives or erroneous issues.

Most organizations would agree that identifying 57% of accessibility blocks via automation is good, but when challenged with becoming fully accessible, or even facing an accessibility lawsuit, there's the remaining 43%! At this point, many believe the process becomes entirely manual — a real drag on time and resources. The better approach is transitioning to a hybrid between automated and manual testing.

IGT involves taking developers on "virtual tours" of their digital properties, pointing out issues and areas in need of optimization. It's based on simple question-and-answer interactions that don't require accessibility expertise, so developers learn as they proceed. Yes, some manual intervention is required, but the process is much easier when the problems are being clearly identified.

Automation is bringing tremendous advances to the field of accessibility testing — but don't be lulled into thinking the entire process can be handled without human intervention. The promise of certain automation-based workarounds often avoid the core issues and can even make the result more frustrating for people with disabilities. Your best bet at identifying the widest and largest range of accessibility issues is through a comprehensive approach that combines both automated and guided manual testing. Then, the remaining minority of issues left can be addressed manually.

Dylan Barrell is CTO of Deque Systems
Share this

Industry News

February 22, 2024

Check Point® Software Technologies Ltd. introduces Check Point Quantum Force series: an innovative lineup of ten high-performance firewalls designed to meet and exceed the stringent security demands of enterprise data centers, network perimeters, campuses, and businesses of all dimensions.

February 22, 2024

Tabnine announced that Tabnine Chat — the enterprise-grade, code-centric chat application that allows developers to interact with Tabnine AI models using natural language — is now available to all users.

February 22, 2024

Avaamo released Avaamo LLaMB™, a new low-code framework for building generative AI applications in the enterprise safely, securely, and fast.

February 21, 2024

CAST announced the winter release of CAST Imaging, an imaging system for software applications, with significant user experience (UX) enhancements and new features designed to simplify and accelerate processes for engineers who develop, maintain, modernize, complex software applications.

February 21, 2024

Pulumi now offers native ways to manage Pinecone indexes, including its latest serverless indexes.

February 21, 2024

Orkes, whose platform offers the fastest way to scale distributed systems, has raised $20 million in new funding.

February 20, 2024

JFrog and Carahsoft Technology announced a partnership that empowers U.S. Government organizations to safeguard their software supply chains with automated DevSecOps workflows to secure software services consumed by citizens.

February 20, 2024

Multiplayer, a collaborative tool for teams that work on system design and distributed software, announced its public beta.

February 20, 2024

DataStax announced its out-of-the-box retrieval augmented generation (RAG) solution, RAGStack, is now generally available powered by LlamaIndex as an open source framework, in addition to LangChain.

February 20, 2024

UiPath announced new features in its platform designed to enable developers to build, test, and accelerate implementation of automations.

February 15, 2024

Kong announced a suite of open-source AI plugins for Kong Gateway 3.6 that can turn any Kong Gateway deployment into an AI Gateway, offering unprecedented support for multi-Language Learning Models (LLMs) integration.

February 15, 2024

ngrok unveiled early access to its API gateway-as-a-service.

February 15, 2024

Tabnine announced a strategic partnership with DigitalOcean.

February 15, 2024

Salt Security announced that the Salt Security API Protection Platform is now available for purchase in the CrowdStrike Marketplace, a one-stop destination for the world-class ecosystem of CrowdStrike compatible security products.

February 14, 2024

Perforce Software signed a definitive agreement to acquire Delphix.