Case Overview
As our client transitioned from Waterfall to Agile methodologies, they encountered two significant challenges:
- Managing a complex portfolio of applications requiring a modern and sophisticated testing stack with skilled resources.
- Managing a rapidly expanding user base, particularly when focusing on larger clients, which broadened the scope of testing to include UI, Automation, and Performance testing, as well as Security and Accessibility.
ABOUT THE CLIENT
Our client is a renowned leader in workflow automation. Their mission is to unlock the full potential of every employee through innovative software solutions. They are committed to continuously improving their product to meet new and upcoming requirements.
BUSINESS CHALLENGE
Lengthy and Manual Regression Testing: The regression testing period was excessively manual and lengthy, which is inefficient by today's standards.
Comprehensive QA Testing: QA teams had to test everything when functionality changed due to unknown impacts, assuming anything could break.
Frequent Releases: With more frequent releases and quicker turnarounds, the inefficiency of the testing process became increasingly problematic.
Complex 'Shadow DOM' Handling: Dealing with the 'Shadow DOM' (Polymer) with multiple root elements required tedious, manual, and fragile JavaScript code to identify page elements before running tests. Current tools like Cucumber did not support multiple root elements.
Continuous UI Changes: Continuous changes in the UI required reworking scripts and implementing new orders.
Solution Overview
We provided a comprehensive solution using a framework-based approach with a Multi-purpose Automator Platform, achieving over 90% automated testing within hours. This platform scales for performance testing, BDD, and API test automation for complex applications with integration challenges. The testing scope then expanded to include Security, Accessibility, GDPR, and other specialized testing services.
Approach:
Active BQD/PQE Process: Active participation in the Business-Quality-Dev (BQD/PQE) process to help clients transition from a Waterfall+On-prem to an Agile SaaS model.
Phased Reduction in Testing Time: Our first objective was to reduce testing time in phases: from several months to less than a month, and eventually to a few hours, by increasing regression automation coverage from 0% to 50-60%, and then to over 95%.
Scalable Solutions: After Phase 1, we piloted the scaling of the application to thousands/millions of users. Subsequent inclusion of specialized test services like Security and Accessibility.
Dedicated Team: Our core team included three developers, QA, and designers with managerial oversight.
IMPACT
Dramatic Reduction in Manual Testing Efforts: Automated testing reduced manual test efforts from 30 days to 36 hours for a regression suite of 3200 test cases.
Consistent High-Quality Product Delivery: We maintained the highest level of product quality over the past 5+ years.
Significant Reduction in Support Tickets: Minimizing support ticket volume resulted in a reduction of the support team size from three to one.
Secured Critical Certifications: We helped secure certifications like GDPR and ISO 27001.
Successful Polymer.js Automation:Implemented challenging Polymer.js (Shadow DOM) UI Automation.
Improved Product Documentation: Enhanced product documentation accuracy, significantly improving the bandwidth utilization of the customer success team.
Technology Stack
Python, Selenium, BDD, Behave, JMeter, ZAP, NVDA, Axe, AWS
For more detailed insights into our approach to Shadow DOM automation,
visit this link
AT A GLANCE
CHALLENGE
Challenge
Provide comprehensive solutions to maintain application quality and meet industry benchmarks. This involved automated testing, integrated CI/CD pipelines, and Agile methodologies for faster delivery, covering functional, performance, security, and accessibility testing.
IMPACT
Our Indexnine testing framework significantly reduced defect leakage, enhancing overall product stability. By implementing efficient testing processes, we streamlined development workflows, enabling quicker release cycles. This improved development velocity accelerated time-to-market and enhanced agility in addressing evolving customer needs.
