About cookies on this site Our websites require some cookies to function properly (required). In addition, other cookies may be used with your consent to analyze site usage, improve the user experience and for advertising. For more information, please review your options. By visiting our website, you agree to our processing of information as described in IBM’sprivacy statement. To provide a smooth navigation, your cookie preferences will be shared across the IBM web domains listed here.
Accelerating software testing with automation and generative AI
ContextQA + IBM
Software testing is the piece that is always lacking, and because of that, software releases are often delayed, and product quality is often compromised. ContextQA has developed an application that does not require any coding knowledge. Instead, it uses AI and automation to test web applications, APIs and mobile applications.
Before generative AI, ContextQA started with automation. It met the IBM team at the South by Southwest (SXSW) event in Austin. The Build IBM Team provided the company with the opportunity to try out a new tool without needing more infrastructure. It was eye-opening because the IBM solution allowed ContextQA to use generative AI models and many out-of-the-box capabilities.
The company worked with the Build Partner team as a technical resource support for a month. The Build Partner team guided ContextQA on what options were available and how to use them for successful deployment. Without much training data, ContextQA wanted to migrate manual test cases and automate them across disparate organizational data. Using natural language processing (NLP) models that IBM provides, ContextQA was able to come up with a large amount of data and automate the manual steps. It was also able to solve for flakiness in software development.
ContextQA had tried OpenAI, but the company experienced several limitations. One of the main issues that ContextQA faced was the privacy and ethics around those models. It is crucial for enterprise customers to have secure, non-biased ethical models, and the IBM® watsonx.ai™ studio solved that problem. ContextQA tried different solutions but couldn’t find the right answer, except with IBM.
With IBM AI technology, the company was able to identify what had changed in the software, provide relevant, accurate suggestions, and perform the correct tasks. So, flakiness in testing was gone using the IBM models.
“We used watsonx.ai studio to do the NLP-based migration of the manual test cases for larger enterprises with 5,000 test cases written in plain English in their Excel spreadsheet,” says Deep Barot, CEO and Founder of ContextQA. “We were able to migrate all those cases and automate them within a few minutes. This is the power of generative AI that IBM provides.”
IBM has a big ecosystem, its own DevOps tools and is backed by IBM Consulting® to develop cutting-edge technologies, which have proven advantageous for ContextQA in its ability to improve testing and reporting capabilities as well as open doors to many more enterprise customers.
ContextQA (link resides outside of ibm.com) is a software product development company based in Austin, Texas. It has a software automation platform that automates application testing and quality assurance processes using single-click AI technology. ContextQA works with enterprises and startup clients throughout the software development process.
Legal
© Copyright IBM Corporation 2024. IBM Corporation, New Orchard Road, Armonk, NY 10504.
Produced in the United States of America, February 2024.
IBM, the IBM logo, ibm.com, IBM Consulting, and watsonx.ai are trademarks or registered trademarks of International Business Machines Corporation, in the United States and/or other countries. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on A current list of IBM trademarks is available on ibm.com/legal/copyright-trademark.
This document is current as of the initial date of publication and may be changed by IBM at any time. Not all offerings are available in every country in which IBM operates.
All client examples cited or described are presented as illustrations of the manner in which some clients have used IBM products and the results they may have achieved. Actual environmental costs and performance characteristics will vary depending on individual client configurations and conditions. Generally expected results cannot be provided as each client’s results will depend entirely on the client’s systems and services ordered. THE INFORMATION IN THIS DOCUMENT IS PROVIDED “AS IS” WITHOUT ANY WARRANTY, EXPRESS OR IMPLIED, INCLUDING WITHOUT ANY WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND ANY WARRANTY OR CONDITION OF NON-INFRINGEMENT. IBM products are warranted according to the terms and conditions of the agreements under which they are provided.