Welcome!

Microservices Expo Authors: Pat Romanski, Liz McMillan, Elizabeth White, Yeshim Deniz, Zakia Bouachraoui

Related Topics: Microservices Expo, Java IoT, Containers Expo Blog, Cloud Security, @DXWorldExpo, SDN Journal

Microservices Expo: Blog Feed Post

How Mature Is Your API Testing Process?

Assess where your organization's API testing currently stands and see what’s involved in moving forward

Without an enterprise-level automated solution for ensuring the integrity of APIs and API-driven composite applications, organizations risk:

  • Brand erosion as faulty software drives away customers
  • Time-to-market delays that diminish market share
  • Exposure to legal liability associated with application failure
  • Failure to comply with applicable regulatory standards and technical contracts

API Testing solutions help organizations reduce the risks, costs, and resources associated with exposing and consuming APIs. The application of API Testing solutions can range from very simple ad-hoc or reactive efforts to highly-complex test environments driven by business risks.

Ad-Hoc API Testing
With ad-hoc API testing efforts, no formal process or tool is used to unit test or exercise the API. It is assumed that the API is exercised via manual testing of the UI. Ad-hoc API testing characteristics include:

  • Organization has invested little in test automation.
  • Manual test efforts are the primary driver for QA.
  • Defects are commonly found in deployed applications.
  • Test breadth is severely hampered by lack of automation.
  • Limited understanding of the dependent endpoints.

Any pockets of maturity at this point are based on the experience and initiative of individuals. There is no centralization of assets; it’s every man for himself. Along the same vein, testing assets are typically created as one-off solutions and stored on a local machine, inaccessible to anyone but the creator. There’s no test automation here; it’s all manual, ad-hoc execution.

Organizations are driven to move to a mature level of API testing when:

  • Proliferation of APIs exposes weakness within the quality process, requiring an API-centric view for testing.
  • Brittle manual tests impede agility.
  • Composite applications with dependencies beyond the group’s direct control add complexity.

Optimized API Testing
With optimized API testing efforts, business risks drive the testing process and the optimization of associated policies. Optimized API Testing characteristics include:

  • Optimized environment for goal-oriented, business-driven scenarios significantly reduces application risk.
  • Test scenarios are reused as components of complex end-to-end transactions.
  • Consistent, continuous environment access enables more extensive and accurate testing to occur with or without access to a staged test environment.
  • A Center of Excellence is established to optimize and manage policies, procedures, and standards.

At this point, there’s seamless integration and orchestration of Service Virtualization with virtual test lab management systems. Automated regression suites are called and executed against complex environments and environment-based views deliver perspective on coverage and business risk.

API Testing Maturity Model

APITestingMaturityThis is just a brief introduction to the two extremes of API testing maturity. Most organizations today fall somewhere in between these two polar extremes.

Parasoft has developed an API Testing maturity model that provides a detailed look at the five different levels of API testing: Ad-hoc, Reactive, Proactive, Managed, and Optimized.

If you want to assess where your organization currently stands and see what’s involved in moving forward, download the complete API Testing Maturity Model.

More Stories By Cynthia Dunlop

Cynthia Dunlop, Lead Content Strategist/Writer at Tricentis, writes about software testing and the SDLC—specializing in continuous testing, functional/API testing, DevOps, Agile, and service virtualization. She has written articles for publications including SD Times, Stickyminds, InfoQ, ComputerWorld, IEEE Computer, and Dr. Dobb's Journal. She also co-authored and ghostwritten several books on software development and testing for Wiley and Wiley-IEEE Press. Dunlop holds a BA from UCLA and an MA from Washington State University.

Microservices Articles
Discussions of cloud computing have evolved in recent years from a focus on specific types of cloud, to a world of hybrid cloud, and to a world dominated by the APIs that make today's multi-cloud environments and hybrid clouds possible. In this Power Panel at 17th Cloud Expo, moderated by Conference Chair Roger Strukhoff, panelists addressed the importance of customers being able to use the specific technologies they need, through environments and ecosystems that expose their APIs to make true ...
In his session at 20th Cloud Expo, Scott Davis, CTO of Embotics, discussed how automation can provide the dynamic management required to cost-effectively deliver microservices and container solutions at scale. He also discussed how flexible automation is the key to effectively bridging and seamlessly coordinating both IT and developer needs for component orchestration across disparate clouds – an increasingly important requirement at today’s multi-cloud enterprise.
Modern software design has fundamentally changed how we manage applications, causing many to turn to containers as the new virtual machine for resource management. As container adoption grows beyond stateless applications to stateful workloads, the need for persistent storage is foundational - something customers routinely cite as a top pain point. In his session at @DevOpsSummit at 21st Cloud Expo, Bill Borsari, Head of Systems Engineering at Datera, explored how organizations can reap the bene...
SYS-CON Events announced today that DatacenterDynamics has been named “Media Sponsor” of SYS-CON's 18th International Cloud Expo, which will take place on June 7–9, 2016, at the Javits Center in New York City, NY. DatacenterDynamics is a brand of DCD Group, a global B2B media and publishing company that develops products to help senior professionals in the world's most ICT dependent organizations make risk-based infrastructure and capacity decisions.
Most DevOps journeys involve several phases of maturity. Research shows that the inflection point where organizations begin to see maximum value is when they implement tight integration deploying their code to their infrastructure. Success at this level is the last barrier to at-will deployment. Storage, for instance, is more capable than where we read and write data. In his session at @DevOpsSummit at 20th Cloud Expo, Josh Atwell, a Developer Advocate for NetApp, will discuss the role and value...
DevOpsSummit New York 2018, colocated with CloudEXPO | DXWorldEXPO New York 2018 will be held November 11-13, 2018, in New York City. Digital Transformation (DX) is a major focus with the introduction of DXWorldEXPO within the program. Successful transformation requires a laser focus on being data-driven and on using all the tools available that enable transformation if they plan to survive over the long term.
CloudEXPO New York 2018, colocated with DXWorldEXPO New York 2018 will be held November 11-13, 2018, in New York City and will bring together Cloud Computing, FinTech and Blockchain, Digital Transformation, Big Data, Internet of Things, DevOps, AI, Machine Learning and WebRTC to one location.
Consumer-driven contracts are an essential part of a mature microservice testing portfolio enabling independent service deployments. In this presentation we'll provide an overview of the tools, patterns and pain points we've seen when implementing contract testing in large development organizations.
Adding public cloud resources to an existing application can be a daunting process. The tools that you currently use to manage the software and hardware outside the cloud aren’t always the best tools to efficiently grow into the cloud. All of the major configuration management tools have cloud orchestration plugins that can be leveraged, but there are also cloud-native tools that can dramatically improve the efficiency of managing your application lifecycle. In his session at 18th Cloud Expo, ...
Using new techniques of information modeling, indexing, and processing, new cloud-based systems can support cloud-based workloads previously not possible for high-throughput insurance, banking, and case-based applications. In his session at 18th Cloud Expo, John Newton, CTO, Founder and Chairman of Alfresco, described how to scale cloud-based content management repositories to store, manage, and retrieve billions of documents and related information with fast and linear scalability. He addresse...