Microservices Expo Authors: Liz McMillan, Pat Romanski, Carmen Gonzalez, Elizabeth White, Jason Bloomberg

Related Topics: Microservices Expo

Microservices Expo: Article

SOA World Expo: The Agile Life Cycle for SOA

Test & Quality Management - Part Two of a Six Part Series

John Michelsen's iTKO Blog

In the past, test “scripts” in TM tools were largely recorded as actual step-by-step instructions (in a Word doc or Excel spreadsheet) for a manual tester to point-and-click through a finished interface to test the application. When tests were completed, the tester would then “check a box” in the test management UI, to indicate that the test had passed or failed.

With so many changing components and middle tier systems in today’s enterprise apps, that form of manual testing is no longer enough, so teams are trying to define (and run) far more sophisticated tests that can actually test behind the user interface, where the business logic lies.

In addition to deeper functional testing, teams using TM tools are asking for a higher degree of automation from their test suites. A thousand manual test scripts can delay cycles by days or weeks while they are executed, costing the team serious agility, and making the testing less valuable over time due to repetition and human error.

Therefore functional, regression and load/stress tests need to be stored directly within the TM tool – for instance as executable command line or XML scripts that launch a test from a ready server-side tool. In this way, a sophisticated set of tests can be executed with just one click in the TM tool, and the pass/fail and other results and issues are automatically written back into the TM tool.

In this way, the whole team gets to use the test process they are familiar with, while getting much deeper tests that can talk to middle tiers, and as much as a 95% improvement in test execution time compared to manual tests. In addition, quality is improved as the teams can focus on testing new functionality, instead of repeating the rote execution of tests against existing functionality.

We are asked for this kind of functionality at virtually every customer engagement - so I'll mention our solution here. iTKO LISA provides connectivity to Test Management (TM) tools, such as HP TestDirector for Quality Center (formerly Mercury TestDirector), giving them a key point of automated test execution, enforcement and test feedback. A welcome “byproduct” or end result of this integration between LISA and test management software is auditable documentation of the test, with details about the status of the many systems under test – showing that at a specific point in time, the system was working as expected, or not working as expected. The testing tool has then fulfilled the requirement of being the "long arm of the law," by spotting the issue, enforcing or “making judgment” on it, and reporting the issue to the TM tool.

The overarching goal of this process is to allow better Collaboration on testing, by sharing and iterating on tests across Development, Testing, business analysis and IT Operations teams. This increases the level of reuse in SOA and enables faster release cycles, as all teams can focus on delivering quality into new features, instead of repeating test creation and execution manually with each new release. In our next post, we will cover application lifecycle management.

More Stories By John Michelsen

John Michelsen is co-Founder and “Chief Geek” at iTKO. He has over twenty years of experience as a technical leader at all organization levels, designing, developing, and managing large-scale, object-oriented solutions in traditional and network architectures. He is the chief architect of iTKO's LISA cloud virtualization and testing product and a leading industry advocate for efficient software development and quality. Before forming iTKO, Michelsen was Director of Development at Trilogy Inc., and VP of Development at AGENCY.COM. He has been titled Chief Technical Architect at companies like Raima, Sabre, and Xerox while performing as a consultant. Through work with clients like Cendant Financial, Microsoft, American Airlines, Union Pacific and Nielsen Market Research, John has deployed solutions using technologies from the mainframe to the handheld device.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.

Microservices Articles
Modern software design has fundamentally changed how we manage applications, causing many to turn to containers as the new virtual machine for resource management. As container adoption grows beyond stateless applications to stateful workloads, the need for persistent storage is foundational - something customers routinely cite as a top pain point. In his session at @DevOpsSummit at 21st Cloud Expo, Bill Borsari, Head of Systems Engineering at Datera, explored how organizations can reap the bene...
"NetApp's vision is how we help organizations manage data - delivering the right data in the right place, in the right time, to the people who need it, and doing it agnostic to what the platform is," explained Josh Atwell, Developer Advocate for NetApp, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
The Jevons Paradox suggests that when technological advances increase efficiency of a resource, it results in an overall increase in consumption. Writing on the increased use of coal as a result of technological improvements, 19th-century economist William Stanley Jevons found that these improvements led to the development of new ways to utilize coal. In his session at 19th Cloud Expo, Mark Thiele, Chief Strategy Officer for Apcera, compared the Jevons Paradox to modern-day enterprise IT, examin...
In his session at 20th Cloud Expo, Mike Johnston, an infrastructure engineer at Supergiant.io, discussed how to use Kubernetes to set up a SaaS infrastructure for your business. Mike Johnston is an infrastructure engineer at Supergiant.io with over 12 years of experience designing, deploying, and maintaining server and workstation infrastructure at all scales. He has experience with brick and mortar data centers as well as cloud providers like Digital Ocean, Amazon Web Services, and Rackspace. H...
Skeuomorphism usually means retaining existing design cues in something new that doesn’t actually need them. However, the concept of skeuomorphism can be thought of as relating more broadly to applying existing patterns to new technologies that, in fact, cry out for new approaches. In his session at DevOps Summit, Gordon Haff, Senior Cloud Strategy Marketing and Evangelism Manager at Red Hat, will discuss why containers should be paired with new architectural practices such as microservices ra...
In his session at 20th Cloud Expo, Scott Davis, CTO of Embotics, discussed how automation can provide the dynamic management required to cost-effectively deliver microservices and container solutions at scale. He also discussed how flexible automation is the key to effectively bridging and seamlessly coordinating both IT and developer needs for component orchestration across disparate clouds – an increasingly important requirement at today’s multi-cloud enterprise.
The Software Defined Data Center (SDDC), which enables organizations to seamlessly run in a hybrid cloud model (public + private cloud), is here to stay. IDC estimates that the software-defined networking market will be valued at $3.7 billion by 2016. Security is a key component and benefit of the SDDC, and offers an opportunity to build security 'from the ground up' and weave it into the environment from day one. In his session at 16th Cloud Expo, Reuven Harrison, CTO and Co-Founder of Tufin, ...
DevOps is often described as a combination of technology and culture. Without both, DevOps isn't complete. However, applying the culture to outdated technology is a recipe for disaster; as response times grow and connections between teams are delayed by technology, the culture will die. A Nutanix Enterprise Cloud has many benefits that provide the needed base for a true DevOps paradigm. In their Day 3 Keynote at 20th Cloud Expo, Chris Brown, a Solutions Marketing Manager at Nutanix, and Mark Lav...
Many organizations are now looking to DevOps maturity models to gauge their DevOps adoption and compare their maturity to their peers. However, as enterprise organizations rush to adopt DevOps, moving past experimentation to embrace it at scale, they are in danger of falling into the trap that they have fallen into time and time again. Unfortunately, we've seen this movie before, and we know how it ends: badly.
TCP (Transmission Control Protocol) is a common and reliable transmission protocol on the Internet. TCP was introduced in the 70s by Stanford University for US Defense to establish connectivity between distributed systems to maintain a backup of defense information. At the time, TCP was introduced to communicate amongst a selected set of devices for a smaller dataset over shorter distances. As the Internet evolved, however, the number of applications and users, and the types of data accessed and...