Microservices Expo Authors: Liz McMillan, Pat Romanski, Carmen Gonzalez, Elizabeth White, Jason Bloomberg

Related Topics: Microservices Expo

Microservices Expo: Article

Data Services: Bridging the SOA and Metadata Management Gap

Deliver significant business and IT benefits

In today's difficult economic times, maximizing return on assets is a strategic imperative. Information assets are no exception. Service-oriented architecture (SOA), with its focus on agility and reuse, plays a critical role by accelerating development of new high-business-value applications from existing information assets.

However, before new SOA applications can unleash the business value of these information assets, enterprises must first gain an understanding of and control over the assets they have. This fundamental truth is the basis of today's metadata management initiatives.

Enterprises must strike a balance between resources spent on managing metadata, and resources spent on leveraging this metadata in their SOA initiatives. In doing so, they must address the following questions:

  • Where should the focus be?
  • How can the enterprise deliver the most business value the fastest?
  • Is there a sweet spot where metadata management and SOA align for the benefit of both IT and the business?

Managing Metadata - More Important Than Ever
The fact that metadata is important goes without saying. Furthermore, its importance is growing as it evolves from a passive knowledge store to critical content for automated development. Business intelligence (BI) and data warehousing (DW) applications were some of the first to leverage data-oriented metadata. Business process management (BPM) initiatives leverage process-oriented metadata. IT management initiatives leverage IT asset-oriented metadata. Recently SOA-based new development and legacy migrations are driving additional metadata requirements. Finally, governmental regulations, such as Sarbanes-Oxley, are turning what used to be good IT hygiene into mandates. Given this explosive metadata proliferation, enterprises are expending ever-increasing resources on understanding, cataloguing, and managing metadata.

Today's metadata management applications and techniques vary widely. This is primarily a result of three factors. The first factor is driven by the various classes of metadata identified above. For example, the metadata used to define the extract, transform, and load (ETL) scripts for a data warehouse is far different from the metadata used to help define and manage the handoffs in a complex, order-to-cash business process. Not only do these usages influence the types of data and attributes being managed, but also the frequency and impact of change.

The second factor is the compartmentalized nature of IT organizations. Different teams work on different classes of applications. These range from business-to-business (B2B), to back-office applications, to BI, and so forth. Additionally, different teams work on different layers in the application stack: database, workflow, and reporting, to name a few. As a result, each team focuses on understanding its slice of the metadata pie, with little or no concern for other users.

The third factor is the software vendor-driven approach to metadata management. As metadata has risen in importance in recent years, applications and tools vendors have added metadata extensions to their core offerings. Further, a number of metadata management specialist vendors have arisen, each attacking the metadata management problem from a unique perspective. The result is a disparate set of metadata management tools and a new set of metadata integration challenges.

Data Services - The Sweet Spot for Managing and Leveraging Metadata
With so many classes of metadata, along with the various users and tools, it's easy to get lost in the metadata management journey. However, it's important not to get sidetracked! Enterprises need to pick their battles. They need to focus on managing information assets with the highest return, while using metadata management approaches that deliver those returns the fastest. When it comes to SOA, focusing on data assets often reaps the best and most immediate returns.

More Stories By David Besemer

David Besemer, CTO for Composite Software, Inc., drives the technical vision of the company. Customers in a diverse range of industries including financial services, pharmaceutical, manufacturing and consumer produce/services use Composite’s Enterprise Information Integration (EII) solutions to create individual data-services layers, thus enabling these users to find, access, combine and deliver on-demand information from critical and disparate sources located across the enterprise, including SAP, Siebel, Oracle and Salesforce.com applications.

Comments (2)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.

Microservices Articles
Modern software design has fundamentally changed how we manage applications, causing many to turn to containers as the new virtual machine for resource management. As container adoption grows beyond stateless applications to stateful workloads, the need for persistent storage is foundational - something customers routinely cite as a top pain point. In his session at @DevOpsSummit at 21st Cloud Expo, Bill Borsari, Head of Systems Engineering at Datera, explored how organizations can reap the bene...
"NetApp's vision is how we help organizations manage data - delivering the right data in the right place, in the right time, to the people who need it, and doing it agnostic to what the platform is," explained Josh Atwell, Developer Advocate for NetApp, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
The Jevons Paradox suggests that when technological advances increase efficiency of a resource, it results in an overall increase in consumption. Writing on the increased use of coal as a result of technological improvements, 19th-century economist William Stanley Jevons found that these improvements led to the development of new ways to utilize coal. In his session at 19th Cloud Expo, Mark Thiele, Chief Strategy Officer for Apcera, compared the Jevons Paradox to modern-day enterprise IT, examin...
In his session at 20th Cloud Expo, Mike Johnston, an infrastructure engineer at Supergiant.io, discussed how to use Kubernetes to set up a SaaS infrastructure for your business. Mike Johnston is an infrastructure engineer at Supergiant.io with over 12 years of experience designing, deploying, and maintaining server and workstation infrastructure at all scales. He has experience with brick and mortar data centers as well as cloud providers like Digital Ocean, Amazon Web Services, and Rackspace. H...
Skeuomorphism usually means retaining existing design cues in something new that doesn’t actually need them. However, the concept of skeuomorphism can be thought of as relating more broadly to applying existing patterns to new technologies that, in fact, cry out for new approaches. In his session at DevOps Summit, Gordon Haff, Senior Cloud Strategy Marketing and Evangelism Manager at Red Hat, will discuss why containers should be paired with new architectural practices such as microservices ra...
In his session at 20th Cloud Expo, Scott Davis, CTO of Embotics, discussed how automation can provide the dynamic management required to cost-effectively deliver microservices and container solutions at scale. He also discussed how flexible automation is the key to effectively bridging and seamlessly coordinating both IT and developer needs for component orchestration across disparate clouds – an increasingly important requirement at today’s multi-cloud enterprise.
The Software Defined Data Center (SDDC), which enables organizations to seamlessly run in a hybrid cloud model (public + private cloud), is here to stay. IDC estimates that the software-defined networking market will be valued at $3.7 billion by 2016. Security is a key component and benefit of the SDDC, and offers an opportunity to build security 'from the ground up' and weave it into the environment from day one. In his session at 16th Cloud Expo, Reuven Harrison, CTO and Co-Founder of Tufin, ...
DevOps is often described as a combination of technology and culture. Without both, DevOps isn't complete. However, applying the culture to outdated technology is a recipe for disaster; as response times grow and connections between teams are delayed by technology, the culture will die. A Nutanix Enterprise Cloud has many benefits that provide the needed base for a true DevOps paradigm. In their Day 3 Keynote at 20th Cloud Expo, Chris Brown, a Solutions Marketing Manager at Nutanix, and Mark Lav...
Many organizations are now looking to DevOps maturity models to gauge their DevOps adoption and compare their maturity to their peers. However, as enterprise organizations rush to adopt DevOps, moving past experimentation to embrace it at scale, they are in danger of falling into the trap that they have fallen into time and time again. Unfortunately, we've seen this movie before, and we know how it ends: badly.
TCP (Transmission Control Protocol) is a common and reliable transmission protocol on the Internet. TCP was introduced in the 70s by Stanford University for US Defense to establish connectivity between distributed systems to maintain a backup of defense information. At the time, TCP was introduced to communicate amongst a selected set of devices for a smaller dataset over shorter distances. As the Internet evolved, however, the number of applications and users, and the types of data accessed and...