Welcome!

Microservices Expo Authors: Elizabeth White, Liz McMillan, Yeshim Deniz, Pat Romanski, Zakia Bouachraoui

Related Topics: Microservices Expo

Microservices Expo: Article

The Case for Coordinated EDM and SOA Strategies

And what strategic EDM & SOA components require attention to facilitate the appropriate coordination - Part 1

4. When establishing governance, stay away from dictatorships
As shown in Figure 7, there are three general governance approaches for organizations:

  • "Wild West": Non-existent or ad hoc and uncoordinated governance. Lack of enterprise-level coordination, with minimal governance processes/roles developed out of necessity in selected domains.
  • Federated: Coordinated independent efforts between domains. Selective enterprise coordination, but standards, best practices, and tools are inconsistent between domains. Also inconsistent coordination points with business requirements, etc., between domains.
  • Dictatorship: Centralized control of all data or service assets; all assets considered from an enterprise perspective, which is not as effective for domain-specific assets. Here, everything is coordinated at the cost of domain flexibility.

The goal is not to progress to dictatorial governance. While "Wild West" is a problem with lack of control/coordination, dictatorships swing the pendulum too far toward centralized control of all decisions regarding enterprise-wide and domain-specific assets (data or services).

Establishing balanced governance is facilitated by coordinated:

  • Data and SOA governance roles and processes
  • Enterprise-level EDM assets (EIA, MDM, metadata management) with enterprise-level SOA assets (enterprise architecture, SOA services model, and services portfolio)
  • Enterprise-level EDM and SOA architecture and design processes/tools

5. Establish a Center of Excellence (COE) to provide guidance, governance, and coordination
A well-organized and managed EDM or SOA environment should establish a COE to:

  • Involve appropriate stakeholders (business/IT) early and often
  • Facilitate necessary coordination between interdependent projects, programs, and organizational divisions

Mature EDM/SOA strategies include development and management of a supporting COE. However, there is the danger of organizations developing disparate EDM/SOA COEs when pursuing both strategies, despite overlapping roles, dependencies, and synergies.

As Figure 8 demonstrates, an Integration Competency Center (ICC) does more than a traditional COE by providing a design, development, prototyping, and testing sandbox for data and services integration.

An ICC provides processes/tools for EDM and SOA environments, and facilitates coordinated services and information architecture and development to achieve, among other things, service-data normalization.

An ICC coordinates with data-SOA governance and the EIA, as well as overall enterprise architecture concerns. It identifies key components managed within governance for which instances will reside in the ICC and/or production implementations.

Establishing a services-data COE/ICC for stakeholders and interdependent projects is facilitated by coordinated:

  • Data and SOA governance roles and processes
  • EIA and its enterprise data model, with SOA services portfolio and releases
  • EIA, MDM, and metadata management processes/tools with SOA services' initiatives architecture and design processes/tools
  • Enterprise-level EDM assets (EIA, MDM, and metadata management) with enterprise-level SOA assets (enterprise architecture, services model, services portfolio)
  • Enterprise-level EDM and SOA architecture and design processes/tools

6. Start with the right program size in the right area of emphasis
Starting too big with EDM or SOA can lead to mistakes. Think strategically, but act tactically with an emphasis on launching a realistic program that can become successful initially and grow. Develop a coordinated long-term vision for your EDM/SOA programs, and implement these incrementally in support of each other. Coordinated data-SOA governance programs, and a supporting COE/ICC that addresses data and services (see Best Practice # 5), can support the scoping and launch of a "right-sized" program.

For example, you can design sets of services around selected business and data models. The data model can be used to encapsulate business data, and the business model can link further business processes of applications with its software implementation (i.e., services). Business services typically consume data services that are usually not exposed outside the enterprise.

Alternatively, the data model may become primary design criteria for an application; the data model would be the best choice on which to base application services, user interfaces, and business process designs.

Implementing an appropriately sized and focused EDM-SOA program is facilitated by coordinated:

  • Data and SOA governance organizations and processes
  • EDM/SOA COEs (or ICCs) with the EIA and enterprise data model, and the SOA services portfolio and release management

7. Invest in systematically designed core services initially, allowing for rapid opportunistic extensions later
An SOA program may be launched tactically with flexibility and scalability to systematically incorporate program scope under the guidance of governance and an ICC.

Key intermediary services that intercept and handle operations common across services that should be reused include: authentication, logging, monitoring, and routing.

A common data services layer:

  • Provides abstraction between producers and consumers of data; service and data consumers are insulated from complexity, location, and changes in source systems
  • Presents services/data consumers, whether human, application, or services, with aggregated views from multiple sources
  • Manages, monitors, and reports on the enterprise views of data/metadata

SOA strategies cause organizations to implement an EIA and infrastructure in support of services, including common data services capable of supporting producers and consumers with timely and consistent information.

The main categories of data services include:

  • Enterprise Data Services: Directly around the data (e.g., retrieve, update). Also enablement of traditional MDM functionality (e.g., data quality/harmonization across systems exposed as services).
  • Enterprise Metadata Services: Around metadata (e.g., retrieve master data schema). SOA designers/developers creating business services, and those consuming them, reference organizational master data schemas via services.
  • Enterprise Data Platform Services: Around services/data platforms, including management, monitoring, and reporting.

Within other services, and across the data services layer, common infrastructure methods for search, access, creation, update, and deletion functionality are made available.

Systematically/progressively designing services is facilitated by coordinated:

  • Data and SOA governance organizations and processes
  • EIA and its enterprise data model, with SOA services portfolio and releases
  • EIA, MDM, and metadata management processes/tools with SOA services' initiatives architecture and design processes/tools
  • EDM/SOA COEs (or ICCs) with the EIA and enterprise data model, and SOA data with infrastructure services releases

Conclusion
This article demonstrates the case for coordinated EDM and SOA strategies and capabilities in organizations. It further shows what strategic EDM and SOA components require attention to facilitate appropriate coordination.

This article shows that organizations should develop a coordinated data-SOA governance program, as coordination needs to be established at leadership levels to enable the optimal value of their services and data. This is the highest priority toward coordinated EDM-SOA capabilities.

Initial data/SOA governance models should be coordinated for processes, checkpoints, and ownership. We rarely develop these strategies and governance models in coordination from scratch though hopefully this article will spark this. Hence, it's important to adapt appropriate processes and checkpoints between separate models and (re)define roles to support coordinated data-SOA governance.

Organizations should scale progressive EDM-SOA initiatives with shared data-SOA governance, processes, and communications complemented by educating EDM/SOA resources/stakeholder to effectively leverage each other in joint data-services development.

Ensure business- and data-modeling analysts are involved in services design (e.g., not just services analysts), so business functionalities are reflected rather than technical partitioning of software/data. An appropriate COE/ICC will facilitate diverse stakeholders working proactively to drive phases of coordinated EDM-SOA initiatives. Last, promote a culture of collaboration as an underpinning of successful EDM, SOA, and coordinated programs.

Part 2 of this series on EDM and SOA will introduce the coordinated service-oriented data architecture framework and the capability maturity model (CMM), including how to use the C-SODA framework and CMM to drive assessments and improvement roadmaps for organizational maturity.

More Stories By Keith R. Worfolk

Keith R. Worfolk is a senior architect with Hitachi Consulting. He has more than 21 years of senior IT management and executive-level success in strategic enterprise architecture, software development, and large-scale systems integration. He has strong international and Big 5 project experience. Keith earned an MBA from Duke University.

Comments (1) View Comments

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


Most Recent Comments
graham_charters 11/10/08 05:51:15 AM EST

Thanks for posting this information.
I agree that EDM and MDM are growth areas at the moment, with more and more companies recognising the benefits - both business and economic - that these types of technologies provide.
And companies such as Initiate Systems (www.initiatesystems.com) are ideally placed to deliver these solutions.

Microservices Articles
SYS-CON Events announced today that DatacenterDynamics has been named “Media Sponsor” of SYS-CON's 18th International Cloud Expo, which will take place on June 7–9, 2016, at the Javits Center in New York City, NY. DatacenterDynamics is a brand of DCD Group, a global B2B media and publishing company that develops products to help senior professionals in the world's most ICT dependent organizations make risk-based infrastructure and capacity decisions.
Most DevOps journeys involve several phases of maturity. Research shows that the inflection point where organizations begin to see maximum value is when they implement tight integration deploying their code to their infrastructure. Success at this level is the last barrier to at-will deployment. Storage, for instance, is more capable than where we read and write data. In his session at @DevOpsSummit at 20th Cloud Expo, Josh Atwell, a Developer Advocate for NetApp, will discuss the role and value...
DevOpsSummit New York 2018, colocated with CloudEXPO | DXWorldEXPO New York 2018 will be held November 11-13, 2018, in New York City. Digital Transformation (DX) is a major focus with the introduction of DXWorldEXPO within the program. Successful transformation requires a laser focus on being data-driven and on using all the tools available that enable transformation if they plan to survive over the long term.
CloudEXPO New York 2018, colocated with DXWorldEXPO New York 2018 will be held November 11-13, 2018, in New York City and will bring together Cloud Computing, FinTech and Blockchain, Digital Transformation, Big Data, Internet of Things, DevOps, AI, Machine Learning and WebRTC to one location.
Consumer-driven contracts are an essential part of a mature microservice testing portfolio enabling independent service deployments. In this presentation we'll provide an overview of the tools, patterns and pain points we've seen when implementing contract testing in large development organizations.
Adding public cloud resources to an existing application can be a daunting process. The tools that you currently use to manage the software and hardware outside the cloud aren’t always the best tools to efficiently grow into the cloud. All of the major configuration management tools have cloud orchestration plugins that can be leveraged, but there are also cloud-native tools that can dramatically improve the efficiency of managing your application lifecycle. In his session at 18th Cloud Expo, ...
Using new techniques of information modeling, indexing, and processing, new cloud-based systems can support cloud-based workloads previously not possible for high-throughput insurance, banking, and case-based applications. In his session at 18th Cloud Expo, John Newton, CTO, Founder and Chairman of Alfresco, described how to scale cloud-based content management repositories to store, manage, and retrieve billions of documents and related information with fast and linear scalability. He addresse...
Containers and Kubernetes allow for code portability across on-premise VMs, bare metal, or multiple cloud provider environments. Yet, despite this portability promise, developers may include configuration and application definitions that constrain or even eliminate application portability. In this session we'll describe best practices for "configuration as code" in a Kubernetes environment. We will demonstrate how a properly constructed containerized app can be deployed to both Amazon and Azure ...
Enterprise architects are increasingly adopting multi-cloud strategies as they seek to utilize existing data center assets, leverage the advantages of cloud computing and avoid cloud vendor lock-in. This requires a globally aware traffic management strategy that can monitor infrastructure health across data centers and end-user experience globally, while responding to control changes and system specification at the speed of today’s DevOps teams. In his session at 20th Cloud Expo, Josh Gray, Chie...
Discussions of cloud computing have evolved in recent years from a focus on specific types of cloud, to a world of hybrid cloud, and to a world dominated by the APIs that make today's multi-cloud environments and hybrid clouds possible. In this Power Panel at 17th Cloud Expo, moderated by Conference Chair Roger Strukhoff, panelists addressed the importance of customers being able to use the specific technologies they need, through environments and ecosystems that expose their APIs to make true ...