Welcome!

Microservices Expo Authors: Jason Bloomberg, Karthick Viswanathan, Elizabeth White, Mehdi Daoudi, Pat Romanski

Related Topics: Microservices Expo

Microservices Expo: Article

Service-Oriented Architecture Best Practices

Meeting your goals takes a mixed effort

The concept of a service-oriented architecture is a powerful tool for simplifying enterprise integration. Following the three principles of modularity, encapsulation and loose coupling will achieve some amount of improvement for an individual service. It is insufficient to have a loose set of principles to guide enterprise architecture designs. It is also important to have "best practices" on how to build, run and manage enterprise systems. This document will cover the best practices that have been culled from Epiphany, a number of Epiphany's top customers and leading analyst firms.

Define the language of your enterprise. First and foremost, there must be a common language that your, enterprise must speak. This amounts to being able to define important entities as XML Schemas and transformations as XML style sheets. Enforcement is crucial, as well ensuring interoperability across an enterprise wide system. This is the single most important action an enterprise can take to smooth its transition to an SOA.

In one sense, this principle should not be necessary if industry standards groups could agree on basic XML document formats for simple things like names and addresses. Since this is unlikely to happen anytime soon, it is important that your organization set its own language policies now, and deal with transformation issues via XSLT later.

Establish a naming convention for your enterprise. In a SOA environment, having a document that formulates how to name Web services, service interfaces, legacy system endpoints, or any public component will help the enterprise architects, administrators, and developers provide consistent services.

Define service interfaces first, implement later. In a SOA, the interface for a Web service is more important than its actual implementation. When designing composite applications (i.e. applications composed from a cluster of web services), recognize that heterogeneity is the norm. One analyst study put the average number of hardware/software platforms in the Fortune 500 at 6. This underscores setting a baseline "language" for your organization, as heterogeneity is an unavoidable fact in any large enterprise.

In addition to having best practices around people, practices, and technology, it is also important to have "design patterns" that can be reused in order to make the design and construction of an SOA faster and easier. Just as there are design patterns for object-oriented programming, there is a group of experts who are looking at describing common enterprise workflows as a set of patterns. Led by BEA and the Middleware Company, initial work has been done to catalog a number of enterprise workflows captured as patterns for an SOA. While their efforts are in the early stage, the work appears promising.

Establish a service categorization. Services come in a number of flavors. An organization should decide on its services taxonomy. This definition will help to define development roles, as well as help to suggest a level or organizational structure. At a high level, there are only a few types of services. The Middleware Company group is attempting to pull together a set of best practices for building out a service-oriented architecture. The expert group has defined a taxonomy of services, which is a useful starting place:

  • Component services: Simple atomic services potentially acting on single enterprise resource (e.g., database, code, etc).
  • Data services: Service providing data querying, combination and transformation for multiple data sources.
  • Business services: Atomic services composed of combinations of component services and rules.
  • Workflow services: Long lived business processes coordinating other services with external interactions.
Separate rules. It is important to categorize business logic/rules, further, into "process" type business rules versus "UI" type business rules. Process-type business rules are good candidates to encompass within business services and UI-level business rules should be separated out.

Don't skimp on training. Start with a common skill set. Most organizations are new to the technologies behind SOA (like WS-I, WS-BPEL, etc.), so it is important for an IT staff to acquire the skills to understand and implement SOA on an enterprise-wide scale.

Architect a common management layer. A service-oriented architecture provides both additional opportunity and complexity for managing an operational system. Many of the infrastructure vendors like IBM and BEA provide the ability to monitor and manage Web services. It is important to implement a uniform management infrastructure for managing hardware, operating systems, applications, and Web services for maximum visibility.

Analyst firms have begun to discuss implementation issues around SOA as well. In a recent report, Forrester offers several suggestions for SOA best practices. The Forrester report offers several points for enterprises to consider:

Align services with business processes. This is important for a number of reasons. First, the service must be understood by the business users for it to be useful and successful. Second, the service should match the business process it is managing to mitigate the need to change management. Third, change management will be easier. As business processes change, determining which services need to change will be made easier.

Design decisions need to be made regarding integrating business rules within services. Consumer application-specific business rules may not have to be integrated within the producer services if there is no value in having these rules apply to other consumer applications. This also facilitates easy maintenance of services because there is less coordination with multiple consumer applications

Start with services, do Web services later. Moving to an SOA does not necessarily require Web services. Many companies have been successful building out an SOA message-oriented middleware (MOM). This includes JMS-based software as well as IBM WebSphere MQ (the former MQSeries). Applications rooted in MOM-based systems generally met the requirements of SOA: encapsulation, loose-coupling and modularity, but with the notion of messages on a queue rather than SOAP/XML messages.

Wrap packaged applications in service interfaces. This was mentioned above, but is important enough to restate. Enterprises should be wary of vendors claiming to provide a platform. Leveraging a single vendor's platform will unnecessarily tie an organization to one vendor. This is a risky strategy. It is better for enterprise information assets to speak a neutral, common language that will ensure interoperability.

Have a version resolution architecture. Web services present the ability to reuse software like never before. A Web service can be a public resource used by hundreds of applications. However, if the Web service changes the applications will have to change. This will create a maintenance nightmare. It is important to have an architecture where interfaces have a version associated with them, and a way of resolving a particular interface to a particular version. As Web service producers are changed, the consumers can be migrated slowly to the new service. This way disruption is minimized.

Conclusion
Successful enterprises know that achieving an organization's goals is a mix of best practices around people, policies, and technology. This article has attempted to illustrate that it is not sufficient to adopt SOA technologies. It is important to adopt best practices around how a group is organized and how it behaves. It is also important to adopt a set of policies that ensure smooth, visible operations and minimal effort in the face of change. This article has attempted show some of the current thinking around best practices from Epiphany, Epiphany's customers, and leading analyst firms. The nascent body of SOA best practices is still developing.

Resources

  • Some efforts in this area, like xNAL, are by no means universally accepted. See http://xml.coverpages.org/xnal.html for more details.
  • Gamma, E., et al. (1995). Design Patterns: Elements of Reusable Object-Oriented Softwar. Addison Wesley.
  • SOA Blueprints: www.middlewareresearch.com/soa-blueprints/
  • More Stories By Bill Roth

    Bill Roth is a Silicon Valley veteran with over 20 years in the industry. He has played numerous product marketing, product management and engineering roles at companies like BEA, Sun, Morgan Stanley, and EBay Enterprise. He was recently named one of the World's 30 Most Influential Cloud Bloggers.

    Comments (1) View Comments

    Share your thoughts on this story.

    Add your comment
    You must be signed in to add a comment. Sign-in | Register

    In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


    Most Recent Comments
    David Knox 02/10/05 11:05:08 AM EST

    This arcticle starts off right with the three bastions of SOA (standardized interfaces, separation of concerns, loose coupling), after that it falls off the edge. I was most alarmed by the notion that SOA requires 'common language'. The author's argument clearly implies that an enterprise architecture must mandate an all XML protocol. I find it difficult to believe that J2EE app servers shouldn't freely use RMI-IIOP between containers. If every application in the enterprise must have the same transport protocol it contradicts the edict of loose coupling. In the first paragraph the author states a working SOA definition, in the second the author contradicts a necessary aspect of SOA.

    @MicroservicesExpo Stories
    Many organizations are now looking to DevOps maturity models to gauge their DevOps adoption and compare their maturity to their peers. However, as enterprise organizations rush to adopt DevOps, moving past experimentation to embrace it at scale, they are in danger of falling into the trap that they have fallen into time and time again. Unfortunately, we've seen this movie before, and we know how it ends: badly.
    These days, APIs have become an integral part of the digital transformation journey for all enterprises. Every digital innovation story is connected to APIs . But have you ever pondered over to know what are the source of these APIs? Let me explain - APIs sources can be varied, internal or external, solving different purposes, but mostly categorized into the following two categories. Data lakes is a term used to represent disconnected but relevant data that are used by various business units wit...
    There is a huge demand for responsive, real-time mobile and web experiences, but current architectural patterns do not easily accommodate applications that respond to events in real time. Common solutions using message queues or HTTP long-polling quickly lead to resiliency, scalability and development velocity challenges. In his session at 21st Cloud Expo, Ryland Degnan, a Senior Software Engineer on the Netflix Edge Platform team, will discuss how by leveraging a reactive stream-based protocol,...
    Today most companies are adopting or evaluating container technology - Docker in particular - to speed up application deployment, drive down cost, ease management and make application delivery more flexible overall. As with most new architectures, this dream takes significant work to become a reality. Even when you do get your application componentized enough and packaged properly, there are still challenges for DevOps teams to making the shift to continuous delivery and achieving that reducti...
    21st International Cloud Expo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, will feature technical sessions from a rock star conference faculty and the leading industry players in the world. Cloud computing is now being embraced by a majority of enterprises of all sizes. Yesterday's debate about public vs. private has transformed into the reality of hybrid cloud: a recent survey shows that 74% of enterprises have a hybrid cloud strategy. Me...
    Enterprises are moving to the cloud faster than most of us in security expected. CIOs are going from 0 to 100 in cloud adoption and leaving security teams in the dust. Once cloud is part of an enterprise stack, it’s unclear who has responsibility for the protection of applications, services, and data. When cloud breaches occur, whether active compromise or a publicly accessible database, the blame must fall on both service providers and users. In his session at 21st Cloud Expo, Ben Johnson, C...
    Many organizations adopt DevOps to reduce cycle times and deliver software faster; some take on DevOps to drive higher quality and better end-user experience; others look to DevOps for a clearer line-of-sight to customers to drive better business impacts. In truth, these three foundations go together. In this power panel at @DevOpsSummit 21st Cloud Expo, moderated by DevOps Conference Co-Chair Andi Mann, industry experts will discuss how leading organizations build application success from all...
    ‘Trend’ is a pretty common business term, but its definition tends to vary by industry. In performance monitoring, trend, or trend shift, is a key metric that is used to indicate change. Change is inevitable. Today’s websites must frequently update and change to keep up with competition and attract new users, but such changes can have a negative impact on the user experience if not managed properly. The dynamic nature of the Internet makes it necessary to constantly monitor different metrics. O...
    The last two years has seen discussions about cloud computing evolve from the public / private / hybrid split to the reality that most enterprises will be creating a complex, multi-cloud strategy. Companies are wary of committing all of their resources to a single cloud, and instead are choosing to spread the risk – and the benefits – of cloud computing across multiple providers and internal infrastructures, as they follow their business needs. Will this approach be successful? How large is the ...
    Agile has finally jumped the technology shark, expanding outside the software world. Enterprises are now increasingly adopting Agile practices across their organizations in order to successfully navigate the disruptive waters that threaten to drown them. In our quest for establishing change as a core competency in our organizations, this business-centric notion of Agile is an essential component of Agile Digital Transformation. In the years since the publication of the Agile Manifesto, the conn...
    The nature of the technology business is forward-thinking. It focuses on the future and what’s coming next. Innovations and creativity in our world of software development strive to improve the status quo and increase customer satisfaction through speed and increased connectivity. Yet, while it's exciting to see enterprises embrace new ways of thinking and advance their processes with cutting edge technology, it rarely happens rapidly or even simultaneously across all industries.
    You know you need the cloud, but you’re hesitant to simply dump everything at Amazon since you know that not all workloads are suitable for cloud. You know that you want the kind of ease of use and scalability that you get with public cloud, but your applications are architected in a way that makes the public cloud a non-starter. You’re looking at private cloud solutions based on hyperconverged infrastructure, but you’re concerned with the limits inherent in those technologies.
    Most of the time there is a lot of work involved to move to the cloud, and most of that isn't really related to AWS or Azure or Google Cloud. Before we talk about public cloud vendors and DevOps tools, there are usually several technical and non-technical challenges that are connected to it and that every company needs to solve to move to the cloud. In his session at 21st Cloud Expo, Stefano Bellasio, CEO and founder of Cloud Academy Inc., will discuss what the tools, disciplines, and cultural...
    With the rise of DevOps, containers are at the brink of becoming a pervasive technology in Enterprise IT to accelerate application delivery for the business. When it comes to adopting containers in the enterprise, security is the highest adoption barrier. Is your organization ready to address the security risks with containers for your DevOps environment? In his session at @DevOpsSummit at 21st Cloud Expo, Chris Van Tuin, Chief Technologist, NA West at Red Hat, will discuss: The top security r...
    "NetApp's vision is how we help organizations manage data - delivering the right data in the right place, in the right time, to the people who need it, and doing it agnostic to what the platform is," explained Josh Atwell, Developer Advocate for NetApp, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
    The “Digital Era” is forcing us to engage with new methods to build, operate and maintain applications. This transformation also implies an evolution to more and more intelligent applications to better engage with the customers, while creating significant market differentiators. In both cases, the cloud has become a key enabler to embrace this digital revolution. So, moving to the cloud is no longer the question; the new questions are HOW and WHEN. To make this equation even more complex, most ...
    One of the biggest challenges with adopting a DevOps mentality is: new applications are easily adapted to cloud-native, microservice-based, or containerized architectures - they can be built for them - but old applications need complex refactoring. On the other hand, these new technologies can require relearning or adapting new, oftentimes more complex, methodologies and tools to be ready for production. In his general session at @DevOpsSummit at 20th Cloud Expo, Chris Brown, Solutions Marketi...
    Leading companies, from the Global Fortune 500 to the smallest companies, are adopting hybrid cloud as the path to business advantage. Hybrid cloud depends on cloud services and on-premises infrastructure working in unison. Successful implementations require new levels of data mobility, enabled by an automated and seamless flow across on-premises and cloud resources. In his general session at 21st Cloud Expo, Greg Tevis, an IBM Storage Software Technical Strategist and Customer Solution Architec...
    Today companies are looking to achieve cloud-first digital agility to reduce time-to-market, optimize utilization of resources, and rapidly deliver disruptive business solutions. However, leveraging the benefits of cloud deployments can be complicated for companies with extensive legacy computing environments. In his session at 21st Cloud Expo, Craig Sproule, founder and CEO of Metavine, will outline the challenges enterprises face in migrating legacy solutions to the cloud. He will also prese...
    DevOps at Cloud Expo – being held October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA – announces that its Call for Papers is open. Born out of proven success in agile development, cloud computing, and process automation, DevOps is a macro trend you cannot afford to miss. From showcase success stories from early adopters and web-scale businesses, DevOps is expanding to organizations of all sizes, including the world's largest enterprises – and delivering real r...