|By Hal Hilderbrad, Nickolaos Kavantzas, Ashwini Surpur, Mohamad Afshar, Dave Shaffer||
|November 5, 2004 12:00 AM EST||
Agile and adaptive business processes and supporting IT infrastructure are the holy grail of enterprise applications. The industry is heading in the right direction to start delivering on this promise. SOAs (service-oriented architectures) promise to enable businesses to align their business processes to customer needs, and optimize them to improve customer responsiveness and drive efficiency. A process-oriented realization of SOAs is necessary to deliver on this promise.
The process-oriented model is based on an SOA component model augmented with an underlying formal model in which business processes are expressed through orchestration and choreography. This model blends the bottom-up framework of SOA with a top-down, process-centric view. By simplifying the set of activities that are part of the life cycle of business processes, we'll outline how this approach is an effective and efficient way to develop, maintain, and improve best-in-class inter- and intra-enterprise business processes. We'll also emphasize that enterprises looking to automate their business processes around an agile platform can start building, service-enabling, deploying, securing, and managing services - both internal and external - with Business Process Execution Language for Web Services (BPEL4WS or BPEL) business flows today.
The SOA Promise
Traditionally, business information systems have been developed with a functional orientation, often resulting in silos of services and information. However, end-to-end business processes that must span silos can't adapt to change as business needs evolve - they're fragmented and embedded deep within systems. SOA is a software architecture that facilitates the development of enterprise applications as modular and loosely coupled business services.
SOA's intent is to integrate software components, or services, in new runtime contexts and business processes. It creates a unification layer on which business processes and enterprise dashboards can be built. SOA promises to deliver greater responsiveness to business change and provide real-time visibility into business processes. When effectively implemented, it improves business agility by letting you modularize legacy, packaged, and custom applications, and orchestrate them in easily changeable business flows.
The Web services platform, including SOAP and other protocols accessed through Web services binding frameworks, acts as the component model and ubiquitous network fabric through which newly built and existing applications cooperate. Information can be exchanged much more seamlessly, unconstrained by the hardware, operating systems platforms, and programming languages used to implement services.
Whereas a Web services model and SOA often take an essentially bottom-up view, business processes are inherently top-down activities. Bridging the capabilities envisioned by SOA with the requirements of supporting distributed business processes - including trading partner collaborations - is the focus of the process-oriented realization of SOA discussed here.
The process-centric realization of SOA can provide the glue between modular business services for the end-to-end business processes that companies rely on, such as order-to-cash, procure-to-pay, store order-to-sales compensation, and supplier-invoice to settlement. To complete this picture you must define all forms of business processes, including those of a collaborative nature, and deliver these processes reliably so that they, in turn, can be leveraged by other business processes and services (see Figure 1)
Today, mature standards such as BPEL and Web services effectively enable businesses to implement private processes and collaborative processes based on ad hoc collaboration definitions. The process-centric model of SOA considers processes and collaborations as first-class citizens, much as an object-oriented language would consider objects as first-class citizens, and encourages the same maturity of global standards for the definition of B2B processes. With this vision, business processes, collaborations, information exchanges, and work activities are expressed through service aggregation - a combination of BPEL orchestration and WS-CDL choreography, with operational semantics based on the pi-calculus:
In order to deliver quality of service to enterprise-class business processes a number of supporting services are required. With quality of service, a number of supporting services are required. These include security, reliable messaging, transactions, context and coordination, message translation and transformation services, message validation, and content-based routing. Although these services are vital for the vision of networked-enabled business processes, we'll focus on the service aggregation/business process aspects.
BPEL: Automating Business Processes
In the SOA architecture, and within the Web services platform in particular, services must be combined into business processes/business flows. BPEL provides a standard, portable language for coordinating the flow of business process services and builds upon a decade of progress in the areas of business process management, workflow, and integration technologies. Traditionally, such technologies have suffered from proprietary business processes definitions; the resulting applications are seldom portable across implementations, and skills are not transferable. Since BPEL is a standard, it creates a common language for developers. It's built from the ground up around XML and Web services and is supported on both the .NET and Java platforms.
Asynchrony, parallelism, sophisticated exception handling, long-running processes, and a need for compensating transactions change the fundamental nature of what we think of as an application. In order to support the required executable behavior, BPEL provides constructs for control-flow (conditionals, sequencing, parallelism, loops), variables, and constructs for manipulating them; event handlers, timeouts, exceptions, and forward recovery; and nested scoping units of work.
The process-oriented realization of BPEL also adds the following capabilities on top of standard BPEL:
- Advanced data handling and transformation activities that are used to manipulate variables using XQuery
- Advanced process life-cycle management capabilities such as versioning, Suspend Process instance, and Resume Process instance
- Activities that use a business rules framework, which lets you model business rules in a purely declarative way
- Advanced human workflow activities such as assigning tasks to specific users, sending notifications, and approving requests through mechanisms such as task lists
WS-CDL: Collaborations Between Peer-to-Peer Business Processes
In complex integration scenarios, capturing the collaborations between two or more business processes engaging in peer-to-peer business transactions, potentially across trust boundaries, requires a higher-level model. This is the fundamental thrust of WS-CDL, which is based on a variant of pi-calculus. It enables the formal modeling of the common observable behavior of all collaborating participants from a global viewpoint.
WS-CDL describes the global message exchange of participants during their joint interaction, global reactive rules for declaratively prescribing normal/abnormal progress, common agreement of the outcomes, and a recursive composition model that lets you build choreographies incrementally by combining existing choreographies. In this way, complex inter-organization business processes can be implemented as a collection of services, which, in turn, implement complex business processes themselves.
Choreography perfectly complements the effort of orchestration and BPEL, offering a global viewpoint into the peer-to-peer interacting business processes that are defined and implemented in BPEL.
To understand how orchestration and choreography come together, let's consider an example.
Case Study: Order Management Business Process
For any business interaction to work, the rules of collaboration must first be agreed upon. These rules can be represented in English. However, since English is unstructured and frequently vague, the rules may not be represented precisely. Choreography, and WS-CDL in particular, lets us write the above rules in a precise and unambiguous manner. So how do orchestration and choreography fit into the larger picture? The case study below demonstrates their complementary role by presenting the example of a localized business process that's concerned with handling purchase orders in a really big corporation (RBC).
This business process leverages several trading partners and links to a range of back-end services and legacy applications into an end-to-end business process. As Figure 2 shows, the RBC process interacts with different applications such as J2EE, .NET, portals, human workflow, ERP financials, trading partners such as subcontractors, and rules engine interfaces.
What makes this process interesting is that it requires both the integration of existing applications and new functionality. In our example, a clerk takes an action that causes a PO to be sent out. This is logged against a custom application (which could be J2EE or .NET) that registers the PO and ensures that the total amount does not violate the employee's sign-off authority level. If management approval is required, a workflow is initiated.
Upon confirmation, the PO needs to kick off a number of business processes, including one that updates the total POs that have been approved by the employee and manager, and one that checks the availability of goods from an existing warehouse or nearby distribution center and requisitions them if they're not available. If the goods aren't available at any location, then the system updates the financials application.
Notice that in this case, the overall business process is implemented in BPEL. Each of the services can publish a Web service interface that is then orchestrated in BPEL. Using SOAP, WSDL, XML Schema, and BPEL, the business process can be built in a vendor-independent fashion. RBC's business process is shown in Figure 2.
Using BPEL and other open standards, the task of integrating these systems into an end-to-end business process is straightforward. At any stage, the business process may be changed; for example, by adding extra approval steps, or by updating the BPEL definition of the business process.
Now consider what's needed when the RBC order process interacts with an outside supplier, STC, which manufactures and distributes t-shirts. RBC and STC are engaged in a collaborative fashion to achieve their common business goal: order fulfillment. For the collaboration to work successfully, RBC must provide the terms under which it's willing to do electronic business with suppliers such as STC.
RBC has the following simple business rules for collaborating with STC:
- RBC places an order for STC t-shirts.
- STC acknowledges the purchase order. This initiates a business process in STC that handles the PO. For all RBC knows, STC has an employee at a computer handle the PO, or a sophisticated BPEL process that's linked with back-end manufacturing, logistics, and procurement systems.
- After the internal processes within STC regarding the PO are completed - which may take days or even months - STC sends a Purchase Order Completed message back to RBC.
- RBC can send a Cancel Order message any time before it receives the Purchase Order Completed message.
- If the Cancel Order message arrives at STC before the Purchase Order Completed message is sent, STC aborts its business process and acknowledges this to RBC with the Purchase Order CancelAck message.
- If STC has already sent the Purchase Order Completed message, it ignores the Cancel Order message because RBC has agreed that it will honor POs when cancellations are not sent out within an agreed-upon timeframe.
- When a PurchaseOrder message is sent from the buyer to the seller and the acknowledgement is received by the buyer, the OrderStatus at both parties is set to New.
- When the OrderStatus at both the buyer and seller is New, either a Cancel Purchase Order Message can be sent by the buyer to the seller or a Complete Purchase Order Message can be sent by the seller to the buyer.
- When the buyer sends a Cancel Purchase OrderCancel message, the buyer sets itself to CancelPending; when a CancelAck message is sent from the seller to the buyer, this sets both parties to OrderCancelled.
- When the seller sends an OrderCompleted message, the OrderStatus at both parties is set to OrderCompleted.
Today, these rules are frequently described in English, and each trading partner's business processes that interact collaboratively can be defined in BPEL or in any other language. What WS-CDL offers is a standardized way to define these interactions, leaving unambiguous documentation of the roles and responsibilities of each. Also, in the future, products that support business process implementation languages such as BPEL could provide tools that would generate, for example, an implementation skeleton for a particular role or validate behavior. Developers looking to define collaborations in B2B situations should keep an eye on WS-CDL. Today, however, BPEL provides the basis for automating business processes on both sides of the firewall.
The maximum value of SOA architecture is realized by blending SOA with a process-centric view that explicitly defines trading partner collaborations. The basic building blocks to do this are already in place and standards like WS-CDL are emerging to support the full life cycle of collaborative business processes.
Enterprises looking to automate their business processes around an agile platform can build, service-enable, deploy, secure, and manage services (both internal and external) with BPEL business flows today. Looking further down the road, we expect the ways that business-to-business collaborations can be defined will be greatly enhanced through standards such as Web services choreography and we're actively working in these areas. What's clear today is that there is much value to be gained by streamlining your business around SOA with a process-centric view. Go build!
It's 2:15pm on a Friday, and I'm sitting in the keynote hall at PyCon 2013 fidgeting through a succession of lightning talks that have very little relevance to my life. Topics like "Python code coverage techniques" (ho-hum) and "Controlling Christmas lights with Python” (yawn - I wonder if there's anything new on Hacker News)...when Solomon Hykes takes the stage, unveils Docker, and the world shifts. If you haven't seen it yet, you should watch the video of Solomon's Pycon The Future of Linux C...
Mar. 31, 2015 05:00 PM EDT Reads: 590
OmniTI has expanded its services to help customers automate their processes to deliver high quality applications to market faster. Consistent with its focus on IT agility and quality, OmniTI operates under DevOps principles, exploring the flow of value through the IT delivery process, identifying opportunities to eliminate waste, realign misaligned incentives, and open bottlenecks. OmniTI takes a unique, value-centric approach by plotting each opportunity in an effort-payoff quadrant, then work...
Mar. 31, 2015 04:00 PM EDT Reads: 1,069
SYS-CON Events announced today that Solgenia will exhibit at SYS-CON's 16th International Cloud Expo®, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY, and the 17th International Cloud Expo®, which will take place on November 3–5, 2015, at the Santa Clara Convention Center in Santa Clara, CA. Solgenia is the global market leader in Cloud Collaboration and Cloud Infrastructure software solutions. Designed to “Bridge the Gap” between Personal and Professional S...
Mar. 31, 2015 03:00 PM EDT Reads: 3,019
SYS-CON Events announced today that MangoApps will exhibit at SYS-CON's 16th International Cloud Expo®, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY., and the 17th International Cloud Expo®, which will take place on November 3–5, 2015, at the Santa Clara Convention Center in Santa Clara, CA. MangoApps provides private all-in-one social intranets allowing workers to securely collaborate from anywhere in the world and from any device. Social, mobile, and eas...
Mar. 31, 2015 03:00 PM EDT Reads: 3,196
When it comes to microservices there are myths and uncertainty about the journey ahead. Deploying a “Hello World” app on Docker is a long way from making microservices work in real enterprises with large applications, complex environments and existing organizational structures. February 19, 2015 10:00am PT / 1:00pm ET → 45 Minutes Join our four experts: Special host Gene Kim, Gary Gruver, Randy Shoup and XebiaLabs’ Andrew Phillips as they explore the realities of microservices in today’s IT worl...
Mar. 31, 2015 12:45 PM EDT Reads: 1,922
The world's leading Cloud event, Cloud Expo has launched Microservices Journal on the SYS-CON.com portal, featuring over 19,000 original articles, news stories, features, and blog entries. DevOps Journal is focused on this critical enterprise IT topic in the world of cloud computing. Microservices Journal offers top articles, news stories, and blog posts from the world's well-known experts and guarantees better exposure for its authors than any other publication. Follow new article posts on T...
Mar. 31, 2015 12:00 PM EDT Reads: 1,561
Hosted PaaS providers have given independent developers and startups huge advantages in efficiency and reduced time-to-market over their more process-bound counterparts in enterprises. Software frameworks are now available that allow enterprise IT departments to provide these same advantages for developers in their own organization. In his workshop session at DevOps Summit, Troy Topnik, ActiveState’s Technical Product Manager, will show how on-prem or cloud-hosted Private PaaS can enable organ...
Mar. 31, 2015 12:00 PM EDT Reads: 1,397
This month I want to revisit supporting infrastructure and datacenter environments. I have touched (some would say rant) upon this topic since my post in April 2014 called "Take a Holistic View of Support". My thoughts and views on this topic have not changed at all: it's critical for any organization to have a holistic, comprehensive strategy and view of how they support their IT infrastructure and datacenter environments. In fact, I believe it's even more critical today then it was a year ago ...
Mar. 31, 2015 12:00 PM EDT Reads: 790
Cloud computing is changing the way we look at IT costs, according to industry experts on a recent Cloud Luminary Fireside Chat panel discussion. Enterprise IT, traditionally viewed as a cost center, now plays a central role in the delivery of software-driven goods and services. Therefore, companies need to understand their cloud utilization and resulting costs in order to ensure profitability on their business offerings. Led by Bernard Golden, this fireside chat offers valuable insights on ho...
Mar. 31, 2015 11:45 AM EDT Reads: 958
Even though it’s now Microservices Journal, long-time fans of SOA World Magazine can take comfort in the fact that the URL – soa.sys-con.com – remains unchanged. And that’s no mistake, as microservices are really nothing more than a new and improved take on the Service-Oriented Architecture (SOA) best practices we struggled to hammer out over the last decade. Skeptics, however, might say that this change is nothing more than an exercise in buzzword-hopping. SOA is passé, and now that people are ...
Mar. 31, 2015 11:00 AM EDT Reads: 1,413
Microservice architectures are the new hotness, even though they aren't really all that different (in principle) from the paradigm described by SOA (which is dead, or not dead, depending on whom you ask). One of the things this decompositional approach to application architecture does is encourage developers and operations (some might even say DevOps) to re-evaluate scaling strategies. In particular, the notion is forwarded that an application should be built to scale and then infrastructure sho...
Mar. 31, 2015 11:00 AM EDT Reads: 2,565
SYS-CON Events announced today the IoT Bootcamp – Jumpstart Your IoT Strategy, being held June 9–10, 2015, in conjunction with 16th Cloud Expo and Internet of @ThingsExpo at the Javits Center in New York City. This is your chance to jumpstart your IoT strategy. Combined with real-world scenarios and use cases, the IoT Bootcamp is not just based on presentations but includes hands-on demos and walkthroughs. We will introduce you to a variety of Do-It-Yourself IoT platforms including Arduino, Ras...
Mar. 31, 2015 11:00 AM EDT Reads: 2,237
Microservices are the result of decomposing applications. That may sound a lot like SOA, but SOA was based on an object-oriented (noun) premise; that is, services were built around an object - like a customer - with all the necessary operations (functions) that go along with it. SOA was also founded on a variety of standards (most of them coming out of OASIS) like SOAP, WSDL, XML and UDDI. Microservices have no standards (at least none deriving from a standards body or organization) and can be b...
Mar. 31, 2015 10:45 AM EDT Reads: 2,272
Right off the bat, Newman advises that we should "think of microservices as a specific approach for SOA in the same way that XP or Scrum are specific approaches for Agile Software development". These analogies are very interesting because my expectation was that microservices is a pattern. So I might infer that microservices is a set of process techniques as opposed to an architectural approach. Yet in the book, Newman clearly includes some elements of concept model and architecture as well as p...
Mar. 31, 2015 10:15 AM EDT Reads: 2,202
Microservices, for the uninitiated, are essentially the decomposition of applications into multiple services. This decomposition is often based on functional lines, with related functions being grouped together into a service. While this may sound a like SOA, it really isn't, especially given that SOA was an object-centered methodology that focused on creating services around "nouns" like customer and product. Microservices, while certainly capable of being noun-based, are just as likely to be v...
Mar. 31, 2015 10:00 AM EDT Reads: 1,968
You hear the terms “subscription economy” and “subscription commerce” all the time. And with good reason. Subscription-based monetization is transforming business as we know it. But what about usage? Where’s the “consumption economy”? Turns out, it’s all around us. When most people think of usage-based billing, the example that probably comes to mind first is metered public utilities — water, gas and electric. Phone services, especially mobile, might come next. Then maybe taxis. And that’s ab...
Mar. 31, 2015 10:00 AM EDT Reads: 887
SYS-CON Events announced today the DevOps Foundation Certification Course, being held June ?, 2015, in conjunction with DevOps Summit and 16th Cloud Expo at the Javits Center in New York City, NY. This sixteen (16) hour course provides an introduction to DevOps – the cultural and professional movement that stresses communication, collaboration, integration and automation in order to improve the flow of work between software developers and IT operations professionals. Improved workflows will res...
Mar. 31, 2015 10:00 AM EDT Reads: 1,760
As a group of concepts, DevOps has converged on several prominent themes including continuous software delivery, automation, and configuration management (CM). These integral pieces often form the pillars of an organization’s DevOps efforts, even as other bigger pieces like overarching best practices and guidelines are still being tried and tested. Being that DevOps is a relatively new paradigm - movement - methodology - [insert your own label here], standards around it have yet to be codified a...
Mar. 31, 2015 10:00 AM EDT Reads: 900
Containers and microservices have become topics of intense interest throughout the cloud developer and enterprise IT communities. Accordingly, attendees at the upcoming 16th Cloud Expo at the Javits Center in New York June 9-11 will find fresh new content in a new track called PaaS | Containers & Microservices Containers are not being considered for the first time by the cloud community, but a current era of re-consideration has pushed them to the top of the cloud agenda. With the launch ...
Mar. 31, 2015 09:15 AM EDT Reads: 2,299
An explosive combination of technology trends will be where ‘microservices’ and the IoT Internet of Things intersect, a concept we can describe by comparing it with a previous theme, the ‘X Internet.' The idea of using small self-contained application components has been popular since XML Web services began and a distributed computing future of smart fridges and kettles was imagined long back in the early Internet years.
Mar. 31, 2015 09:00 AM EDT Reads: 2,235