|By Hal Hilderbrad, Nickolaos Kavantzas, Ashwini Surpur, Mohamad Afshar, Dave Shaffer||
|November 5, 2004 12:00 AM EST||
Agile and adaptive business processes and supporting IT infrastructure are the holy grail of enterprise applications. The industry is heading in the right direction to start delivering on this promise. SOAs (service-oriented architectures) promise to enable businesses to align their business processes to customer needs, and optimize them to improve customer responsiveness and drive efficiency. A process-oriented realization of SOAs is necessary to deliver on this promise.
The process-oriented model is based on an SOA component model augmented with an underlying formal model in which business processes are expressed through orchestration and choreography. This model blends the bottom-up framework of SOA with a top-down, process-centric view. By simplifying the set of activities that are part of the life cycle of business processes, we'll outline how this approach is an effective and efficient way to develop, maintain, and improve best-in-class inter- and intra-enterprise business processes. We'll also emphasize that enterprises looking to automate their business processes around an agile platform can start building, service-enabling, deploying, securing, and managing services - both internal and external - with Business Process Execution Language for Web Services (BPEL4WS or BPEL) business flows today.
The SOA Promise
Traditionally, business information systems have been developed with a functional orientation, often resulting in silos of services and information. However, end-to-end business processes that must span silos can't adapt to change as business needs evolve - they're fragmented and embedded deep within systems. SOA is a software architecture that facilitates the development of enterprise applications as modular and loosely coupled business services.
SOA's intent is to integrate software components, or services, in new runtime contexts and business processes. It creates a unification layer on which business processes and enterprise dashboards can be built. SOA promises to deliver greater responsiveness to business change and provide real-time visibility into business processes. When effectively implemented, it improves business agility by letting you modularize legacy, packaged, and custom applications, and orchestrate them in easily changeable business flows.
The Web services platform, including SOAP and other protocols accessed through Web services binding frameworks, acts as the component model and ubiquitous network fabric through which newly built and existing applications cooperate. Information can be exchanged much more seamlessly, unconstrained by the hardware, operating systems platforms, and programming languages used to implement services.
Whereas a Web services model and SOA often take an essentially bottom-up view, business processes are inherently top-down activities. Bridging the capabilities envisioned by SOA with the requirements of supporting distributed business processes - including trading partner collaborations - is the focus of the process-oriented realization of SOA discussed here.
The process-centric realization of SOA can provide the glue between modular business services for the end-to-end business processes that companies rely on, such as order-to-cash, procure-to-pay, store order-to-sales compensation, and supplier-invoice to settlement. To complete this picture you must define all forms of business processes, including those of a collaborative nature, and deliver these processes reliably so that they, in turn, can be leveraged by other business processes and services (see Figure 1)
Today, mature standards such as BPEL and Web services effectively enable businesses to implement private processes and collaborative processes based on ad hoc collaboration definitions. The process-centric model of SOA considers processes and collaborations as first-class citizens, much as an object-oriented language would consider objects as first-class citizens, and encourages the same maturity of global standards for the definition of B2B processes. With this vision, business processes, collaborations, information exchanges, and work activities are expressed through service aggregation - a combination of BPEL orchestration and WS-CDL choreography, with operational semantics based on the pi-calculus:
In order to deliver quality of service to enterprise-class business processes a number of supporting services are required. With quality of service, a number of supporting services are required. These include security, reliable messaging, transactions, context and coordination, message translation and transformation services, message validation, and content-based routing. Although these services are vital for the vision of networked-enabled business processes, we'll focus on the service aggregation/business process aspects.
BPEL: Automating Business Processes
In the SOA architecture, and within the Web services platform in particular, services must be combined into business processes/business flows. BPEL provides a standard, portable language for coordinating the flow of business process services and builds upon a decade of progress in the areas of business process management, workflow, and integration technologies. Traditionally, such technologies have suffered from proprietary business processes definitions; the resulting applications are seldom portable across implementations, and skills are not transferable. Since BPEL is a standard, it creates a common language for developers. It's built from the ground up around XML and Web services and is supported on both the .NET and Java platforms.
Asynchrony, parallelism, sophisticated exception handling, long-running processes, and a need for compensating transactions change the fundamental nature of what we think of as an application. In order to support the required executable behavior, BPEL provides constructs for control-flow (conditionals, sequencing, parallelism, loops), variables, and constructs for manipulating them; event handlers, timeouts, exceptions, and forward recovery; and nested scoping units of work.
The process-oriented realization of BPEL also adds the following capabilities on top of standard BPEL:
- Advanced data handling and transformation activities that are used to manipulate variables using XQuery
- Advanced process life-cycle management capabilities such as versioning, Suspend Process instance, and Resume Process instance
- Activities that use a business rules framework, which lets you model business rules in a purely declarative way
- Advanced human workflow activities such as assigning tasks to specific users, sending notifications, and approving requests through mechanisms such as task lists
WS-CDL: Collaborations Between Peer-to-Peer Business Processes
In complex integration scenarios, capturing the collaborations between two or more business processes engaging in peer-to-peer business transactions, potentially across trust boundaries, requires a higher-level model. This is the fundamental thrust of WS-CDL, which is based on a variant of pi-calculus. It enables the formal modeling of the common observable behavior of all collaborating participants from a global viewpoint.
WS-CDL describes the global message exchange of participants during their joint interaction, global reactive rules for declaratively prescribing normal/abnormal progress, common agreement of the outcomes, and a recursive composition model that lets you build choreographies incrementally by combining existing choreographies. In this way, complex inter-organization business processes can be implemented as a collection of services, which, in turn, implement complex business processes themselves.
Choreography perfectly complements the effort of orchestration and BPEL, offering a global viewpoint into the peer-to-peer interacting business processes that are defined and implemented in BPEL.
To understand how orchestration and choreography come together, let's consider an example.
Case Study: Order Management Business Process
For any business interaction to work, the rules of collaboration must first be agreed upon. These rules can be represented in English. However, since English is unstructured and frequently vague, the rules may not be represented precisely. Choreography, and WS-CDL in particular, lets us write the above rules in a precise and unambiguous manner. So how do orchestration and choreography fit into the larger picture? The case study below demonstrates their complementary role by presenting the example of a localized business process that's concerned with handling purchase orders in a really big corporation (RBC).
This business process leverages several trading partners and links to a range of back-end services and legacy applications into an end-to-end business process. As Figure 2 shows, the RBC process interacts with different applications such as J2EE, .NET, portals, human workflow, ERP financials, trading partners such as subcontractors, and rules engine interfaces.
What makes this process interesting is that it requires both the integration of existing applications and new functionality. In our example, a clerk takes an action that causes a PO to be sent out. This is logged against a custom application (which could be J2EE or .NET) that registers the PO and ensures that the total amount does not violate the employee's sign-off authority level. If management approval is required, a workflow is initiated.
Upon confirmation, the PO needs to kick off a number of business processes, including one that updates the total POs that have been approved by the employee and manager, and one that checks the availability of goods from an existing warehouse or nearby distribution center and requisitions them if they're not available. If the goods aren't available at any location, then the system updates the financials application.
Notice that in this case, the overall business process is implemented in BPEL. Each of the services can publish a Web service interface that is then orchestrated in BPEL. Using SOAP, WSDL, XML Schema, and BPEL, the business process can be built in a vendor-independent fashion. RBC's business process is shown in Figure 2.
Using BPEL and other open standards, the task of integrating these systems into an end-to-end business process is straightforward. At any stage, the business process may be changed; for example, by adding extra approval steps, or by updating the BPEL definition of the business process.
Now consider what's needed when the RBC order process interacts with an outside supplier, STC, which manufactures and distributes t-shirts. RBC and STC are engaged in a collaborative fashion to achieve their common business goal: order fulfillment. For the collaboration to work successfully, RBC must provide the terms under which it's willing to do electronic business with suppliers such as STC.
RBC has the following simple business rules for collaborating with STC:
- RBC places an order for STC t-shirts.
- STC acknowledges the purchase order. This initiates a business process in STC that handles the PO. For all RBC knows, STC has an employee at a computer handle the PO, or a sophisticated BPEL process that's linked with back-end manufacturing, logistics, and procurement systems.
- After the internal processes within STC regarding the PO are completed - which may take days or even months - STC sends a Purchase Order Completed message back to RBC.
- RBC can send a Cancel Order message any time before it receives the Purchase Order Completed message.
- If the Cancel Order message arrives at STC before the Purchase Order Completed message is sent, STC aborts its business process and acknowledges this to RBC with the Purchase Order CancelAck message.
- If STC has already sent the Purchase Order Completed message, it ignores the Cancel Order message because RBC has agreed that it will honor POs when cancellations are not sent out within an agreed-upon timeframe.
- When a PurchaseOrder message is sent from the buyer to the seller and the acknowledgement is received by the buyer, the OrderStatus at both parties is set to New.
- When the OrderStatus at both the buyer and seller is New, either a Cancel Purchase Order Message can be sent by the buyer to the seller or a Complete Purchase Order Message can be sent by the seller to the buyer.
- When the buyer sends a Cancel Purchase OrderCancel message, the buyer sets itself to CancelPending; when a CancelAck message is sent from the seller to the buyer, this sets both parties to OrderCancelled.
- When the seller sends an OrderCompleted message, the OrderStatus at both parties is set to OrderCompleted.
Today, these rules are frequently described in English, and each trading partner's business processes that interact collaboratively can be defined in BPEL or in any other language. What WS-CDL offers is a standardized way to define these interactions, leaving unambiguous documentation of the roles and responsibilities of each. Also, in the future, products that support business process implementation languages such as BPEL could provide tools that would generate, for example, an implementation skeleton for a particular role or validate behavior. Developers looking to define collaborations in B2B situations should keep an eye on WS-CDL. Today, however, BPEL provides the basis for automating business processes on both sides of the firewall.
The maximum value of SOA architecture is realized by blending SOA with a process-centric view that explicitly defines trading partner collaborations. The basic building blocks to do this are already in place and standards like WS-CDL are emerging to support the full life cycle of collaborative business processes.
Enterprises looking to automate their business processes around an agile platform can build, service-enable, deploy, secure, and manage services (both internal and external) with BPEL business flows today. Looking further down the road, we expect the ways that business-to-business collaborations can be defined will be greatly enhanced through standards such as Web services choreography and we're actively working in these areas. What's clear today is that there is much value to be gained by streamlining your business around SOA with a process-centric view. Go build!
What if you could build a web application that could support true web-scale traffic without having to ever provision or manage a single server? Sounds magical, and it is! In his session at 20th Cloud Expo, Chris Munns, Senior Developer Advocate for Serverless Applications at Amazon Web Services, will show how to build a serverless website that scales automatically using services like AWS Lambda, Amazon API Gateway, and Amazon S3. We will review several frameworks that can help you build serverle...
Mar. 22, 2017 06:30 PM EDT Reads: 1,069
As Enterprise business moves from Monoliths to Microservices, adoption and successful implementations of Microservices become more evident. The goal of Microservices is to improve software delivery speed and increase system safety as scale increases. Documenting hurdles and problems for the use of Microservices will help consultants, architects and specialists to avoid repeating the same mistakes and learn how and when to use (or not use) Microservices at the enterprise level. The circumstance w...
Mar. 22, 2017 03:00 PM EDT Reads: 3,920
DevOps is often described as a combination of technology and culture. Without both, DevOps isn't complete. However, applying the culture to outdated technology is a recipe for disaster; as response times grow and connections between teams are delayed by technology, the culture will die. A Nutanix Enterprise Cloud has many benefits that provide the needed base for a true DevOps paradigm. In his Day 3 Keynote at 20th Cloud Expo, Chris Brown, a Solutions Marketing Manager at Nutanix, will explore t...
Mar. 22, 2017 02:15 PM EDT Reads: 2,140
DevOps is often described as a combination of technology and culture. Without both, DevOps isn't complete. However, applying the culture to outdated technology is a recipe for disaster; as response times grow and connections between teams are delayed by technology, the culture will die. A Nutanix Enterprise Cloud has many benefits that provide the needed base for a true DevOps paradigm.
Mar. 22, 2017 02:00 PM EDT Reads: 792
With major technology companies and startups seriously embracing Cloud strategies, now is the perfect time to attend @CloudExpo | @ThingsExpo, June 6-8, 2017, at the Javits Center in New York City, NY and October 31 - November 2, 2017, Santa Clara Convention Center, CA. Learn what is going on, contribute to the discussions, and ensure that your enterprise is on the right path to Digital Transformation.
Mar. 22, 2017 01:30 PM EDT Reads: 8,101
The IT industry is undergoing a significant evolution to keep up with cloud application demand. We see this happening as a mindset shift, from traditional IT teams to more well-rounded, cloud-focused job roles. The IT industry has become so cloud-minded that Gartner predicts that by 2020, this cloud shift will impact more than $1 trillion of global IT spending. This shift, however, has left some IT professionals feeling a little anxious about what lies ahead. The good news is that cloud computin...
Mar. 22, 2017 01:00 PM EDT Reads: 444
@DevOpsSummit at Cloud taking place June 6-8, 2017, at Javits Center, New York City, is co-located with the 20th International Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The widespread success of cloud computing is driving the DevOps revolution in enterprise IT. Now as never before, development teams must communicate and collaborate in a dynamic, 24/7/365 environment. There is no time to wait for long developm...
Mar. 22, 2017 12:00 PM EDT Reads: 2,626
Everyone wants to use containers, but monitoring containers is hard. New ephemeral architecture introduces new challenges in how monitoring tools need to monitor and visualize containers, so your team can make sense of everything. In his session at @DevOpsSummit, David Gildeh, co-founder and CEO of Outlyer, will go through the challenges and show there is light at the end of the tunnel if you use the right tools and understand what you need to be monitoring to successfully use containers in your...
Mar. 22, 2017 11:15 AM EDT Reads: 790
In his General Session at 16th Cloud Expo, David Shacochis, host of The Hybrid IT Files podcast and Vice President at CenturyLink, investigated three key trends of the “gigabit economy" though the story of a Fortune 500 communications company in transformation. Narrating how multi-modal hybrid IT, service automation, and agile delivery all intersect, he will cover the role of storytelling and empathy in achieving strategic alignment between the enterprise and its information technology.
Mar. 22, 2017 08:00 AM EDT Reads: 7,166
Without a clear strategy for cost control and an architecture designed with cloud services in mind, costs and operational performance can quickly get out of control. To avoid multiple architectural redesigns requires extensive thought and planning. Boundary (now part of BMC) launched a new public-facing multi-tenant high resolution monitoring service on Amazon AWS two years ago, facing challenges and learning best practices in the early days of the new service.
Mar. 22, 2017 03:30 AM EDT Reads: 2,713
All organizations that did not originate this moment have a pre-existing culture as well as legacy technology and processes that can be more or less amenable to DevOps implementation. That organizational culture is influenced by the personalities and management styles of Executive Management, the wider culture in which the organization is situated, and the personalities of key team members at all levels of the organization. This culture and entrenched interests usually throw a wrench in the work...
Mar. 22, 2017 01:00 AM EDT Reads: 2,620
SYS-CON Events announced today that HTBase will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. HTBase (Gartner 2016 Cool Vendor) delivers a Composable IT infrastructure solution architected for agility and increased efficiency. It turns compute, storage, and fabric into fluid pools of resources that are easily composed and re-composed to meet each application’s needs. With HTBase, companies can quickly prov...
Mar. 22, 2017 12:45 AM EDT Reads: 2,207
As software becomes more and more complex, we, as software developers, have been splitting up our code into smaller and smaller components. This is also true for the environment in which we run our code: going from bare metal, to VMs to the modern-day Cloud Native world of containers, schedulers and micro services. While we have figured out how to run containerized applications in the cloud using schedulers, we've yet to come up with a good solution to bridge the gap between getting your contain...
Mar. 21, 2017 10:15 PM EDT Reads: 7,017
TechTarget storage websites are the best online information resource for news, tips and expert advice for the storage, backup and disaster recovery markets. By creating abundant, high-quality editorial content across more than 140 highly targeted technology-specific websites, TechTarget attracts and nurtures communities of technology buyers researching their companies' information technology needs. By understanding these buyers' content consumption behaviors, TechTarget creates the purchase inte...
Mar. 21, 2017 09:45 PM EDT Reads: 4,019
In recent years, containers have taken the world by storm. Companies of all sizes and industries have realized the massive benefits of containers, such as unprecedented mobility, higher hardware utilization, and increased flexibility and agility; however, many containers today are non-persistent. Containers without persistence miss out on many benefits, and in many cases simply pass the responsibility of persistence onto other infrastructure, adding additional complexity.
Mar. 21, 2017 02:15 PM EDT Reads: 3,894
Buzzword alert: Microservices and IoT at a DevOps conference? What could possibly go wrong? In this Power Panel at DevOps Summit, moderated by Jason Bloomberg, the leading expert on architecting agility for the enterprise and president of Intellyx, panelists peeled away the buzz and discuss the important architectural principles behind implementing IoT solutions for the enterprise. As remote IoT devices and sensors become increasingly intelligent, they become part of our distributed cloud enviro...
Mar. 21, 2017 12:00 PM EDT Reads: 7,677
Building custom add-ons does not need to be limited to the ideas you see on a marketplace. In his session at 20th Cloud Expo, Sukhbir Dhillon, CEO and founder of Addteq, will go over some adventures they faced in developing integrations using Atlassian SDK and other technologies/platforms and how it has enabled development teams to experiment with newer paradigms like Serverless and newer features of Atlassian SDKs. In this presentation, you will be taken on a journey of Add-On and Integration ...
Mar. 21, 2017 07:45 AM EDT Reads: 2,877
True Story. Over the past few years, Fannie Mae transformed the way in which they delivered software. Deploys increased from 1,200/month to 15,000/month. At the same time, productivity increased by 28% while reducing costs by 30%. But, how did they do it? During the All Day DevOps conference, over 13,500 practitioners from around the world to learn from their peers in the industry. Barry Snyder, Senior Manager of DevOps at Fannie Mae, was one of 57 practitioners who shared his real world journe...
Mar. 21, 2017 07:00 AM EDT Reads: 3,448
An overall theme of Cloud computing and the specific practices within it is fundamentally one of automation. The core value of technology is to continually automate low level procedures to free up people to work on more value add activities, ultimately leading to the utopian goal of full Autonomic Computing. For example a great way to define your plan for DevOps tool chain adoption is through this lens. In this TechTarget article they outline a simple maturity model for planning this.
Mar. 21, 2017 05:45 AM EDT Reads: 4,141
The essence of cloud computing is that all consumable IT resources are delivered as services. In his session at 15th Cloud Expo, Yung Chou, Technology Evangelist at Microsoft, demonstrated the concepts and implementations of two important cloud computing deliveries: Infrastructure as a Service (IaaS) and Platform as a Service (PaaS). He discussed from business and technical viewpoints what exactly they are, why we care, how they are different and in what ways, and the strategies for IT to transi...
Mar. 21, 2017 05:00 AM EDT Reads: 5,638