Welcome!

Microservices Expo Authors: Elizabeth White, Todd Matters, Pat Romanski, Kevin Jackson, ManageEngine IT Matters

Related Topics: Microservices Expo

Microservices Expo: Article

Knowing When to Use Web Services

Knowing When to Use Web Services

Web services are moving from the latest buzzword to a mature and accepted technology. Mainstream companies such as Eastman Chemical, Wells Fargo, and NEC have begun deploying significant Web Services-Based Integration (WSBI) projects. Avnet Computer Marketing (Avnet CM) is one of many companies also betting heavily on Web services. This month, "Web Services in the Real World" describes Avnet CM's strategic foray into WSBI (see sidebar). We'll explore their business objectives, why they chose Web services for some parts of their architecture (and not others), and the results they achieved.

Background
Avnet Computer Marketing (Avnet CM) markets enterprise technology products from the world's premier computer manufacturers and software suppliers. Customers include value-added resellers (VARs) and enterprise customers, and Avnet CM provides them with marketing support, pricing strategies, and supplier-relationship management. Avnet CM is an operating group of Avnet, Inc. (NYSE:AVT), a Phoenix, Ariz.-based Fortune 500 company. Avnet is a technology marketing and services provider, and one of the world's largest distributors of electronic components and computer products from industry leading manufacturers.

The Challenge
Avnet CM manages Avnet's Hall-Mark e-business portal that allows customers and suppliers to configure and place orders, retrieve real-time pricing and availability information for products, and view their order status.

To provide customers and suppliers with a broad range of online services, Avnet CM needed to connect the portal to various back-end systems using a variety of protocols and file formats. "Maintaining this growing number of proprietary interfaces became untenable and prevented us from being able to respond quickly to new market opportunities," said Bud Alexander, vice president of Enterprise Integrated Solutions. He wanted to build a responsive IT infrastructure that allowed him to

  • Reduce the cost of development and maintenance by consolidating and standardizing internal system interfaces, and
  • Speed time to market by maximizing interface reuse.

    The Solution
    Alexander's strategy was to wrap applications with business-oriented WSDL interfaces, creating common business services, and then to pull data from multiple applications into one "Business Service Hub." (This is one of the usage patterns identified in the first article of this series, "Patterns in Web Services Projects"; WSJ, Vol. 3, issue 5). The goal was to consolidate interfaces and reduce the number of connections among systems. The architecture was required to maximize the potential for reuse, and the services had to be accessible from anywhere using any technology.

    With this framework in place, Alexander hoped to reduce system integration maintenance by combining and reusing connections among systems. Such a model would speed integration by reusing Web service components that were already built.

    The Architecture
    Three integrated portal applications, each developed and maintained by separate teams, provide the following capabilities to Avnet's sales force, customers, and suppliers:

  • Quote to Order: Intranet application used by Avnet sales to provide customers with product quotations and to expeditiously convert them to orders
  • Channel Connection: Customer portal that lets Avnet's authenticated VARs and customers retrieve real-time order status, leads, sales, credit history, and key performance information
  • Customer management: Internal portal that allows customer service representatives to centrally view and update customers' account information

    Avnet CM implemented the Business Service Hub with a Web services-based integration platform (see Figure 1). The portal applications communicate with this integration platform via SOAP to access data from the following back-end systems:

  • The IMS mainframe processes orders and performs other sales order management functions;
  • The operational data store (ODS) consolidates customer data to create a single view of the customer. The ODS is exposed as a simple set of Web services that aggregates information from a CRM system, database, mainframe, and external data from suppliers and manufacturers (using RosettaNet and EDI).

     

    The architecture also includes trading partner gateways for processing orders. Avnet CM currently supports RosettaNet and EDI transactions, and is planning to add a SOAP gateway in the future.

    Why Web Services?
    Avnet CM used Web services between the portal and the integration platform for the following reasons:

  • Simplicity: Even nonprogrammers are able to assemble Web service-based integration solutions using the integration platform tools. According to Alexander, "Users do not need expertise in SOAP or WSDL, so I don't need to hire senior messaging experts to develop integration services. I could put anyone on my integration team, no matter what their experience level, onto Web services projects." In addition, the portal's application server can readily consume SOAP messages. This made the integration easier, faster, and cheaper.
  • Abstraction: The portal team is organizationally separate from the IT team, which owns the back-end systems. The IT team wanted to make it easy for the portal team (and others in the future) to access information without having to know about the complexities and data formats of the back-office. "The portal content team can focus on the presentation layer and need not be proficient in databases, mainframes, and CRM systems. They simply call a Web service using whatever technology they already know," says Alexander. The contract between the teams is the WSDL interface.
  • Reusability: Reuse was critical. Other teams needed to access the same capabilities. Once a connection has been made and exposed as a Web service, it's easy to connect other applications.
  • Performance and reliability: Even though Avnet CM processes a high volume of orders from their web site, they found performance to be satisfactory. Alexander adds that they have never lost a single order.

    These reasons for using Web services are consistent with why other companies said they chose Web services for integration (see "Why Web Services Work"; WSJ, Vol. 3, issue 7). Interestingly, Alexander did not use Web services for the entire project. Specifically, his team did not use Web services between the integration layer and the mainframe and CRM systems. Instead, they used adapters and native APIs. Here's why:

  • Back-end ownership: Alexander's group is responsible for the back-end systems they are integrating with. This means they had the necessary domain expertise, had direct access to these systems, and could control the technology to access these systems. Web services, on the other hand, are better at facilitating the integration between different organizations because they provide an abstraction layer, define a contract (the WSDL interface) between the groups, and let each group use whatever technology they want to access the interface.
  • Lack of SOAP support: The mainframe's SOAP support was inadequate. The CRM systems actually consisted of four separate applications, and not every one of these had native SOAP support. On the other hand, the four systems all supported APIs and adapters.
  • Performance and reliability requirements could not be satisfied with Web services: Each service consisted of a complex set of transactions on the back end that required transactional integrity, which was managed by the integration platform.
  • No reuse required: The mainframe and CRM APIs were never meant to be accessed directly. Thus, reusing the APIs directly was not a requirement. They were instead rolled up into composite applications that were exposed to the outside world as a simpler set of Web services that were meant for reuse.

    The Results
    With Web services connecting several back-end systems with their portal applications, Avnet CM realized the following benefits:

  • Reduced cost of maintaining and extending the integration architecture by consolidating the interfaces and standardizing on Web services. Avnet CM has been able to successfully retire their proprietary interfaces (custom XML, FTP, and IP sockets) in favor of Web services.
  • Faster time to market with improved IT agility. New projects are now measured in days instead of weeks. Previously, integrating the quote-to-order application with the IMS mainframe required approximately six weeks. But, because the Web service was already built, connecting the order entry e-business system took only one day.

    What's Next
    In the future, Avnet CM will extend the Web services framework to its customers and suppliers. "Web services continue to be central to our IT strategy. The investment in our Web serviced-based integration platform allows us to take advantage of our IT investments and to deliver greater value for the company," concludes Alexander.

    Conclusion
    Companies like Avnet CM prove that Web services are maturing as an accepted technology. At the same time, it's clear that Web services are not the silver bullet to solving complex integration problems, either. The trick is figuring out when to use Web services, and when not to. Based on the ROI realized by Avnet and other customers profiled in this column, Web services, and the service-oriented architectures that support them, are increasingly becoming a key component of any successful company's integration strategy.

    SIDEBAR
    Avnet CM turns to Web Services

    Customer: Avnet Computer Marketing is an operating group of Avnet, Inc. (NYSE:AVT), a Phoenix, Ariz.-based Fortune 500 company. Avnet is a technology marketing and services provider and one of the world's largest distributors of electronic components and computer products from industry leading manufacturers.

    Challenge: Consolidate and standardize application interfaces; implement a service-oriented integration architecture to speed time to market.

    Solution: Avnet's e-business portal allows customers and suppliers to configure and place orders, retrieve real-time pricing & availability information, and view their order status. Web Services-Based Integration (WSBI) feeds the portal with data from various back-end systems.

    Why Web Services: Avnet chose WSBI primarily for three reasons:

    • Simplicity
    • Reusability
    • Abstraction
    Key Business Benefits: By using WSBI, Avnet benefits from:
    • Reduced development and maintenance cost
    • IT agility
    • Faster time to market
  • More Stories By Michael Blank

    Michael Blank is a founding member of webMethods, Inc. and was its first software engineer. During his tenure, he has started and commercialized several product offerings. As director of developer marketing, he manages webMethods’ developer communities as well as the software evaluation program (http://evals.webmethods.com).

    Comments (2) View Comments

    Share your thoughts on this story.

    Add your comment
    You must be signed in to add a comment. Sign-in | Register

    In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


    Most Recent Comments
    Michael Blank 12/02/03 12:38:59 PM EST

    Below is the response from Avnet:

    1. Did you use Trading Networks to use webservices ? or you have exposed
    webservices to the partner directly ?

    The external facing web services are exposed to to our partners via a UDDI server which allow for anonymous browsing of services. We do not use Trading Networks to manage Avnet's web services environment.

    2. Do you suggest me to use WebServices or Trading Networks for the batch
    customer processing coming in single XML document ? Please let me know what
    your views on this.

    Trading Networks natively will handle XML documents via it's 'receive' service. Once it is received the document can then be processed and routed via the routing rules that are associated with the document. In the case of batch processing you could route the request to a service that would break it apart to be processed as individual transactions. Web Services have a role of transporting the document and Trading Networks have a role of managing the documents once they are received or submitted.

    naveen kenche 11/20/03 03:14:47 PM EST

    Hi!, I understood the way you have used webservices from the external clients. My questions are as follows.
    1. Did you use Trading Networks to use webservices ? or you have exposed webservices to the partner directly ?
    2. Do you suggest me to use WebServices or Trading Networks for the batch customer processing coming in single XML document ? Please let me know what your views on this.
    Thanks and Regards
    Naveen

    @MicroservicesExpo Stories
    @DevOpsSummit at Cloud Expo taking place Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center, Santa Clara, CA, is co-located with the 21st International Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The widespread success of cloud computing is driving the DevOps revolution in enterprise IT. Now as never before, development teams must communicate and collaborate in a dynamic, 24/7/365 environment. There is ...
    For most organizations, the move to hybrid cloud is now a question of when, not if. Fully 82% of enterprises plan to have a hybrid cloud strategy this year, according to Infoholic Research. The worldwide hybrid cloud computing market is expected to grow about 34% annually over the next five years, reaching $241.13 billion by 2022. Companies are embracing hybrid cloud because of the many advantages it offers compared to relying on a single provider for all of their cloud needs. Hybrid offers bala...
    You know you need the cloud, but you’re hesitant to simply dump everything at Amazon since you know that not all workloads are suitable for cloud. You know that you want the kind of ease of use and scalability that you get with public cloud, but your applications are architected in a way that makes the public cloud a non-starter. You’re looking at private cloud solutions based on hyperconverged infrastructure, but you’re concerned with the limits inherent in those technologies.
    For organizations that have amassed large sums of software complexity, taking a microservices approach is the first step toward DevOps and continuous improvement / development. Integrating system-level analysis with microservices makes it easier to change and add functionality to applications at any time without the increase of risk. Before you start big transformation projects or a cloud migration, make sure these changes won’t take down your entire organization.
    There's a lot to gain from cloud computing, but success requires a thoughtful and enterprise focused approach. Cloud computing decouples data and information from the infrastructure on which it lies. A process that is a LOT more involved than dragging some folders from your desktop to a shared drive. Cloud computing as a mission transformation activity, not a technological one. As an organization moves from local information hosting to the cloud, one of the most important challenges is addressi...
    Managing mission-critical SAP systems and landscapes has never been easy. Add public cloud with its myriad of powerful cloud native services and this may not change any time soon. Public cloud offers exciting new possibilities for enterprise workloads. But to make use of these possibilities and capabilities, IT teams need to re-think everything they have done before. Otherwise, they will just end up using public cloud as a hosting platform for their workloads, aka known as “lift and shift.”
    What's the role of an IT self-service portal when you get to continuous delivery and Infrastructure as Code? This general session showed how to create the continuous delivery culture and eight accelerators for leading the change. Don Demcsak is a DevOps and Cloud Native Modernization Principal for Dell EMC based out of New Jersey. He is a former, long time, Microsoft Most Valuable Professional, specializing in building and architecting Application Delivery Pipelines for hybrid legacy, and cloud ...
    21st International Cloud Expo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, will feature technical sessions from a rock star conference faculty and the leading industry players in the world. Cloud computing is now being embraced by a majority of enterprises of all sizes. Yesterday's debate about public vs. private has transformed into the reality of hybrid cloud: a recent survey shows that 74% of enterprises have a hybrid cloud strategy. Me...
    The reality of data ubiquity is here—data is buried in operational statistics, machine logs, stacks of overflowing tickets and customer details, among other things. How can any user get valuable information amid this rapid influx of data? Imagine a situation where your firm’s revenue takes a hit owing to an unexpected failure in some business process. It would be a nightmare for IT admins to sift through the interminable piles of data to deduce exactly why and where the problem occurred. To sav...
    "Tintri focuses on the Ops side of the DevOps, which basically is pushing more and more of the accessibility of the infrastructure to the developers and trying to get behind the scenes," explained Dhiraj Sehgal of Tintri in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
    SYS-CON Events announced today that CA Technologies has been named "Platinum Sponsor" of SYS-CON's 21st International Cloud Expo®, which will take place October 31-November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. CA Technologies helps customers succeed in a future where every business - from apparel to energy - is being rewritten by software. From planning to development to management to security, CA creates software that fuels transformation for companies in the applic...
    Cloud Expo, Inc. has announced today that Andi Mann and Aruna Ravichandran have been named Co-Chairs of @DevOpsSummit at Cloud Expo Silicon Valley which will take place Oct. 31-Nov. 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. "DevOps is at the intersection of technology and business-optimizing tools, organizations and processes to bring measurable improvements in productivity and profitability," said Aruna Ravichandran, vice president, DevOps product and solutions marketing...
    Both SaaS vendors and SaaS buyers are going “all-in” to hyperscale IaaS platforms such as AWS, which is disrupting the SaaS value proposition. Why should the enterprise SaaS consumer pay for the SaaS service if their data is resident in adjacent AWS S3 buckets? If both SaaS sellers and buyers are using the same cloud tools, automation and pay-per-transaction model offered by IaaS platforms, then why not host the “shrink-wrapped” software in the customers’ cloud? Further, serverless computing, cl...
    In the decade following his article, cloud computing further cemented Carr’s perspective. Compute, storage, and network resources have become simple utilities, available at the proverbial turn of the faucet. The value they provide is immense, but the cloud playing field is amazingly level. Carr’s quote above presaged the cloud to a T. Today, however, we’re in the digital era. Mark Andreesen’s ‘software is eating the world’ prognostication is coming to pass, as enterprises realize they must be...
    Hybrid IT is today’s reality, and while its implementation may seem daunting at times, more and more organizations are migrating to the cloud. In fact, according to SolarWinds 2017 IT Trends Index: Portrait of a Hybrid IT Organization 95 percent of organizations have migrated crucial applications to the cloud in the past year. As such, it’s in every IT professional’s best interest to know what to expect.
    A common misconception about the cloud is that one size fits all. Companies expecting to run all of their operations using one cloud solution or service must realize that doing so is akin to forcing the totality of their business functionality into a straightjacket. Unlocking the full potential of the cloud means embracing the multi-cloud future where businesses use their own cloud, and/or clouds from different vendors, to support separate functions or product groups. There is no single cloud so...
    Companies have always been concerned that traditional enterprise software is slow and complex to install, often disrupting critical and time-sensitive operations during roll-out. With the growing need to integrate new digital technologies into the enterprise to transform business processes, this concern has become even more pressing. A 2016 Panorama Consulting Solutions study revealed that enterprise resource planning (ERP) projects took an average of 21 months to install, with 57 percent of th...
    In 2014, Amazon announced a new form of compute called Lambda. We didn't know it at the time, but this represented a fundamental shift in what we expect from cloud computing. Now, all of the major cloud computing vendors want to take part in this disruptive technology. In his session at 20th Cloud Expo, Doug Vanderweide, an instructor at Linux Academy, discussed why major players like AWS, Microsoft Azure, IBM Bluemix, and Google Cloud Platform are all trying to sidestep VMs and containers wit...
    The taxi industry never saw Uber coming. Startups are a threat to incumbents like never before, and a major enabler for startups is that they are instantly “cloud ready.” If innovation moves at the pace of IT, then your company is in trouble. Why? Because your data center will not keep up with frenetic pace AWS, Microsoft and Google are rolling out new capabilities. In his session at 20th Cloud Expo, Don Browning, VP of Cloud Architecture at Turner, posited that disruption is inevitable for comp...
    New competitors, disruptive technologies, and growing expectations are pushing every business to both adopt and deliver new digital services. This ‘Digital Transformation’ demands rapid delivery and continuous iteration of new competitive services via multiple channels, which in turn demands new service delivery techniques – including DevOps. In this power panel at @DevOpsSummit 20th Cloud Expo, moderated by DevOps Conference Co-Chair Andi Mann, panelists examined how DevOps helps to meet the de...