Microservices Expo Authors: AppDynamics Blog, Liz McMillan, TJ Randall, Elizabeth White, Pat Romanski

Related Topics: Microservices Expo

Microservices Expo: Article

Managing Enterprise Data Complexity Using Web Services: Part 2

Developing enterprise digital dashboards using data services architecture

We take the case of a multibillion-dollar automotive company that has business units spread across geographies. The automotive company is structured across geographies as strategic business units (SBUs). SBUs have a mix of both legacy as well as modern systems (e.g., ERP, SCM, and CRM). The systems of the automotive company across SBUs are as follows:

1.  North America

  • Legacy systems (Mainframes)
2.  Europe
  • Legacy + SCM
3.  Asia
  • ERP + SCM + CRM
4.  South America
  • Java based + Oracle RDBMS
The automotive company wants to offer its CEO a top-level view of the performance of its SBUs. The KPIs required are:

1.  Revenues by SBU

  • Drill down (break up by product categories e.g., trucks, cars)
    - Drill down (break up by brands)
2.  Revenues - target vs. actual, by SBU
  • Drill down (break up by product categories)
    - Drill down (break up by cars)
3.  Revenue forecast by SBU
  • Drill down (break-up by product categories)
    - Drill down (break-up by cars)
4.  Sales volumes by SBU
  • Drill down (break up by product categories)
    - Drill down (break up by cars)
5.  Production volumes by SBU
  • Drill down (break up by manufacturing plants)
    - Drill down (break up by cars)
6.  Top dealers by SBU
  • Drill down (break up by product categories)
    - Drill down (break up by cars)
7.  Profit margins by SBU
  • Drill down (break up by product categories)
Current Enterprise Architecture
The current high-level architecture of the systems is illustrated in Figure 1. This diagram highlights the scatter of critical data across geographies. Given the nature of the problem requirements and the diversity of the data sources involved, it seems that the management of the data sources and the centralization of common data across lines of business and geographies would prove to be very important in fulfilling the business requirements. Some of the specific issues and challenges in this regard are listed below.
  • Heterogeneous applications: Core data is required by the dashboard as well as by other enterprise applications. In order to be consistent, the data must be integrated and disseminated using open standards. All consumers of data must obtain data from the same source. Apart from this, the dashboard would require leveraging logic from several applications that are written using different technologies. These disparate applications must be integrated to present consistent information to the dashboard.
  • Incomplete view of data: The scatter of critical data, e.g., customer data across multiple databases in various businesses and geographies creates a serious issue with respect to the identification of key customer attributes.
  • Complex systems logic: The spread of multiple systems and databases will result in business applications having to embed the logic associated with the retrieval/update of multiple data elements residing in different databases.
  • Financial impact: Depending on the manner in which specific technologies have evolved in a given LOB (Line of Business), the data access techniques may vary between applications. This can lead to higher costs incurred for integration across lines of business due to the difference in technical abilities between lines of business.
  • Problems due to multiple channels of update: As discussed above, the core business data in a specific database may be updated by a number of mechanisms such as direct update through the business applications dedicated for that line of business, indirect update through synchronization, and update through other channels.
  • User experience issues: Such a situation may arise when a user requests a change in personal information over the phone or IVR and attempts to look up the same data online. Latencies in the update of the data that has been sent over the phone may cause incorrect data to be displayed.
  • Resource contention: This issue can arise due to heavy loads on any of the databases arising during a bulk update situation.
  • Latencies in data retrieval: The spread of critical data across multiple databases and the associated redundancy may cause additional latencies for certain applications. This can happen due to the bulk update scenario illustrated above.
The proposed architecture for the dashboard consists of two main tiers: the data access tier and the enterprise dashboard tier. The enterprise dashboard provides an aggregated view of the enterprise information collected from varied data sources that are geographically dispersed.

More Stories By Sriram Anand

Dr. Sriram Anand is a principal researcher at Infosys Technologies, Bangalore. Prior to joining Infosys he worked in IT consulting as well as product engineering in the US for over 12 years. His interests include enterprise architecture, service-oriented architecture, and legacy integration and software engineering methodologies. Dr. Anand is experienced in designing enterprise architectural strategy for leading U.S. companies in the financial services, retail, and pharmaceutical domains. He holds a Bachelor?s degree from IIT-Madras with a PhD from SUNY-Buffalo, USA.

More Stories By Dr. Jai Ganesh

Dr. Jai Ganesh is a Research Associate with the technology research division of Infosys Technologies Limited. He obtained his PhD in information systems from the Indian Institute of Management Bangalore (IIMB) in 2003 and holds an MBA degree in corporate strategy and marketing. His research focuses on Web services, IT strategy and adaptive enterprises.

His research has been published in journals such as Information and Management, Journal of Global Information Management, International Journal of Retail and Distribution Management, etc. and conferences such as AMCIS, ICWS, ICEC, ICEB etc. He serves as a reviewer for a number of peer-reviewed journals and conferences, and has consulted for many software firms.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.

Microservices Articles
With the rise of Docker, Kubernetes, and other container technologies, the growth of microservices has skyrocketed among dev teams looking to innovate on a faster release cycle. This has enabled teams to finally realize their DevOps goals to ship and iterate quickly in a continuous delivery model. Why containers are growing in popularity is no surprise — they’re extremely easy to spin up or down, but come with an unforeseen issue. However, without the right foresight, DevOps and IT teams may lo...
DevOps is under attack because developers don’t want to mess with infrastructure. They will happily own their code into production, but want to use platforms instead of raw automation. That’s changing the landscape that we understand as DevOps with both architecture concepts (CloudNative) and process redefinition (SRE). Rob Hirschfeld’s recent work in Kubernetes operations has led to the conclusion that containers and related platforms have changed the way we should be thinking about DevOps and...
At its core DevOps is all about collaboration. The lines of communication must be opened and it takes some effort to ensure that they stay that way. It’s easy to pay lip service to trends and talk about implementing new methodologies, but without action, real benefits cannot be realized. Success requires planning, advocates empowered to effect change, and, of course, the right tooling. To bring about a cultural shift it’s important to share challenges. In simple terms, ensuring that everyone k...
Is advanced scheduling in Kubernetes achievable?Yes, however, how do you properly accommodate every real-life scenario that a Kubernetes user might encounter? How do you leverage advanced scheduling techniques to shape and describe each scenario in easy-to-use rules and configurations? In his session at @DevOpsSummit at 21st Cloud Expo, Oleg Chunikhin, CTO at Kublr, answered these questions and demonstrated techniques for implementing advanced scheduling. For example, using spot instances and co...
Today most companies are adopting or evaluating container technology - Docker in particular - to speed up application deployment, drive down cost, ease management and make application delivery more flexible overall. As with most new architectures, this dream takes significant work to become a reality. Even when you do get your application componentized enough and packaged properly, there are still challenges for DevOps teams to making the shift to continuous delivery and achieving that reducti...
Skeuomorphism usually means retaining existing design cues in something new that doesn’t actually need them. However, the concept of skeuomorphism can be thought of as relating more broadly to applying existing patterns to new technologies that, in fact, cry out for new approaches. In his session at DevOps Summit, Gordon Haff, Senior Cloud Strategy Marketing and Evangelism Manager at Red Hat, discussed why containers should be paired with new architectural practices such as microservices rathe...
Kubernetes is a new and revolutionary open-sourced system for managing containers across multiple hosts in a cluster. Ansible is a simple IT automation tool for just about any requirement for reproducible environments. In his session at @DevOpsSummit at 18th Cloud Expo, Patrick Galbraith, a principal engineer at HPE, will discuss how to build a fully functional Kubernetes cluster on a number of virtual machines or bare-metal hosts. Also included will be a brief demonstration of running a Galer...
In his session at 20th Cloud Expo, Mike Johnston, an infrastructure engineer at Supergiant.io, will discuss how to use Kubernetes to setup a SaaS infrastructure for your business. Mike Johnston is an infrastructure engineer at Supergiant.io with over 12 years of experience designing, deploying, and maintaining server and workstation infrastructure at all scales. He has experience with brick and mortar data centers as well as cloud providers like Digital Ocean, Amazon Web Services, and Rackspace....
"There is a huge interest in Kubernetes. People are now starting to use Kubernetes and implement it," stated Sebastian Scheele, co-founder of Loodse, in this SYS-CON.tv interview at DevOps at 19th Cloud Expo, held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.
Modern software design has fundamentally changed how we manage applications, causing many to turn to containers as the new virtual machine for resource management. As container adoption grows beyond stateless applications to stateful workloads, the need for persistent storage is foundational - something customers routinely cite as a top pain point. In his session at @DevOpsSummit at 21st Cloud Expo, Bill Borsari, Head of Systems Engineering at Datera, explored how organizations can reap the bene...