Microservices Expo Authors: Liz McMillan, Mehdi Daoudi, Pat Romanski, Andy Thurai, Elizabeth White

Related Topics: Microservices Expo

Microservices Expo: Article

Managing Enterprise Data Complexity Using Web Services: Part 2

Developing enterprise digital dashboards using data services architecture

We take the case of a multibillion-dollar automotive company that has business units spread across geographies. The automotive company is structured across geographies as strategic business units (SBUs). SBUs have a mix of both legacy as well as modern systems (e.g., ERP, SCM, and CRM). The systems of the automotive company across SBUs are as follows:

1.  North America

  • Legacy systems (Mainframes)
2.  Europe
  • Legacy + SCM
3.  Asia
  • ERP + SCM + CRM
4.  South America
  • Java based + Oracle RDBMS
The automotive company wants to offer its CEO a top-level view of the performance of its SBUs. The KPIs required are:

1.  Revenues by SBU

  • Drill down (break up by product categories e.g., trucks, cars)
    - Drill down (break up by brands)
2.  Revenues - target vs. actual, by SBU
  • Drill down (break up by product categories)
    - Drill down (break up by cars)
3.  Revenue forecast by SBU
  • Drill down (break-up by product categories)
    - Drill down (break-up by cars)
4.  Sales volumes by SBU
  • Drill down (break up by product categories)
    - Drill down (break up by cars)
5.  Production volumes by SBU
  • Drill down (break up by manufacturing plants)
    - Drill down (break up by cars)
6.  Top dealers by SBU
  • Drill down (break up by product categories)
    - Drill down (break up by cars)
7.  Profit margins by SBU
  • Drill down (break up by product categories)
Current Enterprise Architecture
The current high-level architecture of the systems is illustrated in Figure 1. This diagram highlights the scatter of critical data across geographies. Given the nature of the problem requirements and the diversity of the data sources involved, it seems that the management of the data sources and the centralization of common data across lines of business and geographies would prove to be very important in fulfilling the business requirements. Some of the specific issues and challenges in this regard are listed below.
  • Heterogeneous applications: Core data is required by the dashboard as well as by other enterprise applications. In order to be consistent, the data must be integrated and disseminated using open standards. All consumers of data must obtain data from the same source. Apart from this, the dashboard would require leveraging logic from several applications that are written using different technologies. These disparate applications must be integrated to present consistent information to the dashboard.
  • Incomplete view of data: The scatter of critical data, e.g., customer data across multiple databases in various businesses and geographies creates a serious issue with respect to the identification of key customer attributes.
  • Complex systems logic: The spread of multiple systems and databases will result in business applications having to embed the logic associated with the retrieval/update of multiple data elements residing in different databases.
  • Financial impact: Depending on the manner in which specific technologies have evolved in a given LOB (Line of Business), the data access techniques may vary between applications. This can lead to higher costs incurred for integration across lines of business due to the difference in technical abilities between lines of business.
  • Problems due to multiple channels of update: As discussed above, the core business data in a specific database may be updated by a number of mechanisms such as direct update through the business applications dedicated for that line of business, indirect update through synchronization, and update through other channels.
  • User experience issues: Such a situation may arise when a user requests a change in personal information over the phone or IVR and attempts to look up the same data online. Latencies in the update of the data that has been sent over the phone may cause incorrect data to be displayed.
  • Resource contention: This issue can arise due to heavy loads on any of the databases arising during a bulk update situation.
  • Latencies in data retrieval: The spread of critical data across multiple databases and the associated redundancy may cause additional latencies for certain applications. This can happen due to the bulk update scenario illustrated above.
The proposed architecture for the dashboard consists of two main tiers: the data access tier and the enterprise dashboard tier. The enterprise dashboard provides an aggregated view of the enterprise information collected from varied data sources that are geographically dispersed.

More Stories By Sriram Anand

Dr. Sriram Anand is a principal researcher at Infosys Technologies, Bangalore. Prior to joining Infosys he worked in IT consulting as well as product engineering in the US for over 12 years. His interests include enterprise architecture, service-oriented architecture, and legacy integration and software engineering methodologies. Dr. Anand is experienced in designing enterprise architectural strategy for leading U.S. companies in the financial services, retail, and pharmaceutical domains. He holds a Bachelor?s degree from IIT-Madras with a PhD from SUNY-Buffalo, USA.

More Stories By Dr. Jai Ganesh

Dr. Jai Ganesh is a Research Associate with the technology research division of Infosys Technologies Limited. He obtained his PhD in information systems from the Indian Institute of Management Bangalore (IIMB) in 2003 and holds an MBA degree in corporate strategy and marketing. His research focuses on Web services, IT strategy and adaptive enterprises.

His research has been published in journals such as Information and Management, Journal of Global Information Management, International Journal of Retail and Distribution Management, etc. and conferences such as AMCIS, ICWS, ICEC, ICEB etc. He serves as a reviewer for a number of peer-reviewed journals and conferences, and has consulted for many software firms.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.

Microservices Articles
"NetApp's vision is how we help organizations manage data - delivering the right data in the right place, in the right time, to the people who need it, and doing it agnostic to what the platform is," explained Josh Atwell, Developer Advocate for NetApp, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
TCP (Transmission Control Protocol) is a common and reliable transmission protocol on the Internet. TCP was introduced in the 70s by Stanford University for US Defense to establish connectivity between distributed systems to maintain a backup of defense information. At the time, TCP was introduced to communicate amongst a selected set of devices for a smaller dataset over shorter distances. As the Internet evolved, however, the number of applications and users, and the types of data accessed and...
DevOps is often described as a combination of technology and culture. Without both, DevOps isn't complete. However, applying the culture to outdated technology is a recipe for disaster; as response times grow and connections between teams are delayed by technology, the culture will die. A Nutanix Enterprise Cloud has many benefits that provide the needed base for a true DevOps paradigm. In their Day 3 Keynote at 20th Cloud Expo, Chris Brown, a Solutions Marketing Manager at Nutanix, and Mark Lav...
Kin Lane recently wrote a couple of blogs about why copyrighting an API is not common. I couldn’t agree more that copyrighting APIs is uncommon. First of all, the API definition is just an interface (It is the implementation detail … Continue reading →
The Jevons Paradox suggests that when technological advances increase efficiency of a resource, it results in an overall increase in consumption. Writing on the increased use of coal as a result of technological improvements, 19th-century economist William Stanley Jevons found that these improvements led to the development of new ways to utilize coal. In his session at 19th Cloud Expo, Mark Thiele, Chief Strategy Officer for Apcera, compared the Jevons Paradox to modern-day enterprise IT, examin...
The Software Defined Data Center (SDDC), which enables organizations to seamlessly run in a hybrid cloud model (public + private cloud), is here to stay. IDC estimates that the software-defined networking market will be valued at $3.7 billion by 2016. Security is a key component and benefit of the SDDC, and offers an opportunity to build security 'from the ground up' and weave it into the environment from day one. In his session at 16th Cloud Expo, Reuven Harrison, CTO and Co-Founder of Tufin, ...
Many organizations are now looking to DevOps maturity models to gauge their DevOps adoption and compare their maturity to their peers. However, as enterprise organizations rush to adopt DevOps, moving past experimentation to embrace it at scale, they are in danger of falling into the trap that they have fallen into time and time again. Unfortunately, we've seen this movie before, and we know how it ends: badly.
Kubernetes is a new and revolutionary open-sourced system for managing containers across multiple hosts in a cluster. Ansible is a simple IT automation tool for just about any requirement for reproducible environments. In his session at @DevOpsSummit at 18th Cloud Expo, Patrick Galbraith, a principal engineer at HPE, discussed how to build a fully functional Kubernetes cluster on a number of virtual machines or bare-metal hosts. Also included will be a brief demonstration of running a Galera MyS...
Your homes and cars can be automated and self-serviced. Why can't your storage? From simply asking questions to analyze and troubleshoot your infrastructure, to provisioning storage with snapshots, recovery and replication, your wildest sci-fi dream has come true. In his session at @DevOpsSummit at 20th Cloud Expo, Dan Florea, Director of Product Management at Tintri, provided a ChatOps demo where you can talk to your storage and manage it from anywhere, through Slack and similar services with...
Growth hacking is common for startups to make unheard-of progress in building their business. Career Hacks can help Geek Girls and those who support them (yes, that's you too, Dad!) to excel in this typically male-dominated world. Get ready to learn the facts: Is there a bias against women in the tech / developer communities? Why are women 50% of the workforce, but hold only 24% of the STEM or IT positions? Some beginnings of what to do about it! In her Day 2 Keynote at 17th Cloud Expo, Sandy Ca...