Microservices Expo Authors: TJ Randall, David Sprott, Liz McMillan, Pat Romanski, Derek Weeks

Related Topics: Microservices Expo, Java IoT, Agile Computing, Release Management , @CloudExpo

Microservices Expo: Article

How to Enhance Applications to Support Business Agility (Part 2)

Soaring with the cloud – “no software” doesn’t mean “no integration”

Sustaining applications in the most cost-effective and efficient fashion is the foundation to maximizing a return on data. But it is only the foundation. Organizations have to move beyond sustaining applications to driving innovation, and the first step in that progression is learning the best ways to enhance existing applications and implement new applications that will help modernize business processes and support business agility.

The challenges around enhancing applications are well agreed upon. The top challenges include:

  • Insufficient Data Quality - Data quality issues of one degree or another are pervasive in the majority of enterprises, leading users to distrust the data. This is a problem within applications and, even more so, across applications.
  • Right-Time Access to Information - The pace of business continues to accelerate, and users can no longer wait weeks or days for information necessary to perform their jobs. If business users need immediate access to fresh and trusted information in the applications they use every day, IT must find ways to provide it.
  • SaaS Sprawl - As more and more applications move to the Cloud, IT needs to be proactive in maintaining visibility and control over SaaS applications and their data, including the ability to easily integrate them with on-premise applications. After all, "no software" does not imply "no integration."
  • Successful Data Migration to New Applications - As organizations implement new applications, existing data must be moved quickly and smoothly to the new apps, on time and on budget, so that dependent business processes are not negatively impacted.

Building Trust in the Data with Automated Data Quality
The core reason why business users lack trust in their data is because that data resides in data silos across multiple systems and, when it is delivered to them, it is all too frequently inconsistent, incorrect and incomplete, not to mention late. This impacts both day-to-day data usage as well as strategic usage. For example, Procurement processes need consistent and correct data on vendor price and performance in order to negotiate favorable contracts, as well as data that is timely in order to either drive or block purchase requisitions and payments to vendors per their adherence to their contracts.

Hence, the first step to modernizing business processes is to enhance application quality with trusted, authoritative data that is predictable, valuable and timely, regardless of how many source systems it is being drawn and integrated from.

Integrating data quality processes into the overall enterprise data integration process is a definitive step for any organization looking to build user trust in their data. This is as simple as introducing automated data cleansing that can be leveraged by all applications across the company. A further step is introducing proactive data quality monitoring capabilities into the hands of data owners, so they participate in improving the quality of their information.

The payoff comes with users spending less time reconciling data and more time working with it.

Ensuring Right-Time Delivery with Data services
Ensuring that the right information is delivered at the right time to the right person is another formidable challenge, but one that can be solved, and data services provide the solution within the context of a service-oriented architecture (SOA). Traditional SOA approaches lack a data integration layer. Anything that cannot be handled by a simple Web service, such as complex data transformations or data cleansing, requires hand-coding and proprietary interfaces, which are things one wants to avoid.

Data services, on the other hand, present a discrete set of sophisticated data integration tasks that support the entire data integration life cycle. These data services can be readily consumed as Web services by the various components of a SOA, and also by composite applications and portals. The complexity of the task is hidden, plus the data services can be easily published to SOA registries and repositories.

Results? Organizations using data services have reported up to five times faster delivery of new data, and cost savings of up to three times. This means that these organizations are able to respond faster to changing information demands, increase IT project success rates, and even deliver comprehensive single customer views on-demand to help drive new revenues and increase customer satisfaction.

Soaring with the Cloud - "No Software" Doesn't Mean "No Integration"
SaaS application spending, as everyone knows, is soaring. As a result, more and more companies need to find ways to support hybrid IT infrastructures that span cloud and on-premise applications and make them work seamlessly together to maximize the return on all enterprise data. And this requires data integration.

Cloud applications have to integrate with other systems in order to provide full value. At the same time, integration needs to happen in a secure fashion lest IT lose control of enterprise data assets. Fortunately, appropriately designed cloud data integration will support hybrid IT environments, essentially by extending unified, enterprise-class data integration services to the cloud.

Things to look for when supporting hybrid IT include a "secure agent" that provides the ability to create and securely manage all aspects of integration jobs, which can be shared between on-premise and cloud deployments. While the agent can be invoked via a web browser, what it does is establish a secure connection between data source and data target and all data integration processing occurs on-premise in the enterprise environment for maximum IT control.

Ensuring the Success of New Applications Through Efficient Migration
As organizations modernize their systems and business processes, they find that migrating data to their new applications is not usually a slam dunk proposition. All data migrations are inherently risky and subject to the lack of suitable tools, skills, knowledge of the data, and an access, validation, and audit strategy. Moreover, there is a lack of tools and processes to help business stakeholders and data users ensure and verify that the data is actually fit for use.

Having the right technology platform and skills goes a long way toward ensuring an on-time and on-budget migration. Knowledge of the data that is being moved is critical to each step of the migration process and ultimately is key to ensuring that the migrated data actually "works" in the new application. Having an infrastructure that supports change during the migration process is mandatory. And active business involvement is the hallmark of every successful migration. Hand-coding, using the wrong migration methodology, and relying strictly on IT are all pathways to migration time and money overruns or outright failure.

In selecting a migration platform, you want to ensure it provides:

  • Connectivity to the broadest range of environments and databases
  • Built-in data quality profiling, cleansing, and transformations (for all data types)
  • Fast, easy development, updating, and reuse of transformations
  • Easy auditability of the data from source to target

From Application Enhancement to Business Transformation
The above steps, from building trust in data to ensuring the success of new applications, all speak to enhancing applications to drive business process modernization and business agility. The next leap is to transform applications and, by extension, to transform the business, to drive innovation and growth. Much of what is accomplishable to enhance applications is leveragable when transforming them, but there are also new and highly valuable things to accomplish, as will to be seen in Part 3 of this article.

More Stories By Adam Wilson

Adam Wilson is the General Manager for Informatica’s Information Lifecycle Management Business Unit. Prior to assuming this role, he was in charge of product definition and go-to-market strategy for Informatica’s award-winning enterprise data integration platform. Mr. Wilson holds an MBA from the Kellogg School of Management and an engineering degree from Northwestern University. He can be reached at [email protected] or follow him on Twitter @ a_adam_wilson

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.

@MicroservicesExpo Stories
Right off the bat, Newman advises that we should "think of microservices as a specific approach for SOA in the same way that XP or Scrum are specific approaches for Agile Software development". These analogies are very interesting because my expectation was that microservices is a pattern. So I might infer that microservices is a set of process techniques as opposed to an architectural approach. Yet in the book, Newman clearly includes some elements of concept model and architecture as well as p...
Without lifecycle traceability and visibility across the tool chain, stakeholders from Planning-to-Ops have limited insight and answers to who, what, when, why and how across the DevOps lifecycle. This impacts the ability to deliver high quality software at the needed velocity to drive positive business outcomes. In his general session at @DevOpsSummit at 19th Cloud Expo, Eric Robertson, General Manager at CollabNet, will discuss how customers are able to achieve a level of transparency that e...
SYS-CON Events announced today that SoftNet Solutions will exhibit at the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. SoftNet Solutions specializes in Enterprise Solutions for Hadoop and Big Data. It offers customers the most open, robust, and value-conscious portfolio of solutions, services, and tools for the shortest route to success with Big Data. The unique differentiator is the ability to architect and ...
With emerging ideas, innovation, and talents, the lines between DevOps, release engineering, and even security are rapidly blurring. I invite you to sit down for a moment with Principle Consultant, J. Paul Reed, and listen to his take on what the intersection between these once individualized fields entails, and may even foreshadow.
In his session at 19th Cloud Expo, Claude Remillard, Principal Program Manager in Developer Division at Microsoft, will contrast how his team used config as code and immutable patterns for continuous delivery of microservices and apps to the cloud. He will show the immutable patterns helps developers do away with most of the complexity of config as code-enabling scenarios such as rollback, zero downtime upgrades with far greater simplicity. He will also have live demos of building immutable pipe...
A completely new computing platform is on the horizon. They’re called Microservers by some, ARM Servers by others, and sometimes even ARM-based Servers. No matter what you call them, Microservers will have a huge impact on the data center and on server computing in general. Although few people are familiar with Microservers today, their impact will be felt very soon. This is a new category of computing platform that is available today and is predicted to have triple-digit growth rates for some ...
SYS-CON Events announced today that Transparent Cloud Computing (T-Cloud) Consortium will exhibit at the 19th International Cloud Expo®, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. The Transparent Cloud Computing Consortium (T-Cloud Consortium) will conduct research activities into changes in the computing model as a result of collaboration between "device" and "cloud" and the creation of new value and markets through organic data proces...
The best way to leverage your Cloud Expo presence as a sponsor and exhibitor is to plan your news announcements around our events. The press covering Cloud Expo and @ThingsExpo will have access to these releases and will amplify your news announcements. More than two dozen Cloud companies either set deals at our shows or have announced their mergers and acquisitions at Cloud Expo. Product announcements during our show provide your company with the most reach through our targeted audiences.
When we talk about the impact of BYOD and BYOA and the Internet of Things, we often focus on the impact on data center architectures. That's because there will be an increasing need for authentication, for access control, for security, for application delivery as the number of potential endpoints (clients, devices, things) increases. That means scale in the data center. What we gloss over, what we skip, is that before any of these "things" ever makes a request to access an application it had to...
Virgil consists of an open-source encryption library, which implements Cryptographic Message Syntax (CMS) and Elliptic Curve Integrated Encryption Scheme (ECIES) (including RSA schema), a Key Management API, and a cloud-based Key Management Service (Virgil Keys). The Virgil Keys Service consists of a public key service and a private key escrow service. 

Apache Hadoop is a key technology for gaining business insights from your Big Data, but the penetration into enterprises is shockingly low. In fact, Apache Hadoop and Big Data proponents recognize that this technology has not yet achieved its game-changing business potential. In his session at 19th Cloud Expo, John Mertic, director of program management for ODPi at The Linux Foundation, will explain why this is, how we can work together as an open data community to increase adoption, and the i...
All clouds are not equal. To succeed in a DevOps context, organizations should plan to develop/deploy apps across a choice of on-premise and public clouds simultaneously depending on the business needs. This is where the concept of the Lean Cloud comes in - resting on the idea that you often need to relocate your app modules over their life cycles for both innovation and operational efficiency in the cloud. In his session at @DevOpsSummit at19th Cloud Expo, Valentin (Val) Bercovici, CTO of So...
What do dependency resolution, situational awareness, and superheroes have in common? Meet Chris Corriere, a DevOps/Software Engineer at Autotrader, speaking on creative ways to maximize usage of all of the above. Mark Miller, Community Advocate and senior storyteller at Sonatype, caught up with Chris to learn more about what his team is up to.
Monitoring of Docker environments is challenging. Why? Because each container typically runs a single process, has its own environment, utilizes virtual networks, or has various methods of managing storage. Traditional monitoring solutions take metrics from each server and applications they run. These servers and applications running on them are typically very static, with very long uptimes. Docker deployments are different: a set of containers may run many applications, all sharing the resource...
SYS-CON Events announced today that eCube Systems, the leading provider of modern development tools and best practices for Continuous Integration on OpenVMS, will exhibit at SYS-CON's @DevOpsSummit at Cloud Expo New York, which will take place on June 7-9, 2016, at the Javits Center in New York City, NY. eCube Systems offers a family of middleware products and development tools that maximize return on technology investment by leveraging existing technical equity to meet evolving business needs. ...
DevOps is a term that comes full of controversy. A lot of people are on the bandwagon, while others are waiting for the term to jump the shark, and eventually go back to business as usual. Regardless of where you are along the specturm of loving or hating the term DevOps, one thing is certain. More and more people are using it to describe a system administrator who uses scripts, or tools like, Chef, Puppet or Ansible, in order to provision infrastructure. There is also usually an expectation of...
JetBlue Airways uses virtual environments to reduce software development costs, centralize performance testing, and create a climate for continuous integration and real-time monitoring of mobile applications. The next BriefingsDirect Voice of the Customer performance engineering case study discussion examines how JetBlue Airways in New York uses virtual environments to reduce software development costs, centralize performance testing, and create a climate for continuous integration and real-tim...
The general concepts of DevOps have played a central role advancing the modern software delivery industry. With the library of DevOps best practices, tips and guides expanding quickly, it can be difficult to track down the best and most accurate resources and information. In order to help the software development community, and to further our own learning, we reached out to leading industry analysts and asked them about an increasingly popular tenet of a DevOps transformation: collaboration.
At its core DevOps is all about collaboration. The lines of communication must be opened and it takes some effort to ensure that they stay that way. It’s easy to pay lip service to trends and talk about implementing new methodologies, but without action, real benefits cannot be realized. Success requires planning, advocates empowered to effect change, and, of course, the right tooling. To bring about a cultural shift it’s important to share challenges. In simple terms, ensuring that everyone k...
In case you haven’t heard, the new hotness in app architectures is serverless. Mainly restricted to cloud environments (Amazon Lambda, Google Cloud Functions, Microsoft Azure Functions) the general concept is that you don’t have to worry about anything but the small snippets of code (functions) you write to do something when something happens. That’s an event-driven model, by the way, that should be very familiar to anyone who has taken advantage of a programmable proxy to do app or API routing ...