|By Adam Wilson||
|March 31, 2012 01:00 PM EDT||
Sustaining applications in the most cost-effective and efficient fashion is the foundation to maximizing a return on data. But it is only the foundation. Organizations have to move beyond sustaining applications to driving innovation, and the first step in that progression is learning the best ways to enhance existing applications and implement new applications that will help modernize business processes and support business agility.
The challenges around enhancing applications are well agreed upon. The top challenges include:
- Insufficient Data Quality - Data quality issues of one degree or another are pervasive in the majority of enterprises, leading users to distrust the data. This is a problem within applications and, even more so, across applications.
- Right-Time Access to Information - The pace of business continues to accelerate, and users can no longer wait weeks or days for information necessary to perform their jobs. If business users need immediate access to fresh and trusted information in the applications they use every day, IT must find ways to provide it.
- SaaS Sprawl - As more and more applications move to the Cloud, IT needs to be proactive in maintaining visibility and control over SaaS applications and their data, including the ability to easily integrate them with on-premise applications. After all, "no software" does not imply "no integration."
- Successful Data Migration to New Applications - As organizations implement new applications, existing data must be moved quickly and smoothly to the new apps, on time and on budget, so that dependent business processes are not negatively impacted.
Building Trust in the Data with Automated Data Quality
The core reason why business users lack trust in their data is because that data resides in data silos across multiple systems and, when it is delivered to them, it is all too frequently inconsistent, incorrect and incomplete, not to mention late. This impacts both day-to-day data usage as well as strategic usage. For example, Procurement processes need consistent and correct data on vendor price and performance in order to negotiate favorable contracts, as well as data that is timely in order to either drive or block purchase requisitions and payments to vendors per their adherence to their contracts.
Hence, the first step to modernizing business processes is to enhance application quality with trusted, authoritative data that is predictable, valuable and timely, regardless of how many source systems it is being drawn and integrated from.
Integrating data quality processes into the overall enterprise data integration process is a definitive step for any organization looking to build user trust in their data. This is as simple as introducing automated data cleansing that can be leveraged by all applications across the company. A further step is introducing proactive data quality monitoring capabilities into the hands of data owners, so they participate in improving the quality of their information.
The payoff comes with users spending less time reconciling data and more time working with it.
Ensuring Right-Time Delivery with Data services
Ensuring that the right information is delivered at the right time to the right person is another formidable challenge, but one that can be solved, and data services provide the solution within the context of a service-oriented architecture (SOA). Traditional SOA approaches lack a data integration layer. Anything that cannot be handled by a simple Web service, such as complex data transformations or data cleansing, requires hand-coding and proprietary interfaces, which are things one wants to avoid.
Data services, on the other hand, present a discrete set of sophisticated data integration tasks that support the entire data integration life cycle. These data services can be readily consumed as Web services by the various components of a SOA, and also by composite applications and portals. The complexity of the task is hidden, plus the data services can be easily published to SOA registries and repositories.
Results? Organizations using data services have reported up to five times faster delivery of new data, and cost savings of up to three times. This means that these organizations are able to respond faster to changing information demands, increase IT project success rates, and even deliver comprehensive single customer views on-demand to help drive new revenues and increase customer satisfaction.
Soaring with the Cloud - "No Software" Doesn't Mean "No Integration"
SaaS application spending, as everyone knows, is soaring. As a result, more and more companies need to find ways to support hybrid IT infrastructures that span cloud and on-premise applications and make them work seamlessly together to maximize the return on all enterprise data. And this requires data integration.
Cloud applications have to integrate with other systems in order to provide full value. At the same time, integration needs to happen in a secure fashion lest IT lose control of enterprise data assets. Fortunately, appropriately designed cloud data integration will support hybrid IT environments, essentially by extending unified, enterprise-class data integration services to the cloud.
Things to look for when supporting hybrid IT include a "secure agent" that provides the ability to create and securely manage all aspects of integration jobs, which can be shared between on-premise and cloud deployments. While the agent can be invoked via a web browser, what it does is establish a secure connection between data source and data target and all data integration processing occurs on-premise in the enterprise environment for maximum IT control.
Ensuring the Success of New Applications Through Efficient Migration
As organizations modernize their systems and business processes, they find that migrating data to their new applications is not usually a slam dunk proposition. All data migrations are inherently risky and subject to the lack of suitable tools, skills, knowledge of the data, and an access, validation, and audit strategy. Moreover, there is a lack of tools and processes to help business stakeholders and data users ensure and verify that the data is actually fit for use.
Having the right technology platform and skills goes a long way toward ensuring an on-time and on-budget migration. Knowledge of the data that is being moved is critical to each step of the migration process and ultimately is key to ensuring that the migrated data actually "works" in the new application. Having an infrastructure that supports change during the migration process is mandatory. And active business involvement is the hallmark of every successful migration. Hand-coding, using the wrong migration methodology, and relying strictly on IT are all pathways to migration time and money overruns or outright failure.
In selecting a migration platform, you want to ensure it provides:
- Connectivity to the broadest range of environments and databases
- Built-in data quality profiling, cleansing, and transformations (for all data types)
- Fast, easy development, updating, and reuse of transformations
- Easy auditability of the data from source to target
From Application Enhancement to Business Transformation
The above steps, from building trust in data to ensuring the success of new applications, all speak to enhancing applications to drive business process modernization and business agility. The next leap is to transform applications and, by extension, to transform the business, to drive innovation and growth. Much of what is accomplishable to enhance applications is leveragable when transforming them, but there are also new and highly valuable things to accomplish, as will to be seen in Part 3 of this article.
Docker is hot. However, as Docker container use spreads into more mature production pipelines, there can be issues about control of Docker images to ensure they are production-ready. Is a promotion-based model appropriate to control and track the flow of Docker images from development to production? In his session at DevOps Summit, Fred Simon, Co-founder and Chief Architect of JFrog, will demonstrate how to implement a promotion model for Docker images using a binary repository, and then show h...
Oct. 9, 2015 09:45 AM EDT Reads: 105
With containerization using Docker, the orchestration of containers using Kubernetes, the self-service model for provisioning your projects and applications and the workflows we built in OpenShift is the best in class Platform as a Service that enables introducing DevOps into your organization with ease. In his session at DevOps Summit, Veer Muchandi, PaaS evangelist with RedHat, will provide a deep dive overview of OpenShift v3 and demonstrate how it helps with DevOps.
Oct. 9, 2015 09:00 AM EDT Reads: 664
Containers have changed the mind of IT in DevOps. They enable developers to work with dev, test, stage and production environments identically. Containers provide the right abstraction for microservices and many cloud platforms have integrated them into deployment pipelines. DevOps and Containers together help companies to achieve their business goals faster and more effectively.
Oct. 9, 2015 08:15 AM EDT Reads: 134
What Is Emergent About Emergent Architecture? By @TheEbizWizard | @DevOpsSummit #DevOps #BigData #API
All we need to do is have our teams self-organize, and behold! Emergent design and/or architecture springs up out of the nothingness! If only it were that easy, right? I follow in the footsteps of so many people who have long wondered at the meanings of such simple words, as though they were dogma from on high. Emerge? Self-organizing? Profound, to be sure. But what do we really make of this sentence?
Oct. 9, 2015 08:00 AM EDT Reads: 397
Containers are revolutionizing the way we deploy and maintain our infrastructures, but monitoring and troubleshooting in a containerized environment can still be painful and impractical. Understanding even basic resource usage is difficult - let alone tracking network connections or malicious activity. In his session at DevOps Summit, Gianluca Borello, Sr. Software Engineer at Sysdig, will cover the current state of the art for container monitoring and visibility, including pros / cons and li...
Oct. 9, 2015 08:00 AM EDT Reads: 220
The web app is agile. The REST API is agile. The testing and planning are agile. But alas, data infrastructures certainly are not. Once an application matures, changing the shape or indexing scheme of data often forces at best a top down planning exercise and at worst includes schema changes that force downtime. The time has come for a new approach that fundamentally advances the agility of distributed data infrastructures. Come learn about a new solution to the problems faced by software organ...
Oct. 9, 2015 08:00 AM EDT Reads: 882
Achim Weiss is Chief Executive Officer and co-founder of ProfitBricks. In 1995, he broke off his studies to co-found the web hosting company "Schlund+Partner." The company "Schlund+Partner" later became the 1&1 web hosting product line. From 1995 to 2008, he was the technical director for several important projects: the largest web hosting platform in the world, the second largest DSL platform, a video on-demand delivery network, the largest eMail backend in Europe, and a universal billing syste...
Oct. 9, 2015 07:45 AM EDT Reads: 145
Application availability is not just the measure of “being up”. Many apps can claim that status. Technically they are running and responding to requests, but at a rate which users would certainly interpret as being down. That’s because excessive load times can (and will be) interpreted as “not available.” That’s why it’s important to view ensuring application availability as requiring attention to all its composite parts: scalability, performance, and security.
Oct. 9, 2015 06:00 AM EDT Reads: 426
Last month, my partners in crime – Carmen DeArdo from Nationwide, Lee Reid, my colleague from IBM and I wrote a 3-part series of blog posts on DevOps.com. We titled our posts the Simple Math, Calculus and Art of DevOps. I would venture to say these are must-reads for any organization adopting DevOps. We examined all three ascpects – the Cultural, Automation and Process improvement side of DevOps. One of the key underlying themes of the three posts was the need for Cultural change – things like t...
Oct. 9, 2015 05:00 AM EDT Reads: 337
In today's digital world, change is the one constant. Disruptive innovations like cloud, mobility, social media, and the Internet of Things have reshaped the market and set new standards in customer expectations. To remain competitive, businesses must tap the potential of emerging technologies and markets through the rapid release of new products and services. However, the rigid and siloed structures of traditional IT platforms and processes are slowing them down – resulting in lengthy delivery ...
Oct. 9, 2015 05:00 AM EDT Reads: 1,011
There once was a time when testers operated on their own, in isolation. They’d huddle as a group around the harsh glow of dozens of CRT monitors, clicking through GUIs and recording results. Anxiously, they’d wait for the developers in the other room to fix the bugs they found, yet they’d frequently leave the office disappointed as issues were filed away as non-critical. These teams would rarely interact, save for those scarce moments when a coder would wander in needing to reproduce a particula...
Oct. 9, 2015 05:00 AM EDT Reads: 301
Overgrown applications have given way to modular applications, driven by the need to break larger problems into smaller problems. Similarly large monolithic development processes have been forced to be broken into smaller agile development cycles. Looking at trends in software development, microservices architectures meet the same demands. Additional benefits of microservices architectures are compartmentalization and a limited impact of service failure versus a complete software malfunction....
Oct. 9, 2015 04:00 AM EDT Reads: 229
Containers are changing the security landscape for software development and deployment. As with any security solutions, security approaches that work for developers, operations personnel and security professionals is a requirement. In his session at @DevOpsSummit, Kevin Gilpin, CTO and Co-Founder of Conjur, will discuss various security considerations for container-based infrastructure and related DevOps workflows.
Oct. 9, 2015 04:00 AM EDT Reads: 238
It is with great pleasure that I am able to announce that Jesse Proudman, Blue Box CTO, has been appointed to the position of IBM Distinguished Engineer. Jesse is the first employee at Blue Box to receive this honor, and I’m quite confident there will be more to follow given the amazing talent at Blue Box with whom I have had the pleasure to collaborate. I’d like to provide an overview of what it means to become an IBM Distinguished Engineer.
Oct. 9, 2015 04:00 AM EDT Reads: 250
The cloud has reached mainstream IT. Those 18.7 million data centers out there (server closets to corporate data centers to colocation deployments) are moving to the cloud. In his session at 17th Cloud Expo, Achim Weiss, CEO & co-founder of ProfitBricks, will share how two companies – one in the U.S. and one in Germany – are achieving their goals with cloud infrastructure. More than a case study, he will share the details of how they prioritized their cloud computing infrastructure deployments ...
Oct. 9, 2015 03:00 AM EDT Reads: 739
Opinions on how best to package and deliver applications are legion and, like many other aspects of the software world, are subject to recurring trend cycles. On the server-side, the current favorite is container delivery: a “full stack” approach in which your application and everything it needs to run are specified in a container definition. That definition is then “compiled” down to a container image and deployed by retrieving the image and passing it to a container runtime to create a running...
Oct. 9, 2015 02:30 AM EDT Reads: 241
Internet of Things (IoT) will be a hybrid ecosystem of diverse devices and sensors collaborating with operational and enterprise systems to create the next big application. In their session at @ThingsExpo, Bramh Gupta, founder and CEO of robomq.io, and Fred Yatzeck, principal architect leading product development at robomq.io, discussed how choosing the right middleware and integration strategy from the get-go will enable IoT solution developers to adapt and grow with the industry, while at th...
Oct. 9, 2015 02:00 AM EDT Reads: 2,222
Between the compelling mockups and specs produced by analysts, and resulting applications built by developers, there exists a gulf where projects fail, costs spiral, and applications disappoint. Methodologies like Agile attempt to address this with intensified communication, with partial success but many limitations. In his session at DevOps Summit, Charles Kendrick, CTO and Chief Architect at Isomorphic Software, will present a revolutionary model enabled by new technologies. Learn how busine...
Oct. 9, 2015 02:00 AM EDT Reads: 288
If you are new to Python, you might be confused about the different versions that are available. Although Python 3 is the latest generation of the language, many programmers still use Python 2.7, the final update to Python 2, which was released in 2010. There is currently no clear-cut answer to the question of which version of Python you should use; the decision depends on what you want to achieve. While Python 3 is clearly the future of the language, some programmers choose to remain with Py...
Oct. 9, 2015 02:00 AM EDT Reads: 251
As we increasingly rely on technology to improve the quality and efficiency of our personal and professional lives, software has become the key business differentiator. Organizations must release software faster, as well as ensure the safety, security, and reliability of their applications. The option to make trade-offs between time and quality no longer exists—software teams must deliver quality and speed. To meet these expectations, businesses have shifted from more traditional approaches of d...
Oct. 9, 2015 01:45 AM EDT Reads: 230