Welcome!

Microservices Expo Authors: Liz McMillan, Elizabeth White, PagerDuty Blog, Pat Romanski, Gordon Haff

Blog Feed Post

ITinvolve: Driving Business Agility with Metadata Management and Curation

Balancing Automation and Human Knowledge Curation

There are many metadata management tools on the market today, including Configuration Management Databases (CMDBs) and Service-Oriented Architecture (SOA) Repositories, to name a few. Such tools seek to automate the collection and dissemination of policy-related metadata in hopes of automating policy enforcement – an important part of the automated governance critical to achieving business agility. And yet, such tools have generally fallen short, because they inadequately address the need to support policies that apply primarily to human behavior.

ITinvolve logoIn contrast, there are many tools on the market that focus primarily on supporting human collaboration and communication, either across an organization or specific to particular teams, processes, or tasks. Such tools include portals like Microsoft SharePoint, groupware of various sorts (email, wikis, and the like), and more focused tools such as Portfolio Management or Application Lifecycle Management (ALM) products.

When it comes to driving business agility across the organization, however, such human communication and collaboration tools have also fallen short, as they generally require an onerous amount of configuration and management from people who have scant time or attention to devote to such dull activities. This limitation leads to bloated repositories full of unsearchable documents, or email inboxes with thousands of messages, or knowledge management systems that contain information that is so out of date and incomplete that people refuse to spend any time updating them, thus defeating their purpose entirely.

ITinvolve has largely solved this combination of problems with their aptly-named Agility Manager. Agility Manager can be thought of as a next-generation knowledge management application that combines automated metadata collection and policy enforcement with broad human curation capabilities, balancing the need for automated governance and support for human activities within software development teams or more broadly across the organization.

Agility Manager also adds a set of objects to aid in projects including business goal, release, and iteration objects, as well as project planning functionality like Gantt charting and Kanban boards, as shown in the figure below. Furthermore, data need not physically reside in ITinvolve but can be federated so the object relationships are in ITinvolve but the full data set lives in a third-party source, for example, a pdf-formatted policy document on a file share or detailed functional requirements in Atlassian JIRA or Rally Software’s ALM platform.

ITinvolve Agility Manager illustrating project analysis Kanban boards (Source: ITinvolve)

ITinvolve Agility Manager illustrating project analysis Kanban boards (Source: ITinvolve)

Furthermore, the entire ITinvolve suite of applications (Agility Manager plus some value-added extensions) are Software-as-a-Service (SaaS) applications built on the Salesforce1 Platform. This platform choice gives ITinvolve customers pay-as-you-go, per-user pricing that simplifies onboarding and ramping up, as well as the scalability and integration support you’d expect from Salesforce.

The ITinvolve Agile Architecture Story

Architecting for business agility in the enterprise requires far more than the proper application of architectural practices to Agile development projects. In fact, it requires a complete rethink of what it means to architect an organization. Business agility is a property of the organization as a whole, which means that the enterprise must be treated as a Complex Adaptive System, where business agility is an emergent property of the system.

Such Complex Systems are actually systems of systems; in the case of an organization, the component systems are technology systems and people. The challenge of architecting for business agility, therefore, extends beyond architecting the technology. It’s also critical for the organization to architect its people as well.

The way to “architect the people” in the organization is to apply appropriate governance policies and processes that encourage the desired behavior. Excessive or inappropriate governance typically backfires, however, as too many rules and policies can lower morale and productivity. Instead, it’s important to encourage desired behavior via effective incentives, coupled with tools that facilitate the desired behavior, yet make undesirable behavior difficult. To this end, ITinvolve empowers people so that they are willing and even desirous to adapt their behavior. ITinvolve helps people facilitate their work by giving them the information and analysis they require, and enabling collaboration with other relevant team members (even ones they may not know about).

Giving people better tools and rewarding them with free food or cash bonuses is only part of the story. In order to achieve the business agility goals of the organization, this human governance must be seamlessly integrated with the automated governance of technology. In other words, technology must support the desired human behavior by providing the right tools, but people must also be able to properly manage and govern the technology in order to support the flexibility necessary for the organization to be agile.

Furthermore, as emergent behavior is inherently unpredictable, it is essential that organizations take an iterative approach to directing human and technology behavior in order to increase the organization’s agility. Each iteration should include a feedback loop that reflects the resulting effects of any policy or tooling change in order to improve results of subsequent iterations.

ITinvolve’s combined automated governance and human curation approach brings together the essential elements of this Agile Architecture story. At its core, the Agility Manager is an application that simplifies and encourages the desired behavior from the teams using the application. It also supports multiple approaches to automating the collection and communication of necessary metadata, as well as the automation of policies.

Instead of discouraging active participation in knowledge collection as standard portals and knowledge management tools do, ITinvolve empowers people to share their knowledge, as shown in the figure below. This approach facilitates cross-team collaboration on projects and decisions by supporting more effective risk management using current and accurate information. As a result, people can get their jobs done and make better decisions by fully understanding the various dependencies among requirements, policies, applications, and other elements of their work environment.

ITinvolve Agility Manager illustrating interrelationships among various diverse types of people and objects in the organization (Source: ITinvolve)

ITinvolve Agility Manager illustrating interrelationships among
various diverse types of people and objects in the organization (Source: ITinvolve)

ITinvolve also brings together and integrates varied data sources, including documents on portals, metadata in asset management tools and CMDBs, automation scripts and recipes, and other information that would otherwise be scattered about the organization or locked up in the heads of key personnel. This “tribal knowledge” of each expert in the enterprise is a critical asset that is always at risk of being lost, either through people leaving the organization, or simply forgetting the details over time.

Not only does ITinvolve facilitate the collection and dissemination of such tribal knowledge, but the application also supports the continuous review of such information by other experts in the organization. The result is an iterative, continuous-feedback approach to ongoing improvement of the information that ITinvolve manages. In fact, by bringing various individuals together from across different departments within the organization, ITinvolve supports flexible collaboration across the enterprise. Such cross-silo collaboration is critical for Agile projects, DevOps, and other initiatives that drive greater agility in the enterprise.

The Intellyx Take

One area where Agile development methodologies and the Agile Architecture approach to treating the organization as a Complex Adaptive System overlap is with the focus on self-organizing teams. Top-down approaches to creating teams – essentially, managers formally assigning roles to individuals – limit the flexibility of the team and thus impact the agility of the organization. Allowing teams to organize themselves addresses this issue.

And yet, as teams expand beyond a handful of people, especially when such teams are cross-functional and involve a variety of people in different roles, then self-organization can potentially begin to break down. The challenge isn’t necessarily the competency of the individuals involved, but rather their ability to communicate effectively and maintain coherent, up-to-date tribal knowledge, even as the team’s personnel might change or their tasks may evolve.

Solving this challenge is central to ITinvolve’s value proposition, because it both facilitates and supports the self-organization so critical to Agile teams, while at the same time addressing the communication and knowledge management challenges endemic to cross-functional teams. As a result, ITinvolve fosters a self-regulating system that provides greater transparency to all team members and management alike, as well as automated constraints on the behavior of associated technology assets, in such a way that facilitates the iterative feedback loop essential to driving agility long-term in large organizations.

ITinvolve is an Intellyx client. Intellyx retains full editorial control over the content of this post.

Read the original blog entry...

More Stories By Jason Bloomberg

Jason Bloomberg is the leading expert on architecting agility for the enterprise. As president of Intellyx, Mr. Bloomberg brings his years of thought leadership in the areas of Cloud Computing, Enterprise Architecture, and Service-Oriented Architecture to a global clientele of business executives, architects, software vendors, and Cloud service providers looking to achieve technology-enabled business agility across their organizations and for their customers. His latest book, The Agile Architecture Revolution (John Wiley & Sons, 2013), sets the stage for Mr. Bloomberg’s groundbreaking Agile Architecture vision.

Mr. Bloomberg is perhaps best known for his twelve years at ZapThink, where he created and delivered the Licensed ZapThink Architect (LZA) SOA course and associated credential, certifying over 1,700 professionals worldwide. He is one of the original Managing Partners of ZapThink LLC, the leading SOA advisory and analysis firm, which was acquired by Dovel Technologies in 2011. He now runs the successor to the LZA program, the Bloomberg Agile Architecture Course, around the world.

Mr. Bloomberg is a frequent conference speaker and prolific writer. He has published over 500 articles, spoken at over 300 conferences, Webinars, and other events, and has been quoted in the press over 1,400 times as the leading expert on agile approaches to architecture in the enterprise.

Mr. Bloomberg’s previous book, Service Orient or Be Doomed! How Service Orientation Will Change Your Business (John Wiley & Sons, 2006, coauthored with Ron Schmelzer), is recognized as the leading business book on Service Orientation. He also co-authored the books XML and Web Services Unleashed (SAMS Publishing, 2002), and Web Page Scripting Techniques (Hayden Books, 1996).

Prior to ZapThink, Mr. Bloomberg built a diverse background in eBusiness technology management and industry analysis, including serving as a senior analyst in IDC’s eBusiness Advisory group, as well as holding eBusiness management positions at USWeb/CKS (later marchFIRST) and WaveBend Solutions (now Hitachi Consulting).

@MicroservicesExpo Stories
Thanks to Docker and the DevOps revolution, microservices have emerged as the new way to build and deploy applications — and there are plenty of great reasons to embrace the microservices trend. If you are going to adopt microservices, you also have to understand that microservice architectures have many moving parts. When it comes to incident management, this presents an important difference between microservices and monolithic architectures. More moving parts mean more complexity to monitor an...
Growth hacking is common for startups to make unheard-of progress in building their business. Career Hacks can help Geek Girls and those who support them (yes, that's you too, Dad!) to excel in this typically male-dominated world. Get ready to learn the facts: Is there a bias against women in the tech / developer communities? Why are women 50% of the workforce, but hold only 24% of the STEM or IT positions? Some beginnings of what to do about it! In her Day 2 Keynote at 17th Cloud Expo, Sandy Ca...
As software becomes more and more complex, we, as software developers, have been splitting up our code into smaller and smaller components. This is also true for the environment in which we run our code: going from bare metal, to VMs to the modern-day Cloud Native world of containers, schedulers and micro services. While we have figured out how to run containerized applications in the cloud using schedulers, we've yet to come up with a good solution to bridge the gap between getting your contain...
All organizations that did not originate this moment have a pre-existing culture as well as legacy technology and processes that can be more or less amenable to DevOps implementation. That organizational culture is influenced by the personalities and management styles of Executive Management, the wider culture in which the organization is situated, and the personalities of key team members at all levels of the organization. This culture and entrenched interests usually throw a wrench in the work...
We call it DevOps but much of the time there’s a lot more discussion about the needs and concerns of developers than there is about other groups. There’s a focus on improved and less isolated developer workflows. There are many discussions around collaboration, continuous integration and delivery, issue tracking, source code control, code review, IDEs, and xPaaS – and all the tools that enable those things. Changes in developer practices may come up – such as developers taking ownership of code ...
The rise of containers and microservices has skyrocketed the rate at which new applications are moved into production environments today. While developers have been deploying containers to speed up the development processes for some time, there still remain challenges with running microservices efficiently. Most existing IT monitoring tools don’t actually maintain visibility into the containers that make up microservices. As those container applications move into production, some IT operations t...
As organizations realize the scope of the Internet of Things, gaining key insights from Big Data, through the use of advanced analytics, becomes crucial. However, IoT also creates the need for petabyte scale storage of data from millions of devices. A new type of Storage is required which seamlessly integrates robust data analytics with massive scale. These storage systems will act as “smart systems” provide in-place analytics that speed discovery and enable businesses to quickly derive meaningf...
For organizations that have amassed large sums of software complexity, taking a microservices approach is the first step toward DevOps and continuous improvement / development. Integrating system-level analysis with microservices makes it easier to change and add functionality to applications at any time without the increase of risk. Before you start big transformation projects or a cloud migration, make sure these changes won’t take down your entire organization.
Containers have changed the mind of IT in DevOps. They enable developers to work with dev, test, stage and production environments identically. Containers provide the right abstraction for microservices and many cloud platforms have integrated them into deployment pipelines. DevOps and containers together help companies achieve their business goals faster and more effectively. In his session at DevOps Summit, Ruslan Synytsky, CEO and Co-founder of Jelastic, reviewed the current landscape of Dev...
SYS-CON Events announced today that Outlyer, a monitoring service for DevOps and operations teams, has been named “Bronze Sponsor” of SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Outlyer is a monitoring service for DevOps and Operations teams running Cloud, SaaS, Microservices and IoT deployments. Designed for today's dynamic environments that need beyond cloud-scale monitoring, we make monitoring effortless so you...
Cloud Expo, Inc. has announced today that Andi Mann and Aruna Ravichandran have been named Co-Chairs of @DevOpsSummit at Cloud Expo 2017. The @DevOpsSummit at Cloud Expo New York will take place on June 6-8, 2017, at the Javits Center in New York City, New York, and @DevOpsSummit at Cloud Expo Silicon Valley will take place Oct. 31-Nov. 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
SYS-CON Events announced today that CA Technologies has been named “Platinum Sponsor” of SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY, and the 21st International Cloud Expo®, which will take place October 31-November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. CA Technologies helps customers succeed in a future where every business – from apparel to energy – is being rewritten by software. From ...
TechTarget storage websites are the best online information resource for news, tips and expert advice for the storage, backup and disaster recovery markets. By creating abundant, high-quality editorial content across more than 140 highly targeted technology-specific websites, TechTarget attracts and nurtures communities of technology buyers researching their companies' information technology needs. By understanding these buyers' content consumption behaviors, TechTarget creates the purchase inte...
DevOps is often described as a combination of technology and culture. Without both, DevOps isn't complete. However, applying the culture to outdated technology is a recipe for disaster; as response times grow and connections between teams are delayed by technology, the culture will die. A Nutanix Enterprise Cloud has many benefits that provide the needed base for a true DevOps paradigm. In his general session at 20th Cloud Expo, Chris Brown, a Solutions Marketing Manager at Nutanix, will explore...
@DevOpsSummit at Cloud taking place June 6-8, 2017, at Javits Center, New York City, is co-located with the 20th International Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The widespread success of cloud computing is driving the DevOps revolution in enterprise IT. Now as never before, development teams must communicate and collaborate in a dynamic, 24/7/365 environment. There is no time to wait for long developm...
DevOps and microservices are permeating software engineering teams broadly, whether these teams are in pure software shops but happen to run a business, such Uber and Airbnb, or in companies that rely heavily on software to run more traditional business, such as financial firms or high-end manufacturers. Microservices and DevOps have created software development and therefore business speed and agility benefits, but they have also created problems; specifically, they have created software securi...
The emerging Internet of Everything creates tremendous new opportunities for customer engagement and business model innovation. However, enterprises must overcome a number of critical challenges to bring these new solutions to market. In his session at @ThingsExpo, Michael Martin, CTO/CIO at nfrastructure, outlined these key challenges and recommended approaches for overcoming them to achieve speed and agility in the design, development and implementation of Internet of Everything solutions with...
"We provide DevOps solutions. We also partner with some key players in the DevOps space and we use the technology that we partner with to engineer custom solutions for different organizations," stated Himanshu Chhetri, CTO of Addteq, in this SYS-CON.tv interview at DevOps at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York City, NY.
In his session at 20th Cloud Expo, Scott Davis, CTO of Embotics, will discuss how automation can provide the dynamic management required to cost-effectively deliver microservices and container solutions at scale. He will discuss how flexible automation is the key to effectively bridging and seamlessly coordinating both IT and developer needs for component orchestration across disparate clouds – an increasingly important requirement at today’s multi-cloud enterprise.
All clouds are not equal. To succeed in a DevOps context, organizations should plan to develop/deploy apps across a choice of on-premise and public clouds simultaneously depending on the business needs. This is where the concept of the Lean Cloud comes in - resting on the idea that you often need to relocate your app modules over their life cycles for both innovation and operational efficiency in the cloud. In his session at @DevOpsSummit at19th Cloud Expo, Valentin (Val) Bercovici, CTO of Soli...