Welcome!

Microservices Expo Authors: Liz McMillan, Elizabeth White, Sematext Blog, Lori MacVittie, David Sprott

Blog Feed Post

ITinvolve: Driving Business Agility with Metadata Management and Curation

Balancing Automation and Human Knowledge Curation

There are many metadata management tools on the market today, including Configuration Management Databases (CMDBs) and Service-Oriented Architecture (SOA) Repositories, to name a few. Such tools seek to automate the collection and dissemination of policy-related metadata in hopes of automating policy enforcement – an important part of the automated governance critical to achieving business agility. And yet, such tools have generally fallen short, because they inadequately address the need to support policies that apply primarily to human behavior.

ITinvolve logoIn contrast, there are many tools on the market that focus primarily on supporting human collaboration and communication, either across an organization or specific to particular teams, processes, or tasks. Such tools include portals like Microsoft SharePoint, groupware of various sorts (email, wikis, and the like), and more focused tools such as Portfolio Management or Application Lifecycle Management (ALM) products.

When it comes to driving business agility across the organization, however, such human communication and collaboration tools have also fallen short, as they generally require an onerous amount of configuration and management from people who have scant time or attention to devote to such dull activities. This limitation leads to bloated repositories full of unsearchable documents, or email inboxes with thousands of messages, or knowledge management systems that contain information that is so out of date and incomplete that people refuse to spend any time updating them, thus defeating their purpose entirely.

ITinvolve has largely solved this combination of problems with their aptly-named Agility Manager. Agility Manager can be thought of as a next-generation knowledge management application that combines automated metadata collection and policy enforcement with broad human curation capabilities, balancing the need for automated governance and support for human activities within software development teams or more broadly across the organization.

Agility Manager also adds a set of objects to aid in projects including business goal, release, and iteration objects, as well as project planning functionality like Gantt charting and Kanban boards, as shown in the figure below. Furthermore, data need not physically reside in ITinvolve but can be federated so the object relationships are in ITinvolve but the full data set lives in a third-party source, for example, a pdf-formatted policy document on a file share or detailed functional requirements in Atlassian JIRA or Rally Software’s ALM platform.

ITinvolve Agility Manager illustrating project analysis Kanban boards (Source: ITinvolve)

ITinvolve Agility Manager illustrating project analysis Kanban boards (Source: ITinvolve)

Furthermore, the entire ITinvolve suite of applications (Agility Manager plus some value-added extensions) are Software-as-a-Service (SaaS) applications built on the Salesforce1 Platform. This platform choice gives ITinvolve customers pay-as-you-go, per-user pricing that simplifies onboarding and ramping up, as well as the scalability and integration support you’d expect from Salesforce.

The ITinvolve Agile Architecture Story

Architecting for business agility in the enterprise requires far more than the proper application of architectural practices to Agile development projects. In fact, it requires a complete rethink of what it means to architect an organization. Business agility is a property of the organization as a whole, which means that the enterprise must be treated as a Complex Adaptive System, where business agility is an emergent property of the system.

Such Complex Systems are actually systems of systems; in the case of an organization, the component systems are technology systems and people. The challenge of architecting for business agility, therefore, extends beyond architecting the technology. It’s also critical for the organization to architect its people as well.

The way to “architect the people” in the organization is to apply appropriate governance policies and processes that encourage the desired behavior. Excessive or inappropriate governance typically backfires, however, as too many rules and policies can lower morale and productivity. Instead, it’s important to encourage desired behavior via effective incentives, coupled with tools that facilitate the desired behavior, yet make undesirable behavior difficult. To this end, ITinvolve empowers people so that they are willing and even desirous to adapt their behavior. ITinvolve helps people facilitate their work by giving them the information and analysis they require, and enabling collaboration with other relevant team members (even ones they may not know about).

Giving people better tools and rewarding them with free food or cash bonuses is only part of the story. In order to achieve the business agility goals of the organization, this human governance must be seamlessly integrated with the automated governance of technology. In other words, technology must support the desired human behavior by providing the right tools, but people must also be able to properly manage and govern the technology in order to support the flexibility necessary for the organization to be agile.

Furthermore, as emergent behavior is inherently unpredictable, it is essential that organizations take an iterative approach to directing human and technology behavior in order to increase the organization’s agility. Each iteration should include a feedback loop that reflects the resulting effects of any policy or tooling change in order to improve results of subsequent iterations.

ITinvolve’s combined automated governance and human curation approach brings together the essential elements of this Agile Architecture story. At its core, the Agility Manager is an application that simplifies and encourages the desired behavior from the teams using the application. It also supports multiple approaches to automating the collection and communication of necessary metadata, as well as the automation of policies.

Instead of discouraging active participation in knowledge collection as standard portals and knowledge management tools do, ITinvolve empowers people to share their knowledge, as shown in the figure below. This approach facilitates cross-team collaboration on projects and decisions by supporting more effective risk management using current and accurate information. As a result, people can get their jobs done and make better decisions by fully understanding the various dependencies among requirements, policies, applications, and other elements of their work environment.

ITinvolve Agility Manager illustrating interrelationships among various diverse types of people and objects in the organization (Source: ITinvolve)

ITinvolve Agility Manager illustrating interrelationships among
various diverse types of people and objects in the organization (Source: ITinvolve)

ITinvolve also brings together and integrates varied data sources, including documents on portals, metadata in asset management tools and CMDBs, automation scripts and recipes, and other information that would otherwise be scattered about the organization or locked up in the heads of key personnel. This “tribal knowledge” of each expert in the enterprise is a critical asset that is always at risk of being lost, either through people leaving the organization, or simply forgetting the details over time.

Not only does ITinvolve facilitate the collection and dissemination of such tribal knowledge, but the application also supports the continuous review of such information by other experts in the organization. The result is an iterative, continuous-feedback approach to ongoing improvement of the information that ITinvolve manages. In fact, by bringing various individuals together from across different departments within the organization, ITinvolve supports flexible collaboration across the enterprise. Such cross-silo collaboration is critical for Agile projects, DevOps, and other initiatives that drive greater agility in the enterprise.

The Intellyx Take

One area where Agile development methodologies and the Agile Architecture approach to treating the organization as a Complex Adaptive System overlap is with the focus on self-organizing teams. Top-down approaches to creating teams – essentially, managers formally assigning roles to individuals – limit the flexibility of the team and thus impact the agility of the organization. Allowing teams to organize themselves addresses this issue.

And yet, as teams expand beyond a handful of people, especially when such teams are cross-functional and involve a variety of people in different roles, then self-organization can potentially begin to break down. The challenge isn’t necessarily the competency of the individuals involved, but rather their ability to communicate effectively and maintain coherent, up-to-date tribal knowledge, even as the team’s personnel might change or their tasks may evolve.

Solving this challenge is central to ITinvolve’s value proposition, because it both facilitates and supports the self-organization so critical to Agile teams, while at the same time addressing the communication and knowledge management challenges endemic to cross-functional teams. As a result, ITinvolve fosters a self-regulating system that provides greater transparency to all team members and management alike, as well as automated constraints on the behavior of associated technology assets, in such a way that facilitates the iterative feedback loop essential to driving agility long-term in large organizations.

ITinvolve is an Intellyx client. Intellyx retains full editorial control over the content of this post.

Read the original blog entry...

More Stories By Jason Bloomberg

Jason Bloomberg is the leading expert on architecting agility for the enterprise. As president of Intellyx, Mr. Bloomberg brings his years of thought leadership in the areas of Cloud Computing, Enterprise Architecture, and Service-Oriented Architecture to a global clientele of business executives, architects, software vendors, and Cloud service providers looking to achieve technology-enabled business agility across their organizations and for their customers. His latest book, The Agile Architecture Revolution (John Wiley & Sons, 2013), sets the stage for Mr. Bloomberg’s groundbreaking Agile Architecture vision.

Mr. Bloomberg is perhaps best known for his twelve years at ZapThink, where he created and delivered the Licensed ZapThink Architect (LZA) SOA course and associated credential, certifying over 1,700 professionals worldwide. He is one of the original Managing Partners of ZapThink LLC, the leading SOA advisory and analysis firm, which was acquired by Dovel Technologies in 2011. He now runs the successor to the LZA program, the Bloomberg Agile Architecture Course, around the world.

Mr. Bloomberg is a frequent conference speaker and prolific writer. He has published over 500 articles, spoken at over 300 conferences, Webinars, and other events, and has been quoted in the press over 1,400 times as the leading expert on agile approaches to architecture in the enterprise.

Mr. Bloomberg’s previous book, Service Orient or Be Doomed! How Service Orientation Will Change Your Business (John Wiley & Sons, 2006, coauthored with Ron Schmelzer), is recognized as the leading business book on Service Orientation. He also co-authored the books XML and Web Services Unleashed (SAMS Publishing, 2002), and Web Page Scripting Techniques (Hayden Books, 1996).

Prior to ZapThink, Mr. Bloomberg built a diverse background in eBusiness technology management and industry analysis, including serving as a senior analyst in IDC’s eBusiness Advisory group, as well as holding eBusiness management positions at USWeb/CKS (later marchFIRST) and WaveBend Solutions (now Hitachi Consulting).

@MicroservicesExpo Stories
Internet of @ThingsExpo, taking place November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with the 19th International Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world and ThingsExpo Silicon Valley Call for Papers is now open.
SYS-CON Events announced today that Isomorphic Software will exhibit at DevOps Summit at 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Isomorphic Software provides the SmartClient HTML5/AJAX platform, the most advanced technology for building rich, cutting-edge enterprise web applications for desktop and mobile. SmartClient combines the productivity and performance of traditional desktop software with the simp...
In his session at @DevOpsSummit at 19th Cloud Expo, Yoseph Reuveni, Director of Software Engineering at Jet.com, will discuss Jet.com's journey into containerizing Microsoft-based technologies like C# and F# into Docker. He will talk about lessons learned and challenges faced, the Mono framework tryout and how they deployed everything into Azure cloud. Yoseph Reuveni is a technology leader with unique experience developing and running high throughput (over 1M tps) distributed systems with extre...
Node.js and io.js are increasingly being used to run JavaScript on the server side for many types of applications, such as websites, real-time messaging and controllers for small devices with limited resources. For DevOps it is crucial to monitor the whole application stack and Node.js is rapidly becoming an important part of the stack in many organizations. Sematext has historically had a strong support for monitoring big data applications such as Elastic (aka Elasticsearch), Cassandra, Solr, S...
There's a lot of things we do to improve the performance of web and mobile applications. We use caching. We use compression. We offload security (SSL and TLS) to a proxy with greater compute capacity. We apply image optimization and minification to content. We do all that because performance is king. Failure to perform can be, for many businesses, equivalent to an outage with increased abandonment rates and angry customers taking to the Internet to express their extreme displeasure.
Right off the bat, Newman advises that we should "think of microservices as a specific approach for SOA in the same way that XP or Scrum are specific approaches for Agile Software development". These analogies are very interesting because my expectation was that microservices is a pattern. So I might infer that microservices is a set of process techniques as opposed to an architectural approach. Yet in the book, Newman clearly includes some elements of concept model and architecture as well as p...
SYS-CON Events announced today that LeaseWeb USA, a cloud Infrastructure-as-a-Service (IaaS) provider, will exhibit at the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. LeaseWeb is one of the world's largest hosting brands. The company helps customers define, develop and deploy IT infrastructure tailored to their exact business needs, by combining various kinds cloud solutions.
Adding public cloud resources to an existing application can be a daunting process. The tools that you currently use to manage the software and hardware outside the cloud aren’t always the best tools to efficiently grow into the cloud. All of the major configuration management tools have cloud orchestration plugins that can be leveraged, but there are also cloud-native tools that can dramatically improve the efficiency of managing your application lifecycle. In his session at 18th Cloud Expo, ...
Ovum, a leading technology analyst firm, has published an in-depth report, Ovum Decision Matrix: Selecting a DevOps Release Management Solution, 2016–17. The report focuses on the automation aspects of DevOps, Release Management and compares solutions from the leading vendors.
SYS-CON Events announced today that Venafi, the Immune System for the Internet™ and the leading provider of Next Generation Trust Protection, will exhibit at @DevOpsSummit at 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Venafi is the Immune System for the Internet™ that protects the foundation of all cybersecurity – cryptographic keys and digital certificates – so they can’t be misused by bad guys in attacks...
SYS-CON Events has announced today that Roger Strukhoff has been named conference chair of Cloud Expo and @ThingsExpo 2016 Silicon Valley. The 19th Cloud Expo and 6th @ThingsExpo will take place on November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. "The Internet of Things brings trillions of dollars of opportunity to developers and enterprise IT, no matter how you measure it," stated Roger Strukhoff. "More importantly, it leverages the power of devices and the Interne...
DevOps at Cloud Expo – being held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA – announces that its Call for Papers is open. Born out of proven success in agile development, cloud computing, and process automation, DevOps is a macro trend you cannot afford to miss. From showcase success stories from early adopters and web-scale businesses, DevOps is expanding to organizations of all sizes, including the world's largest enterprises – and delivering real results. Am...
The 19th International Cloud Expo has announced that its Call for Papers is open. Cloud Expo, to be held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA, brings together Cloud Computing, Big Data, Internet of Things, DevOps, Digital Transformation, Microservices and WebRTC to one location. With cloud computing driving a higher percentage of enterprise IT budgets every year, it becomes increasingly important to plant your flag in this fast-expanding business opportuni...
This digest provides an overview of good resources that are well worth reading. We’ll be updating this page as new content becomes available, so I suggest you bookmark it. Also, expect more digests to come on different topics that make all of our IT-hearts go boom!
Keeping pace with advancements in software delivery processes and tooling is taxing even for the most proficient organizations. Point tools, platforms, open source and the increasing adoption of private and public cloud services requires strong engineering rigor – all in the face of developer demands to use the tools of choice. As Agile has settled in as a mainstream practice, now DevOps has emerged as the next wave to improve software delivery speed and output. To make DevOps work, organization...
This is a no-hype, pragmatic post about why I think you should consider architecting your next project the way SOA and/or microservices suggest. No matter if it’s a greenfield approach or if you’re in dire need of refactoring. Please note: considering still keeps open the option of not taking that approach. After reading this, you will have a better idea about whether building multiple small components instead of a single, large component makes sense for your project. This post assumes that you...
The Internet of Things will challenge the status quo of how IT and development organizations operate. Or will it? Certainly the fog layer of IoT requires special insights about data ontology, security and transactional integrity. But the developmental challenges are the same: People, Process and Platform and how we integrate our thinking to solve complicated problems. In his session at 19th Cloud Expo, Craig Sproule, CEO of Metavine, will demonstrate how to move beyond today's coding paradigm ...
"We provide DevOps solutions. We also partner with some key players in the DevOps space and we use the technology that we partner with to engineer custom solutions for different organizations," stated Himanshu Chhetri, CTO of Addteq, in this SYS-CON.tv interview at DevOps at 18th Cloud Expo, held June 7-9, 2016, at the Javits Center in New York City, NY.

Let's just nip the conflation of these terms in the bud, shall we?

"MIcro" is big these days. Both microservices and microsegmentation are having and will continue to have an impact on data center architecture, but not necessarily for the same reasons. There's a growing trend in which folks - particularly those with a network background - conflate the two and use them to mean the same thing.

They are not.

One is about the application. The other, the network. T...

If you are within a stones throw of the DevOps marketplace you have undoubtably noticed the growing trend in Microservices. Whether you have been staying up to date with the latest articles and blogs or you just read the definition for the first time, these 5 Microservices Resources You Need In Your Life will guide you through the ins and outs of Microservices in today’s world.