|By Jason Bloomberg||
|June 2, 2014 06:13 AM EDT||
My five months with EnterpriseWeb have run their course, and I’m returning to the world of advisory, analysis, and architecture training with my new company, Intellyx, and this, the inaugural issue of our Cortex newsletter. After a dozen years with ZapThink, doing my best to help organizations around the globe get architecture right, you might wonder why I took a detour as Chief Evangelist for a vendor. The answer: EnterpriseWeb has brought technology to market that can upend the entire Agile Architecture discussion. They have set the bar for what it means to build a platform that can enable organizations to achieve the elusive business agility benefits that SOA promised but never delivered. And if a five-person company out of upstate New York can do that, then anybody can.
As of today I return full time to being a chief evangelist for the style of Enterprise Architecture I refer to as Agile Architecture in my book, The Agile Architecture Revolution. In that book I talk about REST-Based SOA, Cloud Computing, mobile technologies, and a host of other modern enterprise technology trends that are shaking up IT departments as they try to get a handle on the business value such technologies promise. And yet, I’ll be the first to admit that the book didn’t go far enough. You could take every word I wrote to heart and still not know how to architect agility in your organization. There were pieces missing from the story – and all these missing elements centered on the fundamental challenge of distributed computing.
The central challenge of distributed computing, of course, is how to get your various distributed bits to communicate with each other properly. Since those distributed components are typically heterogeneous, we must somehow come up with a common means of establishing interaction among components everybody can agree on. Yet, once we do that, we’ve necessarily compromised on flexibility, because changing how our components interact is a difficult, complex endeavor. Agile Architecture must solve this problem.
This problem pervades the entire history of APIs, from remote procedure calls to Web Services to RESTful APIs and everything in between. We must somehow contract interfaces in order to abstract the underlying functionality, thus providing loose coupling and with it, some measure of flexibility within the underlying code. Yet the very act of introducing such contracts (including REST’s uniform interface) is a compromise, since the interface itself now lacks flexibility. Basically, we look at the world of distributed computing and convince ourselves that the only way to get this stuff to work at all is to give up agility. The end result? Instead of being an enabler of business agility, enterprise IT is now cast in the role of limiter of business agility.
The central technical challenge for Agile Architecture, therefore, is how to achieve functionality and performance without having to trade off flexibility. This central compromise of distributed computing is the nut that EnterpriseWeb has been able to crack by adding an additional layer of abstraction over the entire distributed environment, coupled with an agent-oriented runtime engine that resolves abstracted references dynamically in real time. The bottom line: at least one vendor in the marketplace has shown that it is possible to deliver on the promise of Agile Architecture. And if one can, so can others.
The Four Central Patterns of Agile Architecture
Now it’s time for me to take off my EnterpriseWeb hat and put it in a drawer. In its place goes the Intellyx hat, blue brain and all. After all, the point of this article isn’t to talk about what a single vendor has accomplished. Rather, my goal is to lay out the essential patterns of Agile Architecture that heretofore have been difficult or impossible to implement in practice.
The context for these central patterns of Agile Architecture is the concept of architecting at the “meta” level I discuss in my book – the higher level of abstraction that EnterpriseWeb has been able to implement. At this meta level, there are four central patterns of Agile Architecture that are essential to resolving the fundamental compromise of distributed computing:
- Dynamic Coupling. Tightly coupled interfaces require detailed knowledge of both sides of a distributed computing interaction, and any change on one side might break the other. Contracted interfaces introduce loose coupling, implementing an abstraction that separates interface from implementation, thus allowing changes to the implementation, but at the expense of a static interface. With dynamic coupling, interface differences are resolved dynamically at run time. The underlying integration engine must be able to find all relevant metadata and resolve any interaction issues in real time in order to allow the metadata to change from one request to the next.
- Dynamic Schemas. Neither the WSDL files that specify Web Services, nor the URIs, HTTP verbs, and Internet Media Types that specify RESTful APIs adequately contract the message semantics for any interaction. As a result, metadata describing such semantics are scattered about in XML schemas or Custom Media Types or other arbitrary places, leading to the reintroduction of tight coupling and inflexibility. Dynamic schemas abstract all such semantic metadata in a consistent way, relying once again upon the integration engine to resolve these dynamic schemas for each interaction at run time.
- Extreme Late Binding. Remember the original promise of SOA registries and the ungainly UDDI standard? The idea was that a Service consumer could automatically look up a Web Service at run time, and based upon the WSDL file it found as a result, bind to the newly discovered service in real time, potentially choosing a different Web Service for each interaction. Unfortunately, Web Services rarely if ever worked this way. Registries ended up doing little more than resolving endpoint references at run time, similar to the way DNS resolves domain names – in other words, they provided late binding. Such late binding adds some flexibility to an interaction, but typically at the expense of performance. Today, however, dynamic coupling and dynamic schemas enable any client to discover at run time all the metadata it requires to interact with any endpoint, without sacrificing performance – what I call extreme late binding.
- Dynamic Constraint Satisfaction. The publication of Services at design time for later discovery shifted SOA’s focus from integration to governance. How are you going to manage all the Services in your directory – let alone actually reuse any of them – unless you are able to create and enforce policies across your organization for how to do so properly? Yes, SOA management tools (helpfully renamed API management tools for the 2010s) provide some measure of API governance, but typically constrained to the technical context of software interactions. However, ask a business stakeholder what governance means to them, and you’ll get an entirely different context for the word. While some policies are technical in nature and apply narrowly to specific APIs or applications, others are more business-centric and apply broadly across departments or even entire organizations. To enforce the full breadth of such policies properly, your run time environment must essentially solve for the combination of all applicable policies dynamically at run time across the entire application environment – a classic dynamic constraint satisfaction problem.
If you believe any of these patterns is nothing more than an old pattern warmed over with a new name, you may be missing something important. True, each of these patterns builds upon patterns that came before, but they all advance the discussion of Agile Architecture to a new level. On the other hand, if you think any of the above patterns are too difficult to implement – if it sounds like you need some kind of magic wand to make this vision work – then I’m here to tell you, I’ve seen a platform that can implement all four patterns, and furthermore, can do so without sacrificing performance. Thus we know they are possible. The question now is, why isn’t everyone doing them?
You may, however, believe that you’re actually implementing some or all of these patterns, either as an architect or as a vendor whose product supports such patterns for your customers. If so, I want to hear from you. Intellyx wants to tell your story.
The Intellyx Take
The Agile Architecture bar is set. Vendors should know what their products must do. Architects have some insight into the patterns they must follow. And business stakeholders can finally rest assured that at least it’s possible to achieve technology-enabled business agility. True, it’s difficult. Many of the pieces are only just now falling into place. Levels of maturity are low across the board. But we’re on our way.
I’m looking forward to helping organizations like yours by leading the Agile Architecture story. I hope to see you in one of my all-new Bloomberg Agile Architecture courses, the sequel to my popular Licensed ZapThink Architect course, coming to Seattle, Dubai, Sydney, Washington DC, and London in the next few months. Or perhaps I can present a keynote at your corporate event or conference, or if you’re a vendor or service provider, consider an Intellyx unlimited advisory subscription or participating in our upcoming Agile Architecture Vendor Landscape Report. You can also join our LinkedIn group or subscribe to the Cortex newsletter. And don’t forget to see me speak on Breaking Down Enterprise Silos in the Cloud next week at Cloud Expo in New York City, where I’ll be giving away a copy of my book. I’m looking forward to working with you again!
While DevOps most critically and famously fosters collaboration, communication, and integration through cultural change, culture is more of an output than an input. In order to actively drive cultural evolution, organizations must make substantial organizational and process changes, and adopt new technologies, to encourage a DevOps culture. Moderated by Andi Mann, panelists will discuss how to balance these three pillars of DevOps, where to focus attention (and resources), where organizations m...
Apr. 25, 2015 10:15 AM EDT Reads: 2,017
SYS-CON Events announced today the IoT Bootcamp – Jumpstart Your IoT Strategy, being held June 9–10, 2015, in conjunction with 16th Cloud Expo and Internet of @ThingsExpo at the Javits Center in New York City. This is your chance to jumpstart your IoT strategy. Combined with real-world scenarios and use cases, the IoT Bootcamp is not just based on presentations but includes hands-on demos and walkthroughs. We will introduce you to a variety of Do-It-Yourself IoT platforms including Arduino, Ras...
Apr. 25, 2015 10:15 AM EDT Reads: 2,980
One of the most frequently requested Rancher features, load balancers are used to distribute traffic between docker containers. Now Rancher users can configure, update and scale up an integrated load balancing service to meet their application needs, using either Rancher's UI or API. To implement our load balancing functionality we decided to use HAproxy, which is deployed as a contianer, and managed by the Rancher orchestration functionality. With Rancher's Load Balancing capability, users ...
Apr. 25, 2015 10:15 AM EDT Reads: 1,076
The only place to be June 9-11 is Cloud Expo & @ThingsExpo 2015 East at the Javits Center in New York City. Join us there as delegates from all over the world come to listen to and engage with speakers & sponsors from the leading Cloud Computing, IoT & Big Data companies. Cloud Expo & @ThingsExpo are the leading events covering the booming market of Cloud Computing, IoT & Big Data for the enterprise. Speakers from all over the world will be hand-picked for their ability to explore the economic...
Apr. 25, 2015 10:00 AM EDT Reads: 4,151
As we recently previewed (read more about our London PoP in Jesse's post), Blue Box is opening a new Data Center in London, but hadn't announced the provider. Today we're excited to partner with TelecityGroup, whom we've selected as our data center partner in London. We chose their Powergate location, which is one of the U.K.'s most advanced, flexible and energy efficient carrier-neutral data centres. Why does that matter to you? Well, when customers choose Blue Box, they're trusting us with ...
Apr. 25, 2015 10:00 AM EDT Reads: 1,352
How do you securely enable access to your applications in AWS without exposing any attack surfaces? The answer is usually very complicated because application environments morph over time in response to growing requirements from your employee base, your partners and your customers. In his session at 16th Cloud Expo, Haseeb Budhani, CEO and Co-founder of Soha, will share five common approaches that DevOps teams follow to secure access to applications deployed in AWS, Azure, etc., and the frict...
Apr. 25, 2015 10:00 AM EDT Reads: 1,636
Cloud Expo New York is happening from June 9 - 11. This event brings together the worlds of Cloud Computing, DevOps, IoT, WebRTC, Big Data and SDDC. We hope to see you there-members of the Blue Box team will exhibit in booth 218 next to the DevOps area. Plus, our Chief Product Officer, Hernan Alvarez, will present his talk "The Cloud Has a Down-and-Dirty Lining" as part of the Operations track in the DevOps Summit portion of the event on June 9 at 11 am. Learn more about his session her...
Apr. 25, 2015 10:00 AM EDT Reads: 1,500
As a company making software for Continuous Delivery and Devops at scale, at XebiaLabs we’re pretty much always in discussions with users about the benefits and challenges of new development styles, application architectures, and runtime platforms. Unsurprisingly, many of these discussions right now focus on microservices on the application side and containers and related frameworks […]
Containers and microservices have become topics of intense interest throughout the cloud developer and enterprise IT communities. Accordingly, attendees at the upcoming 16th Cloud Expo at the Javits Center in New York June 9-11 will find fresh new content in a new track called PaaS | Containers & Microservices Containers are not being considered for the first time by the cloud community, but a current era of re-consideration has pushed them to the top of the cloud agenda. With the launch ...
Apr. 25, 2015 10:00 AM EDT Reads: 2,803
Financial services organizations were among the earliest enterprise adopters of cloud computing. The ability to leverage massive compute, storage and networking resources via RESTful APIs and automated tools like Chef and Puppet made it possible for their high-horsepower IT users to develop a whole new array of applications. Companies like Wells Fargo, Fidelity and BBVA are visible, vocal and engaged supporters of the OpenStack community, running production clouds for applications ranging from d...
Apr. 25, 2015 10:00 AM EDT Reads: 1,517
A few weeks ago, SmartBear hosted API Craft Boston with the folks from Akana, Ian Goldsmith and Laura Heritage, to talk about microservices. It was an extremely informative presentation of where microservices came from, what it solves, and considerations around how it might fit into an organizational API strategy. It’s one thing to read everyone else’s opinions on blogs, twitter, etc. It’s great to go to workshops and conferences, but this was so intelligently presented (and for a meetup too)...
Apr. 25, 2015 10:00 AM EDT Reads: 741
Buzzword alert: Microservices and IoT at a DevOps conference? What could possibly go wrong? Join this panel of experts as they peel away the buzz and discuss the important architectural principles behind implementing IoT solutions for the enterprise. As remote IoT devices and sensors become increasingly intelligent, they become part of our distributed cloud environment, and we must architect and code accordingly. At the very least, you’ll have no problem filling in your buzzword bingo cards.
Apr. 25, 2015 10:00 AM EDT Reads: 2,191
So I guess we’ve officially entered a new era of lean and mean. I say this with the announcement of Ubuntu Snappy Core, “designed for lightweight cloud container hosts running Docker and for smart devices,” according to Canonical. “Snappy Ubuntu Core is the smallest Ubuntu available, designed for security and efficiency in devices or on the cloud.” This first version of Snappy Ubuntu Core features secure app containment and Docker 1.6 (1.5 in main release), is available on public clouds, ...
Apr. 25, 2015 10:00 AM EDT Reads: 1,346
SYS-CON Events announced today that Column Technologies, a global technology solutions company, will exhibit at SYS-CON's DevOps Summit 2015 New York, which will take place June 9-11, 2015, at the Javits Center in New York City, NY. Established in 1998, Column Technologies is a leader in application performance and infrastructure management for commercial and federal markets. The company is headquartered in the United States, with a diverse and talented team of more than 350 employees around th...
Apr. 25, 2015 10:00 AM EDT Reads: 1,787
SYS-CON Events announced today Sematext Group, Inc., a Brooklyn-based Performance Monitoring and Log Management solution provider, will exhibit at SYS-CON's DevOps Summit 2015 New York, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY. Sematext is a globally distributed organization that builds innovative Cloud and On Premises solutions for performance monitoring, alerting and anomaly detection (SPM), log management and analytics (Logsene), search analytics (S...
Apr. 25, 2015 09:30 AM EDT Reads: 3,832
The stack is the hack, Jack. That's my takeaway from several events I attended over the past few weeks in Silicon Valley and Southeast Asia. I listened to and participated in discussions about everything from large datacenter management (think Facebook Open Compute) to enterprise-level cyberfraud (at a seminar in Manila attended by the US State Dept. and Philippine National Police) to the world of entrepreneurial startups, app deployment, and mobility (in a series of meetups and talks in bot...
Apr. 25, 2015 09:15 AM EDT Reads: 1,350
SYS-CON Events announced today Isomorphic Software, the global leader in high-end, web-based business applications, will exhibit at SYS-CON's DevOps Summit 2015 New York, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY. Isomorphic Software is the global leader in high-end, web-based business applications. We develop, market, and support the SmartClient & Smart GWT HTML5/Ajax platform, combining the productivity and performance of traditional desktop software ...
Apr. 25, 2015 09:15 AM EDT Reads: 4,851
SOA Software has changed its name to Akana. With roots in Web Services and SOA Governance, Akana has established itself as a leader in API Management and is expanding into cloud integration as an alternative to the traditional heavyweight enterprise service bus (ESB). The company recently announced that it achieved more than 90% year-over-year growth. As Akana, the company now addresses the evolution and diversification of SOA, unifying security, management, and DevOps across SOA, APIs, microser...
Apr. 25, 2015 09:15 AM EDT Reads: 2,394
An explosive combination of technology trends will be where ‘microservices’ and the IoT Internet of Things intersect, a concept we can describe by comparing it with a previous theme, the ‘X Internet.' The idea of using small self-contained application components has been popular since XML Web services began and a distributed computing future of smart fridges and kettles was imagined long back in the early Internet years.
Apr. 25, 2015 09:00 AM EDT Reads: 2,544
SYS-CON Events announced today that Cisco, the worldwide leader in IT that transforms how people connect, communicate and collaborate, has been named “Gold Sponsor” of SYS-CON's 16th International Cloud Expo®, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY. Cisco makes amazing things happen by connecting the unconnected. Cisco has shaped the future of the Internet by becoming the worldwide leader in transforming how people connect, communicate and collaborat...
Apr. 25, 2015 08:30 AM EDT Reads: 5,816