Welcome!

Microservices Expo Authors: XebiaLabs Blog, Ruxit Blog, Liz McMillan, Sematext Blog, Elizabeth White

Related Topics: Microservices Expo, Java IoT, ColdFusion, Containers Expo Blog, IoT User Interface, Apache

Microservices Expo: Article

Hunting Down the “Herbies” In Your House

Applying the Theory of Constraints to the Management of IT

Recently some colleagues and I were discussing applications of the Theory of Constraints to various process and financial management scenarios.  In our current  economic environment in which organizations are constantly being pushed to new expectations of efficiency, the effective use of all available resources is absolutely critical to the success of an organization.  As we were considering some of the themes from Eli Goldratt’s classic business novel “The Goal” (right around the first anniversary of the author’s passing, coincidentally), I began to see the applicability of Goldratt’s work to the management of enterprise information technology much more clearly.  Although the focus of Goldratt’s seminal novel is primarily targeted at manufacturing, the discussion got me thinking about how well IT professionals embrace similar concepts to focus on eliminating bottlenecks in heterogenous systems and monitoring the various functional components of an application, solution, or environment.

For those unfamiliar with the book, it is the tale of a manufacturing manager who is assigned the dubious honor of fixing persistent production problems at his factory.  In a style that was very unique at the time of publication (1984), Goldratt provides instruction on the Theory of Constraints and methods for dealing with process problems by telling a story rather than rote or more traditional step by step instruction.  One of the core lessons of “The Goal” is provided via a boy in the protagonist’s scout troop named Herbie.  While out on a wilderness hike with the troop, our hero is constantly frustrated by the fact that the scouts seem to have a total and complete inability to stay together.  As the chaperone in charge of ensuring that these young men all come out of the woods safe and sound, he is understandably annoyed.  He eventually notices that Herbie, whose physical condition is less than optimal compared to his peers, is the bottleneck.  Herbie is always bringing up the rear and slowing down the entire troop.  Our hero attempts various methods such as lightening Herbie’s pack, but ultimately discovers that the optimal way to keep the troop together is to let Herbie be the leader leader of the hike.  This ensures that no one will ever hike faster than Herbie and that the group will stay together.  And therein lies one of the core tenets - the slowest activity in any process is the biggest determinant of the overall process cycle time.  Or, the total length of time required to execute any multi step process is most impacted by the length of time required to execute the longest-running task.  This observation is the spark that inspires our hero to analyze the activities in his manufacturing process flows, identify the bottlenecks, and work to optimize and eliminate them with the help of those who actually perform the work.  As the operations at his factory improve, he also fixes his marriage and becomes a better father, but such are the elements of drama (hence the “business novel”) and the side benefits of enjoying one’s vocation.

So what do out of shape scouts and manufacturing process flows have to do with the implementation of enterprise class information technology solutions?  I recall back in the 90s as the middleware market was being developed that there was a great deal of focus on speeds and feeds when comparing message oriented middleware (MOM) software solutions.  The competitive focus was on which solution provider could move message payloads from point A to point B (across networks and operating system platforms) the fastest.  As this technology was the foundation for many business process automation solutions upon which hybrid applications could be built by serializing cross platform components of executable business logic, the point seemed to be that the technology that delivered message payloads fastest would also enable the overall process to execute the fastest.  By extension, this speed of execution would provide a competitive advantage for one’s business.  Those implementing these sorts of solutions quickly realized that if the applications that were processing the messages were inefficiently written or being hosted on inadequate computing platforms, the speed at which the information was delivered to the participant applications made no difference.  This is because the overall process execution time was always determined by the business software applications that were providing actual business function at the endpoints rather than the speed at which the information could be delivered to those endpoint applications.  This is true with humans as well of course, because one cannot process information faster by simply DVRing their favorite news channel and watching it at 2x the speed.


Fast forward to the 21st century and we still see similar issues and impressions that have to be addressed.  According to Jake Gibson, VP of Customer Operations at LightEdge Solutions, “We often see situations in which there are requests for networking speeds that far surpass the performance of the business applications.  This enables us to have additional conversations about true performance requirements in the context of customers’ businesses and provide more appropriate solutions.”

 

Like any business process or heterogenous system, IT solutions have their share of potential bottlenecks and optimization opportunities.  When we take into account the complexity of our networks, storage systems, and computing hardware and combine it with the configuration and tuning options available in the operating systems, database management systems, application servers, and integration middleware, we can truly develop an appreciation for the depth of infrastructure skills required of the modern IT professional.  Add to that the specialized processors, business applications (both custom written and those supported by vendors), and other specialized capabilities such as business process management and analytics that are hosted by the  computing infrastructure and the many challenges that can arise with performance issues start to become apparent.  And don’t forget the need to securely deliver a great deal of functionality to customers and employees via mobile devices that are not located within the corporation’s facilities...

 

IT professionals will find bottlenecks and performance issues such as these easier to address as the burgeoning market for workload optimized and expert integrated systems develops.  Pre-configured hardware and software solutions that have been tuned and optimized for specific business requirements, applications, and workload characteristics will eliminate much of the guesswork and troubleshooting required to squeeze additional performance out of solutions.  Some of these solutions are available today from leading enterprise-class solution providers and many more will be released in the near future.  Additionally, as more solution providers expand the capabilities that can be provided to enterprise customers via cloud computing technologies, some of the burden will be shifted to the providers themselves.

 

The vast majority of the time all of the components in today’s complex information systems function quite well together and the business gets value out of its investment in information technology.  But full optimization of the modern IT environment, or the “hunting of the Herbies” when performance issues do arise, requires coordinated and proactive monitoring of the environment and an in-depth understanding of the overall systems architecture.  And that requires investment in the IT professionals who bring it all together for the business.

More Stories By Douglas Allen

Douglas W. Allen is a husband and father from Des Moines, IA and the owner of the winningtechnicalsales.com blog, dedicated to the sales engineering profession. As a technical sales manager at IBM, his team is dedicated to helping customers design and deploy enterprise-class business technology solutions that enable those customers to make money, save money, or mitigate risk. He is currently on a campaign to convince the world that the past, present, and future of rock and roll recently came out of New Jersey in the form of The Gaslight Anthem. He can be reached at www.linkedin.com/in/douglaswallen.

@MicroservicesExpo Stories
If you are within a stones throw of the DevOps marketplace you have undoubtably noticed the growing trend in Microservices. Whether you have been staying up to date with the latest articles and blogs or you just read the definition for the first time, these 5 Microservices Resources You Need In Your Life will guide you through the ins and outs of Microservices in today’s world.
This is a no-hype, pragmatic post about why I think you should consider architecting your next project the way SOA and/or microservices suggest. No matter if it’s a greenfield approach or if you’re in dire need of refactoring. Please note: considering still keeps open the option of not taking that approach. After reading this, you will have a better idea about whether building multiple small components instead of a single, large component makes sense for your project. This post assumes that you...
This complete kit provides a proven process and customizable documents that will help you evaluate rapid application delivery platforms and select the ideal partner for building mobile and web apps for your organization.
Monitoring of Docker environments is challenging. Why? Because each container typically runs a single process, has its own environment, utilizes virtual networks, or has various methods of managing storage. Traditional monitoring solutions take metrics from each server and applications they run. These servers and applications running on them are typically very static, with very long uptimes. Docker deployments are different: a set of containers may run many applications, all sharing the resource...
SYS-CON Events announced today that Isomorphic Software will exhibit at DevOps Summit at 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Isomorphic Software provides the SmartClient HTML5/AJAX platform, the most advanced technology for building rich, cutting-edge enterprise web applications for desktop and mobile. SmartClient combines the productivity and performance of traditional desktop software with the simp...
Sharding has become a popular means of achieving scalability in application architectures in which read/write data separation is not only possible, but desirable to achieve new heights of concurrency. The premise is that by splitting up read and write duties, it is possible to get better overall performance at the cost of a slight delay in consistency. That is, it takes a bit of time to replicate changes initiated by a "write" to the read-only master database. It's eventually consistent, and it'...
With so much going on in this space you could be forgiven for thinking you were always working with yesterday’s technologies. So much change, so quickly. What do you do if you have to build a solution from the ground up that is expected to live in the field for at least 5-10 years? This is the challenge we faced when we looked to refresh our existing 10-year-old custom hardware stack to measure the fullness of trash cans and compactors.
The emerging Internet of Everything creates tremendous new opportunities for customer engagement and business model innovation. However, enterprises must overcome a number of critical challenges to bring these new solutions to market. In his session at @ThingsExpo, Michael Martin, CTO/CIO at nfrastructure, outlined these key challenges and recommended approaches for overcoming them to achieve speed and agility in the design, development and implementation of Internet of Everything solutions wi...
A company’s collection of online systems is like a delicate ecosystem – all components must integrate with and complement each other, and one single malfunction in any of them can bring the entire system to a screeching halt. That’s why, when monitoring and analyzing the health of your online systems, you need a broad arsenal of different tools for your different needs. In addition to a wide-angle lens that provides a snapshot of the overall health of your system, you must also have precise, ...
It's been a busy time for tech's ongoing infatuation with containers. Amazon just announced EC2 Container Registry to simply container management. The new Azure container service taps into Microsoft's partnership with Docker and Mesosphere. You know when there's a standard for containers on the table there's money on the table, too. Everyone is talking containers because they reduce a ton of development-related challenges and make it much easier to move across production and testing environm...
Node.js and io.js are increasingly being used to run JavaScript on the server side for many types of applications, such as websites, real-time messaging and controllers for small devices with limited resources. For DevOps it is crucial to monitor the whole application stack and Node.js is rapidly becoming an important part of the stack in many organizations. Sematext has historically had a strong support for monitoring big data applications such as Elastic (aka Elasticsearch), Cassandra, Solr, S...
DevOps at Cloud Expo, taking place Nov 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 19th Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The widespread success of cloud computing is driving the DevOps revolution in enterprise IT. Now as never before, development teams must communicate and collaborate in a dynamic, 24/7/365 environment. There is no time to wait for long dev...
There's a lot of things we do to improve the performance of web and mobile applications. We use caching. We use compression. We offload security (SSL and TLS) to a proxy with greater compute capacity. We apply image optimization and minification to content. We do all that because performance is king. Failure to perform can be, for many businesses, equivalent to an outage with increased abandonment rates and angry customers taking to the Internet to express their extreme displeasure.
Right off the bat, Newman advises that we should "think of microservices as a specific approach for SOA in the same way that XP or Scrum are specific approaches for Agile Software development". These analogies are very interesting because my expectation was that microservices is a pattern. So I might infer that microservices is a set of process techniques as opposed to an architectural approach. Yet in the book, Newman clearly includes some elements of concept model and architecture as well as p...
SYS-CON Events announced today that 910Telecom will exhibit at the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Housed in the classic Denver Gas & Electric Building, 910 15th St., 910Telecom is a carrier-neutral telecom hotel located in the heart of Denver. Adjacent to CenturyLink, AT&T, and Denver Main, 910Telecom offers connectivity to all major carriers, Internet service providers, Internet backbones and ...
DevOps at Cloud Expo – being held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA – announces that its Call for Papers is open. Born out of proven success in agile development, cloud computing, and process automation, DevOps is a macro trend you cannot afford to miss. From showcase success stories from early adopters and web-scale businesses, DevOps is expanding to organizations of all sizes, including the world's largest enterprises – and delivering real results. Am...

Modern organizations face great challenges as they embrace innovation and integrate new tools and services. They begin to mature and move away from the complacency of maintaining traditional technologies and systems that only solve individual, siloed problems and work “well enough.” In order to build...

The post Gearing up for Digital Transformation appeared first on Aug. 29, 2016 04:30 PM EDT  Reads: 1,661

Internet of @ThingsExpo, taking place November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 19th Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The Internet of Things (IoT) is the most profound change in personal and enterprise IT since the creation of the Worldwide Web more than 20 years ago. All major researchers estimate there will be tens of billions devices - comp...
As the world moves toward more DevOps and Microservices, application deployment to the cloud ought to become a lot simpler. The Microservices architecture, which is the basis of many new age distributed systems such as OpenStack, NetFlix and so on, is at the heart of Cloud Foundry - a complete developer-oriented Platform as a Service (PaaS) that is IaaS agnostic and supports vCloud, OpenStack and AWS. Serverless computing is revolutionizing computing. In his session at 19th Cloud Expo, Raghav...
19th Cloud Expo, taking place November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA, will feature technical sessions from a rock star conference faculty and the leading industry players in the world. Cloud computing is now being embraced by a majority of enterprises of all sizes. Yesterday's debate about public vs. private has transformed into the reality of hybrid cloud: a recent survey shows that 74% of enterprises have a hybrid cloud strategy. Meanwhile, 94% of enterpri...