Welcome!

Microservices Expo Authors: Liz McMillan, Pat Romanski, Elizabeth White, Stackify Blog, Andreas Grabner

Related Topics: Microservices Expo, @CloudExpo

Microservices Expo: Blog Feed Post

Communities in the Cloud

In the 1990s community of interest networks (COINs) emerged

In the 1990s community of interest networks (COINs) emerged to take advantage of rapidly developing Internet protocol technologies. A small startup named BizNet on London’s Chiswell Street developed an idea to build a secure, closed network to support only companies operating within the securities and financial industries.

BizNet had some reasonable traction in London, with more than 100 individual companies connecting within the secure COIN. Somewhat revolutionary at the time, and it did serve the needs of their target market. Management was also simple, using software from a small company called IPSwitch and their soon to be globally popular “What’s Up” network management and monitoring utility.

However simplicity was the strength of BizNet. While other companies favored strong marketing campaigns and a lot of flash to attract companies to the Internet age, BizNet’s thought leaders (Jez Lloyd and Nick Holland) relied on a strong commitment to service delivery and excellence, and their success became viral within the financial community based on the confidence they built among COIN members.

As networks go, so did BizNet, which was purchased by Level 3 Communications in 1999 and subsequently the COIN network was dismantled in favor of integrating the individual customers into the Level 3 community.

Cloud Communities
Cloud computing supports the idea of a COIN, as companies can not only build their “virtual data center” within a Platform as a Service/PaaS model, but also develop secure virtual interconnections among companies within a business community – not only within the same cloud service provider (CSP), but also among cloud service providers.

In the “BizNet” version of a COIN, dedicated connections (circuits) were needed to connect routers and switches to a central exchange point run by BizNet. BizNet monitored all connections, reinforcing internal operations centers run by individual companies, and added an additional layer of confidence that helped a “viral” growth of their community.

Gerard Briscoe and Alexandros Marinos delivered a paper in 2009 entitled Digital Ecosystems in the Clouds: Towards Community Cloud Computing.” In addition to discussing the idea of using cloud computing to support an outsourced model of the COIN, the paper also drills deeper into additional areas such as the environmental sustainability of a cloud community.

As each member of the cloud community COIN begins to outsource their virtual data center into the cloud, they are able to begin shutting down inefficient servers while migrating processing requirements into a managed virtual architecture. Even the requirement for managing high performance switching equipment supporting fiber channel and SAN systems is eliminated, with the overall result allowing a significant percentage of costs associated with equipment purchase, software licenses, and support agreements to be rechanneled to customer or business-facing activities.

Perhaps the most compelling potential feature of community clouds is the idea that we can bring processing between business or trading partners within the COIN to near zero, as the interaction between members is on the same system, and will not lose any velocity due to delays induced by going through switching, routing, or short/long distance transmission through the Internet or dedicated circuits.

Standards and a Community Applications Library
Most trading communities and supply chains have a common standard for data representation, process, and interconnection between systems. This may be a system such as RosettaNet for the manufacturing industry, or other similar industry specifications. Within the COIN there should also be a central function that provides the APIs, specifications, and other configurations such as security and web services/interconnection interface specs.

As a function of developing a virtual data center within the PaaS model, standard components supporting the COIN such as firewalls, APIs, and other common applications should be easily accessible for any member, ensuring from the point of implementation that joining the community is a painless experience, and a very rapid method of becoming a full member of the community.

A Marriage of Community GRIDs and Cloud Computing?
Many people are very familiar with project such as Seti At Home, and the World Community GRID. Your desktop computer, servers, or even storage equipment can contribute idle compute and storage capacity to batch jobs supporting everything from searching for extraterrestrial life to AIDS research. You simply register your computer with the target project, download a bit of client software, and the client communicates with a project site to coordinate batch processing of work units/packets.

Now we know our COIN is trying to relieve members from the burden of operating their own data centers – at least those portions of the data center focusing on support of a supply chain or trading community of interest. And some companies are more suited to outsourcing their data center requirements than others. So if we have a mix of companies still operating large data centers with potential sources of unused capacity, and other members in the community cloud with little or no onsite data center capacity, maybe there is a way the community can support itself further by developing the concept of processing capacity as a currency.

As all individual data centers and office LAN/MAN/WANs will have physical connections to the cloud service provider (IaaS provider) through an Internet service provider or dedicated metro Ethernet connection, the virtual data centers being produced within the PaaS portion of the CSP’s will be inherently connectable to any user, or any facility within the COIN. Of course that is accepting that security management will protect non-COIN connected portions of the community.

Virtually, those members of the community with excess capacity within their own networks could then easily further contribute their spare capacity to the community for use as non-time critical compute resource, or for supporting “batch” processing. Some CSPs may even consider buying that capacity to provide members either in the COIN, or outside of the COIN, and additional resource available to their virtual customers as low cost, low performance, batch capacity much like SETI at Home or the Protein Folding Project uses spare capacity on an as-available basis. Much like selling your locally produced energy back into a power GRID.

We Have a New, Blank Cloud White Board to Play With
The BizNet COIN was good. Eleven years after BizNet was dissolved, the concept remains valid, and we now have additional infrastructure that will support COINs through community clouds, with enabling features that extend far beyond the initial vision of BizNet. CSPs such as ScaleUp have built IaaS and PaaS empowerment for COINs within their data center.

Cloud computing is an infant. Well, maybe in Internet years it is rapidly heading to adolescence, but it is still pretty young. Like an adolescent, we know it is powerful, getting more powerful by the day, but few people have the vision to wrap their head around what broadband, cloud computing, diffusion of network-enabled knowledge into the basic education system, and the continuation of Moore’s, Metcalf’s, and other laws of industry and physics.

COINs and community clouds may not have been in the initial discussions of cloud computing, but they are here now. Watching a Slingbox feed in a Jakarta hotel room connected to a television in Burbank was probably not a vision shared by the early adopters of the Internet – and cloud computing will make similar un-thought of leaps in utility and capabilities over the next few years.

However, in the near term, do not be surprised if you see the entire membership of the New York Stock Exchange and NASDAQ operating from a shared cloud COIN. It will work.

Read the original blog entry...

More Stories By John Savageau

John Savageau is a life long telecom and Internet geek, with a deep interest in the environment and all things green. Whether drilling into the technology of human communications, cloud computing, or describing a blue whale off Catalina Island, Savageau will try to present complex ideas in terms that are easily appreciated and understood.

Savageau is currently focusing efforts on data center consolidation strategies, enterprise architectures, and cloud computing migration planning in developing countries, including Azerbaijan, The Philippines, Palestine, Indonesia, Moldova, Egypt, and Vietnam.

John Savageau is President of Pacific-Tier Communications dividing time between Honolulu and Burbank, California.

A former career US Air Force officer, Savageau graduated with a Master of Science degree in Operations Management from the University of Arkansas and also received Bachelor of Arts degrees in Asian Studies and Information Systems Management from the University of Maryland.

Microservices Articles
Is advanced scheduling in Kubernetes achievable?Yes, however, how do you properly accommodate every real-life scenario that a Kubernetes user might encounter? How do you leverage advanced scheduling techniques to shape and describe each scenario in easy-to-use rules and configurations? In his session at @DevOpsSummit at 21st Cloud Expo, Oleg Chunikhin, CTO at Kublr, answered these questions and demonstrated techniques for implementing advanced scheduling. For example, using spot instances and co...
Skeuomorphism usually means retaining existing design cues in something new that doesn’t actually need them. However, the concept of skeuomorphism can be thought of as relating more broadly to applying existing patterns to new technologies that, in fact, cry out for new approaches. In his session at DevOps Summit, Gordon Haff, Senior Cloud Strategy Marketing and Evangelism Manager at Red Hat, discussed why containers should be paired with new architectural practices such as microservices rathe...
In his session at 20th Cloud Expo, Mike Johnston, an infrastructure engineer at Supergiant.io, will discuss how to use Kubernetes to setup a SaaS infrastructure for your business. Mike Johnston is an infrastructure engineer at Supergiant.io with over 12 years of experience designing, deploying, and maintaining server and workstation infrastructure at all scales. He has experience with brick and mortar data centers as well as cloud providers like Digital Ocean, Amazon Web Services, and Rackspace....
SYS-CON Events announced today the Kubernetes and Google Container Engine Workshop, being held November 3, 2016, in conjunction with @DevOpsSummit at 19th Cloud Expo at the Santa Clara Convention Center in Santa Clara, CA. This workshop led by Sebastian Scheele introduces participants to Kubernetes and Google Container Engine (GKE). Through a combination of instructor-led presentations, demonstrations, and hands-on labs, students learn the key concepts and practices for deploying and maintainin...
Docker is sweeping across startups and enterprises alike, changing the way we build and ship applications. It's the most prominent and widely known software container platform, and it's particularly useful for eliminating common challenges when collaborating on code (like the "it works on my machine" phenomenon that most devs know all too well). With Docker, you can run and manage apps side-by-side - in isolated containers - resulting in better compute density. It's something that many developer...
Modern software design has fundamentally changed how we manage applications, causing many to turn to containers as the new virtual machine for resource management. As container adoption grows beyond stateless applications to stateful workloads, the need for persistent storage is foundational - something customers routinely cite as a top pain point. In his session at @DevOpsSummit at 21st Cloud Expo, Bill Borsari, Head of Systems Engineering at Datera, explored how organizations can reap the bene...
As software becomes more and more complex, we, as software developers, have been splitting up our code into smaller and smaller components. This is also true for the environment in which we run our code: going from bare metal, to VMs to the modern-day Cloud Native world of containers, schedulers and micro services. While we have figured out how to run containerized applications in the cloud using schedulers, we've yet to come up with a good solution to bridge the gap between getting your contain...
In his general session at 19th Cloud Expo, Manish Dixit, VP of Product and Engineering at Dice, discussed how Dice leverages data insights and tools to help both tech professionals and recruiters better understand how skills relate to each other and which skills are in high demand using interactive visualizations and salary indicator tools to maximize earning potential. Manish Dixit is VP of Product and Engineering at Dice. As the leader of the Product, Engineering and Data Sciences team at D...
DevOps is speeding towards the IT world like a freight train and the hype around it is deafening. There is no reason to be afraid of this change as it is the natural reaction to the agile movement that revolutionized development just a few years ago. By definition, DevOps is the natural alignment of IT performance to business profitability. The relevance of this has yet to be quantified but it has been suggested that the route to the CEO’s chair will come from the IT leaders that successfully ma...
Skeuomorphism usually means retaining existing design cues in something new that doesn’t actually need them. However, the concept of skeuomorphism can be thought of as relating more broadly to applying existing patterns to new technologies that, in fact, cry out for new approaches. In his session at DevOps Summit, Gordon Haff, Senior Cloud Strategy Marketing and Evangelism Manager at Red Hat, will discuss why containers should be paired with new architectural practices such as microservices ra...