Welcome!

Microservices Expo Authors: Elizabeth White, Pat Romanski, Liz McMillan, Charles Araujo, Flint Brenton

Related Topics: @CloudExpo, Microservices Expo, Agile Computing, Cloud Security, @DXWorldExpo, SDN Journal

@CloudExpo: Article

Is the Cloud a CDN Killer?

Using CDNs and cloud together ensures a best-of-both-worlds combination for an optimal online user experience

In our Internet-driven world, both organizations and consumers have come to expect fast, always-on data access from any device. As a result, content providers are tasked with delivering massive files and streaming media to tablets and smartphones while simultaneously ensuring superior website performance. To meet the challenges of this digital data deluge, Content Delivery Networks (CDNs) are often used to efficiently distribute large amounts of content to online users.

The emergence of cloud computing has allowed companies to embrace new, cost-effective approaches to building out their IT infrastructure. The challenge of scaling is no longer prohibitively expensive, and the ability to do so in near-real time allows small and medium-sized businesses to more effectively compete with larger enterprises for market share.

While the cloud can deliver important agility benefits, it still requires careful, strategic planning to address potential challenges, including security and data bottlenecks. CDNs can help to address these issues, enabling cloud networks to meet today's content delivery demands while satisfying customers' expectations for an optimal online experience. When used together, the cloud and CDNs can actually offer the best of both worlds.

The Role of CDNs
A Content Delivery Network is a distributed network of servers and file storage devices deployed to place content and applications in geographic proximity to users, which reduces the load on origin site infrastructure and bandwidth. CDNs are highly flexible and address a wide range of needs - making it possible to simulate a broadcast video network over the Internet, cache large files for faster delivery or optimize entire websites. A CDN is a critical element of modern infrastructure deployment to create a satisfying online user experience.

One of the core functions of a CDN is to optimize media delivery, which involves the streaming of live events and prerecorded video and audio content. A CDN provides content creators and publishers with a robust infrastructure solution for online media distribution to geographically dispersed end users.

Another key benefit of a CDN is its ability to deliver large files and software without the capital expense of building a global network to achieve sufficient bandwidth. Static site caching (also known as reverse proxy caching) is also a prime feature that allows the CDN to point its distributed network at an origin server and cache the content of that origin in geographically diverse areas through a mechanism called GEO-DNS. Though many factors such as current loads contribute to this routing process, the main factor is the proximity of information. The result is much faster page loads and an improved end-user experience.

CDNs offer a multitude of ways to create a dependable, high-quality online user experience by addressing single-point-of-failure, global delivery and scalability concerns. This raises the question of whether the opportunities created by the cloud impact or even overlap with the capabilities of CDNs. If the cloud offers a more economically feasible way to bring content closer to end users, is the CDN still a useful delivery platform? In a word, yes.

Enter the Cloud
In the days before cloud, the main way to address issues regarding performance, availability and scale was by decreasing the physical distance between the origin servers and the end users. Existing infrastructure was optimized and then physically replicated in other geographic locations. Aside from the large capital investments required by this approach, there were other drawbacks and challenges - while companies controlled their infrastructure, they had no control over the network between their servers and the end user, and also had to determine how to replicate their data globally.

The cloud offers businesses a less costly way to expand infrastructure - the ability to scale virtually, on demand, without having to build or buy costly hardware. Businesses can now replicate their infrastructure in the desired geographic locations by purchasing a virtual machine with the required specifications - essentially, buying a "slice" of someone else's pre-built infrastructure. This proves a more cost-effective way to scale and reduce latency for geographically dispersed areas.

Both the cloud and CDNs have evolved into utility platforms, each designed for specialized purposes. The cloud is a utility computing platform consisting of large physical stacks of computational resources or multi-tenant slices of a pre-built mass computational array. This type of dynamic computing power is ideal for processing big data and business intelligence problems, and evolved from the concept of mainframes.

Conversely, a CDN is a utility delivery platform, specializing in one-to-many distribution as opposed to the two-way interactive exchange performed by utility compute platforms. In contrast to the cloud, CDNs are designed specifically to deliver content from servers to the end users as part of a repeatable process. While dynamic content needs to be computed, large amounts of static content also need to be delivered, but only the dynamic portion needs to come from the origin.

Using cloud and CDNs together creates a holistic system that meets the demands for content delivery as well as economical computing power.

CDN POPs and Cloud Availability Zones
Contrary to what the name implies, the cloud has a physical structure, and the proximity and placement of equipment will have an impact on the results. Users in different latitudes/longitudes will have different online experiences depending on their physical distance from the point of origin. Regardless of the provider, most choose to offer cloud availability by region as opposed to state or metropolitan area. Architecturally, having multiple availability zones for cloud and CDNs is beneficial to localize transactions and reduce latency.

Using a CDN extends the reach of the origin server and places cached website content, multimedia or other large files in closer proximity to the end user. CDNs accomplish this by using origin and edge POPs (Points of Presence) that have storage, caching and transfer capabilities. Incoming requests for content are intercepted by the DNS service, which verifies the user's location, and the content is then delivered from the closest POP. By distributing content via a one-to-many repeatable process, end users can consume content more efficiently without increasing the load on origin site infrastructure.

If a POP becomes overwhelmed, the request is routed to the next available POP, which then fulfills the request for content. In either scenario, the POP distributes the local copy via the most efficient route without placing any burden on the origin server. CDN POPs allow for scale during traffic spikes, whereas a server can become overwhelmed and vulnerable once a certain threshold of concurrent interactions is reached.

How CDNs Can Accelerate Cloud Deployments
Without CDNs, the cloud would not be able to meet the performance expectations of today's online users. In fact, CDNs can help alleviate many obstacles to cloud adoption by addressing several key concerns:

Security. A CDN can help ward off raw volume DDoS attacks that can leave web servers inaccessible to users. CDNs essentially absorb the load and prevent the servers from becoming overwhelmed by abnormally high traffic volume. Without a CDN to act as a buffer against these attacks, cloud servers would be exponentially more vulnerable. This is particularly important for eCommerce websites with servers that store personal data and account information.

Availability of service. If an eCommerce server goes down, the effect will not be immediately apparent if content is cached in CDN POPs. By setting Time to Live (TTL), content providers can control how long a piece of static content will remain cached. Determining TTL depends on the nature of the content and how often it needs to change. CDN edge POPs will continue to deliver the cached content for this duration and will check with the server after this time period expires to see if the content has changed.

Data transfer bottlenecks. CDNs help prevent data transfer bottlenecks by efficiently delivering content through multiple egress points to distribute the load. By leveraging a CDN, businesses can scale the egress throughput, which allows the core infrastructure to use its bandwidth for the compute traffic.

Performance assurance. With the growing use of tablets, smartphones and other devices, content providers must be able to deliver streaming media and large amounts of data with minimal latency, or risk losing customers to the competition. Though the smartphone and tablet industry owes its existence to the capabilities of the cloud, delivering a high-quality user experience would not be possible without a CDN. Once content is cached in a CDN POP, a repeatable process delivers content from one-to-many, resulting in lower latency for end users and better server performance.

Scalable storage. CDN file storage devices offer flexibility options that scale as needed. In contrast, cloud storage is available in fixed amounts that can only be scaled up or down by contacting your cloud storage provider. CDN storage devices can scale up based on the size of the content packet to be distributed, resulting in increased operational agility for the business.

Scaling. A CDN increases the capacity of infrastructure, which means servers won't get overwhelmed when video goes viral or when an eCommerce website experiences unexpected traffic spikes. The ability to offload rich media to the CDN allows the compute platform to run more efficiently, and by shouldering the load, the CDN reduces the risk of web servers becoming overwhelmed.

Cloud-CDN Use Cases
Organizations within most industries can benefit from using the cloud and CDNs simultaneously, particularly those with high-performance and low latency requirements as well as a geographically dispersed user base. Below are several common use case examples:

Online Gaming. Low latency, high performance and scalability are mission-critical for multi-player online video games. If players experience downtime or delays, they will quickly abandon the game in search of a new one. Using a CDN can create a high-quality game-playing experience through more efficient content delivery and by helping to manage traffic spikes.

Media and entertainment/OTT content providers. More consumers are choosing to watch their favorite shows and movies via online channels instead of traditional distribution networks. As a result, the ability to efficiently and securely stream video to global locations is critical for the media and entertainment industry as well as OTT (over-the-top) video providers.

Online retail. Website performance, availability, security and scalability are critical factors for online retailers. If content is slow to load or unavailable, consumers will simply take their business elsewhere. For companies that generate most of their revenue online, even minimal downtime can have drastic effects on profits and consumer loyalty. CDNs improve website availability by allowing consumers to browse online catalogs with little server interaction. Offloading the rich media content onto the CDN allows the cloud servers to perform better, resulting in a more efficient purchasing process for consumers.

Cloud and CDN: Symbiotic Relationship
Even though the cloud revolutionized IT infrastructure from a cost perspective, cloud adoption has actually created an increased need for CDNs. The massive amounts of computing power now available via the cloud requires efficient content distribution to meet user expectations. While the cloud allows companies to extend the reach of origin sites into new geographic areas, the result is greater demand for improved performance.

The line between the cloud and CDNs has indeed become blurry, and whether they will continue to exist as we know them today remains to be seen. If they eventually merge into a single platform for the deployment of global applications, the resulting combination of massive computing and delivery capabilities will fundamentally change the face of the Internet.

Regardless of the technology platform and changes that may occur, in today's global economy, high-performance content delivery is a must for any website or online application serving geographically dispersed end users. Using CDNs and cloud together - in whatever form this ultimately takes - ensures a best-of-both-worlds combination for an optimal online user experience.

More Stories By Pete Mastin

Pete Mastin is the vice president of Performance IP and Content Delivery Network services at Internap. He has more than 20 years of experience in software development, project management and operations, with a focus on digital content management and delivery since 1998. Prior to Internap, Pete served as CTO for MulticastMedia where he developed and deployed an Online Video Platform (Media Suite) and an award-winning transcoding platform. He has spoken at a number of industry events on the subject of digital content management and delivery, including Streaming Media, NAB, Digital Hollywood and TMC’s IT EXPO.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@MicroservicesExpo Stories
In IT, we sometimes coin terms for things before we know exactly what they are and how they’ll be used. The resulting terms may capture a common set of aspirations and goals – as “cloud” did broadly for on-demand, self-service, and flexible computing. But such a term can also lump together diverse and even competing practices, technologies, and priorities to the point where important distinctions are glossed over and lost.
In his session at 20th Cloud Expo, Scott Davis, CTO of Embotics, discussed how automation can provide the dynamic management required to cost-effectively deliver microservices and container solutions at scale. He also discussed how flexible automation is the key to effectively bridging and seamlessly coordinating both IT and developer needs for component orchestration across disparate clouds – an increasingly important requirement at today’s multi-cloud enterprise.
In his session at @DevOpsSummit at 20th Cloud Expo, Kelly Looney, director of DevOps consulting for Skytap, showed how an incremental approach to introducing containers into complex, distributed applications results in modernization with less risk and more reward. He also shared the story of how Skytap used Docker to get out of the business of managing infrastructure, and into the business of delivering innovation and business value. Attendees learned how up-front planning allows for a clean sep...
"I will be talking about ChatOps and ChatOps as a way to solve some problems in the DevOps space," explained Himanshu Chhetri, CTO of Addteq, in this SYS-CON.tv interview at @DevOpsSummit at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
You know you need the cloud, but you’re hesitant to simply dump everything at Amazon since you know that not all workloads are suitable for cloud. You know that you want the kind of ease of use and scalability that you get with public cloud, but your applications are architected in a way that makes the public cloud a non-starter. You’re looking at private cloud solutions based on hyperconverged infrastructure, but you’re concerned with the limits inherent in those technologies.
For organizations that have amassed large sums of software complexity, taking a microservices approach is the first step toward DevOps and continuous improvement / development. Integrating system-level analysis with microservices makes it easier to change and add functionality to applications at any time without the increase of risk. Before you start big transformation projects or a cloud migration, make sure these changes won’t take down your entire organization.
When you focus on a journey from up-close, you look at your own technical and cultural history and how you changed it for the benefit of the customer. This was our starting point: too many integration issues, 13 SWP days and very long cycles. It was evident that in this fast-paced industry we could no longer afford this reality. We needed something that would take us beyond reducing the development lifecycles, CI and Agile methodologies. We made a fundamental difference, even changed our culture...
In his session at 20th Cloud Expo, Mike Johnston, an infrastructure engineer at Supergiant.io, discussed how to use Kubernetes to set up a SaaS infrastructure for your business. Mike Johnston is an infrastructure engineer at Supergiant.io with over 12 years of experience designing, deploying, and maintaining server and workstation infrastructure at all scales. He has experience with brick and mortar data centers as well as cloud providers like Digital Ocean, Amazon Web Services, and Rackspace. H...
You often hear the two titles of "DevOps" and "Immutable Infrastructure" used independently. In his session at DevOps Summit, John Willis, Technical Evangelist for Docker, covered the union between the two topics and why this is important. He provided an overview of Immutable Infrastructure then showed how an Immutable Continuous Delivery pipeline can be applied as a best practice for "DevOps." He ended the session with some interesting case study examples.
Without lifecycle traceability and visibility across the tool chain, stakeholders from Planning-to-Ops have limited insight and answers to who, what, when, why and how across the DevOps lifecycle. This impacts the ability to deliver high quality software at the needed velocity to drive positive business outcomes. In his general session at @DevOpsSummit at 19th Cloud Expo, Eric Robertson, General Manager at CollabNet, will discuss how customers are able to achieve a level of transparency that e...
The Jevons Paradox suggests that when technological advances increase efficiency of a resource, it results in an overall increase in consumption. Writing on the increased use of coal as a result of technological improvements, 19th-century economist William Stanley Jevons found that these improvements led to the development of new ways to utilize coal. In his session at 19th Cloud Expo, Mark Thiele, Chief Strategy Officer for Apcera, compared the Jevons Paradox to modern-day enterprise IT, examin...
The taxi industry never saw Uber coming. Startups are a threat to incumbents like never before, and a major enabler for startups is that they are instantly “cloud ready.” If innovation moves at the pace of IT, then your company is in trouble. Why? Because your data center will not keep up with frenetic pace AWS, Microsoft and Google are rolling out new capabilities. In his session at 20th Cloud Expo, Don Browning, VP of Cloud Architecture at Turner, posited that disruption is inevitable for comp...
The next XaaS is CICDaaS. Why? Because CICD saves developers a huge amount of time. CD is an especially great option for projects that require multiple and frequent contributions to be integrated. But… securing CICD best practices is an emerging, essential, yet little understood practice for DevOps teams and their Cloud Service Providers. The only way to get CICD to work in a highly secure environment takes collaboration, patience and persistence. Building CICD in the cloud requires rigorous ar...
"This all sounds great. But it's just not realistic." This is what a group of five senior IT executives told me during a workshop I held not long ago. We were working through an exercise on the organizational characteristics necessary to successfully execute a digital transformation, and the group was doing their ‘readout.' The executives loved everything we discussed and agreed that if such an environment existed, it would make transformation much easier. They just didn't believe it was reali...
Your homes and cars can be automated and self-serviced. Why can't your storage? From simply asking questions to analyze and troubleshoot your infrastructure, to provisioning storage with snapshots, recovery and replication, your wildest sci-fi dream has come true. In his session at @DevOpsSummit at 20th Cloud Expo, Dan Florea, Director of Product Management at Tintri, provided a ChatOps demo where you can talk to your storage and manage it from anywhere, through Slack and similar services with...
Containers are rapidly finding their way into enterprise data centers, but change is difficult. How do enterprises transform their architecture with technologies like containers without losing the reliable components of their current solutions? In his session at @DevOpsSummit at 21st Cloud Expo, Tony Campbell, Director, Educational Services at CoreOS, will explore the challenges organizations are facing today as they move to containers and go over how Kubernetes applications can deploy with lega...
The “Digital Era” is forcing us to engage with new methods to build, operate and maintain applications. This transformation also implies an evolution to more and more intelligent applications to better engage with the customers, while creating significant market differentiators. In both cases, the cloud has become a key enabler to embrace this digital revolution. So, moving to the cloud is no longer the question; the new questions are HOW and WHEN. To make this equation even more complex, most ...
Learn how to solve the problem of keeping files in sync between multiple Docker containers. In his session at 16th Cloud Expo, Aaron Brongersma, Senior Infrastructure Engineer at Modulus, discussed using rsync, GlusterFS, EBS and Bit Torrent Sync. He broke down the tools that are needed to help create a seamless user experience. In the end, can we have an environment where we can easily move Docker containers, servers, and volumes without impacting our applications? He shared his results so yo...
Don’t go chasing waterfall … development, that is. According to a recent post by Madison Moore on Medium featuring insights from several software delivery industry leaders, waterfall is – while still popular – not the best way to win in the marketplace. With methodologies like Agile, DevOps and Continuous Delivery becoming ever more prominent over the past 15 years or so, waterfall is old news. Or, is it? Moore cites a recent study by Gartner: “According to Gartner’s IT Key Metrics Data report, ...
Kubernetes is a new and revolutionary open-sourced system for managing containers across multiple hosts in a cluster. Ansible is a simple IT automation tool for just about any requirement for reproducible environments. In his session at @DevOpsSummit at 18th Cloud Expo, Patrick Galbraith, a principal engineer at HPE, discussed how to build a fully functional Kubernetes cluster on a number of virtual machines or bare-metal hosts. Also included will be a brief demonstration of running a Galera MyS...