Welcome!

Microservices Expo Authors: Pat Romanski, Karthick Viswanathan, Stackify Blog, Elizabeth White, Mehdi Daoudi

Related Topics: @CloudExpo, Microservices Expo, Agile Computing, Cloud Security, @BigDataExpo, SDN Journal

@CloudExpo: Article

Is the Cloud a CDN Killer?

Using CDNs and cloud together ensures a best-of-both-worlds combination for an optimal online user experience

In our Internet-driven world, both organizations and consumers have come to expect fast, always-on data access from any device. As a result, content providers are tasked with delivering massive files and streaming media to tablets and smartphones while simultaneously ensuring superior website performance. To meet the challenges of this digital data deluge, Content Delivery Networks (CDNs) are often used to efficiently distribute large amounts of content to online users.

The emergence of cloud computing has allowed companies to embrace new, cost-effective approaches to building out their IT infrastructure. The challenge of scaling is no longer prohibitively expensive, and the ability to do so in near-real time allows small and medium-sized businesses to more effectively compete with larger enterprises for market share.

While the cloud can deliver important agility benefits, it still requires careful, strategic planning to address potential challenges, including security and data bottlenecks. CDNs can help to address these issues, enabling cloud networks to meet today's content delivery demands while satisfying customers' expectations for an optimal online experience. When used together, the cloud and CDNs can actually offer the best of both worlds.

The Role of CDNs
A Content Delivery Network is a distributed network of servers and file storage devices deployed to place content and applications in geographic proximity to users, which reduces the load on origin site infrastructure and bandwidth. CDNs are highly flexible and address a wide range of needs - making it possible to simulate a broadcast video network over the Internet, cache large files for faster delivery or optimize entire websites. A CDN is a critical element of modern infrastructure deployment to create a satisfying online user experience.

One of the core functions of a CDN is to optimize media delivery, which involves the streaming of live events and prerecorded video and audio content. A CDN provides content creators and publishers with a robust infrastructure solution for online media distribution to geographically dispersed end users.

Another key benefit of a CDN is its ability to deliver large files and software without the capital expense of building a global network to achieve sufficient bandwidth. Static site caching (also known as reverse proxy caching) is also a prime feature that allows the CDN to point its distributed network at an origin server and cache the content of that origin in geographically diverse areas through a mechanism called GEO-DNS. Though many factors such as current loads contribute to this routing process, the main factor is the proximity of information. The result is much faster page loads and an improved end-user experience.

CDNs offer a multitude of ways to create a dependable, high-quality online user experience by addressing single-point-of-failure, global delivery and scalability concerns. This raises the question of whether the opportunities created by the cloud impact or even overlap with the capabilities of CDNs. If the cloud offers a more economically feasible way to bring content closer to end users, is the CDN still a useful delivery platform? In a word, yes.

Enter the Cloud
In the days before cloud, the main way to address issues regarding performance, availability and scale was by decreasing the physical distance between the origin servers and the end users. Existing infrastructure was optimized and then physically replicated in other geographic locations. Aside from the large capital investments required by this approach, there were other drawbacks and challenges - while companies controlled their infrastructure, they had no control over the network between their servers and the end user, and also had to determine how to replicate their data globally.

The cloud offers businesses a less costly way to expand infrastructure - the ability to scale virtually, on demand, without having to build or buy costly hardware. Businesses can now replicate their infrastructure in the desired geographic locations by purchasing a virtual machine with the required specifications - essentially, buying a "slice" of someone else's pre-built infrastructure. This proves a more cost-effective way to scale and reduce latency for geographically dispersed areas.

Both the cloud and CDNs have evolved into utility platforms, each designed for specialized purposes. The cloud is a utility computing platform consisting of large physical stacks of computational resources or multi-tenant slices of a pre-built mass computational array. This type of dynamic computing power is ideal for processing big data and business intelligence problems, and evolved from the concept of mainframes.

Conversely, a CDN is a utility delivery platform, specializing in one-to-many distribution as opposed to the two-way interactive exchange performed by utility compute platforms. In contrast to the cloud, CDNs are designed specifically to deliver content from servers to the end users as part of a repeatable process. While dynamic content needs to be computed, large amounts of static content also need to be delivered, but only the dynamic portion needs to come from the origin.

Using cloud and CDNs together creates a holistic system that meets the demands for content delivery as well as economical computing power.

CDN POPs and Cloud Availability Zones
Contrary to what the name implies, the cloud has a physical structure, and the proximity and placement of equipment will have an impact on the results. Users in different latitudes/longitudes will have different online experiences depending on their physical distance from the point of origin. Regardless of the provider, most choose to offer cloud availability by region as opposed to state or metropolitan area. Architecturally, having multiple availability zones for cloud and CDNs is beneficial to localize transactions and reduce latency.

Using a CDN extends the reach of the origin server and places cached website content, multimedia or other large files in closer proximity to the end user. CDNs accomplish this by using origin and edge POPs (Points of Presence) that have storage, caching and transfer capabilities. Incoming requests for content are intercepted by the DNS service, which verifies the user's location, and the content is then delivered from the closest POP. By distributing content via a one-to-many repeatable process, end users can consume content more efficiently without increasing the load on origin site infrastructure.

If a POP becomes overwhelmed, the request is routed to the next available POP, which then fulfills the request for content. In either scenario, the POP distributes the local copy via the most efficient route without placing any burden on the origin server. CDN POPs allow for scale during traffic spikes, whereas a server can become overwhelmed and vulnerable once a certain threshold of concurrent interactions is reached.

How CDNs Can Accelerate Cloud Deployments
Without CDNs, the cloud would not be able to meet the performance expectations of today's online users. In fact, CDNs can help alleviate many obstacles to cloud adoption by addressing several key concerns:

Security. A CDN can help ward off raw volume DDoS attacks that can leave web servers inaccessible to users. CDNs essentially absorb the load and prevent the servers from becoming overwhelmed by abnormally high traffic volume. Without a CDN to act as a buffer against these attacks, cloud servers would be exponentially more vulnerable. This is particularly important for eCommerce websites with servers that store personal data and account information.

Availability of service. If an eCommerce server goes down, the effect will not be immediately apparent if content is cached in CDN POPs. By setting Time to Live (TTL), content providers can control how long a piece of static content will remain cached. Determining TTL depends on the nature of the content and how often it needs to change. CDN edge POPs will continue to deliver the cached content for this duration and will check with the server after this time period expires to see if the content has changed.

Data transfer bottlenecks. CDNs help prevent data transfer bottlenecks by efficiently delivering content through multiple egress points to distribute the load. By leveraging a CDN, businesses can scale the egress throughput, which allows the core infrastructure to use its bandwidth for the compute traffic.

Performance assurance. With the growing use of tablets, smartphones and other devices, content providers must be able to deliver streaming media and large amounts of data with minimal latency, or risk losing customers to the competition. Though the smartphone and tablet industry owes its existence to the capabilities of the cloud, delivering a high-quality user experience would not be possible without a CDN. Once content is cached in a CDN POP, a repeatable process delivers content from one-to-many, resulting in lower latency for end users and better server performance.

Scalable storage. CDN file storage devices offer flexibility options that scale as needed. In contrast, cloud storage is available in fixed amounts that can only be scaled up or down by contacting your cloud storage provider. CDN storage devices can scale up based on the size of the content packet to be distributed, resulting in increased operational agility for the business.

Scaling. A CDN increases the capacity of infrastructure, which means servers won't get overwhelmed when video goes viral or when an eCommerce website experiences unexpected traffic spikes. The ability to offload rich media to the CDN allows the compute platform to run more efficiently, and by shouldering the load, the CDN reduces the risk of web servers becoming overwhelmed.

Cloud-CDN Use Cases
Organizations within most industries can benefit from using the cloud and CDNs simultaneously, particularly those with high-performance and low latency requirements as well as a geographically dispersed user base. Below are several common use case examples:

Online Gaming. Low latency, high performance and scalability are mission-critical for multi-player online video games. If players experience downtime or delays, they will quickly abandon the game in search of a new one. Using a CDN can create a high-quality game-playing experience through more efficient content delivery and by helping to manage traffic spikes.

Media and entertainment/OTT content providers. More consumers are choosing to watch their favorite shows and movies via online channels instead of traditional distribution networks. As a result, the ability to efficiently and securely stream video to global locations is critical for the media and entertainment industry as well as OTT (over-the-top) video providers.

Online retail. Website performance, availability, security and scalability are critical factors for online retailers. If content is slow to load or unavailable, consumers will simply take their business elsewhere. For companies that generate most of their revenue online, even minimal downtime can have drastic effects on profits and consumer loyalty. CDNs improve website availability by allowing consumers to browse online catalogs with little server interaction. Offloading the rich media content onto the CDN allows the cloud servers to perform better, resulting in a more efficient purchasing process for consumers.

Cloud and CDN: Symbiotic Relationship
Even though the cloud revolutionized IT infrastructure from a cost perspective, cloud adoption has actually created an increased need for CDNs. The massive amounts of computing power now available via the cloud requires efficient content distribution to meet user expectations. While the cloud allows companies to extend the reach of origin sites into new geographic areas, the result is greater demand for improved performance.

The line between the cloud and CDNs has indeed become blurry, and whether they will continue to exist as we know them today remains to be seen. If they eventually merge into a single platform for the deployment of global applications, the resulting combination of massive computing and delivery capabilities will fundamentally change the face of the Internet.

Regardless of the technology platform and changes that may occur, in today's global economy, high-performance content delivery is a must for any website or online application serving geographically dispersed end users. Using CDNs and cloud together - in whatever form this ultimately takes - ensures a best-of-both-worlds combination for an optimal online user experience.

More Stories By Pete Mastin

Pete Mastin is the vice president of Performance IP and Content Delivery Network services at Internap. He has more than 20 years of experience in software development, project management and operations, with a focus on digital content management and delivery since 1998. Prior to Internap, Pete served as CTO for MulticastMedia where he developed and deployed an Online Video Platform (Media Suite) and an award-winning transcoding platform. He has spoken at a number of industry events on the subject of digital content management and delivery, including Streaming Media, NAB, Digital Hollywood and TMC’s IT EXPO.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@MicroservicesExpo Stories
From manual human effort the world is slowly paving its way to a new space where most process are getting replaced with tools and systems to improve efficiency and bring down operational costs. Automation is the next big thing and low code platforms are fueling it in a significant way. The Automation era is here. We are in the fast pace of replacing manual human efforts with machines and processes. In the world of Information Technology too, we are linking disparate systems, softwares and tool...
The goal of Continuous Testing is to shift testing left to find defects earlier and release software faster. This can be achieved by integrating a set of open source functional and performance testing tools in the early stages of your software delivery lifecycle. There is one process that binds all application delivery stages together into one well-orchestrated machine: Continuous Testing. Continuous Testing is the conveyer belt between the Software Factory and production stages. Artifacts are m...
Web services have taken the development world by storm, especially in recent years as they've become more and more widely adopted. There are naturally many reasons for this, but first, let's understand what exactly a web service is. The World Wide Web Consortium (W3C) defines "web of services" as "message-based design frequently found on the Web and in enterprise software". Basically, a web service is a method of sending a message between two devices through a network. In practical terms, this ...
In his session at @DevOpsSummit at 20th Cloud Expo, Kelly Looney, director of DevOps consulting for Skytap, showed how an incremental approach to introducing containers into complex, distributed applications results in modernization with less risk and more reward. He also shared the story of how Skytap used Docker to get out of the business of managing infrastructure, and into the business of delivering innovation and business value. Attendees learned how up-front planning allows for a clean sep...
"At the keynote this morning we spoke about the value proposition of Nutanix, of having a DevOps culture and a mindset, and the business outcomes of achieving agility and scale, which everybody here is trying to accomplish," noted Mark Lavi, DevOps Solution Architect at Nutanix, in this SYS-CON.tv interview at @DevOpsSummit at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
In IT, we sometimes coin terms for things before we know exactly what they are and how they’ll be used. The resulting terms may capture a common set of aspirations and goals – as “cloud” did broadly for on-demand, self-service, and flexible computing. But such a term can also lump together diverse and even competing practices, technologies, and priorities to the point where important distinctions are glossed over and lost.
We have already established the importance of APIs in today’s digital world (read about it here). With APIs playing such an important role in keeping us connected, it’s necessary to maintain the API’s performance as well as availability. There are multiple aspects to consider when monitoring APIs, from integration to performance issues, therefore a general monitoring strategy that only accounts for up-time is not ideal.
Enterprise architects are increasingly adopting multi-cloud strategies as they seek to utilize existing data center assets, leverage the advantages of cloud computing and avoid cloud vendor lock-in. This requires a globally aware traffic management strategy that can monitor infrastructure health across data centers and end-user experience globally, while responding to control changes and system specification at the speed of today’s DevOps teams. In his session at 20th Cloud Expo, Josh Gray, Chie...
All organizations that did not originate this moment have a pre-existing culture as well as legacy technology and processes that can be more or less amenable to DevOps implementation. That organizational culture is influenced by the personalities and management styles of Executive Management, the wider culture in which the organization is situated, and the personalities of key team members at all levels of the organization. This culture and entrenched interests usually throw a wrench in the work...
In his session at 20th Cloud Expo, Mike Johnston, an infrastructure engineer at Supergiant.io, discussed how to use Kubernetes to set up a SaaS infrastructure for your business. Mike Johnston is an infrastructure engineer at Supergiant.io with over 12 years of experience designing, deploying, and maintaining server and workstation infrastructure at all scales. He has experience with brick and mortar data centers as well as cloud providers like Digital Ocean, Amazon Web Services, and Rackspace. H...
Docker is sweeping across startups and enterprises alike, changing the way we build and ship applications. It's the most prominent and widely known software container platform, and it's particularly useful for eliminating common challenges when collaborating on code (like the "it works on my machine" phenomenon that most devs know all too well). With Docker, you can run and manage apps side-by-side - in isolated containers - resulting in better compute density. It's something that many developer...
We define Hybrid IT as a management approach in which organizations create a workload-centric and value-driven integrated technology stack that may include legacy infrastructure, web-scale architectures, private cloud implementations along with public cloud platforms ranging from Infrastructure-as-a-Service to Software-as-a-Service.
When you focus on a journey from up-close, you look at your own technical and cultural history and how you changed it for the benefit of the customer. This was our starting point: too many integration issues, 13 SWP days and very long cycles. It was evident that in this fast-paced industry we could no longer afford this reality. We needed something that would take us beyond reducing the development lifecycles, CI and Agile methodologies. We made a fundamental difference, even changed our culture...
As many know, the first generation of Cloud Management Platform (CMP) solutions were designed for managing virtual infrastructure (IaaS) and traditional applications. But that’s no longer enough to satisfy evolving and complex business requirements. In his session at 21st Cloud Expo, Scott Davis, Embotics CTO, will explore how next-generation CMPs ensure organizations can manage cloud-native and microservice-based application architectures, while also facilitating agile DevOps methodology. He wi...
These days, change is the only constant. In order to adapt and thrive in an ever-advancing and sometimes chaotic workforce, companies must leverage intelligent tools to streamline operations. While we're only at the dawn of machine intelligence, using a workflow manager will benefit your company in both the short and long term. Think: reduced errors, improved efficiency and more empowered employees-and that's just the start. Here are five other reasons workflow automation is leading a revolution...
As today's digital disruptions bounce and smash their way through conventional technologies and conventional wisdom alike, predicting their path is a multifaceted challenge. So many areas of technology advance on Moore's Law-like exponential curves that divining the future is fraught with danger. Such is the problem with artificial intelligence (AI), and its related concepts, including cognitive computing, machine learning, and deep learning.
We have Continuous Integration and we have Continuous Deployment, but what’s continuous across all of what we do is people. Even when tasks are automated, someone wrote the automation. So, Jayne Groll evangelizes about Continuous Everyone. Jayne is the CEO of the DevOps Institute and the author of Agile Service Management Guide. She talked about Continuous Everyone at the 2016 All Day DevOps conference. She describes it as "about people, culture, and collaboration mapped into your value streams....
In our first installment of this blog series, we went over the different types of applications migrated to the cloud and the benefits IT organizations hope to achieve by moving applications to the cloud. Unfortunately, IT can’t just press a button or even whip up a few lines of code to move applications to the cloud. Like any strategic move by IT, a cloud migration requires advanced planning.
Did you know that you can develop for mainframes in Java? Or that the testing and deployment can be automated across mobile to mainframe? In his session and demo at @DevOpsSummit at 21st Cloud Expo, Dana Boudreau, a Senior Director at CA Technologies, will discuss how increasingly teams are developing with agile methodologies, using modern development environments, and automating testing and deployments, mobile to mainframe.
“Why didn’t testing catch this” must become “How did this make it to testing?” Traditional quality teams are the crutch and excuse keeping organizations from making the necessary investment in people, process, and technology to accelerate test automation. Just like societies that did not build waterways because the labor to keep carrying the water was so cheap, we have created disincentives to automate. In her session at @DevOpsSummit at 20th Cloud Expo, Anne Hungate, President of Daring System...