Welcome!

Microservices Expo Authors: Elizabeth White, Yeshim Deniz, Liz McMillan, Anders Wallgren, Pat Romanski

Related Topics: @CloudExpo

@CloudExpo: Blog Feed Post

Cloud Storage for Your File Server

How much bandwidth you need to run file server with cloud storage?

As I was explaining Gladinet CloudAFS to a group of IT people as a file server with cloud storage attached, one question I got was:

How much bandwidth you need to run file server with cloud storage?

It is very obvious where the concern is coming from. If I had an on-premise file server, with cloud storage attached as tier 2 storage, will the slowness of the Internet (as compared to LAN) slow down the file server activities?

Rest assured, Gladinet CloudAFS takes care of this. Specifically, it takes care of two issues.

A. Slow Internet to the Cloud Storage – that is why it is tier2 storage.

B. There is a glitch, Internet is down.

The secret to both maintain local LAN performance and leverage Cloud Storage is to have a tier 1 storage locally on the hard drive (or NAS or SAN). When people read and write to the file server, it is writing to and reading from the tier 1 storage, thus gives you an impression of local storage because it is indeed local storage.

Gladinet CloudAFS will then schedule transfer to and from the tier 2 storage asynchronously.  You can schedule the transfer to be 12 hours later than the tier 1 storage hit so it can happen at night when nobody is working. If the Internet is down at a moment, the transfer will resume and retry later on.

Use Case 1 – File Server Backup

When your Internet is slow or the Internet is not quite reliable, you need to put cloud storage to a more secondary role, such as backup.

In this use case, you can configure Gladinet CloudAFS tier 1 storage to have the same size as tier2 cloud storage. This way, the read/write is always from local and you are guaranteed to have 100% up time and 100% local performance. The cloud storage is something nice to have just in case that your local server crash or out of capacity, you can get it back immediately by provision another CloudAFS server (5 minute install when OS is ready).

The benefit of this use case is that you can always quickly re-provision your file server in case something happens to it.

Use Case 2 – Cloud Storage Gateway

When your Internet is fast and the Internet is reliable, you can put cloud storage to a more prominent role, or on the other hand, put CloudAFS to a more secondary role such as a Cloud Storage Gateway with cache.

For example, if you file server is with Amazon EC2 and your storage is Amazon S3, you know you have fast and reliable connections in between, you have a fit for the Cloud Storage Gateway use case.

Another example, if you are hosting with Peer1 server and also using Peer1’s CloudOne storage, you have a fast and reliable connection in between too. This case fit you as well.

In this case, the local cache on the CloudAFS can be smaller than the actual cloud storage capacity.

When the cache is smaller, you will incur cache miss if a read to the CloudAFS server doesn’t already have the file locally. This case the file needs to be fetched from the cloud storage over the Internet. Since you have fast and reliable connection, this first time and one time cost is OK.

The benefit of this use case is that you can ship a lot of data over to cloud storage. For example, you can turn local backup software to cloud backup software by pointing the backup destination to CloudAFS.

CloudAFS Parameters

The two biggest parameter for CloudAFS are

A. How big the local cache is. The slower and less reliable the Internet is, the bigger the local cache you will need to assign.

B. Scheduled flush time. CloudAFS use a write-through cache with flush schedule. The slower the Internet you have, the more delay you will need to push the synchronization to night time.

At this time, CloudAFS supports a wide variety of cloud storage providers, including Amazon S3, Windows Azure, Rackspace Cloud Files, EMC Atmos, Mezeo, OpenStack, Nirvanix, AT&T Synaptic Storage, Peer 1 CloudOne and more.

Speed is an important factor when you apply cloud storage to file server. Visit other earlier posts about how to pick a cloud storage providers.

Read the original blog entry...

More Stories By Jerry Huang

Jerry Huang, an engineer and entrepreneur, founded Gladinet with his close friends and is pursuing interests in the cloud computing. He has published articles on the company blog as well as following up on the company twitter activities. He graduated from the University of Michigan in 1998 and has lived in West Palm Beach, Florida since.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@MicroservicesExpo Stories
SYS-CON Events announced today TechTarget has been named “Media Sponsor” of SYS-CON's 18th International Cloud Expo, which will take place on June 7–9, 2016, at the Javits Center in New York City, NY, and the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. TechTarget is the Web’s leading destination for serious technology buyers researching and making enterprise technology decisions. Its extensive global networ...
SoftLayer operates a global cloud infrastructure platform built for Internet scale. With a global footprint of data centers and network points of presence, SoftLayer provides infrastructure as a service to leading-edge customers ranging from Web startups to global enterprises. SoftLayer's modular architecture, full-featured API, and sophisticated automation provide unparalleled performance and control. Its flexible unified platform seamlessly spans physical and virtual devices linked via a world...
SYS-CON Events announced today that Commvault, a global leader in enterprise data protection and information management, has been named “Bronze Sponsor” of SYS-CON's 18th International Cloud Expo, which will take place on June 7–9, 2016, at the Javits Center in New York City, NY, and the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. Commvault is a leading provider of data protection and information management...
SYS-CON Events announced today that BMC Software has been named "Siver Sponsor" of SYS-CON's 18th Cloud Expo, which will take place on June 7-9, 2015 at the Javits Center in New York, New York. BMC is a global leader in innovative software solutions that help businesses transform into digital enterprises for the ultimate competitive advantage. BMC Digital Enterprise Management is a set of innovative IT solutions designed to make digital business fast, seamless, and optimized from mainframe to mo...
SYS-CON Events announced today that Tintri Inc., a leading producer of VM-aware storage (VAS) for virtualization and cloud environments, will exhibit at the 18th International CloudExpo®, which will take place on June 7-9, 2016, at the Javits Center in New York City, New York, and the 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.
Automation is a critical component of DevOps and Continuous Delivery. This morning on #c9d9 we discussed CD Automation and how you can apply Automation to accelerate release cycles, improve quality, safety and governance? What is the difference between Automation and Orchestration? Where should you begin your journey to introduce both?
SYS-CON Events announced today BZ Media LLC has been named “Media Sponsor” of SYS-CON's 19th International Cloud Expo, which will take place on November 1–3, 2016, at the Santa Clara Convention Center in Santa Clara, CA. BZ Media LLC is a high-tech media company that produces technical conferences and expositions, and publishes a magazine, newsletters and websites in the software development, SharePoint, mobile development and Commercial Drone markets.
A strange thing is happening along the way to the Internet of Things, namely far too many devices to work with and manage. It has become clear that we'll need much higher efficiency user experiences that can allow us to more easily and scalably work with the thousands of devices that will soon be in each of our lives. Enter the conversational interface revolution, combining bots we can literally talk with, gesture to, and even direct with our thoughts, with embedded artificial intelligence, wh...
Many banks and financial institutions are experimenting with containers in development environments, but when will they move into production? Containers are seen as the key to achieving the ultimate in information technology flexibility and agility. Containers work on both public and private clouds, and make it easy to build and deploy applications. The challenge for regulated industries is the cost and complexity of container security compliance. VM security compliance is already challenging, ...
While there has been much ado about interoperability, there are still no real solutions, same as last year and the year before that. The large EHR vendors who continue to dominate the market still maintain that interoperability is all but solved, still can't connect EHRs across the continuum causing frustration by providers and a disservice to patients. The ONC pays lip service to the problem, but that is about it. It is time for the healthcare industry to consider alternatives like middleware w...
The pace of innovation, vendor lock-in, production sustainability, cost-effectiveness, and managing risk… In his session at 18th Cloud Expo, Dan Choquette, Founder of RackN, will discuss how CIOs are challenged finding the balance of finding the right tools, technology and operational model that serves the business the best. He will discuss how clouds, open source software and infrastructure solutions have benefits but also drawbacks and how workload and operational portability between vendors...
I have an article in the recently released “DZone Guide to Building and Deploying Applications on the Cloud” entitled “Fullstack Engineering in the Age of Hybrid Cloud”. In this article I discuss the need and skills of a Fullstack Engineer with relation to troubleshooting and repairing complex, distributed hybrid cloud applications. My recent experiences with troubleshooting issues with my Docker WordPress container only reinforce the details I wrote about in this piece. Without my comprehensive...
The 19th International Cloud Expo has announced that its Call for Papers is open. Cloud Expo, to be held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA, brings together Cloud Computing, Big Data, Internet of Things, DevOps, Containers, Microservices and WebRTC to one location. With cloud computing driving a higher percentage of enterprise IT budgets every year, it becomes increasingly important to plant your flag in this fast-expanding business opportunity. Submit y...
Internet of @ThingsExpo, taking place November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with the 19th International Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world and ThingsExpo New York Call for Papers is now open.
IoT generates lots of temporal data. But how do you unlock its value? How do you coordinate the diverse moving parts that must come together when developing your IoT product? What are the key challenges addressed by Data as a Service? How does cloud computing underlie and connect the notions of Digital and DevOps What is the impact of the API economy? What is the business imperative for Cognitive Computing? Get all these questions and hundreds more like them answered at the 18th Cloud Expo...
Cloud-based NCLC (No-code/low code) application builder platforms empower everyone in the organization to quickly build applications and executable processes that broaden access, deepen collaboration, and enhance transparency for all team members. Line of business owners (LOBO) and operations managers know best their part of the business and their processes. IT departments are beginning to leverage NCLC platforms to empower and enable LOBOs to lead the innovation, transform the organization, an...
@DevOpsSummit taking place June 7-9, 2016 at Javits Center, New York City, and Nov 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with the 18th International @CloudExpo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world.
SYS-CON Events announced today the Docker Meets Kubernetes – Intro into the Kubernetes World, being held June 9, 2016, in conjunction with 18th Cloud Expo | @ThingsExpo, at the Javits Center in New York, NY. Register for 'Docker Meets Kubernetes Workshop' Here! This workshop led by Sebastian Scheele, co-founder of Loodse, introduces participants to Kubernetes (container orchestration). Through a combination of instructor-led presentations, demonstrations, and hands-on labs, participants learn ...
Just last week a senior Hybris consultant shared the story of a customer engagement on which he was working. This customer had problems, serious problems. We’re talking about response times far beyond the most liberal acceptable standard. They were unable to solve the issue in their eCommerce platform – specifically Hybris. Although the eCommerce project was delivered by a system integrator / implementation partner, the vendor still gets involved when things go really wrong. After all, the vendo...
The initial debate is over: Any enterprise with a serious commitment to IT is migrating to the cloud. But things are not so simple. There is a complex mix of on-premises, colocated, and public-cloud deployments. In this power panel at 18th Cloud Expo, moderated by Conference Chair Roger Strukhoff, panelists will look at the present state of cloud from the C-level view, and how great companies and rock star executives can use cloud computing to meet their most ambitious and disruptive business ...