Welcome!

Microservices Expo Authors: Elizabeth White, Pat Romanski, Harry Trott, Yeshim Deniz, Kevin Jackson

Related Topics: Microservices Expo, Agile Computing

Microservices Expo: Article

Is Everything I Know About Crowdsourcing Wrong?

Is traditional "wisdom" on crowdsourcing missing the point?

Crowdsourcing Visibility Soars
If you haven't heard about Crowdsourcing, you will soon. Crowdsourcing is increasingly in the news, and if you take stock in Google Trends, interest in the topic is increasing at a phenomenal rate.

I wrote an earlier article on this topic entitled  Crowdsourcing - a Best Practice or a Worst Practice?, as well as a follow-on article that was largely contributed by TopCoder, Inc. founder Jack Hughes: Maximizing Crowdsourcing Success.

For those not familiar with the term, Wikipedia's article opens with the following definition:

"sourcing tasks traditionally performed by specific individuals to an undefined large group of people or community (crowd) through an open call.(FZS)

Jeff Howe established that the concept of crowdsourcing depends essentially on the fact that because it is an open call to an undefined group of people, it gathers those who are most fit to perform tasks, solve complex problems and contribute with the most relevant and fresh ideas. For example, the public may be invited to develop a new technology, carry out a design task (also known as community-based design[1] or "design by democracy" and distributed participatory design), refine or carry out the steps of an algorithm (see human-based computation), or help capture, systematize or analyze large amounts of data (see also citizen science).

The term has become popular with businesses, authors, and journalists as shorthand for the trend of leveraging the mass collaboration enabled by Web 2.0 technologies to achieve business goals."

Then Wikipedia goes on to express (in characteristic Wikipedia style) that there is far from 100% agreement on the Crowdsource front: "However, both the term and its underlying business models have attracted controversy and criticisms."

Is Crowdsourcing the Next “....sourcing” Trend?
I've been around for a while now, and I'm used to technology trends coming and going. In some respects, the more things change, the more they stay the same.

I remember the “outsourcing” years where the big trend was to outsource the data center to companies like EDS. Or outsource application development to Andersen Consulting, or “Y2K” to E&Y or a mainframe re-hosting project to some other consulting giant. Same or better quality, less effort, less money. Or so the pitch went.

Then the trend evolved and the big buzz was to outsource everything to India - offshore outsourcing or “offshoring”. Many people jumped onto that bandwagon – proclaiming it as the same quality software at a huge discount. A lot of companies got burned on that one. Others did well.

So is Crowdsourcing simply the next stage in the evolution of this trend of cheaper/faster – after all, it shared the same root word, “sourcing”. So it's not surprising that the assumption is that it must be like offshoring but better. This opinion seems to be pretty commonly held.

Crowdsourcing as an evolution of the "...sourcing" trend?

Recent Crowdsourcing “in the news”
I've been keeping my eye on the Crowdsourcing trend for a couple of years now – keeping tabs on things like:

  • Amazon.com has a “Mechanical Turk” crowdsourcing platform. I use it myself. It's great for repetitive simple to define tasks where you don't want to pay much money. The other week, I wanted to find out how many people had read a lengthy list of articles on the Internet. I paid workers 5 pennies per article to find out for me. According to Amazon, the effective hourly rate was about $1.25 an hour. I suppose you could say that Crowdsourcing and Amazon helped me momentarily operate an Internet-enabled global sweat-shop.
  • The government in the U.K. is Crowdsourcing solutions for reducing government waste and spending. It's a bit like a next generation “suggestion box” on a country-wide level. The pay for that is even less than sweat-shop levels – nothing at all. This made me feel better about my own personal sweat-shop. If the civilized Brits can pay their fellow country-people nothing, then $1.25 an hour that I pay doesn't seem so bad.
  • Companies like TopCoder have been running “algorithm” bake-offs for years, where ultra-smart people write code to solve very focused problems and the winners get a small cash prize, some points and recognition. The non-winners walk away with nothing but “try better next time”.
  • Companies like uTest pay large numbers of widely distributed people small amounts of money to test software or websites for defects/bugs thus allowing companies to “crowdsource” aspects of quality assurance, and pay only when bugs are found.

So it's not at all surprising that the "traditional wisdom" is that  Crowdsourcing is great because:

    1) It's a global thing, so you have instant access to cheap labor
    2) You pay for performance. You only pay for successful work – bugs found, the best algorithms, etc.
    3) You get fast results. TopCoder, for example, advertises over 200,000 developers in their network. With that kind of parallel effort, things should get done in no time at all.

So, to expand on the first graphic, does it look more like this, then?

But Is Traditional Wisdom on Target?
TopCoder, Inc. founder Jack Hughes tells me that I'm missing the point, that I've got it wrong. And to top it off, he doesn't like the term “Crowdsourcing”.

Well, if I've got it all wrong - that would make “me and a lot of other people”.

It's very possible. I was wrong about eBay back in the early 1990s. And I never thought people would pay $5.00 for a cup of coffee. Or $5 for a bottle of water.

I've decided to find out as much as I can. What better place to get to the bottom of things than the 2011 TopCoder Open being held this week in Hollywood, Florida?  It's the biggest concentration of Crowdsourcing participants on the planet.  So I decided to go.  I'm here now at the “Open” to talk to as many people as I can, and decide for myself what Crowdsourcing is all about, and form my own opinion about the moniker “Crowdsourcing”.

I'm sure I'll get an earful. I'll be writing much more about this - more to come this week and next.

More Stories By Hollis Tibbetts

Hollis Tibbetts, or @SoftwareHollis as his 50,000+ followers know him on Twitter, is listed on various “top 100 expert lists” for a variety of topics – ranging from Cloud to Technology Marketing, Hollis is by day Evangelist & Software Technology Director at Dell Software. By night and weekends he is a commentator, speaker and all-round communicator about Software, Data and Cloud in their myriad aspects. You can also reach Hollis on LinkedIn – linkedin.com/in/SoftwareHollis. His latest online venture is OnlineBackupNews - a free reference site to help organizations protect their data, applications and systems from threats. Every year IT Downtime Costs $26.5 Billion In Lost Revenue. Even with such high costs, 56% of enterprises in North America and 30% in Europe don’t have a good disaster recovery plan. Online Backup News aims to make sure you all have the news and tips needed to keep your IT Costs down and your information safe by providing best practices, technology insights, strategies, real-world examples and various tips and techniques from a variety of industry experts.

Hollis is a regularly featured blogger at ebizQ, a venue focused on enterprise technologies, with over 100,000 subscribers. He is also an author on Social Media Today "The World's Best Thinkers on Social Media", and maintains a blog focused on protecting data: Online Backup News.
He tweets actively as @SoftwareHollis

Additional information is available at HollisTibbetts.com

All opinions expressed in the author's articles are his own personal opinions vs. those of his employer.

@MicroservicesExpo Stories
You know you need the cloud, but you’re hesitant to simply dump everything at Amazon since you know that not all workloads are suitable for cloud. You know that you want the kind of ease of use and scalability that you get with public cloud, but your applications are architected in a way that makes the public cloud a non-starter. You’re looking at private cloud solutions based on hyperconverged infrastructure, but you’re concerned with the limits inherent in those technologies.
For organizations that have amassed large sums of software complexity, taking a microservices approach is the first step toward DevOps and continuous improvement / development. Integrating system-level analysis with microservices makes it easier to change and add functionality to applications at any time without the increase of risk. Before you start big transformation projects or a cloud migration, make sure these changes won’t take down your entire organization.
The margins of cloud products like virtual machines are still in the 50% range. In essence, price drops are going to be a regular feature for the foreseeable future. This begets the question - are hosted solutions becoming irrelevant today? Boston-based market research firm, 451 Research, has been publishing their ‘Cloud Price Index' for a few years now. The quarterly study looks into the pricing of various offerings in the cloud market to understand the shifting dynamics in the public, privat...
What's the role of an IT self-service portal when you get to continuous delivery and Infrastructure as Code? This general session showed how to create the continuous delivery culture and eight accelerators for leading the change. Don Demcsak is a DevOps and Cloud Native Modernization Principal for Dell EMC based out of New Jersey. He is a former, long time, Microsoft Most Valuable Professional, specializing in building and architecting Application Delivery Pipelines for hybrid legacy, and cloud ...
21st International Cloud Expo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, will feature technical sessions from a rock star conference faculty and the leading industry players in the world. Cloud computing is now being embraced by a majority of enterprises of all sizes. Yesterday's debate about public vs. private has transformed into the reality of hybrid cloud: a recent survey shows that 74% of enterprises have a hybrid cloud strategy. Me...
"Tintri focuses on the Ops side of the DevOps, which basically is pushing more and more of the accessibility of the infrastructure to the developers and trying to get behind the scenes," explained Dhiraj Sehgal of Tintri in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
"We do one of the best file systems in the world. We learned how to deal with Big Data many years ago and we implemented this knowledge into our software," explained Jakub Ratajczak, Business Development Manager at MooseFS, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
SYS-CON Events announced today that CA Technologies has been named "Platinum Sponsor" of SYS-CON's 21st International Cloud Expo®, which will take place October 31-November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. CA Technologies helps customers succeed in a future where every business - from apparel to energy - is being rewritten by software. From planning to development to management to security, CA creates software that fuels transformation for companies in the applic...
Five years ago development was seen as a dead-end career, now it’s anything but – with an explosion in mobile and IoT initiatives increasing the demand for skilled engineers. But apart from having a ready supply of great coders, what constitutes true ‘DevOps Royalty’? It’ll be the ability to craft resilient architectures, supportability, security everywhere across the software lifecycle. In his keynote at @DevOpsSummit at 20th Cloud Expo, Jeffrey Scheaffer, GM and SVP, Continuous Delivery Busine...
Cloud Expo, Inc. has announced today that Andi Mann and Aruna Ravichandran have been named Co-Chairs of @DevOpsSummit at Cloud Expo Silicon Valley which will take place Oct. 31-Nov. 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. "DevOps is at the intersection of technology and business-optimizing tools, organizations and processes to bring measurable improvements in productivity and profitability," said Aruna Ravichandran, vice president, DevOps product and solutions marketing...
Managing mission-critical SAP systems and landscapes has never been easy. Add public cloud with its myriad of powerful cloud native services and this may not change any time soon. Public cloud offers exciting new possibilities for enterprise workloads. But to make use of these possibilities and capabilities, IT teams need to re-think everything they have done before. Otherwise, they will just end up using public cloud as a hosting platform for their workloads, aka known as “lift and shift.”
There's a lot to gain from cloud computing, but success requires a thoughtful and enterprise focused approach. Cloud computing decouples data and information from the infrastructure on which it lies. A process that is a LOT more involved than dragging some folders from your desktop to a shared drive. Cloud computing as a mission transformation activity, not a technological one. As an organization moves from local information hosting to the cloud, one of the most important challenges is addressi...
The reality of data ubiquity is here—data is buried in operational statistics, machine logs, stacks of overflowing tickets and customer details, among other things. How can any user get valuable information amid this rapid influx of data? Imagine a situation where your firm’s revenue takes a hit owing to an unexpected failure in some business process. It would be a nightmare for IT admins to sift through the interminable piles of data to deduce exactly why and where the problem occurred. To sav...
Hybrid IT is today’s reality, and while its implementation may seem daunting at times, more and more organizations are migrating to the cloud. In fact, according to SolarWinds 2017 IT Trends Index: Portrait of a Hybrid IT Organization 95 percent of organizations have migrated crucial applications to the cloud in the past year. As such, it’s in every IT professional’s best interest to know what to expect.
Both SaaS vendors and SaaS buyers are going “all-in” to hyperscale IaaS platforms such as AWS, which is disrupting the SaaS value proposition. Why should the enterprise SaaS consumer pay for the SaaS service if their data is resident in adjacent AWS S3 buckets? If both SaaS sellers and buyers are using the same cloud tools, automation and pay-per-transaction model offered by IaaS platforms, then why not host the “shrink-wrapped” software in the customers’ cloud? Further, serverless computing, cl...
In the decade following his article, cloud computing further cemented Carr’s perspective. Compute, storage, and network resources have become simple utilities, available at the proverbial turn of the faucet. The value they provide is immense, but the cloud playing field is amazingly level. Carr’s quote above presaged the cloud to a T. Today, however, we’re in the digital era. Mark Andreesen’s ‘software is eating the world’ prognostication is coming to pass, as enterprises realize they must be...
A common misconception about the cloud is that one size fits all. Companies expecting to run all of their operations using one cloud solution or service must realize that doing so is akin to forcing the totality of their business functionality into a straightjacket. Unlocking the full potential of the cloud means embracing the multi-cloud future where businesses use their own cloud, and/or clouds from different vendors, to support separate functions or product groups. There is no single cloud so...
In 2014, Amazon announced a new form of compute called Lambda. We didn't know it at the time, but this represented a fundamental shift in what we expect from cloud computing. Now, all of the major cloud computing vendors want to take part in this disruptive technology. In his session at 20th Cloud Expo, Doug Vanderweide, an instructor at Linux Academy, discussed why major players like AWS, Microsoft Azure, IBM Bluemix, and Google Cloud Platform are all trying to sidestep VMs and containers wit...
Companies have always been concerned that traditional enterprise software is slow and complex to install, often disrupting critical and time-sensitive operations during roll-out. With the growing need to integrate new digital technologies into the enterprise to transform business processes, this concern has become even more pressing. A 2016 Panorama Consulting Solutions study revealed that enterprise resource planning (ERP) projects took an average of 21 months to install, with 57 percent of th...
New competitors, disruptive technologies, and growing expectations are pushing every business to both adopt and deliver new digital services. This ‘Digital Transformation’ demands rapid delivery and continuous iteration of new competitive services via multiple channels, which in turn demands new service delivery techniques – including DevOps. In this power panel at @DevOpsSummit 20th Cloud Expo, moderated by DevOps Conference Co-Chair Andi Mann, panelists examined how DevOps helps to meet the de...