|By Vu Lam||
|December 21, 2012 12:00 PM EST||
Software developers and service providers need a period of usability testing before launch to find out how the product stands up in the hands of end users. An experienced QA team will ferret out bugs and identify major issues, but they won't use your software like a customer will. The value of focus testing is not up for debate, but the way you run it most definitely is.
How Does It Work?
Crowdsourcing-based usability testing services is an emerging niche and you'll find a choice of online services capable of delivering valuable information on your product's usability. Try My UI and User Testing are two good examples and they both offer the chance to see potential customers using your software in real-world conditions. The pricing varies, but you're looking at $35 to $39 per tester for a single test and there are discounts for bulk orders.
You provide the software and a set of instructions and the testers complete the task you set out in their own homes. Their computer screens are recorded so you can see exactly what they are doing and they provide a running audio commentary to explain their thought process. This is a fantastic way to get detailed feedback and immediately identify any usability issues that you may have overlooked. Each video has a maximum time limit of 20 minutes.
Benefits over Traditional Usability Testing
The key benefit is obviously the cost savings, because traditional usability testing is very expensive. Crowdsourcing is actually superior in other ways as well. The turnaround is incredibly fast; you can get same-day results, potentially even within an hour, which would be impossible if you were setting up a series of tests with a focus group in a lab setting. You can also get feedback 24/7 so if time is a factor, or you want to enact quick changes and test again, you can do so.
Consider also the benefit of having testers who are for the most part working from home and therefore relaxed and without expectations. The process of coming into an unfamiliar setting for a test can actually skew the results. With this kind of online testing you are really getting as close to an end-user experience as possible.
What's the Downside?
No solution is ever perfect and so it's important to mention a couple of limitations. This kind of testing in 20-minute chunks is best suited to examining how users interact with a menu or interface system, or how they perform a relatively simple task with your software. There isn't time to go into any great depth.
You also have to consider the demographic you need. You'll find the option to choose an age range, average household income, country, gender, level of expertise, and you can add more stringent guidelines. The system is not ideal if you have very specific needs. For in-depth screening to pinpoint a real niche bracket of testers, you will need to look elsewhere.
The Proof Is in the Testing
With such a low upfront cost and quick turnaround there really is no reason not to give it a try. Any feedback that enables you to streamline your product and improve usability is worth the investment. You can easily annotate or edit the videos you get in from testers and that can be a useful tool to present your findings to the rest of your company and spark the response you need to perfect that software before it goes to market.
In his General Session at 16th Cloud Expo, David Shacochis, host of The Hybrid IT Files podcast and Vice President at CenturyLink, investigated three key trends of the “gigabit economy" though the story of a Fortune 500 communications company in transformation. Narrating how multi-modal hybrid IT, service automation, and agile delivery all intersect, he will cover the role of storytelling and empathy in achieving strategic alignment between the enterprise and its information technology.
Feb. 25, 2017 08:00 AM EST Reads: 5,707
All clouds are not equal. To succeed in a DevOps context, organizations should plan to develop/deploy apps across a choice of on-premise and public clouds simultaneously depending on the business needs. This is where the concept of the Lean Cloud comes in - resting on the idea that you often need to relocate your app modules over their life cycles for both innovation and operational efficiency in the cloud. In his session at @DevOpsSummit at19th Cloud Expo, Valentin (Val) Bercovici, CTO of Soli...
Feb. 25, 2017 07:30 AM EST Reads: 1,132
DevOps is often described as a combination of technology and culture. Without both, DevOps isn't complete. However, applying the culture to outdated technology is a recipe for disaster; as response times grow and connections between teams are delayed by technology, the culture will die. A Nutanix Enterprise Cloud has many benefits that provide the needed base for a true DevOps paradigm. In his general session at 20th Cloud Expo, Chris Brown, a Solutions Marketing Manager at Nutanix, will explore...
Feb. 25, 2017 07:15 AM EST Reads: 1,432
The best way to leverage your Cloud Expo presence as a sponsor and exhibitor is to plan your news announcements around our events. The press covering Cloud Expo and @ThingsExpo will have access to these releases and will amplify your news announcements. More than two dozen Cloud companies either set deals at our shows or have announced their mergers and acquisitions at Cloud Expo. Product announcements during our show provide your company with the most reach through our targeted audiences.
Feb. 25, 2017 07:00 AM EST Reads: 8,973
Culture is the most important ingredient of DevOps. The challenge for most organizations is defining and communicating a vision of beneficial DevOps culture for their organizations, and then facilitating the changes needed to achieve that. Often this comes down to an ability to provide true leadership. As a CIO, are your direct reports IT managers or are they IT leaders? The hard truth is that many IT managers have risen through the ranks based on their technical skills, not their leadership abi...
Feb. 25, 2017 05:00 AM EST Reads: 8,189
After more than five years of DevOps, definitions are evolving, boundaries are expanding, ‘unicorns’ are no longer rare, enterprises are on board, and pundits are moving on. Can we now look at an evolution of DevOps? Should we? Is the foundation of DevOps ‘done’, or is there still too much left to do? What is mature, and what is still missing? What does the next 5 years of DevOps look like? In this Power Panel at DevOps Summit, moderated by DevOps Summit Conference Chair Andi Mann, panelists l...
Feb. 25, 2017 05:00 AM EST Reads: 7,142
The Internet of Things is clearly many things: data collection and analytics, wearables, Smart Grids and Smart Cities, the Industrial Internet, and more. Cool platforms like Arduino, Raspberry Pi, Intel's Galileo and Edison, and a diverse world of sensors are making the IoT a great toy box for developers in all these areas. In this Power Panel at @ThingsExpo, moderated by Conference Chair Roger Strukhoff, panelists discussed what things are the most important, which will have the most profound e...
Feb. 25, 2017 04:00 AM EST Reads: 11,854
In recent years, containers have taken the world by storm. Companies of all sizes and industries have realized the massive benefits of containers, such as unprecedented mobility, higher hardware utilization, and increased flexibility and agility; however, many containers today are non-persistent. Containers without persistence miss out on many benefits, and in many cases simply pass the responsibility of persistence onto other infrastructure, adding additional complexity.
Feb. 25, 2017 12:45 AM EST Reads: 1,250
An overall theme of Cloud computing and the specific practices within it is fundamentally one of automation. The core value of technology is to continually automate low level procedures to free up people to work on more value add activities, ultimately leading to the utopian goal of full Autonomic Computing. For example a great way to define your plan for DevOps tool chain adoption is through this lens. In this TechTarget article they outline a simple maturity model for planning this.
Feb. 25, 2017 12:15 AM EST Reads: 2,386
The rise of containers and microservices has skyrocketed the rate at which new applications are moved into production environments today. While developers have been deploying containers to speed up the development processes for some time, there still remain challenges with running microservices efficiently. Most existing IT monitoring tools don’t actually maintain visibility into the containers that make up microservices. As those container applications move into production, some IT operations t...
Feb. 24, 2017 09:45 PM EST Reads: 1,248
"We got started as search consultants. On the services side of the business we have help organizations save time and save money when they hit issues that everyone more or less hits when their data grows," noted Otis Gospodnetić, Founder of Sematext, in this SYS-CON.tv interview at @DevOpsSummit, held June 9-11, 2015, at the Javits Center in New York City.
Feb. 24, 2017 08:45 PM EST Reads: 6,083
In his General Session at DevOps Summit, Asaf Yigal, Co-Founder & VP of Product at Logz.io, explored the value of Kibana 4 for log analysis and provided a hands-on tutorial on how to set up Kibana 4 and get the most out of Apache log files. He examined three use cases: IT operations, business intelligence, and security and compliance. Asaf Yigal is co-founder and VP of Product at log analytics software company Logz.io. In the past, he was co-founder of social-trading platform Currensee, which w...
Feb. 24, 2017 08:15 PM EST Reads: 5,511
Cloud Expo, Inc. has announced today that Andi Mann returns to 'DevOps at Cloud Expo 2017' as Conference Chair The @DevOpsSummit at Cloud Expo will take place on June 6-8, 2017, at the Javits Center in New York City, NY. "DevOps is set to be one of the most profound disruptions to hit IT in decades," said Andi Mann. "It is a natural extension of cloud computing, and I have seen both firsthand and in independent research the fantastic results DevOps delivers. So I am excited to help the great t...
Feb. 24, 2017 07:45 PM EST Reads: 4,118
As Enterprise business moves from Monoliths to Microservices, adoption and successful implementations of Microservices become more evident. The goal of Microservices is to improve software delivery speed and increase system safety as scale increases. Documenting hurdles and problems for the use of Microservices will help consultants, architects and specialists to avoid repeating the same mistakes and learn how and when to use (or not use) Microservices at the enterprise level. The circumstance w...
Feb. 24, 2017 06:15 PM EST Reads: 743
This week's news brings us further reminders that if you're betting on cloud, you're headed in the right direction. The cloud is growing seven times faster than the rest of IT, according to IDC, with a 25% spending increase just from 2016 to 2017. SaaS still leads the pack, with an estimated two-thirds of public cloud spending going that way. Large enterprises, with more than 1,000 employees, are predicted to account for more than half of cloud spending and have the fastest annual growth rate.
Feb. 24, 2017 06:00 PM EST Reads: 770
SYS-CON Events announced today that CA Technologies has been named “Platinum Sponsor” of SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY, and the 21st International Cloud Expo®, which will take place October 31-November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. CA Technologies helps customers succeed in a future where every business – from apparel to energy – is being rewritten by software. From ...
Feb. 24, 2017 03:15 PM EST Reads: 2,375
Cloud Expo, Inc. has announced today that Andi Mann and Aruna Ravichandran have been named Co-Chairs of @DevOpsSummit at Cloud Expo 2017. The @DevOpsSummit at Cloud Expo New York will take place on June 6-8, 2017, at the Javits Center in New York City, New York, and @DevOpsSummit at Cloud Expo Silicon Valley will take place Oct. 31-Nov. 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
Feb. 24, 2017 02:45 PM EST Reads: 2,095
With 10 simultaneous tracks, keynotes, general sessions and targeted breakout classes, Cloud Expo and @ThingsExpo are two of the most important technology events of the year. Since its launch over eight years ago, Cloud Expo and @ThingsExpo have presented a rock star faculty as well as showcased hundreds of sponsors and exhibitors! In this blog post, I provide 7 tips on how, as part of our world-class faculty, you can deliver one of the most popular sessions at our events. But before reading the...
Feb. 24, 2017 02:15 PM EST Reads: 8,738
Microservices (μServices) are a fascinating evolution of the Distributed Object Computing (DOC) paradigm. Initial design of DOC attempted to solve the problem of simplifying developing complex distributed applications by applying object-oriented design principles to disparate components operating across networked infrastructure. In this model, DOC “hid” the complexity of making this work from the developer regardless of the deployment architecture through the use of complex frameworks, such as C...
Feb. 24, 2017 12:30 PM EST Reads: 1,442
@DevOpsSummit at Cloud taking place June 6-8, 2017, at Javits Center, New York City, is co-located with the 20th International Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The widespread success of cloud computing is driving the DevOps revolution in enterprise IT. Now as never before, development teams must communicate and collaborate in a dynamic, 24/7/365 environment. There is no time to wait for long developm...
Feb. 24, 2017 12:00 PM EST Reads: 1,767