How to Test for a Very Digital Christmas
December 11, 2015

Amir Rozenberg
Perfecto

Smartphones have been threatening for a few years to top laptops as the preferred way consumers engage with their digital lives. But this year it's really happening – just in time for the holidays.

This past Cyber Monday, over $799 million was spent on smartphones and tablets alone! IBM Watson recorded that shoppers on tablets outspent those on PCs by an average of about two dollars, and smartphone shoppers spent over 6% more than they did in 2014. Overall, smartphone shoppers account for 44% of all online traffic to e-commerce sites over the weekend, narrowly beating out PCs.


Similar trends have been noted in the UK and Germany, where this year smartphones overtook laptops for the first time as the most popular device for accessing the Internet. At the same time, e-commerce channels are growing faster; Forrester predicts they will reach $334 billion by the end of this year. Previous predictions had that number at $300 billion by 2017.

Mobile phones are even affecting in-store purchases - according to a recent report from Wanderful Media, 92% of millennial consumers will use their smartphones while browsing for products in physical stores. They're looking for coupons, promotions and deals, as well as trying to find specific shop locations and details about their most-wanted products. Out of those individuals, 78% will use mobile retail apps to purchase items, while 80% simply want to receive mobile app notifications that report the biggest sales.

This sets the scene for a very digital Christmas where consumers worldwide will be hunting out presents using mobile apps and websites. To keep pace with increasingly mobile customers, enterprises, particularly those in the retail and hospitality spaces, need a sophisticated approach to mobile app development and testing that gives finicky users a winning digital retail experience across all stages of a customer's journey: from browsing to connecting with an in-store beacon to tapping "buy" to receiving their gift.

But this smooth customer journey can be just a holiday fantasy if digital strategies get derailed by app development and QA issues. As much as we preach about the power of DevTest unity, open and integrated tools, automation and fast feedback loops, the reality is that enterprise teams struggle to keep up with the pace of digital. A high percentage of bugs still make it out into the real world.

Perfecto's own research shows that 44% of app defects are found by users, with 24% coming from direct feedback and another 20% from public user reviews in app stores (Perfecto, Why Apps Fail, 2014).

There's no good time to force your users to be your beta testers, but the holidays are arguably the worst time. But the data above tells the story: too many apps of low or high value are released without sufficient quality testing, making it important to tighten up testing and monitoring processes to avoid the financial and reputational damage to your brand that comes with angry users.

But how can retailers and hospitality companies sharpen the testing of the customer experience on mobile devices?

It boils down to this: You need to test for the right customers at the right time under the right conditions.

Whether you're Kohl’s or Starbucks or Chipotle, you have a variety of customers who have different characteristics – from the millennial to the middle-aged corporate road warrior to the stay-at-home mom. They use different devices and networks; they switch between devices; they buy different items and shop at different times.

Even if you're using test automation tools to speed up testing and app releases (and bravo if you are), you can't do simple functional testing and expect to keep up with your customers' noisy and dynamic mobile environments. They're frequently switching networks, maxing out battery and getting interrupted by texts, calls and competing apps. All. The. Time.

Understand that your mobile customers are complicated. During the holidays, they'll be shopping at odd times in crowded places, whether they got most of their shopping done on Black Friday, went the e-commerce route on Cyber Monday or are waiting till Dec. 24 to do their last-minute mobile shopping (we've all done it). You can count on them browsing and buying, using your app or website at the same time millions of other buyers are frantically shopping. You need to do rigorous performance testing against peak usage to prepare for the heaviest of loads – some of you may have learned this the hard way when your site crashed over Thanksgiving weekend.

In short, you need to test specifically for the people and conditions you created your app for in the first place. Every business has its target personas, but they've remained in the realm of business development and marketing. Translating those user needs from the business side to the technical side of the company has been a pain point.

Ultimately, testing and quality strategies in retail – and any industry for that matter – need to evolve to become more focused on the user. This Christmas, more users will tap mobile devices for shopping than ever before. Will you be ready for them their mobile moment of need?

Amir Rozenberg is Director of Product Management at Perfecto
Share this

Industry News

November 20, 2024

Spectro Cloud completed a $75 million Series C funding round led by Growth Equity at Goldman Sachs Alternatives with participation from existing Spectro Cloud investors.

November 20, 2024

The Cloud Native Computing Foundation® (CNCF®), which builds sustainable ecosystems for cloud native software, has announced significant momentum around cloud native training and certifications with the addition of three new project-centric certifications and a series of new Platform Engineering-specific certifications:

November 20, 2024

Red Hat announced the latest version of Red Hat OpenShift AI, its artificial intelligence (AI) and machine learning (ML) platform built on Red Hat OpenShift that enables enterprises to create and deliver AI-enabled applications at scale across the hybrid cloud.

November 20, 2024

Salesforce announced agentic lifecycle management tools to automate Agentforce testing, prototype agents in secure Sandbox environments, and transparently manage usage at scale.

November 19, 2024

OpenText™ unveiled Cloud Editions (CE) 24.4, presenting a suite of transformative advancements in Business Cloud, AI, and Technology to empower the future of AI-driven knowledge work.

November 19, 2024

Red Hat announced new capabilities and enhancements for Red Hat Developer Hub, Red Hat’s enterprise-grade developer portal based on the Backstage project.

November 19, 2024

Pegasystems announced the availability of new AI-driven legacy discovery capabilities in Pega GenAI Blueprint™ to accelerate the daunting task of modernizing legacy systems that hold organizations back.

November 19, 2024

Tricentis launched enhanced cloud capabilities for its flagship solution, Tricentis Tosca, bringing enterprise-ready end-to-end test automation to the cloud.

November 19, 2024

Rafay Systems announced new platform advancements that help enterprises and GPU cloud providers deliver developer-friendly consumption workflows for GPU infrastructure.

November 19, 2024

Apiiro introduced Code-to-Runtime, a new capability using Apiiro’s deep code analysis (DCA) technology to map software architecture and trace all types of software components including APIs, open source software (OSS), and containers to code owners while enriching it with business impact.

November 19, 2024

Zesty announced the launch of Kompass, its automated Kubernetes optimization platform.

November 18, 2024

MacStadium announced the launch of Orka Engine, the latest addition to its Orka product line.

November 18, 2024

Elastic announced its AI ecosystem to help enterprise developers accelerate building and deploying their Retrieval Augmented Generation (RAG) applications.

Read the full news on APMdigest

November 18, 2024

Red Hat introduced new capabilities and enhancements for Red Hat OpenShift, a hybrid cloud application platform powered by Kubernetes, as well as the technology preview of Red Hat OpenShift Lightspeed.

November 18, 2024

Traefik Labs announced API Sandbox as a Service to streamline and accelerate mock API development, and Traefik Proxy v3.2.