What the iOS 10 Release Means for Mobile Testing
October 04, 2016

Eran Kinsbruner
Perfecto by Perforce

The recent iOS 10 release raises a lot of questions about how mobile apps will respond to the updated system, and how developers can ensure an untarnished user experience. One of the biggest challenges that development and testing teams are facing is that certain devices have now been made obsolete. iPad 2, iPad 3rd gen, iPad mini, iPhone 4S, iPod touch 5th gen—none of these devices will update to run iOS 10.

With Apple’s decision to withhold the update from these devices the company considers “outdated,” development and testing teams will need to jump through hoops to maintain a quality user experience.

From the recent Perfecto Digital Test Coverage Index report it's clear that at least iPad 2, iPhone 4S and iPad mini are still among the most-used devices in various markets, including the U.S. (see below):


It’s safe to assume that withholding the update from these popular devices may lead to a lower adoption rate for the new OS — large groups of users will continue to use the iPad 2, iPad Mini and iPhone 4S, and will be unable to make the switch. The end result? We're going to see growing iOS fragmentation in various markets, and complex testing ahead.

In preparation for this mobile testing overhaul, developers need to take a look at their existing testing labs and plans, and alter them to fit the new market matrix.

Automate Across Operating Systems

With iOS 10 comes the new version of Mac’s OS Sierra and Safari 10. These new operating systems will need to be tested across iOS 10 devises, and will require additional lab configurations in your overall testing activities. To ensure quality across operating systems, teams should do a full regression of the scripts that were used to run on iOS 9 against iOS 10, and fine tune to make sure the scripts can run on both platforms until the next release.

Test Across Devices

Teams will need to sustain their test automation and development activities on iOS 10 devices and iOS 9 critical devices. This means that teams will need to support the new iPhone 7 and iPhone 7 Plus, along with other Apple devices that will run iOS 10. Unless you have an automated and continuous lab setup to test efficiently across an array of devices, most teams should expect a latency in testing activities.

Ensure Proper Lab Environments

To debug your app across devices, and ensure that it’ll work in parallel across iOS 9 and iOS 10, teams need to prepare environments with the new permutations. This includes both new Safari and Mac OS versions, new Xcode versions for developers, and of course, having new devices, smartphones and tablets with both iOS 9 and iOS 10 tested side by side.

Prepare for Added Complexity with Appium Framework

For teams building tests for iOS using Appium 1.6, things just got a bit more complicated. In iOS 10, Apple dropped its Instruments support and UIAutomation, moving its automation solution towards the new XCUITest framework. This change impacts existing Appium scripts that leverage Apple Instruments and UIAutomation framework, and will cause execution problems and compatibility issues when trying to run them on iOS 10/iPhone 7.

Now consider the growing iOS fragmentation and we’re left with a second layer of complexity. For devices that are no longer supported by iOS 10, existing Appium scripts that use the old UIAutomation framework are still relevant. That means that teams will have to migrate scripts to the new framework, or maintain both the old one for older devices and the new one for newer devices.

As testing roadblocks pop up with the iOS 10 release, end users still expect their mobile apps to perform seamlessly — so it’s time for developers to rise to the challenge.

Eran Kinsbruner is the Technical Evangelist for Perfecto.

Eran Kinsbruner is Chief Evangelist of Test Automation at Perfecto by Perforce
Share this

Industry News

March 05, 2025

MacStadium(link is external) announced the extended availability of Orka(link is external) Cluster 3.2, establishing the market’s first enterprise-grade macOS virtualization solution available across multiple deployment options.

March 05, 2025

JFrog is partnering with Hugging Face, host of a repository of public machine learning (ML) models — the Hugging Face Hub — designed to achieve more robust security scans and analysis forevery ML model in their library.

March 05, 2025

Copado launched DevOps Automation Agent on Salesforce's AgentExchange, a global ecosystem marketplace powered by AppExchange for leading partners building new third-party agents and agent actions for Agentforce.

March 05, 2025

Harness completed its merger with Traceable, effective March 4, 2025.

March 04, 2025

JFrog released JFrog ML, an MLOps solution as part of the JFrog Platform designed to enable development teams, data scientists and ML engineers to quickly develop and deploy enterprise-ready AI applications at scale.

March 04, 2025

Progress announced the addition of Web Application Firewall (WAF) functionality to Progress® MOVEit® Cloud managed file transfer (MFT) solution.

March 04, 2025

Couchbase launched Couchbase Edge Server, an offline-first, lightweight database server and sync solution designed to provide low latency data access, consolidation, storage and processing for applications in resource-constrained edge environments.

March 04, 2025

Sonatype announced end-to-end AI Software Composition Analysis (AI SCA) capabilities that enable enterprises to harness the full potential of AI.

March 03, 2025

Aviatrix® announced the launch of the Aviatrix Kubernetes Firewall.

March 03, 2025

ScaleOps announced the general availability of their Pod Placement feature, a solution that helps companies manage Kubernetes infrastructure.

March 03, 2025

Cloudsmith raised a $23 million Series B funding round led by TCV, with participation from Insight Partners and existing investors.

February 27, 2025

IBM has completed its acquisition of HashiCorp, whose products automate and secure the infrastructure that underpins hybrid cloud applications and generative AI.

February 27, 2025

Veeam® Software announces Veeam Kasten for Kubernetes v7.5, designed to deliver Kubernetes-native data resilience for enterprises.

February 27, 2025

DeepSource released Globstar, an open-source project bringing code security tooling to the AppSec community, with no restrictions on commercial usage.

February 26, 2025

Google Cloud announced the public preview of Gemini Code Assist for individuals, a free version of Gemini Code Assist that will give students an easy-to-use free AI coding assistant with the highest usage limits available