BreadcrumbHomeResourcesBlog For High-Velocity Testing, Plug Some Virtual Devices Into Your Testing Pyramid May 4, 2021 For High-Velocity Testing, Plug Some Virtual Devices Into Your Testing Pyramid Mobile Application TestingBy Eran KinsbrunerConsider this all-too-familiar situation: The dev team sends over a new mobile app feature to QA before releasing it to production. A few days later, the dev team gets a hefty Jira ticket in response. Racing against the clock, the dev team then fixes the issue, QA retests, and hopefully the new feature is fixed in time for the end of the sprint. If they succeed, everyone breathes a sigh of relief before finding themselves again in the same situation. But this back-and-forth makes for a high-pressure work environment, stalls productivity, and can even delay releases. The truth? Testing doesn’t need to be this way. With virtual devices, the dev team could have found the issue much earlier in the development lifecycle. While testing on real devices is critical for high-quality mobile app development, devs don’t need to use them right away. But what if you could test on all the devices you needed, both real and virtual, all in one place? It is with this question that I am excited to announce Perfecto’s latest support of simulators and emulators. You can now test on simulators, emulators, and real devices from our mobile device lab, all within our mobile testing platform. Table of ContentsWhy Add Virtual Devices? Speed & Cost Virtual Devices and the Testing Pyramid Bottom Line Table of Contents1 - Why Add Virtual Devices? Speed & Cost 2 - Virtual Devices and the Testing Pyramid 3 - Bottom Line Back to topWhy Add Virtual Devices? Speed & Cost By testing on both real and virtual devices, developers get fast feedback while organizations get comprehensive application quality at a much lower cost. This fast feedback from early testing helps organizations shift left and catch bugs earlier, faster, and resolve them more easily. Plus, organizations can create a more thorough and all-encompassing mobile testing strategy. With this combination of virtual and real devices, teams can test efficiently at every stage of the SDLC. How, might you ask? Let’s dive in. Back to topVirtual Devices and the Testing Pyramid Many of us are familiar with the testing pyramid, which groups tests strategically into different categories. Tests in the lower portion of the pyramid are faster because they are more automated. Tests at the upper portion of the pyramid are slower and more manual. The higher you go, the fewer the tests. Unit Testing With Virtual Devices Unit tests make up the largest layer of the testing pyramid, which test isolated units of code. Part of unit testing also requires validating code changes on a local machine, which happens during a code commit or as part of a pull request. Within this context, it makes sense to run these on dev-triggered simulation and emulation devices. In this case, simulators and emulators quickly give the appropriate feedback for such an early stage of development. Integration Testing With Real & Virtual Integration tests happen later as the app matures, and teams need to test more complex scenarios across different systems. It makes sense, then, that teams mix testing on simulators and emulators with real devices. Real device tests can cover areas such as performance testing, security, and even accessibility features. Virtual platforms, on the other hand, cover acceptance and unit tests more quickly and efficiently than real devices can. These tests, with a balance of real and virtual devices, complement each other to sufficiently cover this stage of the pipeline. UI & Manual Testing With Real Devices For UI and manual tests, it is— and I cannot stress this enough — critical to test on real devices and the custom operating systems they use. But this is a small part of a much larger mobile testing picture. While there will always be a place for real devices, adding simulators and emulators at earlier stages of development is the best way to test quickly, test early, and fix fast without interruption. Back to topBottom Line Matching your test strategy to the testing pyramid model is now simpler than ever. Combining virtual and real devices when mobile testing offers a powerful combination of speed and quality. With Perfecto’s latest support of simulators and emulators, teams can test their mobile apps both thoroughly and cost-effectively, all in one platform. Want to Learn More? Reach out to our team with questions or check out our eBook that discusses virtual devices in mobile testing. Explore Perfecto Virtual Devices Download Our Virtual Devices eBook Back to top
Eran Kinsbruner DevOps Chief Evangelist & Sr. Director at Perforce Software, Perfecto Eran Kinsbruner is a person overflowing with ideas and inspiration, beyond that, he makes them happen. He is a best-selling author, continuous-testing and DevOps thought-leader, patent-holding inventor (test exclusion automated mechanisms for mobile J2ME testing), international speaker, and blogger. With a background of over 20 years of experience in development and testing, Eran empowers clients to create products that their customers love, igniting real results for their companies.