In 2012, nearly 150 million people worldwide brought their smartphones or tablets to work to use on the job — that’s nearly a quarter of all consumer-owned smart devices. Juniper Research projects that that number will more than double to 350 million personally owned, used-for-work devices by 2014.
Over half of businesses today are supporting workers’ mobile preferences by making line-of-business apps available on their devices. And 90 percent of Fortune 500 companies are deploying or testing iPads (Source: Tab Times). SAP itself has put 20,000 iPads and 40,000 iPhones into the hands of its own workers.
Worksoft recently surveyed 500 SAP clients about their plans for mobile. “One question we asked is if they expected their business to use more mobile technology in the next 12 months,” says Reiner Musier, Worksoft’s chief marketing officer. “Seventy percent said yes, they would be growing their investment in mobile technology.”
It’s predicted that by 2013, 1.2 billion workers will use mobile technology — personally- or company-owned — on their jobs, and that enterprise mobile data traffic will double in each of the next two years.4 From 2011 to 2016, mobile data traffic is projected to grow 18-fold.(Source: Mashable)
“There are certain areas where they are jumping on faster than others,” says Chief Technology Officer Shoeb Javed of Worksoft, a leading supplier of testing solutions for SAP clients and other mid- and large-size enterprises. “In the SAP BusinessObjects solutions and other analytics solutions, a lot of customers have adopted mobile versions. They use them from their iPad as well as phones and so on.”
In the mobile environment if you want to understand the true end-user experience when running checklist for mobile monitoring success simple monitoring is not enough. A successful mobile monitoring plan entails an entire strategy, including the following elements:
●Make sure your monitoring solution comes from a company you trust —one with many years’ experience providing true mobile monitoring.
●View active measurements through an intuitive Web portal interface.
●Trend the performance and availability of mobile content, services, and applications across different devices,networks, and locations.
●Benchmark your performance against your competitors.
●Receive customized real-time alerts.
●Use diagnostics to troubleshoot and resolve issues.
●Integrate with your mobile operations center.
●Feed mobile performance and availability data to your own software analysis tools. native applications, Keynote MDP is the best solution offering real-device monitoring.
●If you want true end-user performance monitoring, Keynote MWP over Air is the best solution. Other solutions provide results that can be misleading under a variety of critical conditions.
●If you only need availability monitoring of your back-end systems, Keynote MWP is a cost-effective solution.
Depending on your application, you will have to assess whether testing on an emulated device or real device is the best option.
Many times it is not either/or decision and the best choice is both.
There are so many factors involved in both the options. Emulators offer the less expensive testing option, but they have many limitations for mobile testing and may not give an accurate depiction of the mobile user experience.
Whereas, testing on real devices gives the tester full functionality of the mobile device. While device types may be more limited than the emulated devices.
Like the Web itself, a mobile Web application is viewable by users around the world. Even if your target audience only in a single country or on a single network, it helps to understand the global dynamic.
While we test mobile web applications we encounter several challenges presented by the nature of the global, mobile Web. As we understand the nature of each challenge, we can explore different technology options to manage issues and mitigate risk.
Choosing the right solutions for your requires an assessment of the advantages and disadvantages inherent in each of the Testing Strategies and Tactics for Mobile Applications testing options available to you and determining the technology that best suits your testing requirements. These mobile testing challenges include devices, network, and scripting.
|Optimize End User Experience For Mobile Devices|
Where in the world are your customers today? Are they at home, at work, or somewhere in between? At a soccer game? The gym?
And what about your employees? Are they at a customer site? In an important meeting in a company hallway? Or working from home today?
It’s nothing new that customers and employees are all over the place and on the go with mobile or tablet. They’ve got their e-mail in their hand while they’re waiting in line at the grocery store, and the company price list on their iPad while they’re sitting across the desk from a prospect.
Companies may now recognize the compelling need to reach customers and employees through mobile apps, but getting those apps built, tested, and to market is a new and complex challenge. Mobile is a many times more fragmented ecosystem than the desktop environment. Existing, “traditional” software development protocols need to be adapted; more importantly, mobile requires an entirely different set of quality assurance and performance protocols.
Rather than testing software in a single operating system environment, mobile apps requires development and mobile testing for as many as five OS platforms — iOS, Android, BlackBerry, Windows, and Symbian. Complicate that further with a multitude of devices, each with its own form factor and display characteristics, add in the nuances of various cellular carriers both domestic and international, and you have a test scenario sure to send even the most sophisticated IT department reaching for the aspirin bottle.
It doesn’t have to be such a headache, though. An effective, expeditious alternative is to go outside and utilize independent testing and monitoring partners that already have mobile infrastructures in place. The partner then becomes responsible for procuring the handsets and other devices, and establishing the carrier contracts in various geographies, typically on a scale far broader than would be realistic for an in-house department to manage. Such outsourcing is the direction the market is taking. International Data Corporation projects worldwide testing services to grow more than 15% a year through 2015, from a total spend of $9.4 billion in 2010 — and mobile applications are a fast-growing part of that total.4
Source : keynote.com
The app has been put through its paces, revised and retested over and over, and now every effort to break it simply fails. Break out the champagne, it’s ready for release — but don’t celebrate too long. Because no app is ever ready to be left all on its own.
With websites, apps, basically anything in the online world, things can and will go wrong. There could be overload issues (because your app is so popular!), server issues somewhere in your network, unexpected usage patterns. Any number of things can dull the sparkle of your shiny new app today, tomorrow or six months from now. Constant vigilance is the key to happy users and a successful app.
That solution is monitoring. Perhaps not surprisingly, some of the same best practices for testing also apply to monitoring performance and availability, most notably, using real devices in real-life scenarios. How and what you monitor, though, is somewhat different from what you tested in the development phase.
Monitoring offers a similar public/private cloud choice as described above for testing. Keynote, for example, has a well-established infrastructure with a broad array of devices on different carriers in multiple locations around the world. An app owner can use this network for ongoing scheduled monitoring. Or, if security is a concern or if volume justifies it, Keynote will build a private cloud network with the devices and in the markets that matter most to the app owner. And with a private cloud, you have the luxury of doing more troubleshooting than you could do in a shared public environment, because you own all of the time on the devices. You can pause the application and monitoring script and interact with the app to see exactly what the end user sees and find out exactly what’s causing a problem.
Public or private, the key to an effective monitoring program is to find out quickly about problems before they become crises.
The demand for enhanced mobile applications, content and services is growing. As a real-time on-demand mobile solution should ensure quality before you push out dynamic content and mobile Web services to live environments.
A mobile testing and monitoring solution lets you test mobile content by quickly switching handset models, or carrier networks. This way you can cover more devices and networks all from your desktop.
You can test mobile Web content using advanced scripting engine to implement sophisticated test cases. This can be done over the internet or over live networks by quickly changing carrier profiles without having to leave your office.
These test cases can then be executed on a regular basis delivering instant results through one unified Web portal.
By mobile web monitoring and benchmarking performance and availability of mobile services down to each step of a transaction, you can ensure the quality of your subscribers’ mobile experience.
There are a few aspects of mobile testing that you will need to consider with respect to real devices. Real handsets are not designed with testing in mind. With limited processing power and storage, the handsets do not allow on board diagnostic software to be loaded, hence they lack instrumentation. Recording protocols going back and forth between the application and the mobile device will not be an option that we will be able to do and this will be a limitation. Hence, we will not be able to isolate problems and make corrections.
The emulators run on more powerful PCs and servers, they are integrated to capture detailed diagnostics and run through client and server at various levels of the stack. When there is an application fault, you can isolate and take a corrective step for the problem. Emulated devices are cost effective; a single platform with frequent updates of devices profiles can be used to test every device on the market.
Know more about Mobile Device Simulator.
When you need a mobile monitoring solution reflecting true user experience, make sure of the pointers below:
● Does this accurately measure response time on the route taken on a mobile network to the target Web server?
● How do I download content that has been added by the mobile operator in-stream during Web content download to accurately represent the end user experience?
● Can I ensure that I’m downloading the exact content served by the Web server depending on the requesting device?
● Does this solution capture the multi threaded behavior of a mobile browser for specific requesting devices?
When you need to check the availability of your pure content and want to view it over the network, make sure you ask:
● How do I accurately measure only the availability of my mobile Web content, bypassing the mobile operator?
When you want to make sure that your native apps are providing a specific end-user experience, make sure you ask:
● Does this measuring and monitoring process run its tests on real target devices?
When choosing a vendor to provide mobile measuring and monitoring technology, make sure that the vendor has the technology and the depth of resources to provide test results that reflect the true end-user experience. Educate yourself on the issues and technologies available before making a decision.
Read More on Mobile Monitoring
There are some unique challenges when it comes to testing mobile applications. These challenges with mobile testing will present you with trade-offs that you need to consider and choices that you will need to mix on the different techniques and methods that you will use in testing.
There are pros and cons associated with each testing option and there will probably be no one testing option that is complete and satisfying. So you will need to consider a testing strategy that combines different testing options that together will provide you with an overall testing result, which is a balance between cost, quality and time to market.
Similar to the web, a mobile web application can be viewed by consumers around the world. Even if the application is targeted to a limited geography, it helps us understand the global problem. We can explore different technology options to manage the challenges in different ways.
Read More on Mobile Testing Strategies