I will cover two different subjects in this blog, first the growing testing trends, and second how these trends are reflected in organizations in APAC region. The topics have been stitched to demonstrate how customer expectations have changed over the years and how testing trends have changed with respect to growing complexity of applications, infrastructure, architecture, technology etc.
Testing as a practice has grown in complexity and significance from the time software industry was in adolescence in early 1990s. I would name pre-Google era as Testing 1.0, post Google until 2006 as Testing 2.0 and post that as Testing 3.0.
In Testing 1.0 period, testing was conducted in simple, ad hoc way which was without any specific processes or methodologies. Testing was part of the debugging process and not really an independent activity per se. Success in testing was mainly achieved by individual's brilliance and not due to any set standard and processes. The testing techniques were ad hoc without any structured documentation.
The financial model was predominantly input based on traditional single service & domain. Then, Google came and many other technology companies with niche applications and products. This era showed significant improvement in test processes and methodologies. Dotcom companies created stress on the network and therefore required agility on network provider's part to deliver services on time despite growing complexity.
This era also marked recessionary spikes which forced many companies to reduce their R&D spend but at the same time sustain the current business. This required testing to become smarter. Testing 2.0 was an era of evaluating an attribute or capability of system and determining that it met required results.
Testing processes were aligned to SDLC. Infrastructure started becoming more planned and dedicated for testing. Testing as an activity started getting more focus and evolved as an independent practice.
New models like Testing COE consolidated disparate testing activities under one roof bringing optimization in processes, tools and resources.
Cost pressure continued to increase leading to better ways to conduct testing through innovative delivery models, remote testing, offshore/onsite mix etc. Customers now had to adapt to newer technologies like 3G and newer architecture types like SOA, Cloud. With these changes, testing started seeing more focus on automation, performance and security testing. Customers explored outsourcing large testing deals comprising E2E ownership of applications, network and infrastructure. Financial model with stringent SLAs were introduced demanding better productivity of execution, reduction in cost and improvement of quality. Testing was getting more significant.
Testing 3.0 is the current era which is extremely complex from technology perspective. Now, the financial model is based on the solution, which is based on integration of various service lines, measured in terms of the value of transformation delivered. Testing is linked to the outcome of the engagement such as defect removal efficiency (DRE).
It encompasses all the risks associated with the delivery of the application in production environment. Networks have become heterogenous and complex as there are integration points from various off-the-shelf products and applications. Phones have become smarter with more and more applications moving onto them.
With this changing scenario, customer preferences and demands have also changed leading to change in the way testing is done. Apart from performance and security testing, structural testing is new methodology to uncover defects as early as in design phase or architecture phase.
Related Articles On the testing trail Testing: Making a Difference Testing in Financial Services: Towards Optimized Security ADM on the road to recovery Important is to understand that with the change applications onto new architecture like SOA or Mobile or Open source, probability of defect slippage right from architecture phase becomes higher if appropriate testing is not done.
It is therefore important to have testing done in architecture phase itself which is called structural testing. There are tools like STAMP which are becoming market leaders in structural testing.
Another important trend clearly seen across all industries is improving test process maturity. Testing of large global organizations is done across various locations.
A framework with overall governance model is required to streamline testing activities across these locations. TMMi model gives the maturity mapping enabling organizations to carve out improvement plan.
Another significant impact on testing is due to infrastructure. With the growing complexity in testing and related infrastructure, creating testing environment becomes too costly. Customers are in continuous pressure to deliver the products and services on time, but for that, they have to ensure that testing is done adequately and efficiently.
Dependency on development activities, infrastructure etc does not allow testing to commence on time in order to meet end customer's expectations.
Service virtualization is another important offering which service providers like Mahindra Satyam are providing to their customers in order to remove the dependency on costly infrastructure, removing dependency on development setup and also dependency on expensive third party applications and plug-ins.
To summarize, Testing 3.0 phase has tremendous complexity in applications and architecture but to tackle it efficiently and effectively, service providers like Mahindra Satyam have offerings like structural testing, service virtualization and TMMi apart from pure play services like automation, security testing and performance testing.
Testing is now considered as revenue generation activity and not as cost reduction activity which was the case until Testing 2.0. Now, testing plays a key role in business transformation. Efficient testing improves the ROI by generating new revenue or profit by offsetting the cost.
We see similar trends in the APAC region which is a growing market from testing perspective. Customers are getting aligned to independent testing services. Industries such as manufacturing, retail, telecom and energy/utilities are the ones to look out for opportunities. Any offering which are aligned towards asset management, infrastructure planning and monitoring are key to success.
Japan hasn't yet adapted cloud services and still sticking to legacy architecture like mainframe. China, Thailand and Malaysia are manufacturing hubs of companies in northern America. One needs to align the business model with north American companies to generate opportunities from their manufacturing hubs in Asian countries. Testing is growing and would remain the focus area for years to come.