Full findings of a new EMA report, sponsored by Plutora, titled EMA 2018 Test Environment Management Survey have been announced. The study demonstrates the immediate cost savings that test environment management (TEM) tools provide, yet finds that only four percent of large enterprises have fully integrated TEM processes into organizational DNA.
One of the most striking findings that emerged from the survey is the scale of test environments in enterprises. There is an average of 188 test environments per enterprise, with the highest total count at 685, and the average spend to support test environments is $682,000 per year. Test environments of this number sprawl and become complex, which directly impact the ability to manage them.
Enterprises are missing out on the advantage of TEM tools
Despite the scale at which enterprises are standing up and utilizing test environments, the adoption of tools to manage and maintain them is very low. Nearly a quarter of respondents in the survey are not using a commercial TEM tool with two-thirds employing their own ad hoc TEM process. This has a significant impact because when the maturity of commercial TEM tools is compared to that of in-house, non-commercial tools, the difference is unmistakable: commercial TEM tools are more advanced and in-house tool users lag in all the measurements of TEM maturity.
Of those utilizing TEM tools, key functionalities respondents are looking for include provisioning and deployment of test environments, integration with configuration management tools and integration with ITSM tools as their top three priorities.
The study also shows that organizations already embracing TEM tools, and looking to mature, recognize the need to develop an even more automated and scalable approach to TEM. They also have a need to integrate the process with existing tools for development, testing and deployment in order to implement a more effective way to manage TEM activities. While those currently using in-house TEM tools are looking for automation, scalability and to transition away from the ad hoc TEM processes they are currently using.
Payback on TEM investment occurs immediately and across the entire application lifecycle
Whatever stage of maturity TEM tool integration is at in an organization, one of the key metrics to understand is the cost savings that can come from optimizing management and embracing the capabilities of commercial tools.
Through faster provisioning, reduced number and cost of test environments, and improved quality, organizations can save between $600 and $4,000 per test environment and ultimately reduce the development and test time, saving close to $10,000 for each release.
No matter what the total of overall production releases is, the payback on TEM investment will occur almost immediately. Also, if these savings are viewed as cost avoidance, ROI will be realized in one or two months.
Additionally, the analysis finds that TEM technology users have not fully embraced the full range of capabilities that robust TEM tools provide. While users are seeing the benefits from many of the capabilities like the deployment of test environments and capacity planning, there is still opportunity for growth in adoption of other capabilities like verifying and maintaining the health of test environments and integrating with CI/CD tools.
“TEM is a technology that every enterprise should be using to the fullest,” said Stephen Hendrick, research director, EMA. “At the core of TEM there is no inefficiency. Environments are spun up exactly as they need to be. Developers and testers can be productive immediately. And ultimately, there is less developer time wasted making for less ambiguity and inconsistency when it comes to what is actually being developed and released. This is reinforced when we totalled up the cost savings, and confirmed our suspicions – using TEM tools can save the average enterprise over a million dollars a year. Organizations, and developers, would jump at the chance to reallocate this budget to projects that move the business forward and it is within their reach through the advancements of TEM tools.”
“This research demonstrates that any organization that isn’t making the effort to fully embrace the advantages of commercial TEM tools is missing out,” said Bob Davis, CMO, Plutora. “In today’s software-driven environment, enterprises that address any single inefficiency in its application lifecycle can gain competitive ground, but if you can bring about a series of time-saving, effort-reducing and quality-enhancing elements to the process that TEM tools provide, you can realize enormous benefits. It’s an easy lift with a huge payoff.”