May 5th, 2020 by inflectra
Often we get asked the question, how do you determine the Return on Investment (ROI) of purchasing and using SpiraTest to manage a team's requirements, test cases and defects. If the organization in question is using another tool (for example Micro Focus / HP ALM) it is easy, you simply compare features and license cost. However what is the ROI and business case for teams that are using manual methods, using MS-Word and MS-Excel instead of a tool? This is a bit trickier to calculate, so don't worry - we've put together a handy spreadsheet to help you out!
As described in our introductory article - What is Test Management Software? - test management is the process of taking your project's requirements, building a test plan, writing the tests, planning the test activities and capturing the results. Those test cases, test plans, and test activities can consist of manual tests, automated functional tests, API tests, load/performance tests, security tests, and frankly any other kind of test and experimentation activity that improves the quality of the final product.
Whether you choose to formally use a test management tool or not, you are in effect performing the functions of test management, namely:
(note that I did not perpetuate the fallacy that it will be defect free).
Now if you don't have a test management tool, then you are probably using:
Plus... Lots of people to review these documents, determine what tests need to be run, and see how close you are to being ready to release.
Whereas if you are using an integrated test management tool (like SpiraTest) you have all of this information in one place, up to date in real-time:
So it clearly makes sense to invest in an easy to use requirements and test management tool that can manage your entire software quality assurance process. If you are interested in knowing what features we think you should look for, here's a good whitepaper - How To Choose A Test Management Tool. However you probably are wondering, how do I justify the cost of such a tool, what is the Return on Investment (ROI) over my existing manual methods?
We have helped several of our customers put together business cases over the years to help them justify the cost of a tool like SpiraTest, and usually what we do is create two scenarios:
In the current state, we need to determine which roles are performing each of these tasks:
Requirements Management
Writing requirements in MS-Word
Managing documents in SharePoint, etc.
Test Case Editing
Writing test cases in Excel
Reviewing test cases
Updating and distributing test cases
Manual Testing
Executing tests and recording results in Excel
Manually updating the test results into a central sheet
Creating new defects in bug-tracker and linking to results
Bug Tracking
Reviewing bugs in old Bug Tracker
Reviewing fixed bugs in old bug tracker
Bug triaging and prioritization
Reporting
Compiling requirements coverage metrics
Compiling testing metrics and making graphs
Compiling defect metrics and making graphs
For each activity you need to assign the number and types of role that perform that activity, and in a given month, how much time they spend on it.
For the future state, we do a similar activity, but now we consider the test management tool to be in place, and estimate (for the same number of requirements) how much time each of the roles would spend on the new activities:
Finally, you need to add in the cost of the tool (software, hosting and any training) and add that to the total for the future state.
That gives you the total future and current states, from which you can determine the cost savings (assuming the future state is cheaper!!) and ultimately the ROI.
To make this process a bit easier, we have created this handy SpiraTest Business Case Estimation spreadsheet. This spreadsheet should not be used 'as-is', but should be customized to meet the specifics of your organization.
In the first Metrics tab, you need to specify how many months you need to demonstrate the ROI for. The longer the time, the greater the ROI, but you'll need to figure out what is a reasonable investment horizon for your organization. You might want to use 3-months for a Proof of Concept (POC) project, or 6-months to a year for a real implementation.
You should also define the various roles you have, the number of people in those roles, and an approximate, notional salary. It doesn't have to be 100% accurate (or include payroll tax costs, etc.), it's just used for comparison purposes.
Then in the current state tab, you will assign the different roles to the various activities, and determine how many hours they would spend on a project of the specified length.
If your team works differently, feel free to adjust then names, number and types of activities, the ones in the spreadsheet are just a guide.
The final row will contain the total cost for the project if you were to do it using your current team and tools.
Then in the future state tab, estimate how many people and how many hours they would need to perform the test management tasks illustrated, for a project of the same length. Unlike the current state, for the most part these activities are pretty standard when using SpiraTest, so you won't need to add/change the activities themselves, just the actors, quantity, and # hours.
Finally, the spreadsheet includes built-in formulas for determining the number of SpiraTest licenses you will need, the duration of the subscription, and the commensurate cost. It will add on the future state personnel cost and use that to determine the % ROI of the software investment.
Please feel free to download the handy SpiraTest Business Case Estimator spreadsheet. If you have any questions, please contact us for assistance.
Ask an Inflectra expert:
SpiraTest combines test management, requirements traceability & bug-tracking
SpiraTeam brings your teams together, managing the entire application lifecycle
SpiraPlan lets you manage your programs and portfolio of projects like never before
Orchestrates your automated regression testing, functional, load and performance
The ultimate test automation platform for web, mobile, and desktop applications
The help desk system, designed specifically for software support teams
Cloud hosted, secure source code management - Git and Subversion
Exploratory testing capture tool that automatically records your testing activity
Let us deal with the IT pain so you don't have to. Or use on-premise if you prefer.
Our customers work in every industry imaginable. From financial services to healthcare and biotech to government and defense and more, we work with our customers to address their specific needs.
Our products do not enforce a methodology on you, instead they let you work your way. Whether you work in agile development, Scrum and XP, Kanban and Lean, Waterfall, hybrid, or Scaled Agile Inflectra can help.
If you want to learn more about application delivery, testing, and more take a look at our whitepapers, videos, background papers, blog, and presentations.
Customers use our tools to help automate repetitive tasks and streamline their business processes using our Robotic Process Automation (RPA) solutions.
We collaborate with a wide range of teams to bring our customers a range of services (including load testing, training, and consultation), complimentary technologies, and specialized tools for specific industries.
Learn how different organizations have benefited from using Inflectra products to manage their software testing and application develooment.
Outstanding support is the foundation of our company. We make support a priority over all other work. Take a look at our support policy.
Discover great tips, discussions, and technical solutions from fellow customers and Inflectra's technical experts.
If you can't find the answer you're looking for, please get in touch with us: over email, phone, or online.
We are constantly creating new videos to help customers learn about our products, including through in depth webinars, all freely available along with a wide selection of presentations.
We provide a number of resources to help customers learn how to get the most out of our products, with free online resources, virtual classrooms, and face to face.
Read about Inflectra, our manifesto, and values. Meet our incredible customers who are building awesome things. We are focused on their success using our tools.
The Inflectra Blog contains articles on all aspects of the software lifecycle.
In addition we have whitepapers,
background articles, videos and
presentations to help get you started.
Events are a big part of our awesome customer service. They are a chance to learn more about us, our products, and how to level up your skills with our tools.
We actively partner with companies and individuals all over the world. We are also a great place to work and encourage you to explore joining our team.
Please contact us with your questions, feedback, comments, or suggestions. We'll get back to you as soon as possible.
When you need additional assistance (be it training, consulting, or integration services) our global certified solution provider partner network is ready to help.
At Inflectra, we are fully committed to provide our customers with the very best products and customer service.
We want to help developers extend and customize our tools to fit in with their needs. We provide robust APIs, sample code, and open source projects.