Testing status assessment for "quick win" identification of process improvements

 

  • Identifies cost reduction opportunities quickly
  • Assesses the current status of testing within an organisation
  • Measures the level of testing maturity within the organization against SQS-UK's unique Testing Maturity Models
  • Identifies prioritised 'quick win' process improvements that can be quickly introduced, allowing areas of testing to mature
  • Proposes longer term initiatives for sustained process improvements
  • Examines all aspects of the project lifecycle to improve testing, reduce costs and speed delivery of fully tested code

 

 

 

 

 

An SQS-UK HealthCheck often reveals a number of improvements that can be made in a relatively short space of time that will have immediate and apparent benefits to an organization. All situations are different so it is difficult to catalogue these as a standard list; however some examples of prioritised 'quick win' changes have been:

  • Clearly defining the scope and boundaries of testing phases to reduce the incidence of duplicated effort and increase the number of areas covered by testing, thereby reducing the numbers of defects detected post launch.
  • Clearly defining Entry and Exit criteria to the various stages of testing to help enable testing to detect defects earlier in the testing cycle and reducing the cost of correction.
  • Targeting areas where the planned implementation of automated testing techniques will reduce the time taken to execute regression tests
  • Introduces more formal test management techniques to give testing focus and priority
  • Introduction of Test Asset Management concepts and practices to reduces wastage and provides return on investment in test assets
  • Improves the set up and maintenance of test environments and helps introduce stability to key elements of the Testing process, thereby reducing the time and effort spent in making testing environments available
  • Improves data strategies by including data selection Detailed understanding of the data cycle helps focus testing effort, reduces test duplication and introduces reliability and repeatability in the testing cycle

Analysis of problem areas and testing practices can be difficult and time consuming to undertake.
HealthCheck provides a quick and simple approach that identifies the most important "quick wins" for improvement - ensuring fast returns and better results.

Why use HealthCheck?

 

It has been proven that, when performing an SQS-UK HealthCheck, testing costs per project can range between 50% and 75% of the total project expenditure. (These figures have been taken from metrics SQS-UK have gathered over time, across a number of industry sectors and exclude figures for Year 2000 testing projects).

Carrying out an SQS-UK HealthCheck helps identify the aspects of testing that could benefit most from improvement - reducing the overall cost of testing, and therefore the cost of all projects to an organisation.
Previous SQS-UK HealthChecks indicate that an organisations level of Testing Maturity is closely related to the overall level of IT process maturity.

SQS-UK's Testing Maturity models, based on widely accepted process maturity models, are a productive means of identifying and prioritising work for Testing Improvements.

The SQS-UK Testing Maturity models identify all the unique disciplines involved in testing. A score is assessed and assigned in each area and provides an indication of the steps required to be taken to move the organisation to the next level of testing maturity.

How does it work?

SQS-UK HealthChecks are delivered by using a combination of Document Reviews, Interviews and Causal Analysis Techniques.

A HealthCheck will begin with a formal kick off meeting that confirms the final scope and deliverables required of the HealthCheck. A list of documentation to assist Consultants to conduct the HealthCheck is requested and reviewed in advance of the interview stage. This enables the interview stage to be more focused, keeping the interviews short and reducing the time impact.

Typically a Testing HealthCheck will examine:

  • Testing Environments, their use, their maintenance and support
  • The business processes and their interactions and interfaces
  • All relevant documentation
  • The availability of relevant experts in key areas such as systems and technical areas
  • The appropriateness of standards, guidelines or best practices currently in use
  • Testing Objects or assets, to determine the levels of reuse available to ensure return on investment in testing
  • Available Test Data to gain an understanding of the data required by an application, where it comes from, how it is processed and where it ends up
  • Testing metrics to understand which areas are in greatest need of improvement
  • Test Tools. Where they are used, their implementation, method of use and maintenance.

SQS-UK always undertakes a risk-based approach to projects. This means that a prioritisation of the work undertaken is based on the highest risks facing an organisation, balanced with a view to finding 'quick-wins'.

SQS-UK utilise a list of topics that will be covered in each of the interviews but do not have a prescribed list of questions. This informal approach to the interviews allows the sessions to be more open and revealing.

The deliverables from the HealthCheck include a PowerPoint presentation of the findings and recommendations together with a fully costed and scheduled implementation plan for all of the recommendations.

Examples

SQS-UK have an excellent track record with clients who have undertaken a HealthCheck in the following areas:

  • In the financial services sector, identification of the problem areas in testing leading to the introduction of version control and to the analysis and rebuilding of mainframe test environments. Using automated techniques provided saving on costs across all projects
  • In the financial services sector again, a major bank reviewing testing practices with Year 2000 readiness as the driving factor, led to test automation using a specialist package and redevelopment of the test environments using automated techniques. This gave a major reduction in the cost of Year 2000 testing against that spent by similar institutions
  • In the Distribution Services sector, the need to improve software quality required testing to be reviewed as part of the strategy. This led to the introduction of test automation and creation of more test environments
  • In the Manufacturing and Warehousing sector, a review of testing practices lead to improved use of automation, preventing the tools from becoming shelfware and ensuring return on the investment in the tools
  • In the Telecommunications sector, a review of testing practices led to a quality program based on the introduction of test resources. The SSQS-UK best practice methodology provided both test procedures and processes.

 

 

Download Healthcheck collateral.