Abstract
Large and complex software systems are developed as a tremendous engineering effort. The aim of the development is to satisfy the customer by delivering the right product, with the right quality, and on time. Errors made by engineers will always occur when a system is developed, but their number can be decreased by process improvement and their effect can be reduced by removing them as early as possible. The research is performed at Ericsson Microwave Systems AB. The thesis consists of six papers and the main contributions are:
- It is presented how measurements can be performed in the various testing activities in an organization. A measure of goodness is introduced, which measures whether faults could have been found earlier in the process.
- It is shown how a template simulation model can be adapted and extended to fit an organization in order to estimate how a change will affect the development process.
- The important characteristics of the verification and validation activities and the dependencies to other project activities in an organization are investigated in order to introduce process improvements. It is shown that interviews are a feasible means for the characterization.
- Two different review methods are compared. The comparison shows that an active review method is more efficient and effective than a passive one.
- The factorial design methodology is introduced as a method in system performance evaluation. The results show that a validation method, based on factorial design, is efficient when few factors are involved, and that prototyping and validation methods, based on fractional factorial designs, are efficient when many factors are involved.
Altogether, this thesis concentrates on how to increase product quality and reduce lead-time, by improving the verification and validation processes and methods.
- It is presented how measurements can be performed in the various testing activities in an organization. A measure of goodness is introduced, which measures whether faults could have been found earlier in the process.
- It is shown how a template simulation model can be adapted and extended to fit an organization in order to estimate how a change will affect the development process.
- The important characteristics of the verification and validation activities and the dependencies to other project activities in an organization are investigated in order to introduce process improvements. It is shown that interviews are a feasible means for the characterization.
- Two different review methods are compared. The comparison shows that an active review method is more efficient and effective than a passive one.
- The factorial design methodology is introduced as a method in system performance evaluation. The results show that a validation method, based on factorial design, is efficient when few factors are involved, and that prototyping and validation methods, based on fractional factorial designs, are efficient when many factors are involved.
Altogether, this thesis concentrates on how to increase product quality and reduce lead-time, by improving the verification and validation processes and methods.
| Original language | English |
|---|---|
| Qualification | Doctor |
| Awarding Institution |
|
| Supervisors/Advisors |
|
| Award date | 2003 Dec 5 |
| Publisher | |
| Publication status | Published - 2003 |
Bibliographical note
Defence detailsDate: 2003-12-05
Time: 13:15
Place: Room E:1406, E-building, Lund Institute of Technology
External reviewer(s)
Name: Bergman, Bo
Title: Prof
Affiliation: Chalmers University of Technology, Sweden
---
Article: An Industrial Case Study of the Verification and Validation ActivitiesBerling, T. and Thelin, T.Proceedings of the 9th International Software Metrics Symposium (Metrics'03), Sydney, Australia, pp. 226-238, September 2003.
Article: Adaptation of a Simulation Model Template for Testing to an Industrial ProjectBerling, T., Andersson, C., Höst, M., and Nyberg, C.Proceedings of the International Workshop on Software Process Simulation and Modeling (PROSIM'03), Portland, USA, May 2003.
Article: A Case Study Investigating the Characteristics of Verification and Validation Activities in the Software Development ProcessBerling, T. and Höst, M.Shorter version published in the proceedings of the 29th Euromicro conference, Belek-Antalya, Turkey, pp. 405-408, September 2003.
Article: Evaluation of a Perspective Based Review Method Applied in an Industrial SettingBerling, T. and Runeson, P.IEE Proceedings Software, Vol.150, No.3, pp.177-184, June 2003.
Article: Application of Factorial Design to Validation of System PerformanceBerling, T. and Runeson, P.Proceedings of the 7th IEEE International Conference and Workshop on the Engineering of Computer Based Systems (ECBS), Edinburgh, Scotland, pp. 318-326, April 2000.
Article: Efficient Evaluation of Multi-Factor Dependent System Performance using Fractional Factorial DesignBerling, T. and Runeson, P.IEEE Transactions on Software Engineering, Vol. 29, No. 9, pp. 769-781, September 2003.
Subject classification (UKÄ)
- Computer Science
Keywords
- Software Verification
- Software Engineering
- Software Validation
- Process Improvement
- Software Process Metrics
- Factorial Design
- Software Inspection
- computer technology
- Systems engineering
- Data- och systemvetenskap