Software Testing and Continuous Quality Improvement

Author: R.T.Sundari

C-DAC/ Noida

www.cdacnoida.in

Agenda
Process Improvement Strategy Process Implementation. Testing Activities Quality Improvement Lesson Learnt Conclusion
2

C-DAC/ Noida

www.cdacnoida.in

Process Improvement Frame Work

There are different frame works such as:
ISO 9001 SEI CMMI IEEE TQM
www.cdacnoida.in
3

C-DAC/ Noida

Why?-SEI CMMI
qCMMI is more tightly connected with the SDLC qIts delivery in the form of multiple levels creates an environment of gradual climbing of a ladder in the quality maturity level

4 3 2
1
C-DAC/ Noida

www.cdacnoida.in

Process Improvement Strategy

Study an existing process to understand its activities. Produce an abstract model of the process. Analyse the model to discover process problems. This involves discussing process activities with stakeholders and discovering problems and possible process changes.

C-DAC/ Noida

www.cdacnoida.in

Process Improvement Model

Set the Goal Constitute the Software Engineering Process Group (SEPG) Flow Chart the current Processes Organize the process champions Simplify the process and make changes Get feedback from practitioner Remove bottlenecks and weak processes after review Baseline the process Train the practitioners

C-DAC/ Noida

www.cdacnoida.in

Process Improvement -Implementation

A Four tier work group created

First level Senior Management Second level SEPG Third level Process Champions Fourth level - Practitioners
7

C-DAC/ Noida

www.cdacnoida.in

Process Implementation - Model

C-DAC/ Noida

www.cdacnoida.in

Process Implementation - activity

Senior Management - committed and provided all necessary resources. SEPG - Responsible for ensuring the process improvement activities addressing CMMI Framework Process Champions-Refining and documenting the processes PractitionersCollective knowledge, experiences and efforts were utilized as a powerful tool to improving the processes 9
C-DAC/ Noida

www.cdacnoida.in

Process Implementation - Execution

Developing the documentation of QMS, this includes quality manual, processes, working instructions, forms, templates, and checklists and base lining. Practical training of CMMI implementation to end users. Conducting the periodical audit to help User to discover the potential issues of QMS. Building the QMS web site where all the process, templates, checklist, tools, methods of best practice and training materials are shared throughout the organization.
C-DAC/ Noida

10

www.cdacnoida.in

Process Implementation - Execution

Cont.

Adaptation of tools VSS/CVS, to perform configuration management, and MS Project 2003 to perform project management. Building up quantitative management mechanism to analyze the quality trend and revise the reasonable quality expectation. Conducting regular (at least monthly) process focused meetings with all key process area members to ensure steady progress.
C-DAC/ Noida

11

www.cdacnoida.in

Process ImplementationExecution Cont.

Reviewing Projects, Scope of Work and Contract. Helping team to identify and collect direct and indirect Data Conducting mini assessments to benchmark progress Integrating the RFID attendance system with Time sheet management and the efforts spent on each process in the project were captured.
C-DAC/ Noida

12

www.cdacnoida.in

Software Testing
Process quality and product quality are closely related and process improvement benefits arise because the quality of the product.

C-DAC/ Noida

13

www.cdacnoida.in

Testing difficulties in R & D

Shorter time to complete the testing Design and functionality of product features changes often New features that are added or deleted, depending upon the progress of the project. but - No change in timeframe

C-DAC/ Noida

14

www.cdacnoida.in

Testing Strategy Evolved

Beginning the test planning earlier in the development life cycle Understanding the Project and map the requirements with test cases Leveraging the results of previous test efforts Improving the management of resources Standardization of the test cases Reusing existing Test Cases from repository
C-DAC/ Noida

15

www.cdacnoida.in

Representative sample of the Efforts and Defects detected

Project Name AHIMS-SMS AHIMS - PGIMER AHIMS-GNCTD FMS-PGIMER AHIMS - User Mgmt. (Core Product) DHBVN - PIS Beej Prabandhan -(NSC-SCM) LAO-PDR (Rural Bazar) Online Counseling System Online Registration and Examination -. RFID - Department of Post RFID - People Mgmt. System RFID-Standalone People Mgmt. System OCR Digital Library eCDAC TOTAL C-DAC/ Noida No. of Test Cases 8562 18194 850 744 180 2542 2364 87 300 433 1490 493 740 170 51 172 35818 Testing Effort in Man days 1610 2662 1254 225 160 970 324 66 18 1002 1176 238 160 96 36 135 10132 No. of defects 2102 2570 501 257 94 587 1173 19 140 416 240 128 257 40 24 33 8581

16

www.cdacnoida.in

Quality Improvement
Both product and process assessment are required for quality improvement.

How?

C-DAC/ Noida

Performing Testing activities, conducting audits and SQA assessments help to improve the process throughout the organization Review of all the processes and documents are done rigorously by the audit team so that margin of error is very less. Project Leaders were helped to close the Non Compliance of quality standards and improve the process compliance. 17

www.cdacnoida.in

Result of Quality Improvement

In Project Planning

C-DAC/ Noida

18

www.cdacnoida.in

Result of Quality Improvement

In Project Monitoring and Control

C-DAC/ Noida

19

www.cdacnoida.in

Lesson Learnt
Keep sizable goals Clear understanding for targets and percolate it down Everyone needs to be engaged train the masses Utilize Teams as process champions Multi-department representation Start the implementation with the groups that want to improve, which eager to benefit from efforts and are able to recognize their own weaknesses Provide skilled coaching, resources, support, and tools Publicize successes; Share best practices

C-DAC/ Noida

20

www.cdacnoida.in

Conclusion
Processes enable people to develop their potential more fully and are more effective within the organization. By defining, measuring, and controlling the process, improvements are more successful and sustained. Appropriate technology, techniques, and tools are introduced successfully increases predictability. The planning and estimation of project scope, schedule, resource and cost are clearer and better controlled based on the quantitative management

C-DAC/ Noida

21

www.cdacnoida.in

References
Standard CMMI Appraisal Method for Process Improvement (SCAMPI),Ve r s i o n 1 . 2 : M e t h o d D e f i n i t i o n Document. CMU/SEI-2006-HB-001. CMMI Practice and Experience 2006 Software Engineering Association of Taiwan Journal of Software Engineering Studies, Vol. 1, No. 1, 8-16 September 2006 How we do CMMI @ Mark and Spencer by Stephen Woods March 2005 Hand Book for Basic process Improvementhttp://www.balancedscorecard.org/Portals/0/PDF/bpihndbk.pdf

C-DAC/ Noida

22

www.cdacnoida.in

C-DAC/ Noida

23

www.cdacnoida.in

Thank You