Joy Shafer October, 2011 - - PowerPoint PPT Presentation

Joy Shafer October, 2011

___________________________________________________________________________________________________________________________ Copies may not be made or distributed for commercial use Excerpt from PNSQC 2011 PNSQC.ORG 1

Introduction

 Why am I here?  Why are you here?

___________________________________________________________________________________________________________________________ Copies may not be made or distributed for commercial use Excerpt from PNSQC 2011 PNSQC.ORG 2

Sabotaging Quality

Sacrificing long-term for short term

 Investment in test, particularly test

automation

 Software quality  Ability to maintain software or service  Investment in infrastructure  Employee morale and vitality  Investment in test, particularly test

automation

 Software quality  Ability to maintain software or service  Investment in infrastructure  Employee morale and vitality

Most of the time, no one sets out to sabotage quality, things just get away from them.

___________________________________________________________________________________________________________________________ Copies may not be made or distributed for commercial use Excerpt from PNSQC 2011 PNSQC.ORG 3

Investment in Test

 Automated BVTs  Continuous Integration  Unit testing  Automated regression tests  The ability to emulate external components  Automated BVTs  Continuous Integration  Unit testing  Automated regression tests  The ability to emulate external components

___________________________________________________________________________________________________________________________ Copies may not be made or distributed for commercial use Excerpt from PNSQC 2011 PNSQC.ORG 4

Automated BVTs

 Robust (reliably functional)  Not dependent on other systems or services  Definitive

 If it fails it’s because of a code issue not a timing

issue, data issue, setup issue, etc.

 Start with basic tests and add on  Robust (reliably functional)  Not dependent on other systems or services  Definitive

 If it fails it’s because of a code issue not a timing

issue, data issue, setup issue, etc.

 Start with basic tests and add on

___________________________________________________________________________________________________________________________ Copies may not be made or distributed for commercial use Excerpt from PNSQC 2011 PNSQC.ORG 5

Continuous Integration

 Daily integration  Scheduled BVTs & Automated Regression tests

A cornerstone of efficient software development

 Daily integration  Scheduled BVTs & Automated Regression tests

Adequate test automation is required

___________________________________________________________________________________________________________________________ Copies may not be made or distributed for commercial use Excerpt from PNSQC 2011 PNSQC.ORG 6

Unit Testing

 Cleaner code  Better designed code  Tools

 Test hooks  Mock objects

 Better appreciation by developers of the

challenges testers face

 Cleaner code  Better designed code  Tools

 Test hooks  Mock objects

 Better appreciation by developers of the

challenges testers face

Management support is required

___________________________________________________________________________________________________________________________ Copies may not be made or distributed for commercial use Excerpt from PNSQC 2011 PNSQC.ORG 7

Automated Regression Tests

Without automated regression testing, teams

• f manual testers will need to comb through

the software with every release, laboriously running the same tests they’ve run countless times before. Without automated regression testing, teams

• f manual testers will need to comb through

the software with every release, laboriously running the same tests they’ve run countless times before.

___________________________________________________________________________________________________________________________ Copies may not be made or distributed for commercial use Excerpt from PNSQC 2011 PNSQC.ORG 8

The ability to emulate external components

 Don’t get too complicated  Check with other teams for emulators you

can modify

 Keep up-to-date  Extremely useful, maybe essential, for

performance testing

 Don’t get too complicated  Check with other teams for emulators you

can modify

 Keep up-to-date  Extremely useful, maybe essential, for

performance testing

Invest early, invest often

___________________________________________________________________________________________________________________________ Copies may not be made or distributed for commercial use Excerpt from PNSQC 2011 PNSQC.ORG 9

Software Quality

 Fix bugs as you find them

 Less time overall on bug fixes  Ship cycles will be shorter and more predictable  No backlog to carry from release to release  Cleaner code

 Consider refactoring  Techniques for quality improvement

 Do a ‘quality release’  Implement a ‘bug jail’

 Fix bugs as you find them

 Less time overall on bug fixes  Ship cycles will be shorter and more predictable  No backlog to carry from release to release  Cleaner code

 Consider refactoring  Techniques for quality improvement

 Do a ‘quality release’  Implement a ‘bug jail’

___________________________________________________________________________________________________________________________ Copies may not be made or distributed for commercial use Excerpt from PNSQC 2011 PNSQC.ORG 10

 Think about maintenance during the design

phase

 Design for ease of deployment  Keep hardware/OS/software current

Ability to Maintain your Service

 Think about maintenance during the design

phase

 Design for ease of deployment  Keep hardware/OS/software current

20% Productive Non- Productive 80% 80% 20%

___________________________________________________________________________________________________________________________ Copies may not be made or distributed for commercial use Excerpt from PNSQC 2011 PNSQC.ORG 11

Investment in Infrastructure

 Physical Infrastructure  Logging  Metrics

Test Case Development

 Physical Infrastructure  Logging  Metrics

0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% 200 400 600 800 1000 1200 Jan 06 Beta 1 Beta 2 v.1.0 v. 1.1 v.1.2 v.1.3 v.1.4

Total Automated Total Test Cases % Automated

___________________________________________________________________________________________________________________________ Copies may not be made or distributed for commercial use Excerpt from PNSQC 2011 PNSQC.ORG 12

Employee Morale and Vitality

 Long hours lead to

 Low productivity  Job dissatisfaction/Burnout  High turnover  Mistrust of

management

 Long hours lead to

 Low productivity  Job dissatisfaction/Burnout  High turnover  Mistrust of

management

___________________________________________________________________________________________________________________________ Copies may not be made or distributed for commercial use Excerpt from PNSQC 2011 PNSQC.ORG 13

Strategy: Appropriate Rewards

 Software development is a team sport  Reward successful teams

___________________________________________________________________________________________________________________________ Copies may not be made or distributed for commercial use Excerpt from PNSQC 2011 PNSQC.ORG 14

Tactics

 Know best practices  Be polite but persistent  Find your allies  Understand the real problem  Measure yourself  Set clear goals  Celebrate success  Know best practices  Be polite but persistent  Find your allies  Understand the real problem  Measure yourself  Set clear goals  Celebrate success

Most importantly, don’t give up!

___________________________________________________________________________________________________________________________ Copies may not be made or distributed for commercial use Excerpt from PNSQC 2011 PNSQC.ORG 15

Questions

___________________________________________________________________________________________________________________________ Copies may not be made or distributed for commercial use Excerpt from PNSQC 2011 PNSQC.ORG 16