Looking Back on Testing

Published Apr 19 2004 12:40 PM 490 Views

It’s amazing how much can change in six years. Test has always been an area of constant innovation, creative problem solving, and process improvement. As a result of this continuous improvement we have dramatically changed our work lives as testers.

When I started my first contract job for Microsoft nearly six years ago I was responsible for running daily BVT’s (build verification tests) for SMTP in MCIS. I had four test machines, two x86’s and two Alpha’s. I had images to build x86 machines, but I had to build the Alpha’s from scratch every day. Someone told me I was lucky to only test on two platforms as there had previously been four (MIPS and PPC support had been recently cut). I was extremely busy, and being new to the industry the learning curve was huge, but I was really, really excited.

My day consisted of setting up four test machines, installing the product, and running the automation. Of course there were side projects that came up, failures to investigate, developers to follow up with, and bugs to log. However, the bulk of my time was spent on BVT’s, and I spent a lot more time preparing to test than actually testing. Running the automation, mostly perl scripts, didn’t take that long. Aside from BVT’s we had a few tools or scripts we used for isolated tasks, but most of the setup and testing was still done manually back then.

Needless to say a lot has changed. Now we have several automated tools to build topologies, and Windows 2000/2003 can be set up in less than an hour. I used to build four machines a day, now I could build hundreds in an hour or two (if I had that many machines). Now in Exchange nearly every tester writes code, and we develop test automation in step with product code. Test passes keep getting faster, we do more testing with fewer resources (aka people), we connect to test machines with Terminal Server and now I enjoy many days in a row without entering the lab.

Still, there is a lot that hasn’t changed. We still work hard, in an environment that is constantly changing, and we still reorg fairly often (I’ve had eight managers in 3.75 years since I was hired full time). We still own product quality and fight for our bugs, and the rush of finding a great bug remains the same. If someone needs to know how a feature really works, they still ask test. The friendly dev-test rivalry will always be part of life. Devs may think they have the upper hand, but as a tester you know the truth. You’re reminded every time a dev you’ve been working with sees you in the hall, stops in their tracks and says “Oh god” as you walk in their direction.

Carol Swales

1 Comment
%3CLINGO-SUB%20id%3D%22lingo-sub-610605%22%20slang%3D%22en-US%22%3ELooking%20Back%20on%20Testing%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-610605%22%20slang%3D%22en-US%22%3E%3CP%3E%3C%2FP%3E%3CDIV%20class%3D%22ehlopost%22%3E%3CP%3EIt%E2%80%99s%20amazing%20how%20much%20can%20change%20in%20six%20years.%20Test%20has%20always%20been%20an%20area%20of%20constant%20innovation%2C%20creative%20problem%20solving%2C%20and%20process%20improvement.%20As%20a%20result%20of%20this%20continuous%20improvement%20we%20have%20dramatically%20changed%20our%20work%20lives%20as%20testers.%3C%2FP%3E%0A%3CP%3EWhen%20I%20started%20my%20first%20contract%20job%20for%20Microsoft%20nearly%20six%20years%20ago%20I%20was%20responsible%20for%20running%20daily%20BVT%E2%80%99s%20(build%20verification%20tests)%20for%20SMTP%20in%20MCIS.%20I%20had%20four%20test%20machines%2C%20two%20x86%E2%80%99s%20and%20two%20Alpha%E2%80%99s.%20I%20had%20images%20to%20build%20x86%20machines%2C%20but%20I%20had%20to%20build%20the%20Alpha%E2%80%99s%20from%20scratch%20every%20day.%20Someone%20told%20me%20I%20was%20lucky%20to%20only%20test%20on%20two%20platforms%20as%20there%20had%20previously%20been%20four%20(MIPS%20and%20PPC%20support%20had%20been%20recently%20cut).%20I%20was%20extremely%20busy%2C%20and%20being%20new%20to%20the%20industry%20the%20learning%20curve%20was%20huge%2C%20but%20I%20was%20really%2C%20really%20excited.%3C%2FP%3E%0A%3CP%3EMy%20day%20consisted%20of%20setting%20up%20four%20test%20machines%2C%20installing%20the%20product%2C%20and%20running%20the%20automation.%20Of%20course%20there%20were%20side%20projects%20that%20came%20up%2C%20failures%20to%20investigate%2C%20developers%20to%20follow%20up%20with%2C%20and%20bugs%20to%20log.%20However%2C%20the%20bulk%20of%20my%20time%20was%20spent%20on%20BVT%E2%80%99s%2C%20and%20I%20spent%20a%20lot%20more%20time%20preparing%20to%20test%20than%20actually%20testing.%20Running%20the%20automation%2C%20mostly%20perl%20scripts%2C%20didn%E2%80%99t%20take%20that%20long.%20Aside%20from%20BVT%E2%80%99s%20we%20had%20a%20few%20tools%20or%20scripts%20we%20used%20for%20isolated%20tasks%2C%20but%20most%20of%20the%20setup%20and%20testing%20was%20still%20done%20manually%20back%20then.%3C%2FP%3E%0A%3CP%3ENeedless%20to%20say%20a%20lot%20has%20changed.%20Now%20we%20have%20several%20automated%20tools%20to%20build%20topologies%2C%20and%20Windows%202000%2F2003%20can%20be%20set%20up%20in%20less%20than%20an%20hour.%20I%20used%20to%20build%20four%20machines%20a%20day%2C%20now%20I%20could%20build%20hundreds%20in%20an%20hour%20or%20two%20(if%20I%20had%20that%20many%20machines).%20Now%20in%20Exchange%20nearly%20every%20tester%20writes%20code%2C%20and%20we%20develop%20test%20automation%20in%20step%20with%20product%20code.%20Test%20passes%20keep%20getting%20faster%2C%20we%20do%20more%20testing%20with%20fewer%20resources%20(aka%20people)%2C%20we%20connect%20to%20test%20machines%20with%20Terminal%20Server%20and%20now%20I%20enjoy%20many%20days%20in%20a%20row%20without%20entering%20the%20lab.%3C%2FP%3E%0A%3CP%3EStill%2C%20there%20is%20a%20lot%20that%20hasn%E2%80%99t%20changed.%20We%20still%20work%20hard%2C%20in%20an%20environment%20that%20is%20constantly%20changing%2C%20and%20we%20still%20reorg%20fairly%20often%20(I%E2%80%99ve%20had%20eight%20managers%20in%203.75%20years%20since%20I%20was%20hired%20full%20time).%20We%20still%20own%20product%20quality%20and%20fight%20for%20our%20bugs%2C%20and%20the%20rush%20of%20finding%20a%20great%20bug%20remains%20the%20same.%20If%20someone%20needs%20to%20know%20how%20a%20feature%20really%20works%2C%20they%20still%20ask%20test.%20The%20friendly%20dev-test%20rivalry%20will%20always%20be%20part%20of%20life.%20Devs%20may%20think%20they%20have%20the%20upper%20hand%2C%20but%20as%20a%20tester%20you%20know%20the%20truth.%20You%E2%80%99re%20reminded%20every%20time%20a%20dev%20you%E2%80%99ve%20been%20working%20with%20sees%20you%20in%20the%20hall%2C%20stops%20in%20their%20tracks%20and%20says%20%E2%80%9COh%20god%E2%80%9D%20as%20you%20walk%20in%20their%20direction.%3C%2FP%3E%0A%3CP%3E%3CSPAN%20class%3D%22author%22%3E%3CA%20href%3D%22http%3A%2F%2Fblogs.msdn.com%2Fexchange%2Farticles%2F114744.aspx%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3ECarol%20Swales%3C%2FA%3E%3C%2FSPAN%3E%3C%2FP%3E%0A%3C%2FDIV%3E%3C%2FLINGO-BODY%3E%3CLINGO-LABS%20id%3D%22lingo-labs-610605%22%20slang%3D%22en-US%22%3E%3CLINGO-LABEL%3Eall%20posts%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3EHistory%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E
Version history
Last update:
‎Jul 01 2019 02:55 PM
Updated by: