February 2011 Monthly Meeting Summary

Test Automation Design - Roundtable Discussion

This was a roundtable discussion followup to our March 2010 roundtable on test automation design. We went over some of the points that came out of the March meeting and continued further discussion of the areas where we ran out of time previously. We also solicited a real automation project from among the attendees, discussed some of its requirements, and discussed design issues.

Took place on: Wed. February 9 2011 6:30 PM

Attendance: 13

Meeting Notes:

One of the attendees discussed a new automation project and its challenges and this provided a focus for early-stage automation design considerations. Much of the design discussion surfaced the kinds of questions that needed to be asked about the project. The considerations that were discussed included:
  • Target audience of the automation results
  • Stakeholders of the project
  • What that audience expected.
  • What were their priorities, which feeds into the desicion of what to try to automate.
  • How configurable should the automation be?
  • Who will use it and run it.
  • Expected outputs - reporting
  • Custom development or use off-the-shelf open source or COTS?
  • Resources/Budget
  • Learning curve
  • Team skills
  • Documentation - Wiki? MS Word? ....?
  • Version control, standards, and enforcement thereof
  • Alignment with development processes
  • Tool/framework patching and updating processes
  • Tests from manual testers? or do the automation people come up with the test cases?
  • If the tests to be automated are written up by manual testers, do they need guidelines as to how to write automatable test cases?
There was some discussion of common code developed for an automation suite/framework:
  • Where there is a lot of common code to be developed, it may require a lot of time/resources - so tradeoff decisions and judgement needed.
  • Development of common code to support negative tests, one-offs, etc can also require a lot of additional time/resources
  • It was recommended to keep functions/classes/methods small and simple - general good coding practices
  • It was suggested that writing good common code requires a good understanding of the software that is to be tested
  • Common code is best written by those with good programming skills

     NoVaTAIG Home Page

Copyright 2011 Northern Virginia Test Automation Interest Group
Northern Virginia Test Automation Interest Group