June 2013 Monthly Meeting Summary
Experiences in Performance Testing - Presentation by Abel Cabrera
Abel discussed his experiences with several past performance testing projects and shared insights and tips from his many years in performance testing.
Abel has an MS from the Astrophysics, Optics and Electronics National Institute in Puebla, Mexico and a PhD in Electrical
and Computer Engineering from Worcester Polytechnic Institute in Worcester, Massachusetts. His 20 years in software engineering
includes working at ATT Bell Labs and interests in performance engineering and architecture.
Took place on: Wed. June 19 2013 6:30 PM
- There was discussion of various types of testing related to performance testing such as stress testing, endurance testing, etc. and
different approaches such as white box vs black box performance testing
- There was discussion about how to gather more granular information to help find performance bottlenecks, such as tools that used embedded
agents throughout a system to monitor various components
- Performance engineering vs performance testing was mentioned and some performance engineering issues and strategies were discussed.
- It was mentioned that 'political' aspects of performance testing often came into play, such as eliciting good information about
expected test scenarios and performance targets, and dealing with issues of test system relevance, meaningfulness of results, risk, and dealing with
- Complexities regarding having an appropriate performance testing environment were discussed, and it was mentioned that a solid understanding
the system under test was critical to gauging the validity of a test environment. It was noted that sometimes the only really valid
performance testing was in a production system, and that preformance requirements were best determined based on an understanding of
live system statistics.
- In discussing tools, there were some opinions that Loadrunner was becoming less popular as a leading test tool and tools like SOASTA
were rising in popularity. Other tools mentioned included the Neoload load testing tool; also ancillary tools such as Splunk, a tool
for collecting and analyzing streams of system data (logs, transactions, etc); and New Relic - a tool for application
performance management and monitoring.
NoVaTAIG Home Page