【文件属性】:
文件名称:Automated GUI performance testing
文件大小:1.3MB
文件格式:PDF
更新时间:2017-03-01 21:26:15
GUI test
A significant body of prior work has devised approaches for automating the
functional testing of interactive applications. However, little work exists for automatically
testing their performance. Performance testing imposes additional requirements upon GUI
test automation tools: the tools have to be able to replay complex interactive sessions, and
they have to avoid perturbing the application’s performance. We study the feasibility of
using five Java GUI capture and replay tools for GUI performance test automation. Besides
confirming the severity of the previously known GUI element identification problem, we
also describe a related problem, the temporal synchronization problem, which is of
increasing importance for GUI applications that use timer-driven activity. We find that
most of the tools we study have severe limitations when used for recording and replaying
realistic sessions of real-world Java applications and that all of them suffer from the
temporal synchronization problem. However, we find that the most reliable tool, Pounder,
causes only limited perturbation and thus can be used to automate performance testing.
Based on an investigation of Pounder’s approach, we further improve its robustness and
reduce its perturbation. Finally, we demonstrate in a set of case studies that the conclusions
about perceptible performance drawn from manual tests still hold when using automated
tests driven by Pounder. Besides the significance of our findings to GUI performance
testing, the results are also relevant to capture and replay-based functional GUI test
automation approaches.