functionaltestingtools

 

FrontPage

Page history last edited by Mark Levison 10 mos ago

Introduction

This wiki exists to help organize our understanding of functional test tools for agile projects.

 

This is different from Opensource Testing Tools on three levels:

  • It will list both open source and commercial tools.
  • It's designed to make it easy to compare a variety of tools
  • The intention is add notes that help compare and sort your thinking about tools.

 

Frameworks vs. Drivers

 

 

Frameworks

Tool

Input Format (XML, Java, Vendor Script)

 Domain Specific Language

Target Driven: browser, Win Forms, Eclipse app, ...

Target Language supported

 Test Before, Test After, Exploratory

Test Results Represented (log files, html Screenshots,...)

Execution support for headed vs. headless

Visible Execution (watch the test executing in parallel with the GUI)

 Tests can be run on multiple machines Tests can be run in parallel Suitable for Perfromance testing

IDE Support

Refactorability

Modularity, Decompostion, ...

 Grouping, Tagging (ways to organise tests) Ignore, Disable etc. Extensibility (plugins, other) CI Support Supported OSes Licence
Fit                                        

Robot Framework

html

 yes

agnostic - drivers for: Selenium, SSH, Swing, Telnet

agnostic

 Before, After, can also be used to drive the system to a certain state

XML (for CI integration, etc.), HTML

agnostic

no

 yes yes no

decidated IDE coming

not built-in to the framework

yes

 yes yes yes yes anything python/java Apache 2.0

 

Driver

Tool

 Website

Input Format (XML, Java, Vendor Script)

 Domain Specific Language

Target Driven: browser, Win Forms, Eclipse app, ...

Target

Language

supported

Refactorability

Modularity,

Decompostion, ...

 Supported OSes Licence

Abbot

  

Java

 programming

Swing

Java

As per Java

As per Java

 As per Java Common Public License 1.0
FEST   Java programming Swing Java As per Java      
pywinauto http://pywinauto.openqa.org/ Python programming WinForms apps .NET As per python As per python Windows BSD

Selenium

  

 

  

 

 

 

 

    

 

Attributes missing columns

Customer Understandable (related to expression at the start.) - customer lang vs. code.

Driver vs. Framework

Ability to run tests in multiple different ways see Rick M for examples.

What do people what out the performance testing question?

Link to tool website?

Refactorability????

Comments (2)

profile picture

Michael DiBernardo said

at 10:49 pm on Aug 4, 2008

I went to fill in some tools and then was thinking I might actually like to have a whole page devoted to each. Maybe the name of the tool in the tool column can hyperlink to a tool-specific page, but we'll fill the criteria columns in here?


profile picture

Mark Levison said

at 11:30 pm on Aug 4, 2008

Sounds good to me. Eventually as Mickey suggested this page should be generated from tags - but in the mean time this works.

You don't have permission to comment on this page.

Printable version
 
Anonymous Create an account or Log in