Tableof content 1.Abstract……………………………………………………………. 1 2.Introduction………………………………………………………… 2 3.
ToolsDescription………………………………………………….. 3 4. FeatureDescription………………………………………………..
. 4 5. Comparison ofTools………..…………………………………….
.. 5 6.
Conclusion………………………………………………………….6 7. References.
. 7 1. Abstract: Animportant part of Software Development Life Cycle is software testing.
Nowadays, there are several tools available that are web based and serve thetesting purpose very well. One reason for it’s success may be the fact thatthey run on any web browser. The system with increased efficiency and less costis more preferable. The discussion here is about the comparison of differentweb automation testing tools.
This will serve two principles, one being theunderstanding of all these tools and secondly, The information about thepopular and competent tools available out there. Many browsers support thesetesting tools and provide API’s and web drivers. These API’s are used in different languages to writeappropriate script for testing. One parameter to consider while choosing one ofthese tools as the best tool is how well and easily it can be integrated.
Theother parameters being performance and cost of each tool. The other thing toconsider is that the tool must be suitable for the application it is going totest. 2. Introduction This paper focuses on a thoroughcomparison between the leading web automation testing tools. This comparisontakes into account all the important parameters necessary in determining boththe best tool for web testing and the most suitable tool for a person’sspecific application. The key features that are considered in comparison are:OS, Language, Type, and Browser support etc. The objective here is to involveall the important parameters that can be used to completely distinguish all thetools and help justify the preference of one or more over others.
Such as theplatform support which can determine if a certain tool can serve as a crossplatform tool or a platform specific tool. Typesof testing Static and dynamic testing:In static testing it isn’t necessary to execute theprogram while in dynamic testing the program needs to be executed. The box approach method:The box approach method involves white-box andblack-box testing. Manual and automation testing:The main difference between automation testing andmanual testing is that the manual testing does not require any tool while theautomation testing requires automation of the manual testing process. Webautomation testing and tools: Webtesting:Thesoftware with complete focus on web applications is called web testing tool.
Webautomation testing:Themain goal of using web automation testing is to check if the website is flawedor has errors in it’s basic functionality as well as evaluating other featuresof the website such as responsiveness and robustness. The benefit of webtesting however, is to use the same script on different platforms, as crossplatform web browsers are easily accessible. Features: Saves time and money Improves accuracy Increases test coverage Does what manual testing cannot Tools 1) Selenium2) HP-QTP3) Test-complete4) Watir5) WET6) Silk-test7) WinRunner 3.
Tools Description: Ø Selenium: Seleniumis a web testing framework that is especially known for it’s portability. It enablesthe tester to develop test scripts without having to learn a specific language.Selenium supports a range of tools for a range of requirements a scriptrequires for web automation. Web testers mostly use only a few of thetools supported by selenium but it is always a good idea to get fullunderstanding of all the provided tools. Selenium is a rich webtesting framework that provides all the web-oriented tools.
This helps bindall the operations of the tool according to the website and its functionality. The selenium’s ability to support multiplebrowsers is probably it’s most important feature. The basic use ofSelenium is functional testing of web applications.Selenium is suitable for agiletesting. Selenium is a free and cross platform software meaning that it runs onLinux, Windows and Mac.
Ø HP-QTP: QTP (QuickTestProfessional) is developed by Hewlett Packard (HP). It doesn’t need to bemonitored by the tester while it performs an automated web testing of a webapplication. When the script iswritten, it uses a VBScript (Visual Basic Scripting) to automate the webapplication. Because of the availability ofthe scripting engine in Windows Operating System, there is no need to installown your own.
The VBScript that comeswith Windows 7 is of version 5.8. VBScript is an object based language.
It features automated regression testing whichhelps find errors or defects in the application’s performance that is beingtested against the required output or result. It only supports WindowsOperatingSystem and it lacks multiple language support for writing scripts. Ø Test-complete: Test-Complete is equippedwith a graphical interface. It uses a technique called record-playback toautomate testing. It enables the tester to use unit testing, functionaltesting, GUI testing, regression testing and distributed testing. Test-completeis used for web application testing and desktop application testing limited toWindows application. It analyzes the features and the shortcoming of theapplication and performs evaluation according to the required conditions.It is an essentialstep in theprocess of SDLC (system development life cycle).
Companies that developsoftwares strictly follow the process of SDLC as a guide while testingapplications.The type of application as wellas the cost regarding the use of the tool are the parameters that dictatetheselection of tool to be used. As it supports both the web application andwindows application testing, there is a range of types of testing regarding webapplications and windows applications, which are as follows: functionaltesting, unit testing, regression testing, manual testing, data-driven testing,object-driven, distributed testing, HTTP load testing, and stress andscalability testing. It does that in an environment with complete automationtesting tools that support Windows, web, Java and .NET application testing. Itrelives the the developers of the excessive energy and time a manual testingrequires. Ø Watir: It is developed with Ruby which is anobject-oriented scripting language.
HTML and test scripts have no layers between them whichmakes it easy to create user specific scripts without having to worry aboutit’s license as it is free of cost. Ø WET:WET Web Tester is a web based testing toolthat drives an IE Browser directly and so the automated testing done is equivalent to how a user would drive the web pages. Thetool allows a user to perform all the operations required for testing web applications – like automatically clicking alink, entering text in a text field, clicking a button etc. One may alsoperform various checks as a part of the testing process by using Checkpoints.The latest version of WET is 1.0.
WET sits ontop of Watir, an automated test tool which uses Ruby scripting language. WET retains all the features that Watir has andadds many usability related functionality 10. WET started off as a small extension library for Watir – WatirExtension Toolkit. It has come a long way and isnow bundled with many compelling features. As the WET code base has grownmultiple times, it now uses Watir just as the library to drive IE. WETnot only offers all that Watir offers but many more powerful features to make test automation effort a success. It’s basecode has received a massive increase which helped it become stand alonesoftware with an independent identity.
It was once considered an extension of Watir but now it is identified as WET.Ø SILK-TEST:It is developed by Segue. It isused for: regression testing and functional testing for large-scaledapplicationsserving environments like .
Net, Web, Java or a client-server. Itprovides a range of features to choose from making it a highly efficientautomation tool for software testing. Customization, creating tests usingwork-flow , validation, complete data base access, robust and flexible testing,automated recovery system, multple platform, browser support are among these features. Ø Win-Runner:Automated testing with WinRunner addresses these problems bydramatically speeding up the testing process. You can create test scripts thatcheck all aspects of your application, and then run these tests on each newbuild.
As WinRunner runs tests, it simulates a human user by moving the mousecursor over the application, clicking Graphical User Interface (GUI) objects,and entering keyboard input—but WinRunner does this faster than any human user. 4. Feature Description: Selenium: Easy to use and adopt No need to learn test scripting language Browser independent Free software Runs on major platforms i.e Windows, Mac, and Linux HP-QTP: No skilled coder is required Object Oriented programming language Easy to use and navigate Easy monitoring and scheduling Supportstesting of Mobile Applications Test-Complete: Fully automated test recording from interactive usage of the application Uses key-word driven testing Test visualization Data-driven test using test, Excel and Database data sources Multi-browser support and cross-browser testing WATIR: It supports cross-platforms Requires skilled coder String and dynamic typing disciple Written in Ruby (Programing language) Does not run multiple scripts WET: Record-playback technique is used for automation Setting parameters of objects Support multiple scripts Script Re-usability Supports Integrated Data Driven testing Makes creation of scripts easy SILK-TEST: · Provides 24/7 unattended testing · Basic Work flow for rapid productivity· Uses externally stored data for Data Driven Workflow to test business logic functionality· Auto-Complete for instant test automation andcustomization infrastructure development· Organizing and sharing test information with thehelp of Project Workspaces· Re-usability and maintenance of scripts andtests are made easy with the help of GUI · Scripting language is extensible, easilymaintainable and highly portable· Distributed testing for efficient usage ofexcessive portability and hardware resources· Silk-Test provides reporting and execution oftests on runtime Win-Runner: · Testingtool for functional regression· Onlysupports Windows platform· Onlyfor applications based on GUI (Graphical User Interface) · UsesOOT (object oriented technology)concept· Forstatic content only· Record-playbacktool 5. Comparison of Tools S.no Name of tool Language use OS Type Release/ Development year Licence Devel-opment status Develo-per Language supported Brows-er support 1 Selenium Java Cross-plat-form Software testing framework for web application May 22, 2013,(2004) Apache 2.
0 Activre Jason huggins Domain specific language All major developer 2 HP-QTP VB script MS-wind-ows Test automation 2006 proprietary Active Mercury Interactive VB script Firefox 3.0 and later Google chrome 3 Test-Complete Java MS-windows Test automation Sept.3 2013/ 1999 proprietary Active SmartBear software Inc. VB script, Jscript,C++,C#script, DelphiScript IE, Firefox, Google Chrome 4 Watir Ruby Cross-plat-form Software testing framework for web application Sept.30, 2012 BSD Active Bret Pettichard and Paul Roger Java, .
Net, c# IE, later multiple browsers 5 WET Ruby MS-Windows Web-Based Testing Tool 2012 MIT Active Gov. of Canada Ruby IE 6 Silk-test 4Test Scripting language MS-windows Test automation Oct.10, 2012 proprietary Active Segue software Java, 4Test, VB,C#, VB.net IE and Firefox 7 Win-Runner C language MS-windows, Linux Load Testing Tool 2006 proprietary Active HP software division Test Scripting language IE, Netscape Selenium: It uses Java language and also supportscross-platform.
It has Apache 2.0 and it runs on all web browsers. It haslanguage support for domain specific languages.
HP-QTP: It uses and supports VB Script andoperates on MS-Windows. It has proprietary license. It runs on IE, Firefox andGoogle Chrome. Test-Complete: It uses Java language and hasMS-Windows support. It has proprietary license.
It has MIT license. It has IE (browser) support. Silk-Test: It uses 4Test scripting language andhas MS-Windows support. It has proprietary license. It runs on InternetExplorer and Firefox. It supports Java,4Test, VB, C#, and VB.
Net. Win-runner: It uses C language, and has MS-Windowsand Linux support. It has proprietary license. It runs on IE and Netscape. Itsupports test Scripting language.6. Conclusion We analyzed various webautomation tools in this paper. A web automation tool tests a web applicationfor flaws or errors of any kind without performing any manual operation .
Thereare a number of web automation testing tools that serve this purpose. To decidewhich tool is best, one has to tally the requirements with the tool’s features.For instance if an organizations is looking for rapid results he will go forspeed and if an organization struggles with their budget, it is likely tosearch for a cost effective tool. The requirements can be categorized accordingto the feasible tools. If an organizationrequires speed in testing then the possible testing tool is Test-Complete,but the tools comes with a cost.
The Test-Complete has to be licensed and it’slicense is quite costly. So if the organization prefers speed over cost then itwill be the right call to use Test-Case. However it the organization can’thandle the cost then they will have to manage the trade-off. On the other hand ifan organization wants a tool that is cost effective, they may have tosettle for a tool that has a very slow testing speed. Or if the material to betested is on large scale the tool should be chosen according to this specificneed.
For example for large-scale testing Watir is most suitablechoice. So it is clear that a tool is best for a job only if it is chosenaccording to the need. An organization thatwants a balanced tool may consider Selenium.
It is both costeffective and flexible but again it is not best known for its speed. So ingeneral it is a good tool but specifically- well it depends on thespecifications. Finally, all testingtools have their strengths and weaknesses or limitations. It is important toknow the requirements to choose the best tool for a test case to perform mosteffectively. All cases are to be judged by their suitability instead of theirshear performance or cost. 7. References: 1.
Kaner, Cem .(November 17, 2006).”ExploratoryTesting”(PDF).
Florida Institute of Technology, Quality Assurance Institute Worldwide Annual Software Testing Conference, Orlando, FL. 2. JiantaoPan, Software Testing, Carnegie Mellon University.3. GlenfordJ. Myers, The Art of Software Testing, Hoboken, New Jersey: Published by JohnWiley & Sons, Inc.4. Kolawa,Adam; Huizinga, Dorota.
(2007). Automated Defect Prevention: Best Practices inSoftware Management. Wiley-IEEE ComputerSociety Press.
ISBN 0-470-04212-5.5. Hayes,Linda G. (March 2004).Automated Testing Handbook, Software Testing Institute,2nd Edition.6.
Krazit,Tom.(April 2015). HP snaps up Mercury Interactive,CNET. CBS InteractiveInc.7. SudheendraHangal , Monica S.
Lam.(2002).Trackingdown software bugs using automatic anomaly detection.In Proc. 24th InternationalConference on Software Engineering, pages291-301.8. Fulton,Scott M.
( April 2015) .HP Aims to Redefine Apps Performance Testing withCloud Platform. ReadWrite.Wearable World Inc.9.
David Saff, Michael D. Ernst.(2003).
Reducingwasted development time via continuous testing. Software Reliability Engineering. In14th International Symposium, ISSRE 2003,pages 281-292..10. Automation testing-www.guru99.com/automationtesting.
html. 11. Richa Rattan, Department of ComputerScience, Hindu Engineering College, Sonipat, Haryana, INDIA, Comparative study of automation testing tools: Test Professional Selenium,VSRD.
12. ZengWandan, Jiang Ningkang, Zhou Xubo, “Design and Implementation of a WebApplication Testing Framework”, 978-0-7695-3745-0/09, 2009 IEEE 13 Shauvik Roy Choudhary, Husayn Versee,Alessandro Orso, “WEBDIFF: Automated Identification of Cross-browser Issues in Web Applications”, 978-1-4244-8628-1, 26th IEEE International conference onSoftware Maintenance, 2010 14. Baowen Xu, Lei Xu, Changhai Nie1, William Chu C. H. Chang, “Applying Combinatorial Method to Test Browser Compatibility”, 0-7695-2031-6/03,Proceedings of the IEEE Fifth InternationalSymposium on Multimedia Software Engineering (ISMSE’03)15.
http://Challenges in Testing Web Based Applications.htm 16. BETTER SOFTWARE, APRIL 2005 by Jonathan Kohland Paul Rogers www.StickyMinds.com