Making The Decision To Automate Your Software Testing
|
Not every software testing project can or should be automated. Before your department accepts a new test automation project, you should establish a process by which projects are reviewed and either accepted or rejected. This can be done with a simple Test Automation Acceptance Checklist.
Repeatable Test Cases with Static Data
The true cost benefit of test automation is achieved only when the same scripts are executed multiple times. The first execution is very expensive because it includes the one-time cost of the automation tools and 100% of the Test Automation engineer's time. When the scripts are executed again, the cost of test automation declines sharply. The tool has already been purchased and the scripts have already been coded. If there have been changes in the application, the scripts may require maintenance before being executed. Maintenance on minor software updates should be minimal.
Because test automation is only successful when the scripts can be executed multiple times, only application which require the same test cases to be executed with the same data are good candidates for automation. For example, a mortgage application that needs to be regression tested on a weekly basis could be a good candidate for test automation. Script maintenance is minimal and the scripts can enter a mortgage application using the same group of test data in a fraction of the time it would take a manual tester to test the same functionality.
On the other hand, a mortgage origination system, which cannot use the same test data for each iteration would not be a good automation candidate. Due to the nature of mortgage systems, data could be staged in various states of approval or rejection, based on the current data and the departments who have already processed their part of the mortgage application. If the script cannot easily figure out what data to enter in the software, it is not a good automation candidate.
Another problem with automating this type of complex system is that the test environment often contains a sampling of production data that is refreshed on a periodic basis. Sometimes this can be overcome by rebuilding the test data when the test environment is refreshed. The feasibility of rebuilding test data on a regular basis depends on the complexity of the application. You will have to make that decision on a case-by-case basis.
Application or Environmental Stability
Environmental stability is crucial to a successfully automating a software testing project. Scripts cannot be coded in a timely manner if the application environment is unavailable, experiences frequent down-times, or excessive defects and errors.
Little or No Application or Environment Downtime
It takes longer to write scripts than it does to manually test the same functionality. Most automation tools are watered down version of C or Visual Basic, which means that writing automated scripts is essentially programming and takes adequate time and specialized skills. Unlike manual test cases, which can sometimes be written based off requirements and mock-ups, automated tools require the actual application. When a test environment is unavailable, automation engineers cannot create scripts, which prolongs the project and ends up costing more.
Excessive downtime can consist of any of the following:
Unstable Environment
Lack of Infrastructure Support
Frequent Application Updates
Buggy Code
Effects of Environment Instability on Script Development and Execution
When an application or environment is unstable, scripting progress is dramatically slowed or stopped altogether. In some cases, it's possible to continue scripting, but this may causes more work at a later date. For example, if you are scripting in buggy code, you may have to script around error messages and the scripts will have to be revised at a later date. Or, you may only be able to create scripts to a certain point and finish them at a later date. To help avoid and decrease environment instability, read the chapter on Service Level Agreements.
Timely Defect Fixes
Application defects do not have to be detrimental to an automated software testing project. When defects are fixed in a timely manner, scripting can continue without significant downtime. When estimating an automated testing project, it's always best to add some buffer time that will accommodate for defect reporting and revisions.
When defect fixes take an excessive amount of time to resolve and are causing the automated software testing project to be delayed, it's time to pull together a meeting. Invite all the major players and discuss the root of the problem and what everyone can to improve the situation. Maybe development is spending too much time trying to reproduce the problem and having your automation team enter better description would help them turn the defect fixes around faster. Maybe you can work together to classify defects and establish reasonable fix times for each classification. For example, a Critical defect needs to be fixed that day while a High defect needs to be fixed with in 24 hours.
Responsive Contact Person
When your team takes on a new automated testing project, you will need a contact person. This person is responsible for making sure you have the business requirements and answering questions about how the application works. This will not be his or her main job, so you will need to make sure he or she is responsive. If you cannot get adequate business requirements, test data, or questions answered, your automation project will not be successful.
Copyright 2004. Danna Henderson. All Rights Reserved.
Danna Henderson has helped many organizations automate their software testing with WinRunner. For information on creating robust, data driven scripts, and successful automated testing, visit WinRunner Experts.
|
|
|
What Is Fleet Maintenance Software?
Simply put, fleet maintenance allows companies to monitor and maintain their fleets of commercial vehicles more efficiently.Fleet maintenance requires a great deal of organization and management skills. Thousands upon thousands of commercial vehicles travel U.S. roadways each day. Most of the companies that use vehicles for commercial purposes need a way to track and manage the various aspects of their usage. Managing maintenance and repairs, creating fueling budgets and monitoring other costs related to vehicle usage are a few of the responsibilities that rest upo...(related: Software)
Netstat - Linux Command To Display Networking Information
In linux, one of great commands for finding out information about your network connections is "netstat". It provides you interface information, statistics, connections, and a lot of other really great information about your computer.There are many intricate commands that you can use with this program, and I won't be discussing all of them. If you would like a full review of the program, check your man or info files for more information. Below I will discuss the basic and most commonly used commands with netstat.netstat -i (interface)This command will give you an overview of networking on your PC. It will give you your local loopback (lo) and any ...(related: Software)
Linux Dual Boot-how To Format
Just the thought of a duel-boot scares many people away, but over the years it's developed into an easier process. Most people are running Windows, so I'm assuming it's your choice o...(related: Software)
Microsoft Crm Integration With Microsoft Office Documents ? Overview For System Integrator
Microsoft CRM is CRM application, maintained and supported by Microsoft Business Solutions. Microsoft CRM utilizes majority of the Microsoft technologies: Windows Active Directory, SQL Server, MS Exchange, BizTalk (integration with MS Great Plains, and soon with Navision), Message Queuing, .Net web services to name a few. There is market demand on the efficient integration of MS Office documents into Microsoft C...(related: Software)
Data Quality Best Practices For Salesforce.com
Executive SummaryAn effective plan for entering, cleaning and updating the data for your salesforce.com (SFDC) system is critical for achieving success with SFDC. According t...(related: Software)
About Microsoft Sysprep (system Preparation) Utility (windows 2000)
The Microsoft system preparation utility for Windows 2000 is a very handy tool for network support shops that deploy PC images as a means of reformatting PC's with problems. Sysprep basically strips out all the hardware information and unique information from that specific PC, which allows you to deploy the image created from that PC on to many other PC's with different hardware configurations.Not only does this program remove the unique information from each PC, but it allows you to do many configuration options automatically. For instance you can setup the workgroup or domain, organization name, computer name, default display size, and a whole lot more.The Sysprep utility finds all it's configuration information in one relatively simple .inf file. Which for the most part follows the below example in terms of...(related: Software)
The Xp Firewall Isnt Enough
You might think you don't need a firewall because windows XP has onebuilt in,but read on for a plain-english explanation why this isn't enough.Before broadband and cable connections were common most people didn't need apersonal firewall because they weren't connected to the Internet for extendedperiods of time.Every computer that connects to the internet has an IP address. This is likea sort of phone number, and is issued either to an individual computer or toa "gateway" that connects a private network to the 'net.Domestic dial-up internet connections normally use a system called DynamicIP Addressing where people are issued with a sort of "new identity" everytime they connect, so it's difficu...(related: Software)
A Guide To Purchasing Professional Xp Icons Online And Enhancing Your Applications
Icons are used everywhere; right from software applications, to internet browsers, to operating systems to websites and even in print media. But businesses have to waste a good deal of money and time in manufacturing icons on their own. Professional icons are tough to create and need expertise in terms of creative artists, lots of ti...(related: Software)
Spyware Statistics -- Whats New In May 2005?
Although statistics often is blamed for various deadly sins -- from being biased to being inaccurate -- there is nothing left to those who are anyhow connected with IT but to keep up with fresh data. Since spyware is literally ubiquitous, nobody who owns or uses a PC can say that it is none of his business. So general public also has to keep an eye on the news about spyware.On May 3 Webroot Software, a privately held anti-spyware company based in Boulder, Colorado, released a comprehensive...(related: Software)
Microsoft Crm Usa Nationwide Remote Support
Remember old good days when your company probably had Great Plains Dynamics? If you are in San Francisco Bay Area ? you had local Great Plains Software partner consulting company, who served you basically coming onsite and charging you four hours minimum, even if the problem deserved 5-min fix? This was at the end of 20th century and remote support technologies were not very advanced ? Citrix was making good progress and taking market over from Symantec PCAnywhere. Today, when Microsoft Terminal Server and Citrix are remote support standards and IT department uses them to host application server for nation-wide and world-wide users, you should probably be thinking of g...(related: Software)
Microsoft Great Plains Chemicals & Paint Industry Implementation & Customization Notes
Microsoft Great Plains fits to majority of industries, in the case of Chemicals & Paint you should consider implementation with balanced approach of utilizing existing Great Plains standard module and light customization and reporting with Great Plains Dexterity, MS SQL Server stored procedures, Modifier/VBA and direct .Net publishing from Great Plains Company database. Let's consider industry requirements and their implementation in Microsoft Great Plains:? Raw Materials Labeling. Microsoft Great Plains ReportWriter supports Barcode fonts and you can print out barcodes off the inventory control items list. You should modify existing report or create new report ? in the case o...(related: Software)
Erp System Of The Future: Database, Business Logic And Interface
We will base our prognosis on our Microsoft Business Solutions ERP consulting practice: Microsoft Great Plains, Navision, Axapta, MS CRM. Also we've analyzed Oracle products: Oracle Financials, JD Edwards, PeopleSoft, and IBM Lotus Notes Domino. The trends could be seen in both: so-called functional consulting, dealing with overall system implementation and user training and customization ? customization tools, open vs. proprietary technologies, etc. Our ideas are addressed to large corporate business IT departments, because in our opinion these professionals are under the highest pressure to foresee the future and make proper selection decision today.? No more ...(related: Software)
How To Tell You Have Spyware, Ad-ware Or Viruses
Usually, the easiest way to tell you have spyware is because your PC is running at a reduced speed. The other way to check is to hit CTRL+ALT+DELETE and hit task manager (if you have windows service pack 2. If you have before SP2, then this should automatically bring up the task manager).Once the task manager is open, check your running processes under the "Processes" tab. If you see a lot of strange processes running you don't recognize, you likely are infected with spyware, ad-ware or viruses.An example of strange processes would be a fg...(related: Software)
site-map - Copyright © 2008 | Contact Webmaster | All Rights Reserved. | Software