Performance Testing Links

Performance Testing Links:

Articles:

http://www.perftestplus.com/pubs.htm

http://www.ibm.com/developerworks/rational/library/4169.html

http://www.acutest.co.uk/performance-testing.html

http://dev2dev.bea.com/pub/a/2005/09/performance_testing.html

http://www.ibm.com/developerworks/rational/library/4169.html

http://www.devbistro.com/articles/Testing/Performance-Testing-Load-Testing

http://www.methodsandtools.com/archive/archive.php?id=38

http://dev2dev.bea.com/pub/a/2006/08/jmeter-performance-testing.html

http://www.softdevarticles.com/modules/weblinks/viewcat.php?cid=36

http://www.software-risk.co.uk/cont383.htm

http://www.informit.com/articles/article.aspx?p=391645&rl=1

http://www.logigear.com/resources/article_links_-_test_types/load_performance.asp

http://www.stickyminds.com/sitewide.asp?ObjectType=ART&ObjectId=2956&function=edetail

http://www.testinggeek.com/perf.asp

http://www.wrox.com/WileyCDA/Section/id-291625.html

http://www.opensourcetesting.org/performance.php

http://searchsoftwarequality.techtarget.com/sDefinition/0,,sid92_gci1259932,00.html

http://www.codeplex.com/PerfTesting/Wiki/View.aspx?title=How%20To%3a%20Load%20Test%20Web%20Applications&referringTitle=Load%20Testing

http://www.usabilitynet.org/tools/testing.htm


Automation Tools:

Load Runner:

http://loadrunnertnt.com/

http://www.loadtester.com/lr9simulateparam.php

http://objectmix.com/software-testing/313472-loadrunner-tnt-new-article-library.html

Silk Performer:

http://support.borland.com/kbshow.php?q=28318

http://www.crn.com/software/159400681

Comparison on Performance tools

Recently We get a chance to taste the two flavors in performance automation tools as you all know, None other than the two world wide competitors Load runner(HP) and Silk Performer(Borland) :-)

Here we identified few features that are identical and unique in both tools. First let me list out Unique features in SilkPerformer and Loadrunner

Unique features for Silk Performer:

A load test is begun by creating a project that automatically keeps all information belonging to that project in a single project directory. So locating items associated with a certain project (e.g., scripts and test results) is easy and efficient.

-It is handling the load test in a sequence manner.
-It allows various profiles for different set of settings in project.
-We can set timers under transactions.
-We have to use try script (Reply) to make error free confirmation to proceed further.
-True log explorer is kind of visual scripting; through this we can customize correlation, parameterization, and content verification.
-It would not allow us into load test without finding the base line.
-With in a project, for every load test a result directory for each run is created.
-We can create our own behavior of end users.
-Root cause diagnostics, and code performance monitoring.
-We can generate the script in the middle of recording.
- Optical Character Recognition capabilities.
SP provide Optical Character Recognition (OCR) capabilities for text displayed in the Citrix client GUI.

Unique features for LoadRunner:

Two options for Error Logs:
Standard: When you selectStandard log, it creates a standard log of functions and messages sent during script execution to use for debugging. Disable this option for large load testing scenarios.

Extended: Enable this to including warnings and other messages. Disable this option for large load testing scenarios

Two options for Debug Vuser Script i) Run step by step command ii) Break prints.

Identical Features for Silk Performer:

Silk Performer components:
o Work bench
o Silk True log
o Silk Performance Explorer

Load Testing Process:
-configuring projects
-modeling projects
-validating projects
-customizing projects
-establishing base line performance
-define work load
-executing load test
-explore test results

Scripting language is BDL (Business Definition Language).

SP provides serialization or synchronization (Serialization enables you to test the effects of transactions executed one at a time).

Parameterization in Silk Performer.
-Go to customize test
-Create New Parameter wizard by selecting any one of them.
-Constant value.
-Parameter from Random variable.
-Parameter from multi column data file.
-Stress think time is nothing but ignore think time.
-We can use silk test script in Silk performer

Identical Features for Load Runner:

Load Runner components:
o The Vuser Generator
o The Controller
o Analysis

-Load Testing Process:
-Plan Load test
-Create Vuser Scripts
-Define Scenario
-Run a ScenarioAnalyze the Results

Scripting Language is in C or Visual Basic.

LR provides Rendezvous point (Rendezvous enables you to test the effects of transactions executed one at a time).

Parameterization in Load Runner.
Select the string which needs to be parameterized.
Mouse right clicks on string and replace with parameter.Select type of parameter.

Ignore think time is nothing but stress think time in SP.

Tiny parameter to kick start with performance testing

Hope this wll give you more clarity and maturity to widen up your performance testing skills

Before we certify any application performance, have to follow

Satisfied with your own performance or not?
conducting effective performance test or not?
Have we ever thought how to ensure the your performance test strategy
performance test report is bug free?

Obsolutely!..we have to get hold of comfortable in the terminologies used in the performance engineering field . And specifically we need to learn one or two popular and effective performance test tools and develop bottleneck analysis skills.

These are the basic skills required for being a performance tester. Then you are matured enough do performance test and look for how effective . When we talk about effectiveness we need to start looking at Analytical modeling and simulation modeling approaches to move to your next level of expertise.

Another important tips is that, understand the operational laws and start applying those laws in your day to day test activities.

Slowly we have to start learning about Workload Modeling concepts and Statistical distribution fitting and apply those learning's to define performance testing goals/SLAs.

And also we have to concentrate more on Demand planning and Performance prediction techniques. Learn Mean value analysis and Erlang's method.

Lastly we have to learn about Capacity Planning.

Happy reading! Work towards those tips ..and get back to us with your experience..

Performance Analysis and Capacity Planning

Performance Analysis is the monitoring of existing system resource usage to respond to unusual in resource usage or failures. The scope of the analysis is typically a server or individual component at a time, and is a short term, technically oriented activity. This function supports the Capacity Planning and Service Level Management functions, as well as Performance Engineering during development.

Capacity Planning is the projection of future resource requirements based on historical data and growth in system projections. Capacity plans must be concerned with responding to resource needs within budgetary constraints, taking into account cycles in
· Resource demand (e.g., year end, or quarterly),
· Peak periods (e.g., tax time),
· Growth and
· New development,
· Leases and
· Depreciation on equipment.

Performance Analysis:

Performance Analysis is the identification/observation of programs behavior using information gathered according to the program runs (i.e. it is a form of dynamic analysis).

The goal of Performance Analysis is to determine which parts of a program are fully optimized for speed, memory and CPU utilization. Dynamic Code Analysis is the Analysis of computer software that is performed during execution of programs that are built from that software on real or virtual processes. Analysis that is performed during with-out executing programs is known as static analysis, as opposed to dynamic code analysis.

Three basic steps in the performance analysis process:

Data collection
Data transformation
Data visualization

Data collection is the process by which data about application performance are obtained from an executing program. Data are normally collected in a file, either during or after execution, although in some situations it may be presented to the user in real time.

Data transformation involves the processes for selecting, targeting, converting, and mapping data so that it may be used by multiple systems.

Data Visualization is the graphical presentation of information, with the goal of providing the viewer with a qualitative understanding of the information contents.

Capacity planning:

Definition:
Capacity planning is the science and art of estimating the space, computer, software, hardware and network infrastructure resources that will be needed over some future period of time.

Reasons for use:
Ensure that sufficient computing resources are available so that workload can meet their service levels. Provide management with an understanding of where computing resources are being used, that is :
Who is using the system,
For what reasons and,
Where is the growth likely to be?

Benefits:
As with any good planning, Price results are not that much critical, but the process and the discipline giving an understanding of the problem.

When conducting a capacity plan, the organization must understand the characteristics of its production systems, their future requirements and their priorities.

More importantly, Capacity planning helps ensure that seasonal operational peaks which are generally critical to the business can met by the resources.

Conclusion:
Key areas for effective performance analysis and capacity planning:
• Increase awareness about your system environment to minimize potential problems.
• Forecast resource consumption and assess hardware requirements to provide business growth.
• Identify congestion that threatens to cause poor system performance by analyzing your key server parameters.

Performance Testing Conference

It is a way to upgrade ourselves with newest methods, tips and tricks. It happens frequnetly at california. Many people will come and share their diverse experience in various spheres of Performance Testing.

The next software test & performance conference in 2008 spring at sillicon valley, California.
The following link gives the details about it.

http://www.stpcon.com/