OK, go ahead.  Admit it.  You listen to Sirius/XM Radio channels 8 & 9 only.  You haven't noticed who the president is since Bill Clinton left office.  If you haven't had your mid-life crisis--you are thinking about having it soon.  And you still call your test tool Mercury LoadRunner, refusing to acknowledge HP's purchase of Mercury since it happened in the summer 8 years ago.  You want to change but you can't.  Why?  You don't speak the new language.  And that language barrier is stopping you from entering the new world order in performance testing:  Cloud-Based Performance testing.

So, I'm here to help you feel young again.  (And for anyone under 35 who is performance testing any web or mobile application with LoadRunner--shame on you!!  Did you really get into this techncally advanced field to use a tool developed in 1989?)

Now on to your language lesson for today:  Let's translate your 1989 client/server tool terminology for today's web & mobile cloud-based performance testing leader--CloudTest.  The future is here.  Embrace it.

CloudTest and LoadRunner Concepts

The goal of this article is to map familiar concepts within LoadRunner to corresponding similar concepts in SOASTA CloudTest.

Both products require planning before creating performance test cases. The performance engineer needs to understand the system, user experience and business drivers for load testing the system under test. The load test plan needs to identify test cases, Entry and Exit criteria, metrics to be collected, timelines and include a final report.

Terminology Differences

1. An environment in CloudTest is very similar to HP Performance Center; they are both web applications. Both of them perform the job of controlling virtual users for a test scenario, and both require a username and password to access the Performance Center manages and maintains scenarios; LoadRunner controller, the stand-alone solution, also does this. It is done by SOASTA’s repository in CloudTest. One important difference is that the SOASTA CloudTest environment incorporates load test creation; browser-based functional test creation and can serve as a Load Generator, all in one platform.

1. A maestro in CloudTest is the same as a load generator in LoadRunner. In the case of SOASTA CloudTest, a load server can be local machine or it can be in the Deploying load generators in the cloud is cost effective and can simulate traffic from different geographic locations on the Internet. With LoadRunner, load generators are usually deployed locally. A recently announced version of LoadRunner, in conjunction with an HP partner, provides the ability to deploy both controller and load generator in the cloud, but this is still evolving.

1. Analytics Dashboards in CloudTest are similar to performance analysis in LoadRunner.

1. Virtual users in CloudTest are similar to Vusers in LoadRunner.

1. Clips in CloudTest are similar to Vuser scripts in LoadRunner.

1. A Composition in CloudTest is similar to a scenario in LoadRunner. Both composition and scenario determine what should happen in a testing session with details about what test cases should be

Building Scripts,

Loadrunner uses VuGen. VuGen captures all the recorded traffic based upon the type of protocol selected for the test.

With SOASTA CloudTest, recording is integrated in the product and uses an agent called the SOASTA Conductor on the machine from which recording is being done. The Conductor acts as a web proxy for capturing all the http/https traffic when recording.

SOASTA CloudTest has the option of viewing recording in list and icon views.

Correlation

SOASTA CloudTest has a “Session Template Package Wizard” which is somewhat similar to LoadRunner’s “Scan Script for Correlations”, however SOASTA CloudTest scans for name/value pairs and not for differences between recording and playback. The Session Template Package Wizard identifies all dynamic values in the clip and required values can be selected from the UI.

Seed Data

SOASTA CloudTest has a seed data repository, which is similar to LoadRunner’s parameterization functionality, but covering only the parameter type File. Test data can be stored within CloudTest or it can be hosted anywhere accessible by the load generators and used within a clip. Once test data is available, it can be used in a random fashion, as single shot data or unique data for each virtual user. This functionality can be achieved either from the UI or by using JavaScript.

Validation

CloudTest has validation functionality similar to LoadRunner’s “Content Check”. The validations can be done within a clip/script and added for text, HTML, JSON, XML and SOAP. Validations can be done for data within the header or body. The validations can be added for each and every message within a clip. Similar to the content check functionality in LoadRunner, success and failure messages can be added as part of validations.

Collections

CloudTest can group multiple messages or pages as transactions (also known as collections) and metrics can be tracked in the analytics dashboard for a particular transaction. This is similar to the concept of transaction in LoadRunner.

Test Compositions

For creating a test in CloudTest, one or more clips are added to a composition. This is similar to adding vu scripts in a scenario. The composition specifies load servers, number of virtual users, number of iterations, ramp time and duration of the test. This is like adding load generators, building a schedule, specifying duration and ramp up and ramp down for the test in LoadRunner.

Analytics

SOASTA CloudTest has extensive metrics in the analytic dashboards. These dashboards show real-time data, independent of the scale of the test. They are similar to LoadRunner’s performance analysis. SOASTA CloudTest results can be viewed during and after the test execution and results can be exported in csv, xml and doc formats.

Repository

The SOASTA repository stores results from the test. This is similar to the result directory in LoadRunner. The SOASTA repository can be maintained on premise or in the cloud and can accessed over the Internet. In both cases, the client is an Ajax- based browser.

Monitoring

Just like LoadRunner, SOASTA CloudTest has integrated monitors for monitoring system utilization of systems under load. These monitors can be created as web monitors, DB monitors, application server monitors, etc. CloudTest can also integrate monitored data from third party monitoring tools, such as those from New Relic, CA, Amazon, AppDynamics, Correlsense and more, displaying the results in the same real-time dashboards.

Takeaways

So now that you are up to speed on the terminology, let's keep the momentum going.  Go ahead and download our free version of CloudTest, CloudTest Lite -- here.  And while you are at it, let's go ahead and take the extra mile by getting trained and certified.  Find out how here.

Once you are done with that feel free to check out the other 200+ channels on Sirius/XM radio.  And kiss 1989 goodbye!   You deserve it.