Load Testing is primarily concerned with assessing the current performance of your system in terms of concurrent users or requests per second.
When you want to understand if your system is meeting the performance goals, this is the type of test you'll run.
What is Load Testing
Load Testing is a type of Performance Testing used to determine a system's behavior under both normal and peak conditions.
Load Testing is used to ensure that the application performs satisfactorily when many users access it at the same time.
You should run Load Test to:
- Assess the current performance of your system under typical and peak load.
- Make sure you are continuously meeting the performance standards as you make changes to your system (code and infrastructure).
You probably have some understanding about the amount of traffic your system is seeing on average and during peak hours. This information will be useful when deciding what your performance goals should be, in other words, how to configure the performance thresholds.
Let's say you're seeing around 60 concurrent users on average and 100 users during the peak hours of operation.
It's probably important to you to meet the performance goals both during normal hours and peak hours, therefore it's recommended to configure the load test with the high load in mind - 100 users in this case.
Note, this test has one simple threshold. The response time for 99% requests must be below 1.5 seconds. Thresholds are a way of ensuring that your system is meeting the performance goals you set for it.
This is a rather simple script that authenticates the user, and retrieves list of objects. If you would like to see a more comprehensive test that makes use of groups, checks, thresholds, helper functions, see our examples section.
Note that the number of users starts at 0, and slowly ramps up to the nominal value, where it stays for an extended period of time. The ramp down stage is optional.
We recommend you to always include a ramp-up stage in all your Load Tests because:
- it allows your system to warm up or auto scale to handle the traffic
- it allows you to compare the response time between the low-load and nominal-load stages.
- If you run a load test using the SaaS cloud service, it allows the automated performance alerts to better understand the normal behaviour of your system.
You may also go one step further and configure the load test to resemble more closely your normal and peak conditions. In that case you could configure the load test to stay at 60 users for most of the day, and ramp-up to 100 users during the peak hours of operation, then ramp-down back to normal load.
Make sure you don't go over your normal number of VUs - that's not load testing, it's stress testing.
The VU chart for the above configuration should look like this:
k6 is very flexible in simulating the ramp-up/ramp-down scenarios.
Whenever you are load testing, you have some expectations in mind.
Typical expectations are:
- 99% of requests should finish within 5 seconds.
- 95% of requests should finish within 1 second.
- 99% users should be able to login successfully on the first try
Performance thresholds are a way to describe your expectations in a formal way, and automatically evaluate those expectations on each test run. Once you have configured the thresholds you'll see a Pass/Fail metric for each threshold, and you will know immediately if your system fulfills your expectations without analyzing the results in details.
If this is your first time running load tests, start small. Your application and infrastructure might not be as rock solid as you think. We've had thousands of users run load tests that quickly crashed their applications (or staging environments).
If your system crashes under a load test, it means that your load test has morphed into a stress test, which is the next type we're covering.