Files
skills/public/testing-performance-testing.html
zeekayandHanzo Dev 9e10c1c10e Each llms index points at the other two
hanzoskills.com/llms.txt now opens with the install line, the API
reference index and the company index, so an agent that lands on any
one of the three can find the rest.

robots.txt claimed 537 documents while llms.txt counts 920. The number
is gone from robots.txt; llms.txt derives it.

public/ is regenerated from scripts/site.py, which it had fallen
behind: the copy-prompt menu and agent bar were in the generator and
not in the committed pages. tests/site.mjs passes against the result.

Co-authored-by: Hanzo Dev <[email protected]>
2026-09-11 00:27:59 -07:00

636 lines
29 KiB
HTML

<!doctype html>
<html lang="en"><head>
<meta charset="utf-8"><meta name="viewport" content="width=device-width,initial-scale=1">
<title>testing-performance-testing</title>
<meta name="color-scheme" content="dark">
<style>
/* Committed to one visual world: a dark instrument panel. No light variant —
the dot field and the hairline rules only read on black, and a naive
inversion would wash both out. Every colour is painted explicitly so the page
never borrows a host background. */
@font-face{font-family:'Zen';src:url('/fonts/Zen-Variable.woff2') format('woff2');font-weight:100 900;font-style:normal;font-display:swap}
@font-face{font-family:'Zen';src:url('/fonts/Zen-Italic-Variable.woff2') format('woff2');font-weight:100 900;font-style:italic;font-display:swap}
@font-face{font-family:'Zen Mono';src:url('/fonts/ZenMono-Variable.woff2') format('woff2');font-weight:100 900;font-style:normal;font-display:swap}
@font-face{font-family:'Zen Mono';src:url('/fonts/ZenMono-Italic-Variable.woff2') format('woff2');font-weight:100 900;font-style:italic;font-display:swap}
@font-face{font-family:'Zen Pixel Square';src:url('/fonts/ZenPixel-Square.woff2') format('woff2');font-style:normal;font-display:swap}
:root{
--ink:#f4f4f2; --soft:#9c9c98; --faint:#6a6a66; --ground:#000; --panel:#0a0a0a;
--line:#232323; --line-hi:#3a3a3a; --accent:#f4f4f2;
--font-zen-sans:'Zen',-apple-system,BlinkMacSystemFont,"Segoe UI",Helvetica,Arial,sans-serif;
--font-zen-mono:'Zen Mono',ui-monospace,"SF Mono",SFMono-Regular,Menlo,Consolas,monospace;
--font-zen-pixel-square:'Zen Pixel Square',monospace;
--mono:var(--font-zen-mono);
--sans:var(--font-zen-sans);
/* Controls are pills and surfaces are soft, as on hanzo.ai. */
--r:999px; --r-soft:14px;
}
*{box-sizing:border-box}
html{-webkit-text-size-adjust:100%}
body{margin:0;background:var(--ground);color:var(--ink);font-family:var(--sans);
font-size:16px;line-height:1.65;-webkit-font-smoothing:antialiased}
.wrap{max-width:60rem;margin:0 auto;padding:0 1.75rem}
/* The dot field. A halftone made of one repeating radial-gradient, faded out
along the diagonal by a mask so it reads as a wave rather than wallpaper. */
/* No overflow clip here: the dot field is inset to the box already, and a clip
would cut off the copy-prompt menu. */
.hero{position:relative;border-bottom:1px solid var(--line)}
.hero::before{content:"";position:absolute;inset:0;
background-image:radial-gradient(var(--line-hi) 1px, transparent 1px);
background-size:7px 7px;
-webkit-mask-image:linear-gradient(115deg,#000 0%,rgba(0,0,0,.55) 38%,transparent 72%);
mask-image:linear-gradient(115deg,#000 0%,rgba(0,0,0,.55) 38%,transparent 72%);
pointer-events:none}
.hero .wrap{position:relative;padding-top:5.5rem;padding-bottom:4rem}
nav{border-bottom:1px solid var(--line)}
nav .in{max-width:60rem;margin:0 auto;padding:1.1rem 1.75rem;display:flex;
justify-content:space-between;align-items:center;gap:1rem}
.brand{font-family:var(--mono);font-size:.85rem;letter-spacing:.14em;
text-transform:uppercase;color:var(--ink);text-decoration:none;
display:inline-flex;align-items:center;gap:.6rem}
.brand i{font-style:normal;color:var(--faint)}
.mark{width:1.15em;height:1.15em;display:block;flex:0 0 auto}
nav a.up{font-family:var(--mono);font-size:.72rem;letter-spacing:.14em;
text-transform:uppercase;color:var(--soft);text-decoration:none}
nav a.up:hover{color:var(--ink)}
h1{font-family:var(--mono);font-size:clamp(2rem,5.4vw,3.4rem);line-height:1.12;
letter-spacing:-.02em;margin:0 0 1.1rem;font-weight:500;text-wrap:balance}
h1 em{font-style:normal;color:var(--faint)}
.lede{color:var(--soft);font-size:1.05rem;max-width:52ch;margin:0 0 2.25rem}
.btns{display:flex;flex-wrap:wrap;gap:.7rem;margin:0 0 .5rem;align-items:center}
.btn{display:inline-flex;align-items:center;gap:.5rem;font-family:var(--mono);
font-size:.72rem;letter-spacing:.14em;text-transform:uppercase;
padding:.8rem 1.4rem;border:1px solid var(--line-hi);border-radius:var(--r);
color:var(--ink);text-decoration:none;background:transparent;cursor:pointer;
line-height:1.2;font-weight:400}
.btn:hover{background:#141414;text-decoration:none;border-color:var(--soft)}
.btn.solid{background:var(--ink);color:#000;border-color:var(--ink)}
.btn.solid:hover{background:#d8d8d4}
.btn .chev{width:.7em;height:.7em;flex:0 0 auto;transition:transform .15s ease}
.btn[aria-expanded="true"] .chev{transform:rotate(180deg)}
/* Copy-prompt selector. Each row copies the prompt for its own target. */
.copy{position:relative;display:inline-flex}
.menu{position:absolute;top:calc(100% + .5rem);left:0;z-index:20;min-width:21rem;
background:var(--panel);border:1px solid var(--line-hi);border-radius:var(--r-soft);
padding:.4rem;display:flex;flex-direction:column;
box-shadow:0 12px 32px rgba(0,0,0,.75)}
.menu[hidden]{display:none}
.mi{display:flex;align-items:center;gap:.7rem;width:100%;text-align:left;
padding:.62rem .8rem;border:0;border-radius:calc(var(--r-soft) - .35rem);
background:transparent;color:var(--ink);font-family:var(--mono);font-size:.76rem;
letter-spacing:.04em;text-decoration:none;cursor:pointer;line-height:1.3;
white-space:nowrap}
.mi:hover,.mi:focus-visible{background:#181818;outline:none}
.mi .mark{width:1.05rem;height:1.05rem;color:var(--soft)}
.mi:hover .mark{color:var(--ink)}
.mi u{margin-left:auto;color:var(--faint);text-decoration:none;font-size:.68rem;
letter-spacing:.1em;text-transform:uppercase}
/* Works-with bar: one scrolling row, name and mark per agent. */
.strip{border-bottom:1px solid var(--line);background:var(--panel)}
.strip .in{max-width:60rem;margin:0 auto;padding:.9rem 1.75rem;display:flex;
align-items:center;gap:1.25rem;font-family:var(--mono);font-size:.72rem;
letter-spacing:.1em;text-transform:uppercase;color:var(--faint)}
.strip b{color:var(--soft);font-weight:400;flex:0 0 auto;
border-right:1px solid var(--line);padding-right:1.25rem;align-self:stretch;
display:flex;align-items:center}
.bar{display:flex;align-items:center;gap:.5rem;flex:1 1 auto;min-width:0;
overflow-x:auto;scrollbar-width:none;scroll-snap-type:x proximity;
-webkit-overflow-scrolling:touch;
-webkit-mask-image:linear-gradient(90deg,#000 calc(100% - 3rem),transparent);
mask-image:linear-gradient(90deg,#000 calc(100% - 3rem),transparent)}
.bar::-webkit-scrollbar{display:none}
.agent{display:inline-flex;align-items:center;gap:.45rem;flex:0 0 auto;
padding:.4rem .85rem;border:1px solid var(--line);border-radius:var(--r);
color:var(--soft);white-space:nowrap;scroll-snap-align:start;
text-decoration:none;background:var(--ground)}
.agent:hover{color:var(--ink);border-color:var(--line-hi);text-decoration:none}
.agent .mark{width:.95rem;height:.95rem}
h2{font-family:var(--mono);font-size:1.1rem;letter-spacing:-.01em;margin:2.75rem 0 .75rem;font-weight:500}
h3{font-size:1rem;margin:2rem 0 .5rem;font-weight:600}
h4,h5,h6{font-size:.94rem;margin:1.5rem 0 .5rem;font-weight:600}
p{margin:0 0 1rem;max-width:70ch}
ul,ol{margin:0 0 1rem;padding-left:1.35rem;max-width:70ch}
li{margin:.22rem 0}
a{color:var(--ink);text-decoration:underline;text-underline-offset:3px;
text-decoration-color:var(--line-hi)}
a:hover{text-decoration-color:var(--ink)}
a:focus-visible{outline:1px solid var(--ink);outline-offset:3px}
code{font-family:var(--mono);font-size:.85em;background:var(--panel);
border:1px solid var(--line);border-radius:5px;padding:.1em .36em}
pre{background:var(--panel);border:1px solid var(--line);padding:1rem 1.1rem;
border-radius:var(--r-soft);overflow-x:auto;margin:0 0 1.25rem}
pre code{background:none;border:0;padding:0;font-size:.82rem;line-height:1.7}
blockquote{margin:0 0 1rem;padding-left:1rem;border-left:1px solid var(--line-hi);color:var(--soft)}
hr{border:0;border-top:1px solid var(--line);margin:2.5rem 0}
table{border-collapse:collapse;width:100%;margin:0 0 1.25rem;font-size:.92rem;
display:block;overflow-x:auto}
th,td{border:1px solid var(--line);padding:.5rem .7rem;text-align:left}
.curl{display:block;background:var(--panel);border:1px solid var(--line);
border-radius:var(--r-soft);padding:.95rem 1.1rem;font-family:var(--mono);
font-size:.8rem;color:var(--soft);overflow-x:auto;margin:0 0 2.5rem;
white-space:pre;line-height:1.9}
.curl b{color:var(--ink);font-weight:400}
.curl i{font-style:normal;color:var(--faint)}
/* index */
#q{width:100%;padding:.85rem 1.2rem;font-family:var(--mono);font-size:.85rem;color:var(--ink);
background:var(--panel);border:1px solid var(--line);border-radius:var(--r);margin:0 0 .6rem}
#q::placeholder{color:var(--faint);text-transform:uppercase;letter-spacing:.1em;font-size:.72rem}
#q:focus{outline:none;border-color:var(--soft)}
#count{color:var(--faint);font-family:var(--mono);font-size:.72rem;letter-spacing:.1em;
text-transform:uppercase;margin:0 0 2rem}
.cat{margin:2.5rem 0 .5rem;font-family:var(--mono);font-size:.7rem;letter-spacing:.16em;
text-transform:uppercase;color:var(--faint);border-bottom:1px solid var(--line);
padding-bottom:.45rem}
.row{display:block;padding:.6rem .9rem;margin:0 -.9rem;border-bottom:1px solid var(--line);
border-radius:var(--r-soft);text-decoration:none}
.row:hover{background:#0a0a0a}
.nm{font-family:var(--mono);font-size:.84rem;color:var(--ink);display:block}
.ds{color:var(--soft);font-size:.9rem;display:block;margin-top:.12rem}
footer{margin-top:4rem;padding:2rem 0 4rem;border-top:1px solid var(--line);
color:var(--faint);font-size:.85rem}
footer a{color:var(--soft)}
.fmap{display:grid;gap:1.75rem;grid-template-columns:repeat(auto-fit,minmax(11rem,1fr));
margin:0 0 2rem;font-size:.85rem}
.fmap b{display:block;font-family:var(--mono);font-size:.68rem;letter-spacing:.16em;
text-transform:uppercase;color:var(--faint);font-weight:400;margin:0 0 .6rem;
border-bottom:1px solid var(--line);padding-bottom:.4rem}
.fmap a{display:inline-block;color:var(--ink);text-decoration:none;margin:.3rem .35rem 0 0}
.fmap a:hover{text-decoration:underline}
.fmap div{color:var(--faint);line-height:1.5}
.fend{border-top:1px solid var(--line);padding-top:1.25rem;font-size:.82rem}
@media (max-width:640px){
.hero .wrap{padding-top:3.25rem;padding-bottom:2.75rem}
.btns{gap:.5rem}
.btn{padding:.75rem 1.15rem;font-size:.68rem}
.copy,.copy .btn{width:100%;justify-content:center}
.menu{left:0;right:0;min-width:0}
.strip .in{flex-direction:column;align-items:flex-start;gap:.6rem;padding:.9rem 1.75rem}
.strip b{border-right:0;padding-right:0}
.bar{width:100%}
}
</style>
<link rel="alternate" type="text/markdown" href="/testing-performance-testing.md">
<link rel="icon" href="/favicon.svg">
<link rel="canonical" href="https://hanzoskills.com/testing-performance-testing">
</head>
<!-- Reading this with a machine? Every page here is also plain markdown.
This one: https://hanzoskills.com/testing-performance-testing.md
Index: https://hanzoskills.com/llms.txt
Corpus: https://hanzoskills.com/all.md
Append .md to any path for the markdown twin. -->
<body>
<nav><div class="in">
<a class="brand" href="/"><svg class="mark" viewBox="0 0 67 67" fill="currentColor" aria-hidden="true"><path d="M22.21 67V44.6369H0V67H22.21Z"/><path d="M66.7038 22.3184H22.2534L0.0878906 44.6367H44.4634L66.7038 22.3184Z"/><path d="M22.21 0H0V22.3184H22.21V0Z"/><path d="M66.7198 0H44.5098V22.3184H66.7198V0Z"/><path d="M66.7198 67V44.6369H44.5098V67H66.7198Z"/></svg> HANZO<i>SKILLS</i></a>
<a class="up" href="/">All skills</a>
</div></nav>
<div class="wrap">
<h1>testing-performance-testing</h1><p class="lede">Measure system performance under load (response time, throughput)</p><h1>Performance Testing</h1>
<h2>When to Use This Skill</h2>
<p>Use this skill when you need to:</p>
<ul><li>Measure system performance under load (response time, throughput)</li><li>Identify bottlenecks in applications and APIs</li><li>Verify service level objectives (SLOs) and SLAs</li><li>Test scalability and capacity limits</li><li>Simulate realistic user behavior patterns</li><li>Benchmark before and after optimizations</li><li>Plan infrastructure capacity and scaling strategies</li></ul>
<p><strong>ACTIVATE THIS SKILL</strong>: When validating performance requirements, optimizing systems, or planning capacity</p>
<h2>Core Concepts</h2>
<h3>Types of Performance Tests</h3>
<p><strong>Load Testing</strong>: Normal expected load</p>
<ul><li>Goal: Verify system handles typical traffic</li><li>Example: 1,000 concurrent users, sustained for 1 hour</li><li>Metrics: Response time, throughput, error rate</li></ul>
<p><strong>Stress Testing</strong>: Beyond normal capacity</p>
<ul><li>Goal: Find breaking point</li><li>Example: Gradually increase to 10,000 users</li><li>Metrics: When does system start failing?</li></ul>
<p><strong>Spike Testing</strong>: Sudden traffic surge</p>
<ul><li>Goal: Handle sudden spikes (flash sales, viral content)</li><li>Example: 100 → 5,000 users in 30 seconds</li><li>Metrics: Recovery time, error rate during spike</li></ul>
<p><strong>Soak Testing</strong>: Sustained load over time</p>
<ul><li>Goal: Detect memory leaks, resource exhaustion</li><li>Example: 1,000 users for 24 hours</li><li>Metrics: Memory usage, connection pool exhaustion</li></ul>
<p><strong>Scalability Testing</strong>: System scales with resources</p>
<ul><li>Goal: Verify horizontal/vertical scaling</li><li>Example: 1 server → 5 servers, does throughput 5x?</li><li>Metrics: Throughput per server, efficiency</li></ul>
<h3>Key Metrics</h3>
<p><strong>Response Time</strong>:</p>
<ul><li>p50 (median): 50% of requests faster than this</li><li>p95: 95% of requests faster (typical SLO)</li><li>p99: 99% of requests faster (outlier detection)</li><li>Max: Slowest request (can indicate issues)</li></ul>
<p><strong>Throughput</strong>:</p>
<ul><li>Requests per second (RPS)</li><li>Transactions per minute (TPM)</li><li>Data transferred (MB/s)</li></ul>
<p><strong>Error Rate</strong>:</p>
<ul><li>HTTP errors (4xx, 5xx)</li><li>Timeouts</li><li>Connection failures</li></ul>
<p><strong>Resource Utilization</strong>:</p>
<ul><li>CPU usage (%)</li><li>Memory usage (MB/GB)</li><li>Network I/O (MB/s)</li><li>Disk I/O (IOPS)</li></ul>
<h3>Performance Testing Tools</h3>
<p><strong>k6</strong> (Recommended, modern):</p>
<ul><li>JavaScript-based test scripts</li><li>Great developer experience</li><li>Real-time metrics</li><li>Cloud and local execution</li></ul>
<p><strong>Locust</strong> (Python-based):</p>
<ul><li>Python test scripts</li><li>Web-based UI</li><li>Distributed load generation</li><li>Easy to extend</li></ul>
<p><strong>JMeter</strong> (Java-based, legacy):</p>
<ul><li>GUI-based test creation</li><li>Wide protocol support</li><li>Large ecosystem</li><li>Heavy and complex</li></ul>
<p><strong>Apache Bench (ab)</strong> (Simple CLI):</p>
<ul><li>Quick one-liners</li><li>Basic load testing</li><li>No scripting required</li><li>Limited features</li></ul>
<h2>Patterns</h2>
<h3>Basic Load Test (k6)</h3>
<pre><code class="lang-javascript">// load-test.js
import http from &#x27;k6/http&#x27;;
import { check, sleep } from &#x27;k6&#x27;;
// Test configuration
export const options = {
stages: [
{ duration: &#x27;2m&#x27;, target: 100 }, // Ramp up to 100 users
{ duration: &#x27;5m&#x27;, target: 100 }, // Stay at 100 users
{ duration: &#x27;2m&#x27;, target: 0 }, // Ramp down
],
thresholds: {
http_req_duration: [&#x27;p(95)&lt;500&#x27;], // 95% of requests &lt; 500ms
http_req_failed: [&#x27;rate&lt;0.01&#x27;], // Error rate &lt; 1%
},
};
// Test scenario
export default function () {
// Test homepage
const res = http.get(&#x27;https://api.example.com/&#x27;);
check(res, {
&#x27;status is 200&#x27;: (r) =&gt; r.status === 200,
&#x27;response time &lt; 500ms&#x27;: (r) =&gt; r.timings.duration &lt; 500,
});
sleep(1); // Think time between requests
}</code></pre>
<pre><code class="lang-bash"># Run test
k6 run load-test.js
# Output:
# ✓ status is 200
# ✓ response time &lt; 500ms
#
# http_req_duration..........: avg=234ms min=102ms med=215ms max=876ms p(95)=456ms
# http_req_failed............: 0.12%
# http_reqs..................: 45000 (150/s)
# vus........................: 100</code></pre>
<h3>API Load Test with Authentication</h3>
<pre><code class="lang-javascript">// api-load-test.js
import http from &#x27;k6/http&#x27;;
import { check } from &#x27;k6&#x27;;
export const options = {
stages: [
{ duration: &#x27;1m&#x27;, target: 50 },
{ duration: &#x27;3m&#x27;, target: 50 },
{ duration: &#x27;1m&#x27;, target: 0 },
],
};
// Setup: Run once before test
export function setup() {
// Authenticate and get token
const loginRes = http.post(&#x27;https://api.example.com/auth/login&#x27;, {
username: &#x27;[email protected]&#x27;,
password: &#x27;testpass123&#x27;,
});
const token = loginRes.json(&#x27;access_token&#x27;);
return { token };
}
// Main test
export default function (data) {
const headers = {
&#x27;Authorization&#x27;: `Bearer ${data.token}`,
&#x27;Content-Type&#x27;: &#x27;application/json&#x27;,
};
// GET request
const getRes = http.get(&#x27;https://api.example.com/api/users&#x27;, { headers });
check(getRes, {
&#x27;GET status 200&#x27;: (r) =&gt; r.status === 200,
&#x27;GET has users&#x27;: (r) =&gt; r.json(&#x27;users&#x27;).length &gt; 0,
});
// POST request
const payload = JSON.stringify({
name: &#x27;Test User&#x27;,
email: `user-${__VU}-${__ITER}@example.com`,
});
const postRes = http.post(&#x27;https://api.example.com/api/users&#x27;, payload, { headers });
check(postRes, {
&#x27;POST status 201&#x27;: (r) =&gt; r.status === 201,
&#x27;POST returns ID&#x27;: (r) =&gt; r.json(&#x27;id&#x27;) !== null,
});
}</code></pre>
<h3>Stress Test (Find Breaking Point)</h3>
<pre><code class="lang-javascript">// stress-test.js
import http from &#x27;k6/http&#x27;;
import { check } from &#x27;k6&#x27;;
export const options = {
stages: [
{ duration: &#x27;2m&#x27;, target: 100 }, // Normal load
{ duration: &#x27;5m&#x27;, target: 100 },
{ duration: &#x27;2m&#x27;, target: 200 }, // Increase load
{ duration: &#x27;5m&#x27;, target: 200 },
{ duration: &#x27;2m&#x27;, target: 300 }, // Further increase
{ duration: &#x27;5m&#x27;, target: 300 },
{ duration: &#x27;2m&#x27;, target: 400 }, // Push to limits
{ duration: &#x27;5m&#x27;, target: 400 },
{ duration: &#x27;10m&#x27;, target: 0 }, // Recovery
],
thresholds: {
http_req_duration: [&#x27;p(99)&lt;1000&#x27;],
http_req_failed: [&#x27;rate&lt;0.05&#x27;],
},
};
export default function () {
const res = http.get(&#x27;https://api.example.com/heavy-endpoint&#x27;);
check(res, {
&#x27;status is 200&#x27;: (r) =&gt; r.status === 200,
});
}
// Analyze output to find where error rate spikes
// Example: System stable at 300 users, errors at 400+ → Capacity is ~300 users</code></pre>
<h3>Spike Test (Sudden Traffic)</h3>
<pre><code class="lang-javascript">// spike-test.js
export const options = {
stages: [
{ duration: &#x27;10s&#x27;, target: 100 }, // Normal traffic
{ duration: &#x27;1m&#x27;, target: 100 },
{ duration: &#x27;10s&#x27;, target: 1400 }, // SPIKE! 14x increase
{ duration: &#x27;3m&#x27;, target: 1400 }, // Sustained spike
{ duration: &#x27;10s&#x27;, target: 100 }, // Recovery
{ duration: &#x27;3m&#x27;, target: 100 },
{ duration: &#x27;10s&#x27;, target: 0 },
],
};
export default function () {
http.get(&#x27;https://api.example.com/&#x27;);
}
// Key metric: How quickly does error rate drop after spike?
// Good system: Errors during spike, recovers within 30s
// Bad system: Errors persist after spike ends (resource exhaustion)</code></pre>
<h3>Soak Test (Endurance)</h3>
<pre><code class="lang-javascript">// soak-test.js
export const options = {
stages: [
{ duration: &#x27;5m&#x27;, target: 100 }, // Ramp up
{ duration: &#x27;24h&#x27;, target: 100 }, // Sustained load for 24 hours
{ duration: &#x27;5m&#x27;, target: 0 }, // Ramp down
],
};
export default function () {
http.get(&#x27;https://api.example.com/&#x27;);
}
// Monitor system metrics over 24 hours:
// - Memory usage: Should be stable (not climbing)
// - Response time: Should remain consistent
// - Error rate: Should stay low
// - DB connections: Should not exhaust pool</code></pre>
<h2>Examples by Tool</h2>
<h3>Locust (Python)</h3>
<pre><code class="lang-python"># locustfile.py
from locust import HttpUser, task, between
class WebsiteUser(HttpUser):
wait_time = between(1, 3) # Wait 1-3s between requests
def on_start(self):
&quot;&quot;&quot;Run once per user on start&quot;&quot;&quot;
# Login
self.client.post(&quot;/auth/login&quot;, json={
&quot;username&quot;: &quot;[email protected]&quot;,
&quot;password&quot;: &quot;testpass123&quot;
})
@task(3) # Weight: 3x more likely than other tasks
def view_homepage(self):
self.client.get(&quot;/&quot;)
@task(2)
def view_product(self):
product_id = random.randint(1, 100)
self.client.get(f&quot;/products/{product_id}&quot;)
# Add to cart
self.client.post(f&quot;/cart/add&quot;, json={
&quot;product_id&quot;: product_id,
&quot;quantity&quot;: 1
})
@task(1)
def checkout(self):
# View cart
self.client.get(&quot;/cart&quot;)
# Checkout
self.client.post(&quot;/checkout&quot;, json={
&quot;payment_method&quot;: &quot;credit_card&quot;
})
# Run:
# locust -f locustfile.py --host=https://api.example.com
# Open http://localhost:8089 (Web UI)</code></pre>
<h3>Apache Bench (Quick Tests)</h3>
<pre><code class="lang-bash"># Simple load test: 1000 requests, 10 concurrent
ab -n 1000 -c 10 https://api.example.com/
# With POST data
ab -n 1000 -c 10 -p data.json -T application/json https://api.example.com/api/users
# With authentication
ab -n 1000 -c 10 -H &quot;Authorization: Bearer TOKEN&quot; https://api.example.com/protected
# Output:
# Requests per second: 150.23 [#/sec] (mean)
# Time per request: 66.566 [ms] (mean)
# Time per request: 6.657 [ms] (mean, across all concurrent requests)
# Transfer rate: 245.67 [Kbytes/sec] received
#
# Percentage of requests served within a certain time (ms)
# 50% 62
# 66% 68
# 75% 73
# 80% 76
# 90% 85
# 95% 95
# 98% 105
# 99% 112
# 100% 234 (longest request)</code></pre>
<h3>JMeter (GUI-based)</h3>
<pre><code class="lang-xml">&lt;!-- test-plan.jmx (simplified) --&gt;
&lt;?xml version=&quot;1.0&quot; encoding=&quot;UTF-8&quot;?&gt;
&lt;jmeterTestPlan version=&quot;1.2&quot;&gt;
&lt;hashTree&gt;
&lt;TestPlan&gt;
&lt;stringProp name=&quot;TestPlan.comments&quot;&gt;API Load Test&lt;/stringProp&gt;
&lt;boolProp name=&quot;TestPlan.functional_mode&quot;&gt;false&lt;/boolProp&gt;
&lt;boolProp name=&quot;TestPlan.serialize_threadgroups&quot;&gt;false&lt;/boolProp&gt;
&lt;ThreadGroup guiclass=&quot;ThreadGroupGui&quot;&gt;
&lt;stringProp name=&quot;ThreadGroup.num_threads&quot;&gt;100&lt;/stringProp&gt;
&lt;stringProp name=&quot;ThreadGroup.ramp_time&quot;&gt;60&lt;/stringProp&gt;
&lt;stringProp name=&quot;ThreadGroup.duration&quot;&gt;300&lt;/stringProp&gt;
&lt;HTTPSamplerProxy&gt;
&lt;stringProp name=&quot;HTTPSampler.domain&quot;&gt;api.example.com&lt;/stringProp&gt;
&lt;stringProp name=&quot;HTTPSampler.port&quot;&gt;443&lt;/stringProp&gt;
&lt;stringProp name=&quot;HTTPSampler.protocol&quot;&gt;https&lt;/stringProp&gt;
&lt;stringProp name=&quot;HTTPSampler.path&quot;&gt;/api/users&lt;/stringProp&gt;
&lt;stringProp name=&quot;HTTPSampler.method&quot;&gt;GET&lt;/stringProp&gt;
&lt;/HTTPSamplerProxy&gt;
&lt;/ThreadGroup&gt;
&lt;/TestPlan&gt;
&lt;/hashTree&gt;
&lt;/jmeterTestPlan&gt;</code></pre>
<pre><code class="lang-bash"># Run JMeter test (command line)
jmeter -n -t test-plan.jmx -l results.jtl -e -o report/
# Generate HTML report
jmeter -g results.jtl -o report/</code></pre>
<h2>Interpreting Results</h2>
<h3>Good Performance Profile</h3>
<pre><code>Metrics:
p50: 120ms (median response time)
p95: 350ms (95th percentile)
p99: 580ms (99th percentile)
max: 1.2s (outliers exist but rare)
error rate: 0.05%
Analysis: ✅
- Most requests fast (p50 = 120ms)
- Tail latency acceptable (p95 &lt; 500ms)
- Very few errors
- System is stable</code></pre>
<h3>Warning Signs</h3>
<pre><code>Metrics:
p50: 800ms (median slow)
p95: 5.2s (tail latency very high)
p99: 12s (extremely slow)
max: 30s (timeouts)
error rate: 3.5%
Analysis: ⚠️
- Median response time too high
- Wide gap between p50 and p95 (inconsistent performance)
- High error rate
- Likely bottleneck (database? cache? CPU?)
Action:
1. Profile application (find slow queries, hot code paths)
2. Check resource utilization (CPU, memory, DB connections)
3. Review logs for errors
4. Consider scaling or optimization</code></pre>
<h3>Identifying Bottlenecks</h3>
<p><strong>Database Bottleneck</strong>:</p>
<pre><code>Symptoms:
- Response time increases linearly with load
- DB CPU/connections maxed out
- Application CPU low
Solution:
- Add database indexes
- Optimize slow queries
- Add read replicas
- Implement caching</code></pre>
<p><strong>CPU Bottleneck</strong>:</p>
<pre><code>Symptoms:
- Response time increases with load
- CPU usage 90-100%
- Queue depth increases
Solution:
- Optimize hot code paths
- Add horizontal scaling
- Use caching
- Offload to background jobs</code></pre>
<p><strong>Memory Bottleneck</strong>:</p>
<pre><code>Symptoms:
- Performance degrades over time
- Memory usage climbs
- GC pauses increase
Solution:
- Fix memory leaks
- Increase memory
- Optimize data structures</code></pre>
<p><strong>Network Bottleneck</strong>:</p>
<pre><code>Symptoms:
- High latency but low CPU/memory
- Network throughput maxed
- Large response payloads
Solution:
- Compress responses
- Reduce payload size
- CDN for static assets
- Upgrade network capacity</code></pre>
<h2>Checklist</h2>
<p><strong>Before Performance Testing</strong>:</p>
<ul><li>[ ] Define performance goals (SLOs: p95 &lt; 500ms, error &lt; 1%)</li><li>[ ] Identify critical user journeys to test</li><li>[ ] Set up monitoring (APM, logs, metrics)</li><li>[ ] Create test environment (production-like)</li><li>[ ] Prepare test data (realistic dataset)</li></ul>
<p><strong>Running Tests</strong>:</p>
<ul><li>[ ] Start with baseline (low load)</li><li>[ ] Gradually increase load (ramp up)</li><li>[ ] Monitor system metrics (CPU, memory, DB)</li><li>[ ] Record results (response times, errors)</li><li>[ ] Test recovery (ramp down, verify cleanup)</li></ul>
<p><strong>Analyzing Results</strong>:</p>
<ul><li>[ ] Check p50, p95, p99 response times</li><li>[ ] Verify error rate within threshold</li><li>[ ] Identify bottlenecks (CPU, DB, network)</li><li>[ ] Compare to SLOs/SLAs</li><li>[ ] Document findings and recommendations</li></ul>
<p><strong>After Testing</strong>:</p>
<ul><li>[ ] Share results with team</li><li>[ ] Prioritize optimizations</li><li>[ ] Retest after improvements</li><li>[ ] Update capacity plans</li><li>[ ] Set up continuous performance monitoring</li></ul>
<h2>Anti-Patterns</h2>
<pre><code>❌ NEVER: Test in production without preparation
→ Risk of actual outages
❌ NEVER: Test with unrealistic data (empty DB)
→ Results not representative
❌ NEVER: Only test happy path
→ Miss error handling performance
❌ NEVER: Ignore tail latency (p95, p99)
→ Bad experience for some users
❌ NEVER: Test from single location
→ Miss geographic latency issues
❌ NEVER: Skip monitoring during tests
→ Can&#x27;t identify bottlenecks
❌ NEVER: Run tests without baseline
→ No comparison for improvements</code></pre>
<h2>Related Skills</h2>
<p><strong>Foundation</strong>:</p>
<ul><li><code>unit-testing-patterns.md</code> - Testing individual components</li><li><code>integration-testing.md</code> - Testing service interactions</li></ul>
<p><strong>Performance</strong>:</p>
<ul><li><code>profiling-applications.md</code> - Finding performance bottlenecks</li><li><code>database-optimization.md</code> - Optimizing queries and indexes</li><li><code>caching-strategies.md</code> - Reducing load with caching</li></ul>
<p><strong>Monitoring</strong>:</p>
<ul><li><code>observability-patterns.md</code> - Metrics, logs, traces</li><li><code>alerting-strategies.md</code> - Performance alerts</li></ul>
<p><strong>Tools</strong>:</p>
<ul><li>k6: Modern, developer-friendly load testing</li><li>Locust: Python-based, distributed testing</li><li>JMeter: Java-based, comprehensive</li><li>Apache Bench: Quick CLI tests</li><li>Artillery: Node.js-based load testing</li></ul>
<footer>
<div class="fmap">
<div><b>Build</b>
<a href="https://hanzo.app">hanzo.app</a> app builder
<a href="https://hanzo.codes">hanzo.codes</a> code with an agent
<a href="https://hanzoskills.com">hanzoskills.com</a> what an agent reads</div>
<div><b>Run</b>
<a href="https://console.hanzo.ai">console.hanzo.ai</a> cloud console
<a href="https://api.hanzo.ai">api.hanzo.ai</a> the API</div>
<div><b>Account</b>
<a href="https://hanzo.id">hanzo.id</a> sign in
<a href="https://pay.hanzo.ai">pay.hanzo.ai</a> top up
<a href="https://billing.hanzo.ai">billing.hanzo.ai</a> invoices and usage</div>
<div><b>Company</b>
<a href="https://hanzo.ai">hanzo.ai</a> canonical
<a href="https://hanzo.ventures">hanzo.ventures</a> ventures</div>
</div>
<div class="fend"><a href="/testing-performance-testing.md">This page as plain text</a> · <a href="/llms.txt">Index for agents</a></div>
</footer>
</div></body></html>