Skip to content

typev: use native sha1#735

Open
praisethemoon wants to merge 3 commits into
MDA2AV:mainfrom
praisethemoon:sch/native-sha1
Open

typev: use native sha1#735
praisethemoon wants to merge 3 commits into
MDA2AV:mainfrom
praisethemoon:sch/native-sha1

Conversation

@praisethemoon
Copy link
Copy Markdown
Contributor

Description

Uses C implementation of sha1 instead of vm level implementation.


PR Commands — comment on this PR to trigger (requires collaborator approval):

Command Description
/benchmark -f <framework> Run all benchmark tests
/benchmark -f <framework> -t <test> Run a specific test
/benchmark -f <framework> --save Run and save results (updates leaderboard on merge)

Always specify -f <framework>. Results are automatically compared against the current leaderboard.


Run benchmarks locally

You can validate and benchmark your framework locally with the lite script — no CPU pinning, fixed connection counts, all load generators run in Docker.

./scripts/validate.sh <framework>
./scripts/benchmark-lite.sh <framework> baseline
./scripts/benchmark-lite.sh --load-threads 4 <framework>

Requirements: Docker Engine on Linux. Load generators (gcannon, h2load, h2load-h3, wrk, ghz) are built as self-contained Docker images on first run.

@praisethemoon
Copy link
Copy Markdown
Contributor Author

/benchmark -f typev

@github-actions
Copy link
Copy Markdown
Contributor

👋 /benchmark request received. A collaborator will review and approve the run.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmark Results

Framework: typev | Test: all tests

Test Conn RPS CPU Mem Δ RPS Δ Mem
baseline 512 1,881,075 6583.3% 212MiB -2.0% +1.4%
baseline 4096 1,857,017 6443.6% 280MiB -3.3% -28.2%
pipelined 512 45,677,062 6522.1% 295MiB -5.9% -0.3%
pipelined 4096 47,789,494 6254.7% 451MiB -0.7% +16.5%
limited-conn 512 879,484 4566.1% 236MiB -0.2% -0.8%
limited-conn 4096 1,260,357 6622.7% 325MiB -3.0% -8.2%
json 4096 1,062,449 6520.6% 482MiB +0.6% +19.3%
upload 32 3,072 1917.8% 195MiB -0.4% +1.6%
upload 256 3,009 3655.6% 272MiB +0.3% +2.3%
echo-ws 512 2,806,886 6599.6% 218MiB -2.2% -19.3%
echo-ws 4096 2,949,622 6640.5% 428MiB -2.7% -5.7%
echo-ws 16384 2,999,470 6330.1% 498MiB +2.8% -0.4%
echo-ws-pipeline 512 19,331,296 6432.2% 196MiB +4.1% +0.5%
echo-ws-pipeline 4096 19,128,784 6138.7% 562MiB ~0% +31.3%
echo-ws-pipeline 16384 19,229,965 6277.8% 437MiB +0.4% -64.4%
Full log
  Pipeline:  16
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency    159us    109us    119us    132us    466us

  93247200 frames sent in 5.00s, 93246653 frames received
  Throughput: 18.64M req/s
  Bandwidth:  124.46MB/s
  WS upgrades: 215
  WS frames:   93246653
  Latency samples: 93246336 / 93246653 responses (100.0%)
[info] CPU 6510.1% | Mem 271MiB

=== Best: 19331296 req/s (CPU: 6432.2%, Mem: 196MiB) ===
[info] saved results/echo-ws-pipeline/512/typev.json
httparena-bench-typev
httparena-bench-typev

==============================================
=== typev / echo-ws-pipeline / 4096c (tool=gcannon) ===
==============================================
[info] waiting for server...
[info] server ready

[run 1/3]
gcannon v0.5.3 [WS]
  Target:    localhost:8080/ws
  Threads:   64
  Conns:     4096 (64/thread)
  Pipeline:  16
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency    307us    115us    473us    725us   6.50ms

  95285040 frames sent in 5.00s, 95283824 frames received
  Throughput: 19.05M req/s
  Bandwidth:  127.17MB/s
  WS upgrades: 387
  WS frames:   95283824
  Latency samples: 95283648 / 95283824 responses (100.0%)
[info] CPU 6255.9% | Mem 287MiB

[run 2/3]
gcannon v0.5.3 [WS]
  Target:    localhost:8080/ws
  Threads:   64
  Conns:     4096 (64/thread)
  Pipeline:  16
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency    208us    108us    169us    930us   9.79ms

  95592480 frames sent in 5.00s, 95592272 frames received
  Throughput: 19.11M req/s
  Bandwidth:  127.58MB/s
  WS upgrades: 571
  WS frames:   95592272
  Latency samples: 95592080 / 95592272 responses (100.0%)
  Latency overflow (>5s): 80
[info] CPU 6574.8% | Mem 433MiB

[run 3/3]
gcannon v0.5.3 [WS]
  Target:    localhost:8080/ws
  Threads:   64
  Conns:     4096 (64/thread)
  Pipeline:  16
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency    228us    112us    269us    578us   6.18ms

  95644096 frames sent in 5.00s, 95643924 frames received
  Throughput: 19.12M req/s
  Bandwidth:  127.66MB/s
  WS upgrades: 434
  WS frames:   95643924
  Latency samples: 95643600 / 95643924 responses (100.0%)
[info] CPU 6138.7% | Mem 562MiB

=== Best: 19128784 req/s (CPU: 6138.7%, Mem: 562MiB) ===
[info] saved results/echo-ws-pipeline/4096/typev.json
httparena-bench-typev
httparena-bench-typev

==============================================
=== typev / echo-ws-pipeline / 16384c (tool=gcannon) ===
==============================================
[info] waiting for server...
[info] server ready

[run 1/3]
gcannon v0.5.3 [WS]
  Target:    localhost:8080/ws
  Threads:   64
  Conns:     16384 (256/thread)
  Pipeline:  16
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency    281us    112us    460us    907us   13.50ms

  96155569 frames sent in 5.00s, 96149825 frames received
  Throughput: 19.22M req/s
  Bandwidth:  128.33MB/s
  WS upgrades: 359
  WS frames:   96149825
  Latency samples: 96149825 / 96149825 responses (100.0%)
  Reconnects: 4305
[info] CPU 6277.8% | Mem 437MiB

[run 2/3]
gcannon v0.5.3 [WS]
  Target:    localhost:8080/ws
  Threads:   64
  Conns:     16384 (256/thread)
  Pipeline:  16
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency    339us    114us    468us   3.02ms   19.80ms

  90067984 frames sent in 5.00s, 90048816 frames received
  Throughput: 18.00M req/s
  Bandwidth:  120.22MB/s
  WS upgrades: 1198
  WS frames:   90048816
  Latency samples: 90048816 / 90048816 responses (100.0%)
  Reconnects: 465230
[info] CPU 6257.9% | Mem 999MiB

[run 3/3]
gcannon v0.5.3 [WS]
  Target:    localhost:8080/ws
  Threads:   64
  Conns:     16384 (256/thread)
  Pipeline:  16
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency    285us    108us    240us   1.21ms   13.80ms

  95874192 frames sent in 5.00s, 95851936 frames received
  Throughput: 19.16M req/s
  Bandwidth:  127.97MB/s
  WS upgrades: 1391
  WS frames:   95851936
  Latency samples: 95851936 / 95851936 responses (100.0%)
  Reconnects: 4264
[info] CPU 6138.2% | Mem 1.1GiB

=== Best: 19229965 req/s (CPU: 6277.8%, Mem: 437MiB) ===
[info] saved results/echo-ws-pipeline/16384/typev.json
httparena-bench-typev
httparena-bench-typev
[info] rebuilding site/data/*.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/frameworks.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/baseline-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/baseline-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/echo-ws-16384.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/echo-ws-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/echo-ws-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/echo-ws-pipeline-16384.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/echo-ws-pipeline-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/echo-ws-pipeline-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/json-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/limited-conn-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/limited-conn-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/pipelined-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/pipelined-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/upload-256.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/upload-32.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/current.json
[info] done
[info] restoring loopback MTU to 65536
[info] restoring CPU governor → powersave

@praisethemoon
Copy link
Copy Markdown
Contributor Author

/benchmark -f typev

@github-actions
Copy link
Copy Markdown
Contributor

👋 /benchmark request received. A collaborator will review and approve the run.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmark Results

Framework: typev | Test: all tests

Test Conn RPS CPU Mem Δ RPS Δ Mem
baseline 512 1,834,604 6418.7% 270MiB -4.5% +29.2%
baseline 4096 1,894,642 6391.0% 417MiB -1.3% +6.9%
pipelined 512 45,080,355 6467.2% 290MiB -7.1% -2.0%
pipelined 4096 46,926,976 6217.5% 478MiB -2.5% +23.5%
limited-conn 512 888,275 4794.5% 237MiB +0.7% -0.4%
limited-conn 4096 1,260,954 6444.3% 320MiB -2.9% -9.6%
json 4096 1,064,245 6739.5% 405MiB +0.8% +0.2%
upload 32 3,069 1948.5% 196MiB -0.5% +2.1%
upload 256 2,984 3703.9% 275MiB -0.5% +3.4%
static 1024 1,063,150 6430.6% 289MiB +9.2% -30.0%
static 4096 1,060,961 6150.7% 590MiB -1.0% -0.8%
static 6800 1,069,720 6443.6% 1.3GiB -0.2% ~0%
echo-ws 512 3,017,141 6692.6% 274MiB +5.1% +1.5%
echo-ws 4096 2,932,317 6703.9% 418MiB -3.3% -7.9%
echo-ws 16384 2,917,836 6326.8% 491MiB ~0% -1.8%
echo-ws-pipeline 512 18,787,465 6494.7% 189MiB +1.2% -3.1%
echo-ws-pipeline 4096 19,565,536 6395.6% 284MiB +2.2% -33.6%
echo-ws-pipeline 16384 19,081,456 5982.5% 493MiB -0.3% -59.9%
Full log
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency    163us    108us    120us    135us   3.12ms

  92374512 frames sent in 5.00s, 92374016 frames received
  Throughput: 18.47M req/s
  Bandwidth:  123.29MB/s
  WS upgrades: 214
  WS frames:   92374016
  Latency samples: 92373616 / 92374016 responses (100.0%)
[info] CPU 6398.9% | Mem 268MiB

=== Best: 18787465 req/s (CPU: 6494.7%, Mem: 189MiB) ===
[info] saved results/echo-ws-pipeline/512/typev.json
httparena-bench-typev
httparena-bench-typev

==============================================
=== typev / echo-ws-pipeline / 4096c (tool=gcannon) ===
==============================================
[info] waiting for server...
[info] server ready

[run 1/3]
gcannon v0.5.3 [WS]
  Target:    localhost:8080/ws
  Threads:   64
  Conns:     4096 (64/thread)
  Pipeline:  16
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency    307us    113us    558us    829us   14.30ms

  97829488 frames sent in 5.00s, 97827680 frames received
  Throughput: 19.56M req/s
  Bandwidth:  130.58MB/s
  WS upgrades: 390
  WS frames:   97827680
  Latency samples: 97827536 / 97827680 responses (100.0%)
[info] CPU 6395.6% | Mem 284MiB

[run 2/3]
gcannon v0.5.3 [WS]
  Target:    localhost:8080/ws
  Threads:   64
  Conns:     4096 (64/thread)
  Pipeline:  16
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency    219us    109us    218us    801us   11.40ms

  97768976 frames sent in 5.00s, 97768814 frames received
  Throughput: 19.55M req/s
  Bandwidth:  130.49MB/s
  WS upgrades: 528
  WS frames:   97768814
  Latency samples: 97771712 / 97768814 responses (100.0%)
  Latency overflow (>5s): 16
[info] CPU 6692.3% | Mem 379MiB

[run 3/3]
gcannon v0.5.3 [WS]
  Target:    localhost:8080/ws
  Threads:   64
  Conns:     4096 (64/thread)
  Pipeline:  16
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency    202us    106us    165us   1.12ms   10.80ms

  97398544 frames sent in 5.00s, 97398352 frames received
  Throughput: 19.47M req/s
  Bandwidth:  129.99MB/s
  WS upgrades: 548
  WS frames:   97398352
  Latency samples: 97406720 / 97398352 responses (100.0%)
  Latency overflow (>5s): 48
[info] CPU 6355.1% | Mem 391MiB

=== Best: 19565536 req/s (CPU: 6395.6%, Mem: 284MiB) ===
[info] saved results/echo-ws-pipeline/4096/typev.json
httparena-bench-typev
httparena-bench-typev

==============================================
=== typev / echo-ws-pipeline / 16384c (tool=gcannon) ===
==============================================
[info] waiting for server...
[info] server ready

[run 1/3]
gcannon v0.5.3 [WS]
  Target:    localhost:8080/ws
  Threads:   64
  Conns:     16384 (256/thread)
  Pipeline:  16
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency    419us    117us    445us   3.03ms   8.98ms

  95414256 frames sent in 5.00s, 95407280 frames received
  Throughput: 19.07M req/s
  Bandwidth:  127.35MB/s
  WS upgrades: 526
  WS frames:   95407280
  Latency samples: 95407280 / 95407280 responses (100.0%)
[info] CPU 5982.5% | Mem 493MiB

[run 2/3]
gcannon v0.5.3 [WS]
  Target:    localhost:8080/ws
  Threads:   64
  Conns:     16384 (256/thread)
  Pipeline:  16
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency    403us    120us    700us   2.43ms   21.20ms

  91735872 frames sent in 5.00s, 91716848 frames received
  Throughput: 18.34M req/s
  Bandwidth:  122.45MB/s
  WS upgrades: 1189
  WS frames:   91716848
  Latency samples: 91716848 / 91716848 responses (100.0%)
  Reconnects: 588800
[info] CPU 6649.6% | Mem 680MiB

[run 3/3]
gcannon v0.5.3 [WS]
  Target:    localhost:8080/ws
  Threads:   64
  Conns:     16384 (256/thread)
  Pipeline:  16
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency    308us    115us    283us   2.23ms   17.90ms

  91963984 frames sent in 5.00s, 91943200 frames received
  Throughput: 18.38M req/s
  Bandwidth:  122.76MB/s
  WS upgrades: 1299
  WS frames:   91943200
  Latency samples: 91943200 / 91943200 responses (100.0%)
  Reconnects: 465295
[info] CPU 6109.7% | Mem 737MiB

=== Best: 19081456 req/s (CPU: 5982.5%, Mem: 493MiB) ===
[info] saved results/echo-ws-pipeline/16384/typev.json
httparena-bench-typev
httparena-bench-typev
[info] rebuilding site/data/*.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/frameworks.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/baseline-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/baseline-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/echo-ws-16384.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/echo-ws-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/echo-ws-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/echo-ws-pipeline-16384.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/echo-ws-pipeline-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/echo-ws-pipeline-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/json-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/limited-conn-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/limited-conn-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/pipelined-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/pipelined-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/static-1024.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/static-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/static-6800.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/upload-256.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/upload-32.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/current.json
[info] done
[info] restoring loopback MTU to 65536
[info] restoring CPU governor → powersave

@praisethemoon
Copy link
Copy Markdown
Contributor Author

/benchmark -f typev

@github-actions
Copy link
Copy Markdown
Contributor

👋 /benchmark request received. A collaborator will review and approve the run.

@github-actions
Copy link
Copy Markdown
Contributor

Benchmark Results

Framework: typev | Test: all tests

Test Conn RPS CPU Mem Δ RPS Δ Mem
baseline 512 1,856,788 6499.3% 267MiB -3.3% +27.8%
baseline 4096 1,842,735 6660.4% 418MiB -4.0% +7.2%
pipelined 512 45,361,436 6366.7% 291MiB -6.5% -1.7%
pipelined 4096 48,157,078 6290.8% 507MiB ~0% +31.0%
limited-conn 512 1,327,369 6680.1% 263MiB +50.6% +10.5%
limited-conn 4096 1,356,843 6685.5% 408MiB +4.4% +15.3%
json 4096 1,077,787 6482.1% 750MiB +2.1% +85.6%
upload 32 3,053 1938.6% 193MiB -1.0% +0.5%
upload 256 2,989 3615.8% 299MiB -0.3% +12.4%
static 1024 1,037,738 6473.1% 415MiB +6.6% +0.5%
static 4096 1,064,194 6318.2% 970MiB -0.7% +63.0%
static 6800 1,062,885 6187.1% 1.4GiB -0.9% +7.7%
echo-ws 512 2,998,641 6725.6% 272MiB +4.5% +0.7%
echo-ws 4096 3,007,080 6570.2% 437MiB -0.9% -3.7%
echo-ws 16384 2,965,138 6217.1% 783MiB +1.7% +56.6%
echo-ws-pipeline 512 18,682,220 6437.4% 194MiB +0.6% -0.5%
echo-ws-pipeline 4096 19,113,334 6646.7% 428MiB -0.2% ~0%
echo-ws-pipeline 16384 19,423,600 6343.2% 493MiB +1.5% -59.9%
Full log
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency    163us    109us    120us    133us    403us

  93008512 frames sent in 5.00s, 93008113 frames received
  Throughput: 18.60M req/s
  Bandwidth:  124.14MB/s
  WS upgrades: 216
  WS frames:   93008113
  Latency samples: 93007824 / 93008113 responses (100.0%)
  Latency overflow (>5s): 16
[info] CPU 6513.2% | Mem 270MiB

=== Best: 18682220 req/s (CPU: 6437.4%, Mem: 194MiB) ===
[info] saved results/echo-ws-pipeline/512/typev.json
httparena-bench-typev
httparena-bench-typev

==============================================
=== typev / echo-ws-pipeline / 4096c (tool=gcannon) ===
==============================================
[info] waiting for server...
[info] server ready

[run 1/3]
gcannon v0.5.3 [WS]
  Target:    localhost:8080/ws
  Threads:   64
  Conns:     4096 (64/thread)
  Pipeline:  16
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency    272us    112us    467us    786us   15.30ms

  94970400 frames sent in 5.00s, 94968688 frames received
  Throughput: 18.99M req/s
  Bandwidth:  126.76MB/s
  WS upgrades: 336
  WS frames:   94968688
  Latency samples: 94968522 / 94968688 responses (100.0%)
[info] CPU 6239.3% | Mem 275MiB

[run 2/3]
gcannon v0.5.3 [WS]
  Target:    localhost:8080/ws
  Threads:   64
  Conns:     4096 (64/thread)
  Pipeline:  16
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency    231us    110us    203us   1.05ms   12.00ms

  95567136 frames sent in 5.00s, 95566672 frames received
  Throughput: 19.11M req/s
  Bandwidth:  127.56MB/s
  WS upgrades: 653
  WS frames:   95566672
  Latency samples: 95566432 / 95566672 responses (100.0%)
  Latency overflow (>5s): 160
[info] CPU 6646.7% | Mem 428MiB

[run 3/3]
gcannon v0.5.3 [WS]
  Target:    localhost:8080/ws
  Threads:   64
  Conns:     4096 (64/thread)
  Pipeline:  16
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency    205us    110us    191us    354us   31.20ms

  95319600 frames sent in 5.00s, 95319326 frames received
  Throughput: 19.06M req/s
  Bandwidth:  127.22MB/s
  WS upgrades: 628
  WS frames:   95319326
  Latency samples: 95385712 / 95319326 responses (100.1%)
  Latency overflow (>5s): 16
[info] CPU 6288.3% | Mem 437MiB

=== Best: 19113334 req/s (CPU: 6646.7%, Mem: 428MiB) ===
[info] saved results/echo-ws-pipeline/4096/typev.json
httparena-bench-typev
httparena-bench-typev

==============================================
=== typev / echo-ws-pipeline / 16384c (tool=gcannon) ===
==============================================
[info] waiting for server...
[info] server ready

[run 1/3]
gcannon v0.5.3 [WS]
  Target:    localhost:8080/ws
  Threads:   64
  Conns:     16384 (256/thread)
  Pipeline:  16
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency    396us    110us    264us   3.24ms   12.60ms

  97126336 frames sent in 5.00s, 97118000 frames received
  Throughput: 19.42M req/s
  Bandwidth:  129.64MB/s
  WS upgrades: 521
  WS frames:   97118000
  Latency samples: 97118000 / 97118000 responses (100.0%)
[info] CPU 6343.2% | Mem 493MiB

[run 2/3]
gcannon v0.5.3 [WS]
  Target:    localhost:8080/ws
  Threads:   64
  Conns:     16384 (256/thread)
  Pipeline:  16
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency    263us    107us    219us   1.22ms   14.10ms

  97084816 frames sent in 5.00s, 97068912 frames received
  Throughput: 19.41M req/s
  Bandwidth:  129.59MB/s
  WS upgrades: 1250
  WS frames:   97068912
  Latency samples: 97068912 / 97068912 responses (100.0%)
[info] CPU 6544.1% | Mem 728MiB

[run 3/3]
gcannon v0.5.3 [WS]
  Target:    localhost:8080/ws
  Threads:   64
  Conns:     16384 (256/thread)
  Pipeline:  16
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency    173us    104us    120us    198us   10.80ms

  96651680 frames sent in 5.00s, 96630816 frames received
  Throughput: 19.32M req/s
  Bandwidth:  129.01MB/s
  WS upgrades: 1368
  WS frames:   96630816
  Latency samples: 96630816 / 96630816 responses (100.0%)
[info] CPU 6131.0% | Mem 778MiB

=== Best: 19423600 req/s (CPU: 6343.2%, Mem: 493MiB) ===
[info] saved results/echo-ws-pipeline/16384/typev.json
httparena-bench-typev
httparena-bench-typev
[info] rebuilding site/data/*.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/frameworks.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/baseline-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/baseline-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/echo-ws-16384.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/echo-ws-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/echo-ws-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/echo-ws-pipeline-16384.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/echo-ws-pipeline-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/echo-ws-pipeline-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/json-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/limited-conn-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/limited-conn-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/pipelined-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/pipelined-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/static-1024.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/static-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/static-6800.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/upload-256.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/upload-32.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/current.json
[info] done
[info] restoring loopback MTU to 65536
[info] restoring CPU governor → powersave

@praisethemoon
Copy link
Copy Markdown
Contributor Author

/benchmark -f typev --save

@github-actions
Copy link
Copy Markdown
Contributor

👋 /benchmark request received. A collaborator will review and approve the run.

@github-actions
Copy link
Copy Markdown
Contributor

⚠️ /benchmark --save cannot start: main has diverged and cannot be auto-merged into this branch. Please merge or rebase main manually, push, and re-run /benchmark --save.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant