user info benchmark of zitadel v4

Benchmark results of v4 release of Zitadel.

Performance test results

Metric	Value
Baseline	none
Purpose	Test current performance
Test start	16:06 UTC
Test duration	30min
Executed test	user_info
k6 version	v1.0.0-rc1
VUs	600
Client location	US1
ZITADEL location	US1
ZITADEL container specification	vCPU: 6 Memory: 6 Gi Container min scale: 2 Container max scale: 7
ZITADEL Version	v4.0.0-rc2
ZITADEL feature flags	webKey: true, improvedPerformance: ["IMPROVED_PERFORMANCE_ORG_BY_ID", "IMPROVED_PERFORMANCE_PROJECT", "IMPROVED_PERFORMANCE_USER_GRANT", "IMPROVED_PERFORMANCE_ORG_DOMAIN_VERIFIED", "IMPROVED_PERFORMANCE_PROJECT_GRANT"]
Database	type: psql version: v17.4
Database location	US1
Database specification	vCPU: 8 memory: 32Gib
ZITADEL metrics during test	Container startup latency is > 3 minutes
Observed errors	Container startup latency is > 3 minutes, elevated error rate during container startup
Top 3 most expensive database queries	1: events by aggregate type and event type 2: events by instance id, aggregate types, event types, position 3: user by id
k6 Iterations per second	2653
k6 output	output
flowchart outcome

Endpoint latencies

k6 output

  █ TOTAL RESULTS 

    checks_total.......................: 4784344 2653.094897/s
    checks_succeeded...................: 99.97%  4783333 out of 4784344
    checks_failed......................: 0.02%   1011 out of 4784344

    ✓ user defined
    ✓ authorize status ok
    ✓ login name status ok
    ✓ login shows password page
    ✓ password status ok
    ✓ password callback
    ✓ code set
    ✓ token status ok
    ✓ access token created
    ✓ id token created
    ✓ info created
    ✓ org created
    ✓ create user is status ok
    ✗ openid configuration
      ↳  89% — ✓ 600 / ✗ 74
    ✗ userinfo status ok
      ↳  99% — ✓ 4782709 / ✗ 936
    ✗ org removed
      ↳  0% — ✓ 0 / ✗ 1

    CUSTOM
    login_ui_enter_login_name_duration......................................: min=149.1ms  avg=176.4ms  max=203.69ms p(50)=176.4ms  p(95)=200.96ms p(99)=203.15ms
    login_ui_enter_password_duration........................................: min=34.7ms   avg=248.44ms max=462.19ms p(50)=248.44ms p(95)=440.82ms p(99)=457.92ms
    login_ui_init_login_duration............................................: min=83.7ms   avg=85.38ms  max=87.05ms  p(50)=85.38ms  p(95)=86.88ms  p(99)=87.01ms 
    login_ui_token_duration.................................................: min=92.78ms  avg=118.84ms max=144.89ms p(50)=118.84ms p(95)=142.29ms p(99)=144.37ms
    oidc_user_info_duration.................................................: min=453.34µs avg=224.58ms max=1m0s     p(50)=83.13ms  p(95)=792.51ms p(99)=926.8ms 
    org_create_org_duration.................................................: min=53.42ms  avg=53.42ms  max=53.42ms  p(50)=53.42ms  p(95)=53.42ms  p(99)=53.42ms 
    user_create_human_duration..............................................: min=373.72ms avg=373.72ms max=373.72ms p(50)=373.72ms p(95)=373.72ms p(99)=373.72ms

    HTTP
    http_req_duration.......................................................: min=453.34µs avg=225.49ms max=1m0s     p(50)=83.13ms  p(95)=792.51ms p(99)=927.03ms
      { expected_response:true }............................................: min=3.29ms   avg=212.92ms max=29.69s   p(50)=83.1ms   p(95)=792.3ms  p(99)=923.17ms
    http_req_failed.........................................................: 0.02%   1011 out of 4784339
    http_reqs...............................................................: 4784339 2653.092124/s

    EXECUTION
    iteration_duration......................................................: min=731.85µs avg=225.74ms max=1m0s     p(50)=83.33ms  p(95)=792.71ms p(99)=927.27ms
    iterations..............................................................: 4783719 2652.748311/s
    vus.....................................................................: 600     min=0               max=600
    vus_max.................................................................: 600     min=600             max=600

    NETWORK
    data_received...........................................................: 3.4 GB  1.9 MB/s
    data_sent...............................................................: 378 MB  210 kB/s

running (30m03.3s), 000/600 VUs, 4783719 complete and 0 interrupted iterations
default ✓ [======================================] 600 VUs  30m0s