Ory is the largest open source community in the world for cloud software application security. We maintain advanced open source security software solving authentication, authorization, access control, application network security, and delegation. Ory implements a variety of industry and best-practice standards including OAuth 2.0 / OAuth 2.1, OpenID Connect, Zero Trust Networking, Google Zanzibar Policy Framework, FIDO2 U2F, WebAuthn, TOTP, and more.

Ory Community

image.png

keto memory leak. im using v0.11.1
not sure if its just my configuration yet though. anyone experiencing the same? (down spikes are from keto pod restarts)

Hi <@U03RSG5ST1Q>, really sorry for the tag -- I don't know whos responsible for keto. Just really want to get insights about this. Hopefully you can help point me to the right person :pray:

Just fyi, we're using keto on production for our apikey authorizations. We do about 10 keto rule checks per second. The above image is directly from our GCP monitoring.

I initially thought it was due to our outdated keto version, but after updating to the latest, its still happening.

I mean, this may not be the answer you want, but did you consider simply forking keto and running some pprof'ing?

Another hot tip is to send your running keto instance a SIGABRT to kill it (of course not during the wildest prod hours). That will dump all running threads (goroutines) to stdout, allowing you to weed out any potential contenders for deadlocks etc.