Hey Ory network! We are, like many others, experiencing some rate limiting. However, we are unable to tell what causes the influx of traffic to ory network - could someone be bothered to help me look at some metrics and try to figure it out?

Hey, we’ll look into immediately

It's not happening right now, so it's not super pressing, but we get it intermittently, and it would be nice to debug

Yes absolutely, I’ve notified SRE. It’s probably some misconfiguration on our end - thank you for letting us know! On a side note: We see a lot of traffic coming from a few servers on your end. Are you proxying Ory’s APIs? Or using a middelware to check the Ory Session cookie?

That's exactly it, I'd love to identify those few servers, to track down the biggest spam-culprits. We do however have one service that proxies permission checks from the front-end (seeing as Keto doesen't accept a kratos session as auth, it needs an api key, which we don't want to distribute to our front-end for obvious reasons).

It looks like there was an outage related to the rate limit service yesterday which could have lead to incorrectly reporting 429. Otherwise we can’t see any rate limit related alerts on your project, so you should be good. Sorry for the inconvenience!

Could someone still help me identify which servers of ours are the most spammy? Please please with sugar on top? 😇

Ok, that makes total sence with Keto. We’re also working on a better API for this to combine auth check + permissions. It’s on the roadmap, just doesn’t have a delivery date yet (cc @fast-lunch-54279)

Thanks man!