Just wanted to answer my own question now that I’ve solved it. The solution is to use oathkeeper along side a reverse proxy such as AWS API Gateway, Traefik, or NGINX (Mentioned in the first part of the
introduction to oathkeeper). Using traefik for now in development since it’s so easy to set up, but eventually will probably migrate to AWS API Gateway.