Is it possible to use the CLI when self hosting?

Some parts, yes. the parts that are related to project configuration not. What are you looking for?

Being able to configure self hosted Kratos using the CLI, particularly identity config and creating jwks

That’s not possible due to the nature of the configuration. In self hosted the configuration is purely file based.