Ory is the largest open source community in the world for cloud software application security. We maintain advanced open source security software solving authentication, authorization, access control, application network security, and delegation. Ory implements a variety of industry and best-practice standards including OAuth 2.0 / OAuth 2.1, OpenID Connect, Zero Trust Networking, Google Zanzibar Policy Framework, FIDO2 U2F, WebAuthn, TOTP, and more.

Ory Community

If I want to create an oidc identity provider that uses a custom authentication/login flow (in my case via an ethereum wallet), what would be a good place in the Ory ecosystem to start from? Would modifying/extending/using parts of Kratos be a good idea? Would I also need Hydra for storing the custom identities?

Hydra would be your oidc provider. It would basically wrap whatever auth flow you have in an oidc compliant layer.
Kratos would be to do user management, password reset, confirmation, etc.
Hydra does not store user info, kratos does.

Curious about your use case! Are you looking to use ethereum addresses as a unique identifier to then have your service be an oauth2 provider for them?