Hello I m doing some benchmarking on keto and for that I nee

Question

Hello I m doing some benchmarking on keto and for that I need to create larger and larger databases I was using `keto relation tuple create`to ingest the benchmarking data but I m starting to hit a size limit when ingesting data at around 4MB I believe I was going to write a script to fragment my data but maybe I missed a simpler solution

steep-lamp-91158 · Answer

are you piping in JSON

steep-lamp-91158 · Answer

it might be the case that the deserialization part is not really optimized for that big data sets at once

steep-lamp-91158 · Answer

the api should have less of a problem

victorious-flower-63171 · Answer

Yes I was giving a single json file as an argument The error seemed to say that the problem came from the gRPC message size ```Error doing the request rpc error code = ResourceExhausted desc = grpc received message larger than max 20135416 vs 4194304 ```

victorious-flower-63171 · Answer

I ll try with the API

steep-lamp-91158 · Answer

right then there is that limit on the api

steep-lamp-91158 · Answer

so split it into separate files wink

victorious-flower-63171 · Answer

OK will do then

victorious-flower-63171 · Answer

Thanks