feat: run stress test on PRs

[kckeiks]

It would be useful to be able to run a stress test for the gateway on command.

Suggestion:

• In a container, run a few nodes, storetheindex, and gateway.
• Nodes can provide ~3 files of different sizes.
• Test gateway with oha or some other tool.
• Display results on PR.

Consider that we should run all participants (indexer, node, gateway) locally in test so that latency (due to its volatility) does not affect the results.

[b0xtch]

Could you elaborate on this?

[kckeiks]

Could you elaborate on this?

👍 I updated the title and added a description.

[b0xtch]

Can we create a bench for each crate we want to benchmark? And then just add one command to ci to run all the benches

[kckeiks]

I don't have any particular preference atm. I imagine that whoever picks this work can assess. I think the minimum requirement should be that the whole flow (querying indexer, requesting from node) is tested.

[b0xtch]

I don't have any particular preference atm. I imagine that whoever picks this work can assess. I think the minimum requirement should be that the whole flow (querying indexer, requesting from node) is tested.

not about preference, whether we decide to do a full benchmark crate to do all of this or are we benchmarking a specific crate.