unify logging

[DavidKorczynski]

We use logging in multiple formats:

• logging.info/debug/..
• print(
• write to files

It's fairly inconsistent. So am unifying it in a more Pythonic way. The format also makes it easier to track performance of the tool as we can find bottlenecks by looking at the logs.

[DavidKorczynski]

/gcbrun exp -n dk-test-infra-99x3 -m vertex_ai_gemini-1-5 -b comparison

[DonggeLiu]

Thanks for unifying the logs, @DavidKorczynski. In addition to the benefit of the consistent format (as you mentioned), this will keep the logs in the correct order, which will help us debug.

However, since you happen to work on this, could you please also help us switch to google-cloud-logging?
The current code prints all logs in stderr, which shows all logs are errors:

Using google-cloud-logging will fix this, here is how it is used in FuzzBench.

[DavidKorczynski]

However, since you happen to work on this, could you please also help us switch to google-cloud-logging?
The current code prints all logs in stderr, which shows all logs are errors:

Am happy to do this, can we do this in follow-up PRs?

[DonggeLiu]

Yep sure, the sooner the better as we won't be able to filter logs by severity once we merge this.