Add timings

[daanelson]

Wanted to add the ability in the python API to return the timing information (created_at, started_at, completed_at) so that we can pull all that info right in python without hopping back and forth between curl/etc.

Didn't want to break the existing predict() -> prediction.output contract, which led me to implementing a create_prediction method that returns an async prediction object (similar, I think, to the current JS API).

[erbridge]

Nice. I like this as an approach.

[bfirsh]

We should definitely get the timing info in, but I'm not sure about this new method, so maybe we shouldn't conflate the two changes.

Is this new method just for convenience, or is there a technical reason why we need it?

This is creating a new verb_noun() pattern that I don't think we use elsewhere. I don't like the idea of us having multiple naming patterns unless we really need it. I wonder if we can follow the existing nouns.verb() pattern by creating a PredictionCollection on versions? E.g.

version = replicate.versions.get("...")
version.predictions.create(...)

That would also imply version.predictions.list(), version.predictions.get(), etc.

[daanelson]

@bfirsh we don't explicitly need it; I suppose I appreciate the simplicity of having one noun from which to get predictions. currently if a user wants to run a prediction method which returns the output of said prediction, they call version.predict(); but if they want to run a prediction method that returns a Prediction they call replicate.predictions.create(version=<some_version>, ...). Would be nice to have it all in one place, but not necessary.

Also a spot where the JS & python clients diverge at the moment, model.predict in JS returns a prediction.

All that said, happy to just push the timings and leave the API as is if it doesn't feel right.

[bfirsh]

Let's maybe pull that out into a separate PR for discussion. I don't want to block getting the uncontroversial change in.

I think we should think carefully about adding a new naming pattern for an API, particularly as we're in the process of trying to align the Python and JS APIs.

[daanelson]

@bfirsh works for me. This is now just timing info.

[zeke]

Nice