Skip to content

Commit

Permalink
[Docs] Clarify spot policy docs (#3725)
Browse files Browse the repository at this point in the history
update spot doc
  • Loading branch information
MaoZiming authored Jul 4, 2024
1 parent c445755 commit 05ce5e9
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion docs/source/serving/spot-policy.rst
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@
Using Spot Instances for Serving
================================

SkyServe supports serving models on a mixture of spot and on-demand replicas with two options: :code:`base_ondemand_fallback_replicas` and :code:`dynamic_ondemand_fallback`.
SkyServe supports serving models on a mixture of spot and on-demand replicas with two options: :code:`base_ondemand_fallback_replicas` and :code:`dynamic_ondemand_fallback`. Currently, SkyServe relies on the user side to retry in the event of spot instance preemptions.


Base on-demand Fallback
Expand Down

0 comments on commit 05ce5e9

Please sign in to comment.