Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history 
Co-authored-by: Alexander Baranov <677093+sashabaranov@users.noreply.github.com>
  • Loading branch information
@vvatanabe @sashabaranov
vvatanabe and sashabaranov authored Jul 30, 2023
1 parent 9fbcc40 commit c504345
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -706,7 +706,7 @@ Even when specifying a temperature field of 0, it doesn't guarantee that you'll
Due to the factors mentioned above, different answers may be returned even for the same question.

**Workarounds:**
1. Using math.SmallestNonzeroFloat32: By specifying math.SmallestNonzeroFloat32 in the temperature field instead of 0, you can mimic the behavior of setting it to 0.
1. Using `math.SmallestNonzeroFloat32`: By specifying `math.SmallestNonzeroFloat32` in the temperature field instead of 0, you can mimic the behavior of setting it to 0.
2. Limiting Token Count: By limiting the number of tokens in the input and output and especially avoiding large requests close to 32k tokens, you can reduce the risk of non-deterministic behavior.

By adopting these strategies, you can expect more consistent results.
Expand Down

0 comments on commit c504345

Please sign in to comment.