Skip to content

Commit

Permalink
[docs] Fix broken links in user guide (#2025)
Browse files Browse the repository at this point in the history
  • Loading branch information
xyang16 authored Jun 5, 2024
1 parent 419b889 commit c3a5a40
Show file tree
Hide file tree
Showing 2 changed files with 4 additions and 4 deletions.
4 changes: 2 additions & 2 deletions serving/docs/lmi/user_guides/lmi-dist_user_guide.md
Original file line number Diff line number Diff line change
Expand Up @@ -77,7 +77,7 @@ option.model_id=<your model id>
option.max_rolling_batch_size=64
```

You can follow [this example](../deployment_guide/deploying-your-endpoint.md#configuration---servingproperties) to deploy a model with serving.properties configuration on SageMaker.
You can follow [this example](../deployment_guide/deploying-your-endpoint.md#option-1-configuration---servingproperties) to deploy a model with serving.properties configuration on SageMaker.

### environment variables

Expand All @@ -89,7 +89,7 @@ OPTION_ROLLING_BATCH=lmi-dist
OPTION_MAX_ROLLING_BATCH_SIZE=64
```

You can follow [this example](../deployment_guide/deploying-your-endpoint.md#configuration---environment-variables) to deploy a model with environment variable configuration on SageMaker.
You can follow [this example](../deployment_guide/deploying-your-endpoint.md#option-2-configuration---environment-variables) to deploy a model with environment variable configuration on SageMaker.

### LoRA Adapter Support

Expand Down
4 changes: 2 additions & 2 deletions serving/docs/lmi/user_guides/trt_llm_user_guide.md
Original file line number Diff line number Diff line change
Expand Up @@ -44,7 +44,7 @@ option.model_id=<your model id>
option.max_num_tokens=50000
```

You can follow [this example](../deployment_guide/deploying-your-endpoint.md#configuration---servingproperties) to deploy a model with serving.properties configuration on SageMaker.
You can follow [this example](../deployment_guide/deploying-your-endpoint.md#option-1-configuration---servingproperties) to deploy a model with serving.properties configuration on SageMaker.

### environment variables

Expand All @@ -55,7 +55,7 @@ TENSOR_PARALLEL_DEGREE=max
OPTION_MAX_NUM_TOKENS=50000
````

You can follow [this example](../deployment_guide/deploying-your-endpoint.md#configuration---environment-variables) to deploy a model with environment variable configuration on SageMaker.
You can follow [this example](../deployment_guide/deploying-your-endpoint.md#option-2-configuration---environment-variables) to deploy a model with environment variable configuration on SageMaker.


### Where to find `max_num_tokens` number?
Expand Down

0 comments on commit c3a5a40

Please sign in to comment.