diff --git a/serving/docs/lmi/user_guides/lmi-dist_user_guide.md b/serving/docs/lmi/user_guides/lmi-dist_user_guide.md index 89aac506b..aaf8a33f4 100644 --- a/serving/docs/lmi/user_guides/lmi-dist_user_guide.md +++ b/serving/docs/lmi/user_guides/lmi-dist_user_guide.md @@ -77,7 +77,7 @@ option.model_id= option.max_rolling_batch_size=64 ``` -You can follow [this example](../deployment_guide/deploying-your-endpoint.md#configuration---servingproperties) to deploy a model with serving.properties configuration on SageMaker. +You can follow [this example](../deployment_guide/deploying-your-endpoint.md#option-1-configuration---servingproperties) to deploy a model with serving.properties configuration on SageMaker. ### environment variables @@ -89,7 +89,7 @@ OPTION_ROLLING_BATCH=lmi-dist OPTION_MAX_ROLLING_BATCH_SIZE=64 ``` -You can follow [this example](../deployment_guide/deploying-your-endpoint.md#configuration---environment-variables) to deploy a model with environment variable configuration on SageMaker. +You can follow [this example](../deployment_guide/deploying-your-endpoint.md#option-2-configuration---environment-variables) to deploy a model with environment variable configuration on SageMaker. ### LoRA Adapter Support diff --git a/serving/docs/lmi/user_guides/trt_llm_user_guide.md b/serving/docs/lmi/user_guides/trt_llm_user_guide.md index 469e9e0d5..98f62498f 100644 --- a/serving/docs/lmi/user_guides/trt_llm_user_guide.md +++ b/serving/docs/lmi/user_guides/trt_llm_user_guide.md @@ -44,7 +44,7 @@ option.model_id= option.max_num_tokens=50000 ``` -You can follow [this example](../deployment_guide/deploying-your-endpoint.md#configuration---servingproperties) to deploy a model with serving.properties configuration on SageMaker. +You can follow [this example](../deployment_guide/deploying-your-endpoint.md#option-1-configuration---servingproperties) to deploy a model with serving.properties configuration on SageMaker. ### environment variables @@ -55,7 +55,7 @@ TENSOR_PARALLEL_DEGREE=max OPTION_MAX_NUM_TOKENS=50000 ```` -You can follow [this example](../deployment_guide/deploying-your-endpoint.md#configuration---environment-variables) to deploy a model with environment variable configuration on SageMaker. +You can follow [this example](../deployment_guide/deploying-your-endpoint.md#option-2-configuration---environment-variables) to deploy a model with environment variable configuration on SageMaker. ### Where to find `max_num_tokens` number?