[Bug]: Static type checking issues with completion and acompletion methods.

[miraclebakelaser]

What happened?

Issue:

When using litellm with pyright, the linter complains about type errors.

Examples:

Dictionary access linting error:

import litellm

response = litellm.completion(
    model="gpt-3.5-turbo",
    messages=[{"content": "Hello, how are you?", "role": "user"}],
    max_tokens=10,
)

print(response["choices"][0]["message"]["content"])
# Error: "__getitem__" method not defined on type "CustomStreamWrapper"
# (variable) response: ModelResponse | CustomStreamWrapper

Attribute access linting error:

print(response.choices[0].message.content)
# Cannot access attribute "choices" for class "CustomStreamWrapper"
# Error: 
# - Attribute "choices" is unknown
# (variable) choices: List[Choices | StreamingChoices] | Unknown
# The list of completion choices the model generated for the input prompt.
# - Cannot access attribute "message" for class "StreamingChoices"
#   Attribute "message" is unknown

Streaming linting error:

import asyncio
import os
import traceback

from litellm import acompletion

async def completion_call():
    try:
        print("test completion + streaming")
        response = await acompletion(
            model="gpt-3.5-turbo",
            messages=[{"content": "Hello, how are you?", "role": "user"}],
            stream=True,
        )
        async for chunk in response:
            # Error: "ModelResponse" is not iterable
            #   "__aiter__" method not defined
            # (variable) response: ModelResponse | CustomStreamWrapper
            print(chunk)
    except:
        print(f"error occurred: {traceback.format_exc()}")
        pass

asyncio.run(completion_call())

Related Issues:
#2006

Relevant log output

Are you a ML Ops Team?

No

What LiteLLM version are you on ?

v1.60.5

Twitter / LinkedIn details

No response