Getting started tutorial

[appoose]

Adding the notebook with the chat_with_video example that will be used for getting started video.

[appoose]

@movchan74 @ashwinnair14 @evanderiel Can you review this tutorial I wrote for the getting started video?

[evanderiel]

LGTM

[movchan74]

!pip install git+https://github.com/mobiusml/aana_sdk.git -qqqU

Shall we use pypi version instead?

[movchan74]

I would suggest to add a link to integrations https://github.com/mobiusml/aana_sdk/blob/main/docs/integrations.md when you talk about Deployments.

[movchan74]

from aana.projects.chat_with_video.const import (
    asr_model_name,
    captioning_model_name,
    max_video_len,
)
from aana.projects.chat_with_video.utils import (
    generate_dialog,
)

consts and generate_dialog util function are imported from the chat_with_video project.

[appoose]

from aana.projects.chat_with_video.const import (
    asr_model_name,
    captioning_model_name,
    max_video_len,
)
from aana.projects.chat_with_video.utils import (
    generate_dialog,
)

consts and generate_dialog util function are imported from the chat_with_video project.

I will take it into the main notebook body.

Question: I find the models being defined at two places and potentially can cause issues. One in the .const and other in deploys configs

asr_model_name = "whisper_medium"
captioning_model_name = "hf_blip2_opt_2_7b"
max_video_len = 60 * 20  # 20 minutes


deployments = [
    {
        "name": "asr_deployment",
        "instance": whisper_medium_deployment,
    },    
    {
        "name": "captioning_deployment",
        "instance": hf_blip2_opt_2_7b_deployment,
    },
    {
        "name": "llm_deployment",
        "instance": internlm2_5_7b_chat_deployment,
    },
]

for deployment in deployments:
    aana_app.register_deployment(
        name=deployment["name"],
        instance=deployment["instance"],
    )

What might be a better way of handling this?

[movchan74]

from aana.projects.chat_with_video.const import (
    asr_model_name,
    captioning_model_name,
    max_video_len,
)
from aana.projects.chat_with_video.utils import (
    generate_dialog,
)

consts and generate_dialog util function are imported from the chat_with_video project.

I will take it into the main notebook body.

Question: I find the models being defined at two places and potentially can cause issues. One in the .const and other in deploys configs

asr_model_name = "whisper_medium"
captioning_model_name = "hf_blip2_opt_2_7b"
max_video_len = 60 * 20  # 20 minutes


deployments = [
    {
        "name": "asr_deployment",
        "instance": whisper_medium_deployment,
    },    
    {
        "name": "captioning_deployment",
        "instance": hf_blip2_opt_2_7b_deployment,
    },
    {
        "name": "llm_deployment",
        "instance": internlm2_5_7b_chat_deployment,
    },
]

for deployment in deployments:
    aana_app.register_deployment(
        name=deployment["name"],
        instance=deployment["instance"],
    )

What might be a better way of handling this?

Model names from const are only used for the database ops. Maybe we can call deployments and get the model name from it in the future.

[appoose]

Okay, then I will keep as it is and update when we have facility to call deployments and get models names.

…

On 12. Jul 2024, at 12:32, Aleksandr Movchan ***@***.***> wrote: from aana.projects.chat_with_video.const import ( asr_model_name, captioning_model_name, max_video_len, ) from aana.projects.chat_with_video.utils import ( generate_dialog, ) consts and generate_dialog util function are imported from the chat_with_video project. I will take it into the main notebook body. Question: I find the models being defined at two places and potentially can cause issues. One in the .const and other in deploys configs asr_model_name = "whisper_medium" captioning_model_name = "hf_blip2_opt_2_7b" max_video_len = 60 * 20 # 20 minutes deployments = [ { "name": "asr_deployment", "instance": whisper_medium_deployment, }, { "name": "captioning_deployment", "instance": hf_blip2_opt_2_7b_deployment, }, { "name": "llm_deployment", "instance": internlm2_5_7b_chat_deployment, }, ] for deployment in deployments: aana_app.register_deployment( name=deployment["name"], instance=deployment["instance"], ) What might be a better way of handling this? Model names from const are only used for the database ops. Maybe we can call deployments and get the model name from it in the future. — Reply to this email directly, view it on GitHub <#133 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAJL5SKZWVRGXDTGKWWCJZDZL6WFHAVCNFSM6AAAAABKXGMDW2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEMRVGI4TENRQGI>. You are receiving this because you authored the thread.