Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(block): Add AI Music Generator Block with Meta Music Gen #8532

Merged
merged 6 commits into from
Nov 11, 2024

Conversation

Torantulino
Copy link
Member

@Torantulino Torantulino commented Nov 3, 2024

Background

image

This pull request introduces two main changes to the AutoGPT platform:

  • Addition of a new AI music generation block in the backend.
  • Enhancement of the frontend's content rendering capabilities.

Changes

  • Backend:

    • Added a new AI music generation block in autogpt_platform/backend/backend/blocks/ai_music_generator.py. This block uses Meta's MusicGen model on Replicate to generate music based on a given prompt. It includes various parameters such as model version, duration, temperature, top_k, top_p, classifier_free_guidance, output_format, and normalization_strategy.
  • Frontend:

    • Enhanced the content rendering capabilities in autogpt_platform/frontend/src/components/ui/render.tsx. The ContentRenderer component now supports rendering video, image, and audio URLs, in addition to text. It includes specific renderers for YouTube videos, other video formats, images, and audio files.

These changes aim to improve the functionality and user experience of the AutoGPT platform by enabling AI-generated music and enhancing content rendering in the frontend.

@Torantulino Torantulino requested review from a team as code owners November 3, 2024 21:31
@Torantulino Torantulino requested review from Swiftyos and kcze and removed request for a team November 3, 2024 21:31
Copy link
Contributor

github-actions bot commented Nov 3, 2024

This PR targets the master branch but does not come from dev or a hotfix/* branch.

Automatically setting the base branch to dev.

@github-actions github-actions bot changed the base branch from master to dev November 3, 2024 21:31
@github-actions github-actions bot added platform/frontend AutoGPT Platform - Front end platform/backend AutoGPT Platform - Back end platform/blocks size/l labels Nov 3, 2024
Copy link

netlify bot commented Nov 3, 2024

Deploy Preview for auto-gpt-docs canceled.

Name Link
🔨 Latest commit eb6bc97
🔍 Latest deploy log https://app.netlify.com/sites/auto-gpt-docs/deploys/6732067697c9120008897c2e

aarushik93
aarushik93 previously approved these changes Nov 6, 2024
Copy link
Contributor

@aarushik93 aarushik93 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Linting needs fixing

@Torantulino Torantulino merged commit 1f0cbc6 into dev Nov 11, 2024
17 checks passed
@Torantulino Torantulino deleted the toran/open-2002-ai-music-generator-block branch November 11, 2024 17:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
platform/backend AutoGPT Platform - Back end platform/blocks platform/frontend AutoGPT Platform - Front end size/l
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants