Terraform Provider for internal Langfuse configuration

[mroedder-d7]

Describe the feature or potential improvement

Hey,

first of all: thanks for all the effort in this project, I really enjoy using it and appreciate the value you´re contributing to the gen AI scene! 👍

Did you already think about a Terraform provider to be able to secure Langfuse configuration via Infrastructure as Code. Basically it would cover all of the Langfuse REST API, making it possible to code-review changes done to Prompts or Datasets etc.

Cheers,
Marc

Additional information

No response

[marcklingen]

Can you explain how terraform would help to enforce semver on API and prompts/datasets features?

[mroedder-d7]

Maybe we´ve got a misunderstanding here.

A Terraform provider would basically use and ecapsulate the following API: https://api.reference.langfuse.com/#overview.
Everything in there would then be manageable via Infrastructure-as-code.

Example: Prompts
A Terraform resource wrapping the API for prompts could look like this:

resource "langfuse_prompt" "system_prompt" {
  name   = "system-prompt"
  prompt = "You are a helpful assistant lorem ipsum dolor sit amet..."
  config = {}
  labels = ["label"]
  tags   = ["tag"]
}

That way, we could deploy new versions of our LLM backend together with the corresponding prompts that are being used in the backend.
And even better, I could inject the prompt name as an env variable into my backend Terraform resource to ensure the prompt is 'really really' there (I´m making something up here for clarity):

resource "some_cloud_service" "llm_backend" {
  name = "llm-backend"
  env {
    key   = "SYSTEM_PROMPT_NAME"
    value = langfuse_prompt.system_prompt.name
  }
}

Hope this makes sense. 🙂

Would you need more explanation on any of this?

[marcklingen]

Thanks, this was super helpful and makes a lot of sense when deploying langfuse and creating prompts programmatically.

Based on quick research it seems like the Terraform provider could be simple to generate from the OpenAPI spec: https://cloud.langfuse.com/generated/api/openapi.yml

Have you tried this already?