MLOps Toys

A collection of MLOps Pipeline toys (templates for how to do things) for creating standard pipelines.

Most of these will be contained to a single folder. The README in that folder will explain what the pipeline is.

Current Toys

• ✅ Working.
• 🚧 In Progress.
• ❌ Not Working.

---

✅	apis :: fastapi_example
✅	credential_mgmt :: sops
✅	data_analytics :: metabase
✅	data_build_tools :: dbt_pg
✅	data_frontend :: streamlit
✅	data_generators :: clf_log_generator
✅	data_generators :: flog
🚧	data_lake :: iceberg
✅	data_logging :: whylogs
🚧	data_platforms :: mlflow
✅	data_processing :: pyspark
✅	databases :: duckdb
✅	databases :: mysql
✅	databases :: pg
✅	databases :: redis
🚧	databases :: trino
✅	doc_styles :: diataxis
✅	ds_models :: utils
✅	graphql :: strawberry_graphql
🚧	local_dev :: localstack
✅	logging :: grafana
✅	logging :: prometheus
✅	message_queues :: rabbitmq
✅	model_explanation :: shap
✅	orchestration_tools :: airflow
✅	pipelines :: dagster-dbt
✅	search_engine :: elasticsearch
✅	streaming :: kafka_consumer_producer
✅	streaming :: kinesis_streaming

Making a New Toy

Use:

just generate toy_name

Where toy_name is the name of the toy. It will make a folder in root. Move it to where it should be.