Skip to content

Dynamic Template-Constrained LLM Inference for Eliminating Formatting Errors and Hallucinations

License

Notifications You must be signed in to change notification settings

niuchuangnn/vllm_structure

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

vLLM-Structure

This project is developed for Structured Radiology Reporting at level-2 based on vLLM.

Installation

git clone https://github.com/niuchuangnn/vllm_structure.git
cd vllm_structure
pip install -e .

Download LLMs

Run

cd structure
python structure_inference.py

Prepare Your Own Data

Citation

@misc{niu2024sr,
      title={Cross-Institutional Structured Radiology Reporting for Lung Cancer Screening Using a Dynamic Template-Constrained Large Language Model}, 
      author={Chuang Niu and Parisa Kaviani and Qing Lyu and Mannudeep K. Kalra and Christopher T. Whitlow and Ge Wang},
      year={2024},
      eprint={2409.18319},
      archivePrefix={arXiv},
      primaryClass={cs.AI},
      url={https://arxiv.org/abs/2409.18319}, 
}

About

Dynamic Template-Constrained LLM Inference for Eliminating Formatting Errors and Hallucinations

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published