Replies: 1 comment
-
Do you only see this issue with this model? I'd guess this isn't a format issue. You should get an error if the binary isn't found, but maybe some other error is causing the server to fail to start. Does launching the server separately work? |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I wanted to use the chatML format but I have no clue how to configure it.
config
I've got this and at least :Mchat qwen opens the menu, but trying to get it to complete just causes this:
![{B9F9B47E-9D5A-443F-9D88-B20DB0E6DAC6}](https://private-user-images.githubusercontent.com/67372293/384598396-f28a5210-a76b-42a9-86c9-2263a30ad518.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3Mzk3NTQ0MDQsIm5iZiI6MTczOTc1NDEwNCwicGF0aCI6Ii82NzM3MjI5My8zODQ1OTgzOTYtZjI4YTUyMTAtYTc2Yi00MmE5LTg2YzktMjI2M2EzMGFkNTE4LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNTAyMTclMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjUwMjE3VDAxMDE0NFomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTBkNzE1NjE5YjQyY2U5ZDRlNTcyOGFlZDgyNTQ2OWJlM2VhZjQzOTMzOWMxZjc4NWI4NGJiOTJjMDVmNWYzNDgmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0In0.tqlcPBqZlxe15BK5TQ_G2jlb9hyt4iRyLEXDEZYGlAs)
to pop up and continue loading forever.
The format here is what i'm trying to make:
Beta Was this translation helpful? Give feedback.
All reactions