Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Weird code merging from deepseek #184

Open
viraptor opened this issue Aug 14, 2024 · 3 comments
Open

Weird code merging from deepseek #184

viraptor opened this issue Aug 14, 2024 · 3 comments

Comments

@viraptor
Copy link

viraptor commented Aug 14, 2024

I've tried using plandex with deepseek. The responses I see in plandex convo seem completely fine and include the whole file being changed.
Unfortunately plandex is spinning for a very long time processing those answers and finally injects a lot of copied code - the new code gets pasted in the middle of the file being edited. (python code)

I'd love for those edits to be handled better.

@viraptor
Copy link
Author

Aider seems to ask for a search/replace pair when working with deepseek and for any issues applying it it just complains to the LLM and makes it try again. Seems to work quite well in practice.

@danenania
Copy link
Contributor

danenania commented Aug 14, 2024

Are you using deepseek for all the roles? You can check with plandex models.

There's a syntax check and a verification step as well, but it may be that deepseek is having trouble with Plandex's line-number based editing. There are pros and cons to this approach vs. aider's search/replace pair strategy... the solution will likely be to change strategies depending on which model is being used, which we are working towards. The prerequisite is a good set of evals that lets us compare different prompting/editing strategies against different models, and we are close to having this in place. So stay tuned :)

@viraptor
Copy link
Author

viraptor commented Aug 14, 2024

Yup, all the roles. It seems like everything works fine, apart from the change merging.

For the editing format, yes, aider uses diff (as in a search/replace pair) instead for deepseek coder. They already did that homework here so it can save you some time 😉 https://aider.chat/docs/leaderboards/ (includes % reliability for the best method)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants