Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add complete action verification #845

Merged
merged 1 commit into from
Sep 18, 2024

Commits on Sep 18, 2024

  1. 🔄 synced local 'skyvern/' with remote 'skyvern/'

    <!-- ELLIPSIS_HIDDEN -->
    
    | 🚀 | This description was created by [Ellipsis](https://www.ellipsis.dev) for commit fb1090a272988bbbff21cd2d3140ac18f4e6b634  |
    |--------|--------|
    
    feat: add LLM-based action completion verification
    
    ### Summary:
    Adds LLM-based verification for action completion with new templates, logging, and exception handling updates.
    
    **Key points**:
    - Adds LLM-based verification for action completion in `action_complete.py` and `agent.py`.
    - Uses `verify_complete_action_via_llm_call()` to check if user goal is achieved.
    - Updates `agent_step()` in `agent.py` to include LLM verification after actions.
    - Introduces `verify-complete-action.j2` and `check-user-goal.j2` templates for LLM prompts.
    - Moves `IllegitComplete` exception from `cloud/exceptions.py` to `skyvern/exceptions.py`.
    - Logs verification responses and errors in `agent.py` and `action_complete.py`.
    
    ----
    Generated with ❤️ by [ellipsis.dev](https://www.ellipsis.dev)
    
    <!-- ELLIPSIS_HIDDEN -->
    ykeremy committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    b7e6c8a View commit details
    Browse the repository at this point in the history