Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for testing OpenAI plugins. #1

Open
mehrandvd opened this issue Jan 11, 2024 · 0 comments · May be fixed by #5
Open

Add support for testing OpenAI plugins. #1

mehrandvd opened this issue Jan 11, 2024 · 0 comments · May be fixed by #5
Labels
documentation Improvements or additions to documentation

Comments

@mehrandvd
Copy link
Owner

skUnit must be able to directly test an OpenAI plugin using its URL.

@mehrandvd mehrandvd added the documentation Improvements or additions to documentation label Jan 11, 2024
@mehrandvd mehrandvd changed the title Add support to test OpenAI plugins. Add support for testing OpenAI plugins. Jan 12, 2024
hootanht added a commit to hootanht/skunit that referenced this issue Sep 2, 2024
Fixes mehrandvd#1

Add support for testing OpenAI plugins using their URL.

* **README.md**:
  - Add a section explaining how to test OpenAI plugins using their URL.
  - Include an example of testing a plugin using its URL.
* **src/skUnit/Asserts/SemanticKernelAssert_Chat.cs**:
  - Add a new method `CheckPluginByUrlAsync` to test chat scenarios using a plugin URL.
  - Implement the method to load the plugin from the URL and run the chat scenario.
* **src/skUnit/Asserts/SemanticKernelAssert_Function.cs**:
  - Add a new method `CheckPluginByUrlAsync` to test function scenarios using a plugin URL.
  - Implement the method to load the plugin from the URL and run the function scenario.
* **src/skUnit/Asserts/SemanticKernelAssert_Initialize.cs**:
  - Add a new constructor to initialize `SemanticKernelAssert` with a plugin URL.
  - Implement the constructor to load the plugin from the URL and initialize the kernel.
@hootanht hootanht linked a pull request Sep 2, 2024 that will close this issue
mehrandvd added a commit that referenced this issue Nov 26, 2024
Refactored SemanticTestBase to use ScenarioAssert and IChatClient. Updated KernelChatTests to use ScenarioAssert. Removed obsolete test classes and methods, including FunctionTests and KernelTests. Deleted config.json, sktest.md, and skprompt.txt files. Updated skUnit.Tests.csproj to remove references to deleted files and scenarios. Updated ScenarioAssert_Initialize.cs and SemanticAssert.cs to use IChatClient. Removed PocomoPlugin.cs and related configurations. Updated skUnit.csproj to target .NET 8.0 and updated package references. Added new ChatClientTests class in ChatClientTests.cs. Introduced new methods in ScenarioAssert for chat scenario validation.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant