Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Add POC of a testing framework #22

Closed
wants to merge 2 commits into from

Conversation

jirimoravcik
Copy link
Member

You can run it via OPENAI_API_KEY=***** npm run e2e.

Let's discuss how to proceed with this.

@github-actions github-actions bot added this to the 77th sprint - Platform team milestone Nov 27, 2023
@github-actions github-actions bot added t-platform Issues with this label are in the ownership of the platform team. tested Temporary label used only programatically for some analytics. labels Nov 27, 2023
github-actions[bot]

This comment was marked as outdated.

Copy link
Member

@drobnikj drobnikj left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good start, I will just do Apify Actor of it.
Plus will be goo to run it in parallel on platform,

@@ -0,0 +1,14 @@
export const TEST_CASES: {
name:string,
expectedOutput: Record<string, unknown>,
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you add model as well?

@@ -0,0 +1,25 @@
import 'zx/globals';
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is good start, I would make this Actor, which can be push to Apify.
The tricky part will be to distinguish between local run and run in platform.
Localy it will be basically same as you have now and you need to add some ifs, in case you run it on platform

  1. Use Actor.call instead npm run start:dev
  2. Input from Actor.getInput not local file.
  3. Save results to dataset maybe.

@drobnikj
Copy link
Member

drobnikj commented Jan 8, 2024

Let's draft this one until we can back to agent, @jirimoravcik

@drobnikj drobnikj requested review from drobnikj and removed request for drobnikj January 8, 2024 15:16
@jirimoravcik jirimoravcik marked this pull request as draft January 8, 2024 15:23
@fnesveda fnesveda added backend Issues related to the platform backend. debt Code quality improvement or decrease of technical debt. labels Feb 5, 2024
@jirimoravcik jirimoravcik removed their assignment May 2, 2024
@fnesveda fnesveda added the validated Issues that are resolved and their solutions fulfill the acceptance criteria. label Sep 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backend Issues related to the platform backend. debt Code quality improvement or decrease of technical debt. t-platform Issues with this label are in the ownership of the platform team. tested Temporary label used only programatically for some analytics. validated Issues that are resolved and their solutions fulfill the acceptance criteria.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants