Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore(weave): Cleanup integrations tests and inline pydantic and dataclass objects #2260

Merged
merged 36 commits into from
Sep 10, 2024

Conversation

andrewtruong
Copy link
Collaborator

@andrewtruong andrewtruong commented Aug 28, 2024

Summary

  1. Uses higher-level client.calls() instead of lower level client.server.calls_query()
    api for tests
    1. The langchain tests still use the lower level because the ordering is different there (seems to be BF?)
  2. Moves scattered utilities into integration_utilities.py

@circle-job-mirror
Copy link

circle-job-mirror bot commented Aug 28, 2024

@andrewtruong andrewtruong force-pushed the andrew/integrations-cleanup branch 3 times, most recently from abeb011 to 6e4b8e1 Compare August 29, 2024 01:04
@andrewtruong andrewtruong changed the base branch from master to andrew/client-calls August 29, 2024 01:04
Base automatically changed from andrew/client-calls to master August 30, 2024 15:39
@andrewtruong andrewtruong marked this pull request as ready for review August 30, 2024 15:39
@andrewtruong andrewtruong requested a review from a team as a code owner August 30, 2024 15:39
("groq.chat.completions.create", 1),
("get_game_score", 1),
("groq.chat.completions.create", 1),
calls_list = [_get_op_name(c.op_name) for c in calls]
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why did you remove the flatten calls? We are not only asserting order, but also depth. Those assertions are important, but lost here

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oh I see, I misunderstood what the index represented.

client.calls() is already flat and doesn't have that nesting atm. Should there be an option for that?

("llama_index.templating", 2),
("llama_index.llm", 2),
("openai.chat.completions.create", 3),
"llama_index.query",
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

same here (and all other places this got dropped

@andrewtruong andrewtruong changed the title chore(weave): Cleanup integrations tests chore(weave): Cleanup integrations tests and inline pydantic and dataclass objects Sep 10, 2024
@andrewtruong andrewtruong enabled auto-merge (squash) September 10, 2024 23:10
@andrewtruong andrewtruong merged commit 2e6acb7 into master Sep 10, 2024
26 checks passed
@andrewtruong andrewtruong deleted the andrew/integrations-cleanup branch September 10, 2024 23:15
@github-actions github-actions bot locked and limited conversation to collaborators Sep 10, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants