Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[APM] Synthtrace high cardinality scenarios #174746

Merged
merged 2 commits into from
Jan 12, 2024

Conversation

sorenlouv
Copy link
Member

@sorenlouv sorenlouv commented Jan 12, 2024

While working on #127036 I needed scenarios for creating a high number of services, transactions and errors. I've removed some unnecessary stuff in the scenarios that we already have elsewhere to make them run faster.

@sorenlouv sorenlouv requested review from a team as code owners January 12, 2024 12:03
@botelastic botelastic bot added Team:obs-ux-infra_services Observability Infrastructure & Services User Experience Team Team:obs-ux-management Observability Management User Experience Team labels Jan 12, 2024
@elasticmachine
Copy link
Contributor

Pinging @elastic/obs-ux-infra_services-team (Team:obs-ux-infra_services)

@sorenlouv sorenlouv added release_note:skip Skip the PR/issue when compiling release notes and removed Team:obs-ux-infra_services Observability Infrastructure & Services User Experience Team Team:obs-ux-management Observability Management User Experience Team labels Jan 12, 2024
@apmmachine
Copy link
Contributor

🤖 GitHub comments

Expand to view the GitHub comments

Just comment with:

  • /oblt-deploy : Deploy a Kibana instance using the Observability test environments.
  • /oblt-deploy-serverless : Deploy a serverless Kibana instance using the Observability test environments.
  • run elasticsearch-ci/docs : Re-trigger the docs validation. (use unformatted text in the comment!)

@sorenlouv sorenlouv force-pushed the synthtrace-improvements branch from e6ab8e1 to bbecbdf Compare January 12, 2024 12:04
@botelastic botelastic bot added the Team:obs-ux-infra_services Observability Infrastructure & Services User Experience Team label Jan 12, 2024
@sorenlouv sorenlouv removed the request for review from a team January 12, 2024 12:04
@elastic elastic deleted a comment from elasticmachine Jan 12, 2024
@sorenlouv sorenlouv changed the title [APM] Synthtrace improvements [APM] Synthtrace high cardinality scenarios Jan 12, 2024
* Side Public License, v 1.
*/

export const randomNames = [
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this should be renamed to ancient Greek random names 😆

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I thought you and @gbamparop would like it :D

generate: ({ range, clients: { apmEsClient } }) => {
const instances = times(numInstances).map((index) => {
const agentVersion = agentVersions[index % agentVersions.length];
const randomName = serviceNames[index % serviceNames.length];
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit:

Suggested change
const randomName = serviceNames[index % serviceNames.length];
const randomName = getRandomNameForIndex[index];

apm
.service({
name: `${services[index % services.length]}-${language}-${index}`,
name: `${serviceNames[index % serviceNames.length]}-${language}-${index}`,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
name: `${serviceNames[index % serviceNames.length]}-${language}-${index}`,
name: `${getRandomNameForIndex[index]-${language}-${index}`,

@sorenlouv sorenlouv enabled auto-merge (squash) January 12, 2024 13:45
@kibana-ci
Copy link
Collaborator

💚 Build Succeeded

Metrics [docs]

✅ unchanged

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

@sorenlouv sorenlouv merged commit 6eb91e8 into elastic:main Jan 12, 2024
20 of 21 checks passed
@kibanamachine
Copy link
Contributor

💔 All backports failed

Status Branch Result
8.12 Backport failed because of merge conflicts

Manual backport

To create the backport manually run:

node scripts/backport --pr 174746

Questions ?

Please refer to the Backport tool documentation

@sorenlouv sorenlouv deleted the synthtrace-improvements branch January 12, 2024 15:44
@sorenlouv sorenlouv removed the v8.12.0 label Jan 12, 2024
@kibanamachine kibanamachine added the backport:skip This commit does not require backporting label Jan 12, 2024
semd pushed a commit to semd/kibana that referenced this pull request Jan 12, 2024
While working on elastic#127036 I
needed scenarios for creating a high number of services, transactions
and errors. I've removed some unnecessary stuff in the scenarios that we
already have elsewhere to make them run faster.
* Side Public License, v 1.
*/

export const randomGreekishNames = [
Copy link
Contributor

@achyutjhunjhunwala achyutjhunjhunwala Jan 13, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@sqren If i were you, i would have sneaked in my name 😆

cauemarcondes added a commit that referenced this pull request Jan 30, 2024
Closes: #127036

This adds the ability to easily search for data in tables. The search
will be performed server side if there are more results than initially
returned by Elasticsearch. If all results were returned the search is
performed client side to provide a more snappy experience.
The feature is guarded by a feature flag (disabled by default) and only
available for services, transactions and errors table.

# Transactions


![quick-filtering](https://github.com/elastic/kibana/assets/209966/20684b88-a103-4000-a012-ee6e35479b44)

# Errors


![error3](https://github.com/elastic/kibana/assets/209966/c7f09dd9-24a5-482a-ae72-4c4477f65d3a)


**Dependencies:**

- #173973
- #174746
- #174750

---------

Co-authored-by: Caue Marcondes <caue.marcondes@elastic.co>
Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
CoenWarmer pushed a commit to CoenWarmer/kibana that referenced this pull request Feb 15, 2024
…174490)

Closes: elastic#127036

This adds the ability to easily search for data in tables. The search
will be performed server side if there are more results than initially
returned by Elasticsearch. If all results were returned the search is
performed client side to provide a more snappy experience.
The feature is guarded by a feature flag (disabled by default) and only
available for services, transactions and errors table.

# Transactions


![quick-filtering](https://github.com/elastic/kibana/assets/209966/20684b88-a103-4000-a012-ee6e35479b44)

# Errors


![error3](https://github.com/elastic/kibana/assets/209966/c7f09dd9-24a5-482a-ae72-4c4477f65d3a)


**Dependencies:**

- elastic#173973
- elastic#174746
- elastic#174750

---------

Co-authored-by: Caue Marcondes <caue.marcondes@elastic.co>
Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
fkanout pushed a commit to fkanout/kibana that referenced this pull request Mar 4, 2024
…174490)

Closes: elastic#127036

This adds the ability to easily search for data in tables. The search
will be performed server side if there are more results than initially
returned by Elasticsearch. If all results were returned the search is
performed client side to provide a more snappy experience.
The feature is guarded by a feature flag (disabled by default) and only
available for services, transactions and errors table.

# Transactions


![quick-filtering](https://github.com/elastic/kibana/assets/209966/20684b88-a103-4000-a012-ee6e35479b44)

# Errors


![error3](https://github.com/elastic/kibana/assets/209966/c7f09dd9-24a5-482a-ae72-4c4477f65d3a)


**Dependencies:**

- elastic#173973
- elastic#174746
- elastic#174750

---------

Co-authored-by: Caue Marcondes <caue.marcondes@elastic.co>
Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport:skip This commit does not require backporting release_note:skip Skip the PR/issue when compiling release notes Team:obs-ux-infra_services Observability Infrastructure & Services User Experience Team v8.13.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

8 participants