Skip to content

Commit

Permalink
update docs
Browse files Browse the repository at this point in the history
  • Loading branch information
pakio committed Oct 23, 2022
1 parent 962450f commit 5887733
Show file tree
Hide file tree
Showing 4 changed files with 13 additions and 13 deletions.
14 changes: 7 additions & 7 deletions docs/command_line_reference.rst
Original file line number Diff line number Diff line change
Expand Up @@ -258,7 +258,7 @@ Example JSON file::

All track parameters are recorded for each metrics record in the metrics store. Also, when you run ``esrally list races``, it will show all track parameters::

Race Timestamp Track Track Parameters Challenge Car User Tag
Race Timestamp Track Track Parameters Challenge Car User Tags
---------------- ------- ------------------------- ------------------- -------- ---------
20160518T122341Z pmc bulk_size=8000 append-no-conflicts defaults
20160518T112341Z pmc bulk_size=2000,clients=16 append-no-conflicts defaults
Expand Down Expand Up @@ -902,8 +902,8 @@ Rally usually installs and launches an Elasticsearch cluster internally and wipe
.. note::
This option does only affect clusters that are provisioned by Rally. More specifically, if you use the pipeline ``benchmark-only``, this option is ineffective as Rally does not provision a cluster in this case.

``user-tag``
~~~~~~~~~~~~
``user-tags/user-tag(deprecated)``
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

This is only relevant when you want to run :doc:`tournaments </tournament>`. You can use this flag to attach an arbitrary text to the meta-data of each metric record and also the corresponding race. This will help you to recognize a race when you run ``esrally list races`` as you don't need to remember the concrete timestamp on which a race has been run but can instead use your own descriptive names.

Expand All @@ -913,21 +913,21 @@ The required format is ``key`` ":" ``value``. You can choose ``key`` and ``valu

::

esrally race --track=pmc --user-tag="intention:github-issue-1234-baseline,gc:cms"
esrally race --track=pmc --user-tags="intention:github-issue-1234-baseline,gc:cms"

You can also specify multiple tags. They need to be separated by a comma.

**Example**

::

esrally race --track=pmc --user-tag="disk:SSD,data_node_count:4"
esrally race --track=pmc --user-tags="disk:SSD,data_node_count:4"



When you run ``esrally list races``, this will show up again::
Wesrally list raceshen you run ``esrally list races``, this will show up again::

Race Timestamp Track Track Parameters Challenge Car User Tag
Race Timestamp Track Track Parameters Challenge Car User Tags
---------------- ------- ------------------ ------------------- -------- ------------------------------------
20160518T122341Z pmc append-no-conflicts defaults intention:github-issue-1234-baseline
20160518T112341Z pmc append-no-conflicts defaults disk:SSD,data_node_count:4
Expand Down
2 changes: 1 addition & 1 deletion docs/metrics.rst
Original file line number Diff line number Diff line change
Expand Up @@ -108,7 +108,7 @@ Rally captures also some meta information for each metric record:
* Node name: If Rally provisions the cluster, it will choose a unique name for each node.
* Source revision: We always record the git hash of the version of Elasticsearch that is benchmarked. This is even done if you benchmark an official binary release.
* Distribution version: We always record the distribution version of Elasticsearch that is benchmarked. This is even done if you benchmark a source release.
* Custom tag: You can define one custom tag with the command line flag ``--user-tag``. The tag is prefixed by ``tag_`` in order to avoid accidental clashes with Rally internal tags.
* Custom tags: You can define one custom tags with the command line flag ``--user-tags``. The tags are prefixed by ``tag_`` in order to avoid accidental clashes with Rally internal tags.
* Operation-specific: The optional substructure ``operation`` contains additional information depending on the type of operation. For bulk requests, this may be the number of documents or for searches the number of hits.

Note that depending on the "level" of a metric record, certain meta information might be missing. It makes no sense to record host level meta info for a cluster wide metric record, like a query latency (as it cannot be attributed to a single node).
Expand Down
2 changes: 1 addition & 1 deletion docs/migrate.rst
Original file line number Diff line number Diff line change
Expand Up @@ -446,7 +446,7 @@ If you need lap functionality, the following shell script can be used instead::

for lap in $(seq 1 ${RALLY_LAPS})
do
esrally --pipeline=benchmark-only --user-tag lap:$lap
esrally --pipeline=benchmark-only --user-tags lap:$lap
done


Expand Down
8 changes: 4 additions & 4 deletions docs/tournament.rst
Original file line number Diff line number Diff line change
Expand Up @@ -5,13 +5,13 @@ Suppose, we want to analyze the impact of a performance improvement.

First, we need a baseline measurement. For example::

esrally race --track=pmc --revision=latest --user-tag="intention:baseline_github_1234"
esrally race --track=pmc --revision=latest --user-tags="intention:baseline_github_1234"

Above we run the baseline measurement based on the latest source code revision of Elasticsearch. We can use the command line parameter ``--user-tag`` to provide a key-value pair to document the intent of a race.
Above we run the baseline measurement based on the latest source code revision of Elasticsearch. We can use the command line parameter ``--user-tags`` to provide a key-value pair to document the intent of a race.

Then we implement our changes and finally we want to run another benchmark to see the performance impact of the change. In that case, we do not want Rally to change our source tree and thus specify the pseudo-revision ``current``::

esrally race --track=pmc --revision=current --user-tag="intention:reduce_alloc_1234"
esrally race --track=pmc --revision=current --user-tags="intention:reduce_alloc_1234"

After we've run both races, we want to know about the performance impact. With Rally we can analyze differences of two given races easily. First of all, we need to find two races to compare by issuing ``esrally list races``::

Expand All @@ -32,7 +32,7 @@ After we've run both races, we want to know about the performance impact. With R
0cfb3576-3025-4c17-b672-d6c9e811b93e 20160518T101957Z pmc append-no-conflicts defaults


We can see that the user tag helps us to recognize races. We want to compare the two most recent races and have to provide the two race IDs in the next step::
We can see that the user tags help us to recognize races. We want to compare the two most recent races and have to provide the two race IDs in the next step::

$ esrally compare --baseline=0bfd4542-3821-4c79-81a2-0858636068ce --contender=beb154e4-0a05-4f45-ad9f-e34f9a9e51f7

Expand Down

0 comments on commit 5887733

Please sign in to comment.