Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Docs Release 2023-09-001 #187

Merged
merged 94 commits into from
Sep 26, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
94 commits
Select commit Hold shift + click to select a range
212d332
[wip] - initial commit
Jul 13, 2023
4419a38
[wip] - ongoing improvements
Jul 14, 2023
899a1a8
[wip] - update architecture to latest
Jul 19, 2023
93a89df
[wip] - minor improvements
Jul 19, 2023
2d52dac
[wip] - start adding videos
Jul 19, 2023
745ca25
[add] - links to completee code in github
Jul 19, 2023
b28b75a
[wip] - add more videos
Jul 19, 2023
6575d69
[wip] - rename data catalogue and de-emphasize
Jul 20, 2023
2ee4bf1
[wip] - add redirect
Jul 20, 2023
13eb11d
[add] - new data store testing topic
Jul 20, 2023
d963561
[wip] - improvements to environments description
Jul 20, 2023
bb4c06c
[add] - next steps
Jul 20, 2023
d83b800
[wip] - glossary updates
Jul 20, 2023
e01df5f
[fix] - typos
Jul 25, 2023
36949fb
Merge pull request #185 from quixio/fix-streaming-token
tbedford Jul 25, 2023
cf6d29d
[add] - remaining videos
Jul 25, 2023
89cd208
Merge branch 'dev' into v2-branch
tbedford Jul 25, 2023
576511d
[add] - notes on syncing
Jul 26, 2023
30401b2
[wip] - restructured ready for arch section
Jul 26, 2023
44deb50
[add] - section on legacy workspaces
Jul 27, 2023
d57b594
[wip] - more v2 term updates
Jul 28, 2023
7ccb067
[wip] - initial section on docker
Jul 28, 2023
83e7b91
[wip] - more restructuring
Jul 28, 2023
97f9a0e
[wip] - make signup more prominent
Jul 28, 2023
38fef06
[wip] - add diagram
Jul 28, 2023
1da910f
[fix] - fix tip
Jul 28, 2023
30ba447
[wip] - minor typo
Aug 1, 2023
3ffb682
[add] - dropdown, not drop-down
Aug 1, 2023
f577faa
[add] - create project how-to
Aug 1, 2023
95ac1c6
[fix] - open in tab
Aug 1, 2023
0728aeb
[fix] - formatting fix
Aug 1, 2023
52dbee3
[fix] - minor typos
Aug 1, 2023
484eff8
[fix] - minor changes
Aug 2, 2023
d3e59ec
[update] - quickstart for v2
Aug 2, 2023
58cca27
[fix] - .env created first then python code
Aug 2, 2023
30162f1
[wip] - formatting
Aug 4, 2023
fa51c9a
[update] - quixtour for v2
Aug 4, 2023
da1338a
[update] - mostly screenshots
Aug 8, 2023
cfd5a9c
[update] - jupyter notebook how to
Aug 9, 2023
0bec7ed
[add] - post data to web app
Aug 10, 2023
6490a2c
[fix] - moving away from pipeline terminology
Aug 29, 2023
77e8b25
[update] - version tags must now be namespaced
Aug 30, 2023
04d48cf
[add] - yaml variables topic
Aug 30, 2023
f3c0bfa
[add] - more entries to glossary
Aug 30, 2023
26ca0af
[update] - screenshot
Aug 30, 2023
012d642
[add] - project structure how-to
Aug 31, 2023
9896025
[chore] - files no longer used
Aug 31, 2023
42f751a
[chore] - files no longer used
Aug 31, 2023
d5046a1
[chore] - files no longer used
Aug 31, 2023
81fa0e5
[chore] - files no longer used
Aug 31, 2023
b704563
[add] - add links to more v2 content
Aug 31, 2023
4f531e0
[add] - replicas and partitions
Sep 1, 2023
33d7978
[add] - consumer group to glossary
Sep 1, 2023
6fe2419
[add] - extend partition description with benefits
Sep 4, 2023
f02859e
[update] - library is now code samples
Sep 5, 2023
55314e1
[add] - clarify use of code samples
Sep 7, 2023
41e7cb1
[add] - initial draft image processing tutorial
Sep 8, 2023
d405d39
Fix copy commands in dockerfiles.
sadeepquix Sep 11, 2023
af93601
[add] - additions to image processing template
Sep 11, 2023
410864b
[add] - layout improvements
Sep 11, 2023
9b505fc
[fix] - copy for matlab dockerfile
Sep 12, 2023
23d8e49
Merge pull request #186 from quixio/matlab-docker
tbedford Sep 12, 2023
3788349
[fix] - case of WebSockets
Sep 12, 2023
b7cc528
[add] - secrets management
Sep 12, 2023
c6e7179
Merge branch 'dev' into v2-branch
tbedford Sep 12, 2023
fe89bee
[add] - info on application name and path
Sep 13, 2023
df1faba
Merge branch 'v2-branch' of https://github.com/quixio/quix-docs into …
Sep 13, 2023
f21cd04
[chore] - create env has own section
Sep 13, 2023
86478fc
[add] - missing intros for get project procedures
Sep 13, 2023
77741db
[chore] - minor additions and fixes
Sep 13, 2023
d855ef2
[fix] - clarify tip
Sep 13, 2023
4310ed2
[add] - technologies used
Sep 13, 2023
74269bf
[add] - link to template
Sep 13, 2023
435f25e
[add] - more details on git
Sep 13, 2023
9e47b57
[wip] - add service
Sep 15, 2023
232bec0
[wip] - completed initial draft of add service
Sep 15, 2023
22c12cd
[add] - notes on the idea of monorepo
Sep 15, 2023
eabab01
[fix] - environment includes storage option
Sep 15, 2023
d2e361c
[add] - microservice to glossary
Sep 19, 2023
43891e1
[add] - apache kafka to technology list
Sep 19, 2023
01bf572
fixed typo - object-detection.md
merlin-quix Sep 20, 2023
5c7755a
[fix] - typo
Sep 20, 2023
6741226
Merge branch 'v2-branch' of https://github.com/quixio/quix-docs into …
Sep 20, 2023
2245123
[chore] - mostly link changes
Sep 21, 2023
a69f672
[add] - links to changelogs
Sep 21, 2023
9998c73
[wip] - many updates and fixes
Sep 22, 2023
0006e54
[chore] - further updates
Sep 25, 2023
a4d760d
[add] - twitch credentials
Sep 25, 2023
4a6c637
[chore] - update pipeline segment
Sep 25, 2023
f2cb27d
[add] - more on credential config
Sep 25, 2023
6bd84b7
[update] - second part of pipeline
Sep 25, 2023
a5ea12d
[chore] - update links to live demos
Sep 26, 2023
7cff257
[update] - chat topics were renamed
Sep 26, 2023
4a72781
Merge pull request #183 from quixio/v2-branch
tbedford Sep 26, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
3 changes: 2 additions & 1 deletion WRITING-STYLE.md
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ Use the following guidelines regarding the company's name:
* Quix Portal is our product, which includes:
* Managed Kafka
* Serverless compute
* Data catalogue
* Quix data store
* APIs
* Quix Streams is our client library:
* A client library is a collection of code specific to one programming language.
Expand Down Expand Up @@ -74,6 +74,7 @@ Use the following guidelines for industry-standard terms, and Quix terms:
* Event-stream processing, not event stream processing
* DevOps, never devops
* Startup and scale-up
* Dropdown (as in dropdown menu) is one word and [not hyphenated](https://learn.microsoft.com/en-us/style-guide/a-z-word-list-term-collections/d/dropdown).

## Use topic-based writing

Expand Down
59 changes: 0 additions & 59 deletions docs/apis/data-catalogue-api/aggregate-time.md

This file was deleted.

17 changes: 0 additions & 17 deletions docs/apis/data-catalogue-api/get-swagger.md

This file was deleted.

78 changes: 0 additions & 78 deletions docs/apis/data-catalogue-api/request.md

This file was deleted.

6 changes: 3 additions & 3 deletions docs/apis/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,9 +2,9 @@

The Quix Platform provides the following APIs:

## Data Catalogue
## Query

The [Data Catalogue HTTP API](data-catalogue-api/intro.md) allows you to fetch data stored in the Quix platform. You can use it for exploring the platform, prototyping applications, or working with stored data in any language with HTTP capabilities.
The [Query API](query-api/intro.md) allows you to fetch data stored in the Quix platform. You can use it for exploring the platform, prototyping applications, or working with stored data in any language with HTTP capabilities.

## Streaming Writer

Expand All @@ -16,4 +16,4 @@ As an alternative to the client library, the Quix platform supports real-time da

## Portal API

The [Portal API](portal-api.md) gives access to the Portal interface allowing you to automate access to data including Users, Workspaces, and Projects.
The [Portal API](portal-api.md) gives access to the Portal interface enabling you to programmatically control projects, environments, applications, and deployments.
2 changes: 1 addition & 1 deletion docs/apis/portal-api.md
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
# Portal API

The Quix Portal API gives access to the Portal interface allowing you to automate access to data including Users, Workspaces, and Projects.
The Portal API gives access to the Portal interface enabling you to programmatically control projects, environments, applications, and deployments.

Refer to [Portal API Swagger](https://portal-api.platform.quix.ai/swagger){target=_blank} for more information.
Original file line number Diff line number Diff line change
@@ -1,23 +1,18 @@
# Aggregate data by tags

If you need to compare data across different values for a given tag,
you’ll want to group results by that tag. You can do so via the
`/parameters/data` endpoint.
If you need to compare data across different values for a given tag, you’ll want to group results by that tag. You can do so using the `/parameters/data` endpoint.

## Before you begin

- If you don’t already have any Stream data in your workspace, you can use any Source from our [Code Samples](../../platform/samples/samples.md) to set some up.
If you don’t already have any stream data in your environment, you can use a Source from the [Code Samples](../../platform/samples/samples.md) to provide suitable data.

- [Get a Personal Access Token](authenticate.md)
to authenticate each request.
You'll need to obtain a [Personal Access Token](authenticate.md) to authenticate each request.

## Using the groupBy property

You can supply a list of Tags in the `groupBy` array to aggregate
results by. For example, you could group a set of Speed readings by the
LapNumber they occurred on using something like:
You can supply a list of Tags in the `groupBy` array to aggregate results by. For example, you could group a set of Speed readings by the LapNumber they occurred on using something like:

``` json
```json
{
"from": 1612191286000000000,
"to": 1612191386000000000,
Expand All @@ -28,11 +23,9 @@ LapNumber they occurred on using something like:
}
```

With these settings alone, we’ll get the `LapNumber` tag included in our
results, alongside the existing timestamps and requested parameters,
e.g.
With these settings alone, we’ll get the `LapNumber` tag included in our results, alongside the existing timestamps and requested parameters, for example:

``` json
```json
{
"timestamps": [
1612191286000000000,
Expand All @@ -58,24 +51,18 @@ e.g.

## Using aggregationType

For meaningful aggregations, you should specify a type of aggregation
function for each parameter. When specifying the parameters to receive,
include the `aggregationType` in each parameter object like so:
For meaningful aggregations, you should specify a type of aggregation function for each parameter. When specifying the parameters to receive, include the `aggregationType` in each parameter object like so:

``` json
```json
"numericParameters": [{
"parameterName": "Speed",
"aggregationType": "mean"
}]
```

Ten standard aggregation functions are provided including `max`,
`count`, and `spread`. When you group by a tag and specify how to
aggregate parameter values, the result will represent that aggregation.
For example, the following results demonstrate the average speed that
was recorded against each lap:
Standard aggregation functions are provided including `max`, `count`, and `spread`. When you group by a tag and specify how to aggregate parameter values, the result will represent that aggregation. For example, the following results demonstrate the average speed that was recorded against each lap:

``` json
```json
{
"timestamps": [
1612191286000000000,
Expand Down
48 changes: 48 additions & 0 deletions docs/apis/query-api/aggregate-time.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,48 @@
# Aggregate data by time

You can downsample and upsample persisted data using the `/parameters/data` endpoint.

## Before you begin

If you don’t already have any Stream data in your environment, you can use a Source from the [Code Samples](../../platform/samples/samples.md) to provide suitable data.

You'll need to obtain a [Personal Access Token](authenticate.md) to authenticate each request.

## Aggregating and interpolating

The JSON payload can include a `groupByTime` property, an object with the following members:

* `timeBucketDuration` - The duration, in nanoseconds, for one aggregated value.
* `interpolationType` - Specify how additional values should be generated when interpolating.

For example, imagine you have a set of speed data, with values recorded at 1-second intervals. You can group such data into 2-second intervals, aggregated by mean average, with the following:

```json
{
"groupByTime": {
"timeBucketDuration": 2000000000,
},
"numericParameters": [{
"parameterName": "Speed",
"aggregationType": "Mean"
}]
}
```

You can specify an `interpolationType` to define how any missing values are generated. `Linear` will provide a value in linear proportion, while `Previous` will repeat the value before the one that was missing:

```json
{
"from": 1612191286000000000,
"to": 1612191295000000000,
"numericParameters": [{
"parameterName": "Speed",
"aggregationType": "First"
}],
"groupByTime": {
"timeBucketDuration": 2000000000,
"interpolationType": "None"
},
"streamIds": [ "302b1de3-2338-43cb-8148-3f0d6e8c0b8a" ]
}
```
Original file line number Diff line number Diff line change
@@ -1,24 +1,22 @@
# Authenticate

You need a Personal Access Token (PAT) to authenticate requests made with the Query API.

## Before you begin

- Sign up on the Quix Portal
- [Sign up for Quix](https://portal.platform.quix.ai/self-sign-up){target=_blank}

## Get a Personal Access Token

You should authenticate requests to the Catalogue API using a Personal
Access Token (PAT). This is a time-limited token which you can revoke if
necessary.
You should authenticate requests to the Query API using a Personal Access Token (PAT). This is a time-limited token which you can revoke if necessary.

Follow these steps to generate a PAT:

1. Click the user icon in the top-right of the Portal and select the
Tokens menu.
1. Click the user icon in the top-right of the Portal and select the Tokens menu.

2. Click **GENERATE TOKEN**.

3. Choose a name to describe the token’s purpose, and an expiration
date, then click **CREATE**.
3. Choose a name to describe the token’s purpose, and an expiration date, then click **CREATE**.

4. Copy the token and store it in a secure place.

Expand All @@ -32,16 +30,13 @@ Follow these steps to generate a PAT:

## Sign all your requests using this token

Make sure you accompany each request to the API with an `Authorization`
header using your PAT as a bearer token, as follows:
Make sure you accompany each request to the API with an `Authorization` header using your PAT as a bearer token, as follows:

``` http
Authorization: bearer <token>
```

Replace `<token>` with your Personal Access Token. For example, if
you’re using curl on the command line, you can set the header using
the `-H` flag:
Replace `<token>` with your Personal Access Token. For example, if you’re using curl on the command line, you can set the header using the `-H` flag:

``` shell
curl -H "Authorization: bearer <token>" ...
Expand Down
Loading
Loading