Website for Thanos' docs using Hugo. #807

bwplotka · 2019-02-04T21:28:01Z

made by @adrien-f

GiedriusS · 2019-03-15T20:46:54Z

Any updates on this? What's missing? It looks really pretty :P

adrien-f · 2019-03-18T10:14:32Z

👋

Was able to spend some time on it ! Latest version: https://adrien-f.github.io/thanos/

TODO:

adrien-f · 2019-03-20T21:31:15Z

Alright. Website updated with a blog, some reorg in files, and a template for proposals.

adrien-f · 2019-03-22T22:07:41Z

More updates !

Spend some time on responsive content, looks nice on mobile except a few elements there and there !
Renamed troubleshooting folder to help. I think this could be a nice section to have guides on collaborating, debugging Thanos and gRPC, Kubernetes deployment, etc...
Footer update

# Conflicts: # docs/getting_started.md # docs/proposals/approved/201901-read-write-operations-bucket.md

FUSAKLA · 2019-03-30T11:41:24Z

.circleci/config.yml

+            cd website/public
+            git init
+            git config --global user.email "adrien-f@users.noreply.github.com"
+            git config --global user.name "AdrienF"


Don't forget to change those :)

yes yes, still in progress (: Thanks

Signed-off-by: Bartek Plotka <bwplotka@gmail.com>

Bartek's weekend hacking.

Signed-off-by: Bartek Plotka <bwplotka@gmail.com>

Sunday hacking.

Signed-off-by: Bartek Plotka <bwplotka@gmail.com>

bwplotka · 2019-04-01T09:58:26Z

We are missing this:

bwplotka · 2019-04-01T09:58:30Z

before merge

Signed-off-by: Bartek Plotka <bwplotka@gmail.com>

bwplotka · 2019-04-01T10:04:28Z

Plus:

bwplotka · 2019-04-09T10:57:41Z

I plan to have more time on this from Thursday. How about you @adrien-f ?

Signed-off-by: Bartek Plotka <bwplotka@gmail.com>

Website hacking

bwplotka · 2019-04-13T22:59:37Z

RDY to go (just rebase needed), final PTAL @GiedriusS @povilasv @brancz @domgreen

Fixing domain as well.

Preview: https://improbable-eng.github.io/thanos

Signed-off-by: adrien-f <adrien.fillon@gmail.com>

# Conflicts: # docs/components/rule.md # docs/getting_started.md # go.sum

Signed-off-by: Bartek Plotka <bwplotka@gmail.com>

brancz · 2019-04-15T06:57:07Z

Very slick, I like it 👍. I'd suggest we use netlify to host + deploy, we have had very good experiences with prometheus.io with it, and it also renders and deploys a staging environment on each PR and adds it to the GitHub status, which makes website changes much easier to review. Just a suggestion, doesn't have to block this at all.

povilasv

LGTM, just a minor nit.

website/layouts/_default/sidemenu.html

GiedriusS · 2019-04-15T08:25:22Z

website/layouts/index.html

+<div class="container-fluid">
+    <div class="row py-5">
+        <div class="col text-center">
+            <h3 class="color-purple">Join the community !</h3>


Small nit but there probably shouldn't be a space before !

damn, forgot this, we will fix in later Pr 👍

plus markdown bit ):

GiedriusS · 2019-04-15T08:28:30Z

Markdown rendering looks a bit off here: https://thanos.io/proposals/201809_gossip-removal.md/ i.e. there is an unordered list but it got pushed into one paragraph on the website. Is this some kind of rendering bug by Hugo? Or perhaps we need to add two new line symbols to properly separate them?

bwplotka · 2019-04-15T09:50:56Z

@brancz Makes sense, wonder how hard to is to move it now vs later?

bwplotka · 2019-04-15T10:17:38Z

Some fancy bits we could add:

adrien-f · 2019-04-15T10:49:39Z

I like it, will add a little star widget !

brancz · 2019-04-15T11:51:58Z

@bwplotka moving is extremely easy. I did github pages -> netlify for my personal blog in ~10mins.

brancz

Seems like everyone is pretty happy with this. I'd say let's go with this and add more things should we want to as follow up.

bwplotka · 2019-04-15T12:14:51Z

Thanks All for help.

Huge thanks to @adrien-f who made that website.

* query: cleanup store statuses as they come and go (thanos-io#910) Signed-off-by: Adrien Fillon <adrien.fillon@cdiscount.com> * [docs] Example of using official prometheus helm chart to deploy server with sidecar (thanos-io#1003) * update documentation with an example of using official prometheus helm chart Signed-off-by: Ivan Kiselev <ivan@messagebird.com> * a little formatting to values Signed-off-by: Ivan Kiselev <ivan@messagebird.com> * satisfy PR comments Signed-off-by: Ivan Kiselev <ivan@messagebird.com> * Compact: group concurrency (thanos-io#1010) * compact: add concurrency to group compact * add flag to controll the number of goroutines to use when compacting group * update compact.md for group-compact-concurrency * fixed: miss wg.Add() * address CR * regenerate docs * use err group * fix typo in flag description * handle context * set up workers in main loop * move var initialisation * remove debug log * validate concurrency * move comment * warn -> error * remove extra newline * fix typo * dns: Added miekgdns resolver as a hidden option to query and ruler. (thanos-io#1016) Fixes: thanos-io#1015 Signed-off-by: Bartek Plotka <bwplotka@gmail.com> * query: set default evaluation interval (thanos-io#1028) Subqueries allows request with no [specified resolution](https://prometheus.io/blog/2019/01/28/subquery-support/). Set it up and allow to configure default evaluation interval. * store+compactor: pre-compute index cache during compaction (thanos-io#986) Fixes first part of thanos-io#942 This changes allow to safe some startup & sync time in store gateway as it is no longer is needed to compute index-cache from block index on its own. For compatibility store GW still can do it, but it first checks bucket if there is index-cached uploaded already. In the same time, compactor precomputes the index cache file on every compaction. To allow quicker addition of index cache files we added `--index.generate-missing-cache-file` flag, that if enabled precompute missing files on compactor startup. Note that it will take time and it's only one-off step per bucket. Signed-off-by: Aleksei Semiglazov <xjewer@gmail.com> * Added website for Thanos' docs using Hugo. (thanos-io#807) Hosted in github pages. Signed-off-by: adrien-f <adrien.fillon@gmail.com> Signed-off-by: Bartek Plotka <bwplotka@gmail.com> * gcs: Fixed scopes for inline ServiceAccount option. (thanos-io#1033) Without this that option was unusable. Signed-off-by: Bartek Plotka <bwplotka@gmail.com> * Fixed root docs and liche is now checking root dir as well. (thanos-io#1040) Signed-off-by: Bartek Plotka <bwplotka@gmail.com> * storage docs: add detail about GCS policies and testing (thanos-io#1037) * add more details about GCS policies and testing * remove fixed names from exec command * Prometheus library updated to v2.8.1 (thanos-io#1009) * compact: group concurrency improvements (thanos-io#1029) * group concurrency improvements * remove unnecessary error check * add to wg in main goroutine * receive: Add block shipping (thanos-io#1011) * receive: Add retention flag for local tsdb storage (thanos-io#1046) * querier: Add /api/v1/labels support (thanos-io#905) * Feature: add /api/v1/labels support Signed-off-by: jojohappy <sarahdj0917@gmail.com> * Disabled gossip by default, marked all flags as deprecated. (thanos-io#1055) + changed small label. Signed-off-by: Bartek Plotka <bwplotka@gmail.com> * ruler: Fixed Chunk going out or Max Uint16. (thanos-io#1041) Fixes thanos-io#1038 Signed-off-by: Bartek Plotka <bwplotka@gmail.com> * store: azure: allow passing an endpoint parameter for specific regions (thanos-io#980) Fix thanos-io#968 Signed-off-by: Adrien Fillon <adrien.fillon@cdiscount.com> * feature: support POST method for series endpoint (thanos-io#1021) Signed-off-by: Joseph Lee <joseph.t.lee@outlook.com> * bucket verify: repair out of order labels (thanos-io#964) * bucket verify: repair out of order labels * verify repair: correctly order series in the index on rewrite When we have label sets that are not in the correct order, fixing that changes the order of the series in the index. So the index must be rewritten in that new order. This makes this repair tool take up a bunch more memory, but produces blocks that verify correctly. * Fix the TSDB block safe-delete function The directory name must be the block ID name exactly to verify. A temp directory or random name will not work here. * verify repair: fix duplicate chunk detection Pointer/reference logic error was eliminating all chunks for a series in a given TSDB block that wasn't the first chunk. Chunks are now referenced correctly via pointers. * PR feedback: use errors.Errorf() instead of fmt.Errorf() * Use errors.New() Some linters catch errors.Errorf() as its not really part of the errors package. * Liberally comment this for loop We're comparing items by pointers, using Go's range variables is misleading here and we need not fall into the same trap. * Take advantage of sort.Interface This prevents us from having to re-implement label sorting. * PR Feedback: Comments are full sentences. * Cut release 0.4.0-rc.0 (thanos-io#1017) * Cut release 0.4.0-rc.0 🎉 🎉 NOTE: This is last release that has gossip. Signed-off-by: Bartek Plotka <bwplotka@gmail.com> Co-Authored-By: povilasv <p.versockas@gmail.com> * Fixed crossbuild. Signed-off-by: Bartek Plotka <bwplotka@gmail.com> * ci: Env fixes. (thanos-io#1058) Signed-off-by: Bartek Plotka <bwplotka@gmail.com> * Removed bzr requirement for make crossbuild. Signed-off-by: Bartek Plotka <bwplotka@gmail.com> * Bump github.com/hashicorp/golang-lru from 0.5.0 to 0.5.1 (thanos-io#1051) Bumps [github.com/hashicorp/golang-lru](https://github.com/hashicorp/golang-lru) from 0.5.0 to 0.5.1. - [Release notes](https://github.com/hashicorp/golang-lru/releases) - [Commits](hashicorp/golang-lru@v0.5.0...v0.5.1) Signed-off-by: dependabot[bot] <support@dependabot.com> * Initialze and correctly register all index cache metrics. (thanos-io#1069) * store/cache: add more tests (thanos-io#1071) * Fixed Downsampling process; Fixed `runutil.CloseAndCaptureErr` (thanos-io#1070) * runutil. Simplified CloseWithErrCapture. Signed-off-by: Bartek Plotka <bwplotka@gmail.com> * Fixed Downsampling process; Fixed runutil.CloseAndCaptureErr Fixes thanos-io#1065 Root cause: * runutil defered capture error function was not passing error properly so unit tests were passing, event though there was bug * streamed block write index cache requires index file which was not closed (saved) properly yet. Closers need to be closed to perform this. Signed-off-by: Bartek Plotka <bwplotka@gmail.com> * objstore: Expose S3 region attribute (thanos-io#1060) Minio is able to autodetect the region for cloud providers like AWS but the logic fails with Scaleway Object Storage solution. Related issue on Minio: minio/mc#2570 * Fixed fetching go-bindata failed (thanos-io#1074) * Fixed bug: - fetching go-bindata failed. - change the repo of go-bindata to github.com/go-bindata/go-bindata, because old repo has been archived. - pin the go-bindata as v3.3.1. Signed-off-by: jojohappy <sarahdj0917@gmail.com> * Add CHANGELOG Signed-off-by: jojohappy <sarahdj0917@gmail.com> * Remove CHANGELOG Signed-off-by: jojohappy <sarahdj0917@gmail.com> * add compare flags func to compare flags between prometheus and sidecar (thanos-io#838) Original message: * update documentation for a max/min block duration add compare flags func to compare flags between prom and sidecar * fix some nits Functional change: now we check the configured flags (if possible) and error out if MinTime != MaxTime. We need to check this always since if that is not true then we will get overlapping blocks. Additionally, an error message is printed out if it is not equal to 2h (the recommended value). * Ensured index cache is best effort, refactored tests, validated edge cases. (thanos-io#1073) Fixes thanos-io#651 Current size also includes slice header. Signed-off-by: Bartek Plotka <bwplotka@gmail.com> * website: Moved to netlify. (thanos-io#1078) Signed-off-by: Bartek Plotka <bwplotka@gmail.com> * website: Fixing netlify. (thanos-io#1080) Signed-off-by: Bartek Plotka <bwplotka@gmail.com> * website: Added "founded by" footer. (thanos-io#1081) Signed-off-by: Bartek Plotka <bwplotka@gmail.com> * store/proxy: properly check if context has ended (thanos-io#1082) How the code was before it could happen that we might receive some series from the stream however by the time we'd send them back to the reader, it would not read it anymore since the deadline would have been exceeded. Properly use a `select` here to get out of the goroutine if the deadline has been exceeded. Might potentially fix a problem where we see one goroutine hanging constantly (and thus blocking from work being done): ``` goroutine profile: total 126 25 @ 0x42f62f 0x40502b 0x405001 0x404de5 0xe7435b 0x45cc41 0xe7435a github.com/improbable-eng/thanos/pkg/store.startStreamSeriesSet.func1+0x18a /go/src/github.com/improbable-eng/thanos/pkg/store/proxy.go:318 ``` * Cut release v0.4.0-rc.1 (thanos-io#1088) Signed-off-by: Bartek Plotka <bwplotka@gmail.com> * website: Removed ghpages handling; fixed docs; and status badge. (thanos-io#1084) Signed-off-by: Bartek Plotka <bwplotka@gmail.com> * Fix readme (thanos-io#1090) * store: Compose indexCache properly allowing injection for testing purposes. (thanos-io#1098) Signed-off-by: Bartek Plotka <bwplotka@gmail.com> * website: add sponsor section on homepage (thanos-io#1062) * website: Adjusted logos sizing and responsiveness. (thanos-io#1105) Signed-off-by: Bartek Plotka <bwplotka@gmail.com> * Add Monzo to "Used by" section 🎉 (thanos-io#1106) * Compactor: remove malformed blocks after delay (thanos-io#1053) * compactor removes malformed blocks after delay * compactor removes malformed blocks after delay * include missing file * reuse existing freshness check * fix comment * remove unused var * fix comment * syncDelay -> consistencyDelay * fix comment * update flag description * address cr * fix dupliacte error handling * minimum value for --consistency-delay * update * docs * add test case * move test to inmem bucket * Add Utility Warehouse to "used by" section (thanos-io#1108) * Add Utility Warehouse logo * Make logo smaller * website: add Adform as users (thanos-io#1109) We use Thanos extensively as well so I have added Adform. * Cut release v0.4.0 (thanos-io#1107) Signed-off-by: Bartek Plotka <bwplotka@gmail.com>

adrien-f added 8 commits March 17, 2019 16:04

docs: try hugo

e27de62

fix: bad root url

2732f36

fix: bad root url

0b2fad8

fix: bad root url

869aa6a

fix: bad root url

e6d50e6

update subtitle

23a956d

update

8ae3ce1

update

7c0af37

adrien-f force-pushed the feature/docs-hugo branch from d52f413 to 7c0af37 Compare March 17, 2019 16:45

domgreen added the component: website/docs label Mar 18, 2019

update hugo

8168bd7

adrien-f added 2 commits March 21, 2019 17:27

fix: menus

13710d9

update

309f9eb

adrien-f and others added 5 commits March 22, 2019 23:13

update

f46ed71

move config outside website folder and rewrite getting-started

a47827f

update

c2355b1

update

dae29eb

Merge branch 'master' into feature/docs-hugo

140d864

# Conflicts: # docs/getting_started.md # docs/proposals/approved/201901-read-write-operations-bucket.md

bwplotka force-pushed the feature/docs-hugo branch from 1d7766b to 140d864 Compare March 30, 2019 11:28

FUSAKLA reviewed Mar 30, 2019

View reviewed changes

bwplotka and others added 6 commits March 30, 2019 12:48

Bartek's weekend hacking.

1f043ec

Signed-off-by: Bartek Plotka <bwplotka@gmail.com>

Merge pull request #1 from improbable-eng/fixes-to-deployment

14b2df0

Bartek's weekend hacking.

Sunday hacking.

1d30983

Signed-off-by: Bartek Plotka <bwplotka@gmail.com>

Merge pull request #2 from improbable-eng/feature/docs-hugo-impr

e3dd9e6

Sunday hacking.

cleanup blog and some links

59fadbe

fix: add perl in circle ci website build

af05ec2

Moved to Improbable.

03a3209

Signed-off-by: Bartek Plotka <bwplotka@gmail.com>

Fixes.

6ee6785

Signed-off-by: Bartek Plotka <bwplotka@gmail.com>

adrien-f and others added 3 commits April 9, 2019 13:23

fix: use GA template tag

1cb36be

Small website fixes.

2a8a915

Signed-off-by: Bartek Plotka <bwplotka@gmail.com>

Merge pull request #3 from improbable-eng/bwplotka-docs-hugo-changes

6199ac1

Website hacking

adrien-f and others added 6 commits April 14, 2019 14:26

fix: update text-indent on sidebar

ff55d5a

Signed-off-by: adrien-f <adrien.fillon@gmail.com>

Merge branch 'master' into adrien-f-feature/docs-hugo

5403918

# Conflicts: # docs/components/rule.md # docs/getting_started.md # go.sum

Moved domains.

bd6ebdf

Signed-off-by: Bartek Plotka <bwplotka@gmail.com>

Fixed link.

7faae79

Signed-off-by: Bartek Plotka <bwplotka@gmail.com>

Removed not needed CI changes.

7c2e817

Signed-off-by: Bartek Plotka <bwplotka@gmail.com>

Added CNAME file.

0377848

Signed-off-by: Bartek Plotka <bwplotka@gmail.com>

povilasv approved these changes Apr 15, 2019

View reviewed changes

website/layouts/_default/sidemenu.html Outdated Show resolved Hide resolved

GiedriusS reviewed Apr 15, 2019

View reviewed changes

povilasv approved these changes Apr 15, 2019

View reviewed changes

brancz approved these changes Apr 15, 2019

View reviewed changes

bwplotka merged commit dda20f0 into thanos-io:master Apr 15, 2019

bwplotka deleted the feature/docs-hugo branch April 15, 2019 12:15

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Website for Thanos' docs using Hugo. #807

Website for Thanos' docs using Hugo. #807

bwplotka commented Feb 4, 2019 •

edited

Loading

GiedriusS commented Mar 15, 2019

adrien-f commented Mar 18, 2019 •

edited

Loading

adrien-f commented Mar 20, 2019

adrien-f commented Mar 22, 2019

FUSAKLA Mar 30, 2019

bwplotka Mar 31, 2019

bwplotka commented Apr 1, 2019

bwplotka commented Apr 1, 2019

bwplotka commented Apr 1, 2019

bwplotka commented Apr 9, 2019

bwplotka commented Apr 13, 2019

brancz commented Apr 15, 2019 •

edited

Loading

povilasv left a comment

GiedriusS Apr 15, 2019

bwplotka Apr 15, 2019 •

edited

Loading

bwplotka Apr 15, 2019

GiedriusS commented Apr 15, 2019 •

edited

Loading

bwplotka commented Apr 15, 2019

bwplotka commented Apr 15, 2019

adrien-f commented Apr 15, 2019

brancz commented Apr 15, 2019

brancz left a comment •

edited

Loading

bwplotka commented Apr 15, 2019 •

edited

Loading

Website for Thanos' docs using Hugo. #807

Website for Thanos' docs using Hugo. #807

Conversation

bwplotka commented Feb 4, 2019 • edited Loading

GiedriusS commented Mar 15, 2019

adrien-f commented Mar 18, 2019 • edited Loading

adrien-f commented Mar 20, 2019

adrien-f commented Mar 22, 2019

FUSAKLA Mar 30, 2019

Choose a reason for hiding this comment

bwplotka Mar 31, 2019

Choose a reason for hiding this comment

bwplotka commented Apr 1, 2019

bwplotka commented Apr 1, 2019

bwplotka commented Apr 1, 2019

bwplotka commented Apr 9, 2019

bwplotka commented Apr 13, 2019

brancz commented Apr 15, 2019 • edited Loading

povilasv left a comment

Choose a reason for hiding this comment

GiedriusS Apr 15, 2019

Choose a reason for hiding this comment

bwplotka Apr 15, 2019 • edited Loading

Choose a reason for hiding this comment

bwplotka Apr 15, 2019

Choose a reason for hiding this comment

GiedriusS commented Apr 15, 2019 • edited Loading

bwplotka commented Apr 15, 2019

bwplotka commented Apr 15, 2019

adrien-f commented Apr 15, 2019

brancz commented Apr 15, 2019

brancz left a comment • edited Loading

Choose a reason for hiding this comment

bwplotka commented Apr 15, 2019 • edited Loading

bwplotka commented Feb 4, 2019 •

edited

Loading

adrien-f commented Mar 18, 2019 •

edited

Loading

brancz commented Apr 15, 2019 •

edited

Loading

bwplotka Apr 15, 2019 •

edited

Loading

GiedriusS commented Apr 15, 2019 •

edited

Loading

brancz left a comment •

edited

Loading

bwplotka commented Apr 15, 2019 •

edited

Loading