PACKAGES: Get ready for v2

[joe-getcouragenow]

Aims

We only need the following for the next release

• auth and authn
• jwt login
• mod-accounts

Deployment

We will run a single instance on Hertner cloud. Single binary with GRPC and genji. LIfe is easy then.

All the other fancy real time stuff we just comment out so its not loaded in maintemplate client and golang. Will make compilation etc easier.

Stages

STOP the CI build to Google k8

• It works and lets not break it as its a good reference.

maintemplate/Client

• comment the https://github.com/getcouragenow/packages/blob/master/maintemplate/client/lib/app_module.dart to not laod any RTC modules.

maintemplate/Server is busted locally. Thats because it relies on NATS from k8.

• Make a new main.go ( rename old one to main.go.v1)
• This will load the GRPC with genji inside.
• Daemonise it. See: https://github.com/getcouragenow/junk/tree/master/archi/daemon/daemon

Get Hertzner account up:
https://github.com/getcouragenow/junk/tree/master/archi/hosting

• Get initial binary there.

CI
Make a New CI_V2 task.

• Take bits of old..
• Must build flutter web and embed build into Server.
• then build Server with it inside.
• Maybe add Desktop client. Not mobile because it needs all that signing crap.

CD
Make the binary self updating off github release.

• SO when github actions build, Hertzner binary updates.
• MUST integrate a DB backup as part of upgrading.
  • 1. Daemon event fires for new binary
  • 2. Daemon does backup of Data to LOCAL FS, and binary to LOCAL FS
  • 3. Does its update of the binary.
    • If we screwed up the data model
    • Manually ssh in and use old binary and old DB.
• See: https://github.com/getcouragenow/junk/tree/master/archi/daemon#restart-servers

Copy core runtime bits we need into the package repo.

• makes CI easier
• We are only using this: sys_core:
  git:
  url: git://github.com/getcouragenow/core-runtime.git
  path: sys-core/client
  ref: master

Get the Desktop updating:
https://github.com/getcouragenow/junk/tree/master/archi/daemon#restart-servers
https://github.com/sanbornm/go-selfupdate

Cut code

Server IOC pattern same that each Module can run by itself OR with other Instances.

• Essentially, if mod-chat needs to take to mod-Auth, it needs to find it via a Factory Pattern.
  • When single binary VERSUS when Many Servers with same binary.

Encrypt data

Get Genji able to encrypt the data. Check with the devs there, but should be a part of the options when we start badger
https://github.com/genjidb/genji/blob/master/engine/badgerengine/engine.go#L23
https://godoc.org/github.com/dgraph-io/badger#Options.WithEncryptionKey

• Assume admin stores key offsite somewhere.
  Rotate: https://github.com/dgraph-io/badger/blob/master/badger/cmd/rotate.go

Encrypt transport

everyone uses github.com/caddyserver/certmagic

• MUST store in DB so it survives upgrades, and we hit the Lets Encrypt rate limiter.
  Examples:
• https://pkg.go.dev/github.com/caddyserver/certmagic?tab=importedby
• https://github.com/micro/go-micro/blob/master/api/server/acme/acme.go
• https://github.com/lithdew/flatend/blob/master/cmd/flatend/main.go#L153
• https://github.com/jwh/caddy-tlsconsul
• https://pkg.go.dev/oya.to/certmagic-badgerstorage?tab=doc
  • THIS LOOKS LIKE THE WINNER ! https://github.com/oyato/certmagic-badgerstorage

Data Backup and Restore

• use standard badger tools
• https://github.com/dgraph-io/badger/blob/master/badger/cmd/backup.go
• https://github.com/dgraph-io/badger/blob/master/badger/cmd/restore.go
• Place in s3 bucket in google storage. Its encrypted so its fine.
• Also can run a Hot backup on another server: https://github.com/dgraph-io/badger/blob/master/badger/cmd/stream.go

Auth in mod-accounts:

• needs domain model done in grpc. Its sort of 80% done
• needs genji
• needs crappy golang CLI client so golang devs know it works.
• needs flutter GUI in /Ops route. Why ? so we know it works and we can fix shit.
• needs Signup, Signin, Change Password, etc: https://maintemplate.ci.getcouragenow.org/#/account/signup
• Will need an Accounts route for user to edit their contact info, Avatar etc
• Will need Email SMTP to send out email on account SignUp and password change.

authz in mod-accounts

• Now to use that Auth domain model.
• JWT based
• there are plugins that do 99% of this in flutter now.
• server code to do the its thing.

Mod-main for Enrollment: https://maintemplate.ci.getcouragenow.org/#/userInfo

• The domain model is about 80% done in grpc
• Ensure we can search the data via GRPC in genji based on the filters: https://maintemplate.ci.getcouragenow.org/#/dashboard/orgs/0
• Get GUi in /Ops route, so we can admin it
• Get GUI working in mod-main/flutter
  • Its data driven GUI