* test

* Fixed CI

* Fixed tests

* Fixed formatting

* Fixed test error by removing chrono default features

* Rename smoketests CI thing

* Hopefully fix the testing issue

* Fix typos

* Fixed install git-hooks

* Fixed formatting

* Fixed compile error

* fixed testing issues

Signed-off-by: Tyler Cloutier <cloutiertyler@users.noreply.github.com>

Co-authored-by: Tyler Cloutier <cloutiertyler@aol.com>

* Clippy runs on default module

* Fix clippy issue with default module

---------

Co-authored-by: Boppy <no-reply@boppygames.gg>

* I think somehow we are adding all tables as orphans, added log

* Removed unneeded clone

---------

Co-authored-by: Boppy <no-reply@boppygames.gg>

)

* Fix bug for subcription that was not executing or returning if empty

* Clippy

* Filter out deleted rows

* Recover the op_type (DELETED, INSERTED) flag for the row in the subscription

* grandfathered docs improvements in bindings

* improve bindings

* address review comments

* remove late bound lifetime

* undo derive for Timestamp to bisect bug

* Forbid unsupported syntax in SELECT (like ORDER BY) & improve accuracy of sql test suite

* Update crates/sqltest/src/main.rs

Co-authored-by: Mazdak Farrokhzad <twingoow@gmail.com>
Signed-off-by: Mario Montoya <mamcx@elmalabarista.com>

---------

Signed-off-by: Mario Montoya <mamcx@elmalabarista.com>
Co-authored-by: Mazdak Farrokhzad <twingoow@gmail.com>

Signed-off-by: John Detter <4099508+jdetter@users.noreply.github.com>
Co-authored-by: Boppy <no-reply@boppygames.gg>

* Working on improving commands that use identities

* Fix lints

* Reverted file that shouldn't have changed

* Found and fixed all other todos

* Addressed more CLI TODOs

* Fixes for formatting issues

* Set names of identities

* Set name of identities + clippy

* Small fix

* Added the start of a doc comment, switching over to another PR

* Fixed tests that needed to be updated

* Addressed more feedback and fixed several clippy issues

* Small fix

* Apply suggestions from code review

Co-authored-by: Mazdak Farrokhzad <twingoow@gmail.com>
Signed-off-by: John Detter <4099508+jdetter@users.noreply.github.com>

* Added more doc comments

* Addressing more feedback

* Fixed really old bug in SpacetimeDB

* Tests to verify new functionality

* Fix clippy lints

* Email during identity creation is optional

* Fix output so testsuite passes

---------

Signed-off-by: John Detter <4099508+jdetter@users.noreply.github.com>
Co-authored-by: Boppy <no-reply@boppygames.gg>
Co-authored-by: Mazdak Farrokhzad <twingoow@gmail.com>

* Some work

* Getting smoketests working on mac

* All tests are passing except known failing tests

---------

Co-authored-by: Boppy <no-reply@boppygames.gg>

…urn wether or not reducer has subscribers; Moved all ReducerEvent and ReducerArgs code into a single file (#10)

Co-authored-by: Steve <steve@codefics.com>

Co-authored-by: Boppy <no-reply@boppygames.gg>

* Changed C# reducer signature; Change reducer invocation method to return wether or not reducer has subscribers; Moved all ReducerEvent and ReducerArgs code into a single file

* Formatting, tests

* Clippy

* Removed union from C# codegen

* Tests

* Update crates/cli/src/subcommands/generate/csharp.rs

Co-authored-by: Tyler Cloutier <cloutiertyler@users.noreply.github.com>
Signed-off-by: John Detter <4099508+jdetter@users.noreply.github.com>

* Removed duplicate code

* Lint

* Clippy

* CLIPPY

* Generating custom indexes for unique / primary keys

---------

Signed-off-by: John Detter <4099508+jdetter@users.noreply.github.com>
Co-authored-by: Steve <steve@codefics.com>
Co-authored-by: John Detter <4099508+jdetter@users.noreply.github.com>
Co-authored-by: Tyler Cloutier <cloutiertyler@users.noreply.github.com>

* Fix incomplete transaction bug

* Clippy

Co-authored-by: Steve <steve@codefics.com>

tokio runtimes cannot be nested, so we only create one if no ambient
context can be found and pass around a runtime handle for spawning
tasks.

* integrate jdetter's review

* address phoebe's comments

* improve errnos naming

Prior to this commit, callbacks in the Rust client SDK shared access to the global
ClientCache while running asynchronously. This meant that a long-running or delayed
callback could observe the ClientCache in a state later than the one that caused the
callback's invocation, and had no way to access the specific state for which it was
invoked.

With this commit, each `Invoke` message to the callback worker includes an
`Arc<ClientCache>` snapshot of the DB state when that callback was invoked. The callback
worker stores that state in a `thread_local`, and methods that inspect
tables (e.g. `TableType::iter`) read the state out of the `thread_local` when it is
present. This allows callbacks to observe exactly the state which caused their invocation,
never a later state, while maintaining the C#-like API where `ClientCache` access is based
on free functions or static trait methods.

---------

Co-authored-by: John Detter <4099508+jdetter@users.noreply.github.com>

* Fix bug and added a test

* Test updates

* Fix tests

---------

Co-authored-by: Boppy <no-reply@boppygames.gg>

…sage log) (#34)

* Fixes the restart problem (i.e. rebuilding the datastore from the message log)

* Remove logging

* simplify is_address

* cli: dedup some code

Co-authored-by: Boppy <no-reply@boppygames.gg>

`IndexDef` contains a table id, which is not yet known (i.e. zero) when
constructing `TableDef` from the module describers. But it /is/ known
for the schema obtained from the database catalog, so schemas compare
inequal even if they're structurally equivalent.

Fixed by just updating the proposed schema for known tables before
comparing. Also update the smoke test to contain an indexed column.

#44)

When running `spacetime generate` on a module which fails to compile,
the last line of the output is now a human-readable error message
which includes the module path and instructions to review the build errors.

* Add primary key class variable to table autogen in python

* Fix lint error

---------

Co-authored-by: Derek Brinkmann <dbrinkmann@citadelstudios.net>

* `ReducerEvent` enum in Rust client SDK

With this commit, row callbacks (`on_insert`, `on_delete`, `on_update`)
in the Rust client SDK take an additional argument,
`Option<&ReducerEvent>`, where `ReducerEvent` is an enum
generated by the CLI's codegen
with a variant for each reducer defined in the module.

Having the SDK pass around an autogenerated type in this way
(without adding a bunch of `<ReducerEvent>` generic parameters everywhere)
requires storing the `ReducerEvent` in an `Arc<dyn Any>`.
This has the added tangential benefit of avoiding cloning the `ReducerEvent`
for each row callback.

* Change NetworkManager to SpacetimeDBClient

* Update csharp gen for ReducerEventBase

* More fixes for ReducerEventBase

* Remove commented out code

---------

Co-authored-by: Derek Brinkmann <dbrinkmann@citadelstudios.net>

* cli: refactor + improve call errors

* cli: improve call errors

* cli: simplify tasks

* misc improvements

* cargo fmt + clippy

With this commit, module-side `filter_by_{non-unique-field}` methods will use an index on the non-unique-field, if one exists.

This is accomplished by altering `query::filter_by_field` to call `iter_by_col_eq` (formerly `seek_eq`), and having the returned `FilterByIter` gradually deserialize the returned buffer in a `Cursor`.

* Pretty banner

* Updated the CLI ascii art

---------

Co-authored-by: Boppy <no-reply@boppygames.gg>
Co-authored-by: Tyler Cloutier <cloutiertyler@aol.com>

* Committing version upgrade script

* Fixes to the upgrade script

* Upgrade version to 0.5.0

* Update Cargo.toml

No longer optional

Signed-off-by: John Detter <4099508+jdetter@users.noreply.github.com>

* Fixed small issue in the version upgrade script

---------

Signed-off-by: John Detter <4099508+jdetter@users.noreply.github.com>
Co-authored-by: Boppy <no-reply@boppygames.gg>

* Remove the ever growing pile of memory in locking_tx_datastore

* Clippy lint

* cargo fmt

* Cleanups

* Fix lint

* Rename TxRecord::pv to product_value

---------

Co-authored-by: Boppy <no-reply@boppygames.gg>
Co-authored-by: Tyler Cloutier <cloutiertyler@aol.com>

* Fixes the restart problem (i.e. rebuilding the datastore from the message log)

* Remove logging

* Enable restart tests

* Fixed small issues with tests

* Fixed restart-repeating-reducer test probably

---------

Co-authored-by: Tyler Cloutier <cloutiertyler@aol.com>
Co-authored-by: Boppy <no-reply@boppygames.gg>

* [TypeScript] Remove entries from filtering

In the TypeScript SDK we keep "entries" - an algebraic value of records.
I added them because they were also used in the C# SDK, but we don't
really need them. This commit changes generated filtering functions so
that they compare actual instances instead of product values.

* Restoring Mazdak's nits

* Update auth.rs

Small issue

Signed-off-by: John Detter <4099508+jdetter@users.noreply.github.com>

---------

Signed-off-by: John Detter <4099508+jdetter@users.noreply.github.com>
Co-authored-by: Boppy <no-reply@boppygames.gg>

* Cargo profile for building more quickly

* opt level is redundant

---------

Co-authored-by: Boppy <no-reply@boppygames.gg>

* Initial bootstrap for private tables

* Separate Access (private, public) for kind o table (system, user)

* Validates the access to private tables

* Check auth for drop table

* Allow to authenticate with a short lived token for websocket

* Add CORS

* Lints

* Name errors properly

* lint

* Script for publishing crates to crates.io

* Added sdk to the publish-crates script, renamed client-sdk to sdk

* Updated Cargo.lock and added 2 crates to the upgrade version script

* Small fix

* Actual fix

* Updated client API messages crate to be publishable

* Added LICENSE file to sdk

* Chose specific version for tokio-tungstenite

---------

Co-authored-by: Boppy <no-reply@boppygames.gg>
Co-authored-by: Tyler Cloutier <cloutiertyler@aol.com>

Co-authored-by: Boppy <no-reply@boppygames.gg>

#70)

Co-authored-by: Boppy <no-reply@boppygames.gg>

Fix name of python sdk package for python

Co-authored-by: Derek Brinkmann <dbrinkmann@citadelstudios.net>

…#71)

script

Co-authored-by: Boppy <no-reply@boppygames.gg>

* SDK: Correctly encode auth header, and ser/de `Credentials`

Prior to this commit, the Rust SDK incorrectly encoded a `Token` passed to `connect`,
making it impossible to re-connect an existing user.
(Shows what I get for never testing that.)
With this commit, auth tokens are correctly base64-encoded
in an `Authorization: Basic` header with the username `token`,
which allows re-connecting as an existing user.

Also, it was difficult to re-use `Credentials` from the Rust SDK, as:
- they were opaque types with non-exported members
- they did not implement any serialization / deserialization
This commit makes `token.string` and `identity.bytes` public fields,
and implements SATN `Serialize` and `Deserialize`
for `Identity`, `Token` and `Credentials`,
allowing clients to save their credentials for re-use, e.g. to a file.

* SDK: Handful of small changes

- `subscribe_owned` accepts `Vec<String>`; behaves like `subscribe`.
  - While developing `letrs`, a demo game, we needed to generate query strings at runtime,
    and passing them to `subscribe` would have involved an unergonomic dance
    of taking references which would then be converted to owned containers
    by the SDK.
    `subscribe_owned` eliminates that, allowing client authors
    to construct a set of queries at runtime and pass it directly to the SDK,
    without intervening referencies and copies.
- Docstrings for `subscribe` and `subscribe_owned`.
- Methods on `Identity` and `Token` for converting to/from strings and byte-vectors.
- Removed long-forgotten `println` within `connect`
  which wrote the computed URI to stdout.

* Added commands for spacetime server list and spacetime server ping

* Small fix

* Updated test

---------

Co-authored-by: Boppy <no-reply@boppygames.gg>

…es. Upgrade SQL parsing (#74)

Prior to this commit, it was possible for a module to crash SpacetimeDB
by scheduling a reducer with a delay longer than ~2yrs.
This was due to our use of `tokio_utils::time::DelayQueue` to handle scheduling.
`DelayQueue`'s internal data structure imposes a limit of 64^6 ms on delays,
a little more than two years.
Attempting to insert with a delay longer than that panics.

With this commit, we avoid the panic by checking ourselves that the requested delay
is not longer than 64^6 ms.
This requires bubbling a `ScheduleError` up from `Scheduler::schedule`
to `WasmInstanceEnv::schedule`, where it is converted into a `RuntimeError`
which crashes the module.

`Scheduler::schedule` could also fail because its transaction to compute a new id
was fallible. This seems unlikely to ever fail, and if it does, we have bigger problems,
so `unwrap`ping might still be reasonable for that case,
but this commit converts it into a handle-able `Err`or anyway,
as there's essentially no cost in complexity to doing so.

* SDK: Convert `http[s]` uri schemes to `ws[s]`

Prior to this commit, the Rust SDK would reject host URIs which began with `http://` or
`https://`, requiring exactly one of `ws://` or `wss://`.
Now, the SDK converts `http` URI schemes to their websocket equivalents,
so clients can do `connect("http://localhost:3000", "my-database", my-creds)`.

* SDK: Append `Args` suffix to generated reducer args structs

This reduces the liklihood of name collisions,
e.g. when a user has both a table `Guess` and a reducer `guess`.
Prior to this commit, in that case, the SDK would generate
a `struct guess::Guess` for the table, and
a `struct guess_reducer::Guess` for the reducer args.
Now, the latter is `struct guess_reducer::GuessArgs`.
This will allow the CLI's codegen to re-export all generated structs
from its main `mod.rs` file.

* SDK: generated `mod.rs` re-exports all other files

The `mod.rs` generated by `spacetime generate --lang rust`
now re-exports all of the types and functions
defined in other files it generates.

This allows users to write e.g. `spacetime_types::Player`,
rather than `spacetime_types::player::Player`.

* Run cargo fmt on all rust output files

* Lint fix

---------

Co-authored-by: Boppy <no-reply@boppygames.gg>

Co-authored-by: Boppy <no-reply@boppygames.gg>

* Working on improving commands that use identities

* Fix lints

* Reverted file that shouldn't have changed

* Found and fixed all other todos

* Addressed more CLI TODOs

* Fixes for formatting issues

* Set names of identities

* Set name of identities + clippy

* Small fix

* Added the start of a doc comment, switching over to another PR

* Fixed tests that needed to be updated

* Addressed more feedback and fixed several clippy issues

* Small fix

* Apply suggestions from code review

Co-authored-by: Mazdak Farrokhzad <twingoow@gmail.com>
Signed-off-by: John Detter <4099508+jdetter@users.noreply.github.com>

* Added more doc comments

* Addressing more feedback

* Fixed really old bug in SpacetimeDB

* Tests to verify new functionality

* Fix clippy lints

* Email during identity creation is optional

* Some work

* Getting smoketests working on mac

* All tests are passing except known failing tests

* Working on parallel smoketests

* Fixed some bugs in saving configs that was preventing this from working

* Fixes required for parallel tests

* Tests are working in parallel

* Pruned changes

* retab

* re-retab

* retab the lib file

* Cargo profile for building more quickly

* I have to rebase on another PR

* smoketest fixes

* create_project and reset_project are now the same thing, removed
create_project

* More fixes

* Removed print statement

* Small fix

* Another fix

* Tons of improvements to the smoketests

* Have to rebase on master

* Small fixes

* More progress

* Finally working correctly!

* Apparently we're missing this

* Enable command output

* Listing installed targets

* Clean before building

* What is going on

* Something super wonky going on

* Another test

* Skip building containers for now

* Small fix

* Test using cargo instead

* Changed workflow a bit

* CI is stuck

* Small fix

* Another fix

* Try cargo run instead of building spacetime CLI

* Removed workflow step

* Fixing all of the tests

* Identity test

* Tests should finally be working

* Enable debug

* Remove spacetime from path

* Another try

* Logic fix

* Another fix

* Another fix

* Working now?

* Another fix

* Finally working again

* Adding github containers back in

* CI fix

* Use SpacetimeDB Large Runner

* Updated test to get more output

* Changed 0ms to 10ms to improve parallel test stability

* Removed unused logs

Signed-off-by: John Detter <4099508+jdetter@users.noreply.github.com>

* Removed unnecessary reset_project

* Removed reset_config where its not needed

* Reset template

---------

Signed-off-by: John Detter <4099508+jdetter@users.noreply.github.com>
Co-authored-by: Boppy <no-reply@boppygames.gg>
Co-authored-by: Mazdak Farrokhzad <twingoow@gmail.com>

* Removing 'repl' as a distinct option for the 'cli' and move into the 'sql' invocation with --interactive

* Move up the logic for parsing in repl

The Rust SDK lives in this repository
and exposes an API on which Rust clients will depend,
distinct from both the module API
and the ClientAPI (which is the protocols all SDKs use to commuticate with a module).

This commit adds a checkbox to the PR template,
in the style of the two existing checkboxes,
to identify breaking changes to the SDK API.

Prior to this commit,
all interfaces for registering and de-registering callbacks returned `Result`,
with an error when attempting to register a callback before `connect`ing.
This was due to a quirk in the SDK's implementation,
where callbacks were stored alongside information
supplied by `connect`, e.g. autogenerated dispatch functions.

With this commit, the SDK stores a partially-initialized `BackgroundDbConnection`
in a `lazy_static`,
into which callbacks can be registered.
The autogenerated `connect` function finishes initializing the `BackgroundDbConnection`,
setting various `Option` fields to `Some`.
This means it is now possible to register callbacks before calling `connect`.

In particular, this prevents a race condition where `on_connect` callbacks
might never be invoked
because credentials might have become available after calling `connect`,
but before registering the callback.

Many user-facing functions which interact with callbacks
have had their return types changed;
where they previously returned a `Result`,
they now return the "success" type unwrapped.

This commit adds support for the `on_subscription_applied` callback,
which runs when the initial rows of a subscription become available
after a `subscribe` call.

[SDK] Functions for saving and loading `Credentials` to/from disk

This commit adds two functions to the Rust SDK, identity::save_credentials and identity::load_credentials, which abstract over the common desire to save a user's credentials to a file in (a subdir of) ~, and load it when re-connecting.

In addition to de-duplicating common functionality, this allows us to remove a relatively complex section of the Rust SDK Quickstart guide.

…e INSERT (#76)

Thin LTO should be about as good as far LTO, but much faster, and debug info is something that takes enormous amount of time to handle throughout build pipeline but something we don't usually need in release builds (symbol information should be enough if it's backtraces that we're interested in).

This cuts `cargo build --release` for the CLI from 9m 40s to 5m 20s on my machine.

Co-authored-by: Boppy <no-reply@boppygames.gg>

* bindings-macro: add note re. autoinc

* Update crates/bindings-macro/src/lib.rs

Co-authored-by: Kim Altintop <kim@eagain.io>
Signed-off-by: Mazdak Farrokhzad <twingoow@gmail.com>

* spacetimedb_tabletype: minor docs tweaks

* address pheobe's review

---------

Signed-off-by: Mazdak Farrokhzad <twingoow@gmail.com>
Co-authored-by: Kim Altintop <kim@eagain.io>

* [SDK] For each reducer, generate `on_{reducer}` and `once_{on_reducer}`

Prior to this commit, to register an on-reducer callback for a reducer `set_name`,
a client author would write `SetNameArgs::on_reducer(...)`,
with their callback accepting a reference to a `SetNameArgs`
which contained the reducer arguments.

Now, in addition to that interface, we generate a function `on_set_name`,
which accepts a callback that takes the arguments unpacked,
rather than as a struct.

That is, for the quickstart's `set_name` reducer, we generate:

```rust
pub fn on_set_name(
    mut __callback: impl FnMut(&Identity, Status, &String) + Send + 'static,
) -> ReducerCallbackId<SetNameArgs> {
    SetNameArgs::on_reducer(move |__identity, __status, __args| {
        let SetNameArgs { name } = __args;
        __callback(__identity, __status, name);
    })
}
```

Note the use of double-underscored variable names to avoid name collisions,
since we can't `gensym` a unique name.

We also generate `once_on_set_name`, which is like `on_set_name`,
but takes a `FnOnce` instead of a `FnMut`;
and `remove_on_set_name`, which un-registers a callback.

* Also generate `remove_on_{reducer}` functions to un-register callbacks.

spacetimedb start