Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add the CHATHISTORY extension specification - refactored #393

Merged
merged 27 commits into from
Nov 9, 2020
Merged
Changes from 1 commit
Commits
Show all changes
27 commits
Select commit Hold shift + click to select a range
bbdba28
Chathistory extension
prawnsalad Jun 26, 2019
c633bb7
Require message-tags, not draft/message-tags
prawnsalad Jun 26, 2019
e7d5def
Examples using msgid instead of draft/msgid
prawnsalad Jun 26, 2019
b0f524f
Language changes for returned message notes
prawnsalad Jun 26, 2019
92b9e20
Backticks are cool
prawnsalad Jun 26, 2019
e1a6b43
Defining history content for query buffers; Language change for LATES…
prawnsalad Jun 27, 2019
3a39a29
Include the target on FAIL messages
prawnsalad Sep 16, 2019
950b019
updates to chathistory spec
slingamn Jan 31, 2020
7942807
move "consistent message order" language up in the spec
slingamn Feb 17, 2020
215b7f5
Merge pull request #2 from slingamn/chathistory.3
prawnsalad Feb 17, 2020
5d90804
add WIP warnings and draft prefix
slingamn Feb 24, 2020
6ede679
clarify dependency relationship
slingamn Feb 24, 2020
e9eb159
fix specification of latest *
slingamn May 6, 2020
0c271a5
Merge pull request #3 from slingamn/chathistory_draft
prawnsalad Jul 20, 2020
caa9cbd
fix example pseudocode
slingamn Oct 5, 2020
8b41bfb
Merge pull request #4 from slingamn/chathistory_pseudocode_revisions
prawnsalad Oct 5, 2020
550eb70
add caveat about bouncers not providing msgids
slingamn Oct 12, 2020
e5d7359
language and formatting tweaks
slingamn Oct 13, 2020
8473d9a
mention channel membership issues under security considerations
slingamn Oct 13, 2020
0570bd6
update copyright notice
slingamn Oct 15, 2020
aaa33fb
adjust copyright notice again
slingamn Oct 15, 2020
e0deca9
specify the batch parameter
slingamn Oct 20, 2020
841ad22
caution about nickname changes
slingamn Oct 20, 2020
aab8bff
rearrange and clarify some language
slingamn Oct 30, 2020
40a919b
add some tentative language about nick rewriting
slingamn Oct 30, 2020
36b3b44
make the batch type and param into MUSTs
slingamn Nov 3, 2020
aa80df2
add INVALID_TARGET fail code
slingamn Nov 4, 2020
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
111 changes: 111 additions & 0 deletions extensions/chathistory.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,111 @@
---
title: IRCv3 chathistory extension
layout: spec
work-in-progress: true
copyrights:
-
name: "Evan Magaliff"
period: "2017"
email: "evan@muffinmedic.net"
-
name: "Darren Whitlen"
period: "2018-2019"
email: "darren@kiwiirc.com"
---
## Description
This document describes the format of the `chathistory` extension. This enables clients to request messages that were previously sent if they are still available on the server.

The server as mentioned in this document may refer to either an IRC server or an IRC bouncer.

## Implementation
The `chathistory` extension uses the [chathistory][batch/chathistory] batch type and introduces a client command, `chathistory`.

To fully support this extension, clients MUST support the [`batch`][batch], [`server-time`][server-time] and [`draft/message-tags`][draft/message-tags] capabilities.
prawnsalad marked this conversation as resolved.
Show resolved Hide resolved

The `chathistory` capability MUST be negotiated. This allows the server and client to act differently when delivering message history on connection.

An ISUPPORT token MUST be sent to the client to state the maximum number of messages a client can request in a single command, represented by an integer. `CHATHISTORY=50`. If `0`, the client SHOULD assume that there is no maximum number of messages.

### `CHATHISTORY` Command
`CHATHISTORY` content can be requested by the client by sending the `CHATHISTORY` command to the server. A `batch` MUST be returned by the server. If no content exists to return, an empty batch SHOULD be returned to avoid the client waiting for a reply and to indicate that no content is available.

This comment was marked as duplicate.


The `chathistory` command uses the following general syntax structure:

CHATHISTORY <subcommand> <target> <timestamp | msgid> <limit>

The `target` parameter specifies a single buffer (channel or query name) from which history SHOULD be retrieved. Any `timestamp` values or parameters MUST be in the format of `YYYY-MM-DDThh:mm:ss.sssZ`.

#### Subcommands

The following subcommands are used to describe how the server should return messages relative to the `timestamp` or `msgid` given.

#### `BEFORE`

CHATHISTORY BEFORE <target> <timestamp=YYYY-MM-DDThh:mm:ss.sssZ | msgid=1234> <limit>

Request up to `limit` number of messages before and including the given `timestamp` or `msgid`. Only one timestamp or msgid MUST be given, not both.

#### `AFTER`
CHATHISTORY AFTER <target> <timestamp=YYYY-MM-DDThh:mm:ss.sssZ | msgid=1234> <limit>
Request up to `limit` number of messages after and excluding the given `timestamp` or `msgid`. Only one timestamp or msgid MUST be given, not both.

#### `LATEST`
CHATHISTORY LATEST <target> <* | timestamp=YYYY-MM-DDThh:mm:ss.sssZ | msgid=1234> <limit>
Request the most recent messages that have been sent since the given `timestamp` or `msgid`. If a `*` is given instead of a timestamp or msgid, the server MUST use the current time as a timestamp. The number of messages returned MUST be equal to or less than `limit`. Only one timestamp or msgid MUST be given, not both.

#### `AROUND`
CHATHISTORY AROUND <target> <timestamp=YYYY-MM-DDThh:mm:ss.sssZ | msgid=1234> <limit>
Request a number of messages before and after the `timestamp` or `msgid` with the total number of returned messages not exceeding `limit`. The implementation may decide how many messages to include before and after the selected message. Only one timestamp or msgid MUST be given, not both.

This is useful for retrieving conversation context around a single message.

#### `BETWEEN`
CHATHISTORY BETWEEN <target> <timestamp=YYYY-MM-DDThh:mm:ss.sssZ | msgid=1234> <timestamp=YYYY-MM-DDThh:mm:ss.sssZ | msgid=1234> <limit>
Request up to `limit` number of messages between the given `timestamp` or `msgid` values. The returned messages MUST start from the inclusive first message selector, while excluding and finishing on the second - this may be forwards or backwards in time.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you use a timestamp for one selector and a msgid for the other?


#### Returned message notes
The returned messages MUST be in ascending time order and the `server-time` SHOULD be the time at which the message was received from the IRC server. The `msgid` that identifies each individual message in a response MUST be the `msgid` as when received from the IRC server.
prawnsalad marked this conversation as resolved.
Show resolved Hide resolved

#### Errors and Warnings
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggestions for more FAIL messages:

  • UNKNOWN_CRITERIA <criteria> — for if someone specifies an invalid criteria like wibble=foo instead of e.g. msgid=abc123.

  • INVALID_CRITERIA <criteria> — for if someone specifies a criteria thats not valid for a command e.g. the wildcard (*) criteria with a non-LATEST command.

  • INVALID_LIMIT <limit> — for if someone specifies a limit that is out of the allowed range.

Errors are returned using the standard replies syntax.

If the server receives a `CHATHISTORY` command with an unknown subcommand, the `UNKNOWN_COMMAND` error code MUST be returned.
> FAIL CHATHISTORY UNKNOWN_COMMAND the_given_command :Unknown command

If the server receives a `CHATHISTORY` command with missing parameters, the `NEED_MORE_PARAMS` error code MUST be returned.
> FAIL CHATHISTORY NEED_MORE_PARAMS the_given_command :Missing parameters

If no message history can be returned due to an error, the `MESSAGE_ERROR` error code SHOULD be returned.
> FAIL CHATHISTORY MESSAGE_ERROR the_given_command [extra_context] :Messages could not be retrieved

### Examples

Requesting the latest conversation upon joining a channel
~~~~
[c] CHATHISTORY LATEST #channel * 50
[s] :irc.host BATCH +ID chathistory #channel
[s] @batch=ID;draft/msgid=1234;time=2019-01-04T14:33:26.123Z :nick!ident@host PRIVMSG #channel :message
prawnsalad marked this conversation as resolved.
Show resolved Hide resolved
[s] @batch=ID;draft/msgid=1235;time=2019-01-04T14:33:38.123Z :nick!ident@host NOTICE #channel :message
[s] @batch=ID;draft/msgid=1238;time=2019-01-04T14:34:17.123Z;+client_tag=val :nick!ident@host PRIVMSG #channel :ACTION message
[s] :irc.host BATCH -ID
~~~~

Requesting further message history than our client currently has
~~~~
[c] CHATHISTORY BEFORE bob timestamp=2019-01-04T14:34:17.123Z 50
[s] :irc.host BATCH +ID chathistory bob
[s] @batch=ID;draft/msgid=1234;time=2019-01-04T14:34:09.123Z :bob!ident@host PRIVMSG alice :hello
[s] @batch=ID;draft/msgid=1235;time=2019-01-04T14:34:10.123Z :alice!ident@host PRIVMSG bob :hi! how are you?
[s] @batch=ID;draft/msgid=1238;time=2019-01-04T14:34:16.123Z; :bob!ident@host PRIVMSG alice :I'm good, thank you!
[s] :irc.host BATCH -ID
~~~~

## Use Cases
The batch type and supporting command are useful for allowing an "infinite scroll" type capability within the client. A client will, upon scrolling to the top of the active window or a manual trigger, may request `chathistory` from the server and, after receiving returned content, append it to the top of the window. Users can repeat this historic scrolling to retrieve prior history until limitations are met (see below).

Upon joining a channel, a client may request the latest messages for the buffer so that the active conversation context may be retrieved.

## Security Considerations
Secure identification of users and clients MUST exist in order to ensure that users cannot obtain history they are not authorised to view. Use of account names, internal account identifiers, or certificate fingerprints SHOULD be strongly considered when matching content to users. If a client requests content for a target that they do not have permission for, eg. a channel they are banned from, an empty batch SHOULD be returned as if no content exists.

While an ISUPPORT token value of `0` may be used to indicate no message limit exists, servers SHOULD set and enforce a reasonable maximum and properly throttle `CHATHISTORY` commands to prevent abuse.