Offer previous messages as context

[TheComamba]

I thought about an implementation: As far as I know, Actor and ChatMessage both inherit from the same class that defines the setFlag functions. My proposal is therefore:

• [X] When a posted message addresses an actor, set the "conversationWith" flag to the actor's id.
• [X] When collecting messages to post to llm, collect all that have this flag with this value.
• [X] Sort the messages by their timestamp.
• [X] Move the setFlag mock implementation to a base class and make Actor and ChatMessage inherit from it.
• [X] Add a maxMessages global setting (no need to offer override in actor) to make sure the preamble makes it into the context.
  • Alternatively: If we can programmatically access the max content size of all models (local and openai), we can automatically drop the earlier messages once the limit is reached.
  • Alternative to Alternative: If there is an easy manual way to find the context size for each mode, we can store it in the MODELS map in model.js.

[TheComamba]

The llm tests are not yet green. I have not yet investigated the three alternatives for limiting the context. Apart from that, the functionality is implemented and tested.

[TheComamba]

The Foundry integration is not working, and I think it comes down to the fact that I erroneously assumed getFlag to be a synchronous function. Changing that changes a lot. Several tests are now broken. We also need to give serious thought to the fact that Hooks.#call does not await asynchronous hooks. Some of our design probably needs to change.

All will turn out well. Eventually.

[TheComamba]

The function _createDocuments in class ClientDatabaseBackend has a line

const response = await SocketInterface.dispatch("modifyDocument", request);

This response contains the id of the document. So it seems that it is given by the server.

The _preCreate function that we currently use is called before that. This means that the document does not yet have an id, which in turn means that the setFlag function fails with an error.

Dear oh me.

[TheComamba]

Ok. The _source field of Document has a flags field. Writing into it with the debugger does indeed persist the data. This means that we do not necessarily need to set flags via the usual mechanism. Another hack 'tis.