Chat SDK now supports concurrent message handling

Chat SDK now lets you control what happens when a new message arrives before a previous one finishes processing, with the new concurrency option for the Chat class.

1
const bot = new Chat({
2
  concurrency: {
3
    strategy: "queue",
4
    maxQueueSize: 20,
5
    onQueueFull: "drop-oldest",
6
    queueEntryTtlMs: 60_000,
7
  },
8
// ...
9
});

Four strategies are available:

• drop (default): discards new messages

• queue: processes the latest message after the handler finishes

• debounce: waits for a pause in conversation, processes only the final message

• concurrent: processes every message immediately, no locking

Read the documentation to get started.