LLM Context

LLM Context (Chat History Data) Although the AI Chatbot can remember the conversation between you, LLM is essentially stateless, meaning it doesn't store any data. Instead, each time you send a prompt, we help you concatenate the stored historical records from the database at the backend. This concatenated history becomes the chat context, and the length of this context is the token length mentioned in the previous section. The longer the maximum number of tokens, the more historical records the AI Chatbot can comprehend.

Last updated