Quarkus: Supersonic Subatomic Java

Thanks a lot for the detailed explanation — you’re right that GPT-4o-mini supports up to 128k tokens and that this is most likely a limitation of the **embedding model** , not the language model itself. To clarify my situation a bit more: * The error is coming up during `similaritySearch()`, which internally embeds the `queryObj.text`. * My `queryObj.text` is well under 8192 tokens based on manual counting using `tiktoken`, but I **still hit the 8192 token limit error**. * The issue is that I can’t calculate the _final token count_ of the prompt at the point when `similaritySearch()` runs, because the full context (which includes similarity results) gets constructed **after** that. * So I’m trying to find a **clean and reliable way to handle this error proactively** , without relying on fragile checks like `err.message.includes("maximum context length is")`. **I’m not against the error happening** — I fully understand that if the input is too long, it should fail. What I want is to **catch and handle that error gracefully** , so I can show a friendly UI message like _“Your input is too long — please shorten it.”_ instead of letting the app crash or show a generic failure. Appreciate the ideas around hypothetical answering and splitting documents — will definitely keep those in mind as I evaluate the options. Thanks again!