Skip to content
Gaunt Sloth Documentation

SCOPED_PROMPT_BUDGET_BYTES

const SCOPED_PROMPT_BUDGET_BYTES: 65536 = 65_536

Defined in: packages/core/src/utils/llmUtils.ts:74

CFG-70 — the byte total above which a run warns that its scoped overlays have become a large prompt in their own right. A warning, never a cap: nothing is truncated, because a guideline cut mid-sentence is worse than a long prompt — the model then follows a rule whose exception was removed.

Where 64 KiB comes from, since a threshold nobody can argue with is a threshold nobody trusts:

  • Measured floor. Every prompt file gaunt-sloth ships — all seven bundled segments together — is under 7 KB. This is an order of magnitude above the whole built-in prompt, so a user is well past “a few per-module guideline files” before it says anything.
  • Context-window ceiling. At the customary ~4 bytes per token this is roughly 16k tokens, about an eighth of a 128k-token window — the smallest among the models review and pr routinely run on — and the diff, the requirements and the model’s own answer still have to fit beside it.

The cost of firing slightly early is one line of output, which is why the estimate is allowed to be an estimate.