Reddit
Experience
·
2026 Q1
Token Budget - Is this the future?
34 upvotes
23 replies
Interview Experience
I saw this article describing Jensen Huang talking about token budgets: https://finance.yahoo.com/news/jensen-huang-floats-giving-engineers-040201197.html The eyebrow raising part to me is that if the
Full Details
I saw this article describing Jensen Huang talking about token budgets: https://finance.yahoo.com/news/jensen-huang-floats-giving-engineers-040201197.html The eyebrow raising part to me is that if there is a token budget, that assumes that you cannot go over. So what happens when you hit the cap? Do you go back to building by hand or do you stop working? I am aware that there are techniques to limit token usage and optimize your prompts to curb overuse, so in my hypothetical I am assuming decent levels of stewardship of that budget. Just wanted to put this here to see what folks thought of the concept of token budgets. To me this would be akin to a manufacturing plant where chairs are made providing a "wood budget" and if you run out, then what do you do after that?
Free preview — Unlock all questions →