Token Forecaster
Forecast how long an LLM reply will run, before Enter
What is Token Forecaster?
Token Forecaster puts a range on an LLM reply before you press Enter: the usual length, and a worst case that held for 90.6% of 4,146 unseen calls. While the reply streams, it shows whether it is running long. It only watches and never changes the request. Learns from your local history. Open source, MIT.
Screenshots
?
No comments yet. Be the first!