tldt — Too Long, Didn't Tokenize
Protect your data and agents while saving tokens
tldt — Too Long, Didn't Tokenize이란?
Too Long; Didn't Tokenize (tl;dt) is a CLI and library that uses machine learning to summarize long texts with context. It targets API calls, document uploads and crawled sites with excess tokens, prompt injection, side instructions. - LexRank and TextRank - OWASP LLM Top 10 support - Unicode confusables protection - Converts from HTML to markdown - Text sanitization - PII and API Keys cleaning - No API keys required - A Go Library for agents that call AI APIs directly - A skill for coding
스크린샷
?
아직 댓글이 없어요. 가장 먼저 남겨보세요!
tldt — Too Long, Didn't Tokenize에 대한 X의 실제 대화
X에 게시