Portkey
Log in

Welcome to Portkey Forum

Updated 9 months ago

anomalous tokens

SSaif
·
Today, I learned that there are anomalous tokens, which may be those when models encounter "don’t know what to do".

For example, couldn't even repeat a name.
S
1 comment
SSaif
🔗 https://www.lesswrong.com/posts/aPeJE8bSo6rAFoLqg/solidgoldmagikarp-plus-prompt-generation#A_possible__partial_explanation
Add a reply
Sign up and join the conversation on Discord