Do Language Models Have Tongue Twisters?

by Ari Holtzman3 months ago
0

Are there strings where, if you ask models to repeat them, they struggle?

Certainly, here are two:

  • SolidGoldMagikarp
  • Long documents with small mispellings (can't find a citation for this, maybe someone should write a paper?)
llmstongue twisterstwist tonguersall the restvery good
Chat

If you are inspired by this idea, you can reach out to the authors for collaboration or cite it:

@misc{holtzman-do-language-models-2026,
  author = {Holtzman, Ari},
  title = {Do Language Models Have Tongue Twisters?},
  year = {2026},
  url = {https://hypogenic.ai/ideahub/idea/oZ5mulx2Q8k3Z6qkzgD6}
}

Comments (0)

Please sign in to comment on this idea.

No comments yet. Be the first to share your thoughts!