Have ten thousand humans annotate a thousand paragraphs for anything interesting that's there: connotations, ideas, corollaries, whatever. Is there a set of things across these texts that LLMs would consistently miss? What would characterize it?
If you are inspired by this idea, you can reach out to the authors for collaboration or cite it:
@misc{holtzman-what-do-llms-2026,
author = {Holtzman, Ari},
title = {What do LLMs miss?},
year = {2026},
url = {https://hypogenic.ai/ideahub/idea/XuTisMyK2liCL7jfGD39}
}Please sign in to comment on this idea.
No comments yet. Be the first to share your thoughts!