How similar are MLP hidden states to each other?

by Ari Holtzman14 days ago
2

Are the hidden spaces of MLPs at different layers totally different? They can't be totally different because there's not that much individual transformation capacity...but then can we compare what differs?

llmsMLPsImplemented:https://github.com/Hypogenic-AI/mlp-hidden-state-b821-claudeImplemented:https://github.com/Hypogenic-AI/mlp-hidden-state-1a8c-codexImplemented:https://github.com/Hypogenic-AI/mlp-hidden-state-2c11-gemini
Chat

If you are inspired by this idea, you can reach out to the authors for collaboration or cite it:

@misc{holtzman-how-similar-are-2026,
  author = {Holtzman, Ari},
  title = {How similar are MLP hidden states to each other?},
  year = {2026},
  url = {https://hypogenic.ai/ideahub/idea/BAIIxHnVfxKETWYLTzn1}
}

Comments (0)

Please sign in to comment on this idea.

No comments yet. Be the first to share your thoughts!