Procrustes alignment

  • ModelCypher: Exploring LLM Geometry


    ModelCypher: A toolkit for the geometry of LLMs (open source) [P]ModelCypher is an open-source toolkit designed to explore the geometry of small language models, challenging the notion that these models are inherently black boxes. It features cross-architecture adapter transfer and jailbreak detection using entropy divergence, implementing methods from over 46 recent research papers. Although the hypothesis that Wierzbicka's "Semantic Primes" would show unique geometric invariance was disproven, the toolkit reveals that distinct concepts have a high convergence across different models. The tools are documented with analogies to aid understanding, though they primarily provide raw metrics rather than user-friendly outputs. This matters because it provides a new way to understand and potentially improve language models by examining their geometric properties.

    Read Full Article: ModelCypher: Exploring LLM Geometry