Open Compass is an open-source platform that offers a comprehensive kit, hub, and ranking system for evaluating large models efficiently. The CompassHub, CompassRank, and CompassKit are integral parts of this system, designed to facilitate the assessment and comparison of large-scale models across various benchmarks. The platform encourages community contributions and aims to provide a transparent and accessible evaluation process for the field.