Following your feedback, we are prototyping the 2nd generation of the CK framework with MLCommons and OctoML.ai:
github.com/mlcommons/ck/tree/master/cm
CK SOTA scoreboards are now available here.