Following your feedback, we are prototyping the 2nd generation of the CK framework with MLCommons and OctoML.ai:
github.com/mlcommons/ck/tree/master/cm

CM framework (aka CK2)

• GitHub (Documentation)

CK framework (low-level SDK)

• GitHub (Documentation, overview)

CK browser plugin to annotate web pages with research objects

• Chrome & Edge
• Firefox

CK workflows

• CK solutions to automate ML Systems benchmarking and optimization
• MLPerf benchmark automation

CK-based Android apps

• Collaborative AI/ML benchmarking using mobile devices: try it on your Android mobile phone
• Collective training set with image misclassifications

CK "solutions" for collaborative benchmarking and optimization of ML Systems

• CK solutions to automate ML Systems benchmarking and optimization
• MLPerf benchmark automation

Modular and adaptive CK containers

• All Docker containers with portable CK workflows

CK wrapper to simplify the user experience (cBench)

• GitHub