Join an open taskforce on education and reproducibility at MLCommons to participate in the collaborative development of the next generation of this open-source automation meta-framework (CK2 aka CM) to modularize ML&AI Systems and automate their benchmarking, optimization, design space exploration and deployment from the cloud to the edge!

MLCommons CK2 framework aka CM

Since 2022, this framework is being developed by the open taskforce on education and reproducibility at MLCommons:

• GitHub
• Documentation
• Reusable CK2 scripts for MLOps and DevOps
• CK2-based MLPerf modularization and automation tutorial from SuperComputing'22
• Modular CK2 container for MLPerf

---

Discontinued CK1 framework (2015-2021)

CK-based Android apps

• Collaborative AI/ML benchmarking using mobile devices: try it on your Android mobile phone
• Collective training set with image misclassifications

CK browser plugin to annotate web pages with research objects

• Chrome & Edge
• Firefox

CK workflows

• CK solutions to automate ML Systems benchmarking and optimization
• MLPerf benchmark automation

CK "solutions" for collaborative benchmarking and optimization of ML Systems

• CK solutions to automate ML Systems benchmarking and optimization
• MLPerf benchmark automation

Modular and adaptive CK containers

• All Docker containers with portable CK workflows

CK wrapper to simplify the user experience (cBench)

• GitHub