Join the new education and reproducibility workgroup at MLCommons to participate in the collaborative development of the next generation of the open-source automation meta-framework to modularize ML&AI Systems and automate their benchmarking, optimization, design space exploration and deployment!

CM framework (aka CK2)

• GitHub (Documentation)

CK framework (low-level SDK)

• GitHub (Documentation, overview)

CK browser plugin to annotate web pages with research objects

• Chrome & Edge
• Firefox

CK workflows

• CK solutions to automate ML Systems benchmarking and optimization
• MLPerf benchmark automation

CK-based Android apps

• Collaborative AI/ML benchmarking using mobile devices: try it on your Android mobile phone
• Collective training set with image misclassifications

CK "solutions" for collaborative benchmarking and optimization of ML Systems

• CK solutions to automate ML Systems benchmarking and optimization
• MLPerf benchmark automation

Modular and adaptive CK containers

• All Docker containers with portable CK workflows

CK wrapper to simplify the user experience (cBench)

• GitHub