Join the new education and reproducibility workgroup at MLCommons to participate in the collaborative development of the next generation of the open-source automation meta-framework to modularize ML&AI Systems and automate their benchmarking, optimization, design space exploration and deployment!

CK-based Android applications to crowdsource AI/SW/HW co-design experiments

[ Project overview, Reddit disccusion ]

You can download and install two CK-based applications for your Android device to participate in collaborative benchmarking, optimization, autotuning and co-design of efficient model/SW/HW stacks for emerging workloads. You can see all aggregated results from these experiments (speed, accuracy, costs) across diverse mobile phones in the public repository (note that we gradually move all CK SOTA scoreboards here). We use this open-source technology in open and reproducible ACM ReQuEST tournaments to co-design Pareto-efficient deep learning stacks (speed, accuracy, costs) and in a joint project with Raspberry Pi foundation to crowdsource compiler autotuning and machine learning (see interactive article).

To our surprise, our open science applications were removed from Google Play in August 2018 after 3 years of successful participation by thousands of users because it apparently violates recent Google's terms of use: it's not allowed to download extra code or data from external sources. However, the whole point of our applications and our novel crowd-tuning concept is to download slightly differently modified code and models to different users to collaboratively find the most efficient solutions across diverse platforms and environments provided by volunteers similar to SETI@home in terms of speed, accuracy, costs and other metrics or automatically detect software and hardware bugs (see paper 1, paper 2, paper 3 and paper 4).

While we are discussing with Google how to move our applications back to Google Play Store, you can download and install them here. Just make sure that your Android device is configured to allow installation from sources other than the Play Store before downloading and installing our CK-based Android apps. You can check it as follows:

You can now download, install and run two CK-based Android applications to


This application was originally developed by Grigori Fursin with a user-friendly GUI developed by our partners. See this white paper for our future plans.