CK Browser

Pamela project - slambench crowdtuning scenario

Demo of the multi-objective autotuning of slambench via CK (can be any objective, i.e. execution time, energy, code size, cost, precision, reliability). Black dot - GCC with -O3. Green dot - LLVM with -O3

[ Discussion wiki (comments, reproducibility, etc.) ]

Select subgraph:

Graph:

Graph params (to customize/reproduce):

{
  "axis_x_desc": "Binary file size (bytes)", 
  "axis_y_desc": "Whole execution time, expected value (sec.)", 
  "bound_lines": "no", 
  "data_uoa_list": [
    "pamela-autotune-flags-slambench-linux-i10", 
    "pamela-autotune-flags-slambench-linux-best", 
    "pamela-autotune-flags-slambench-linux-i10-pareto", 
    "pamela-autotune-flags-slambench-linux-best-llvm"
  ], 
  "display_x_error_bar": "no", 
  "display_y_error_bar": "no", 
  "experiment_module_uoa": "experiment", 
  "flat_keys_list": [
    "##characteristics#compile#binary_size#min", 
    "##characteristics#run#execution_time_kernel_0#exp"
  ], 
  "mpl_image_dpi": "100", 
  "mpl_image_size_x": "12", 
  "mpl_image_size_y": "6", 
  "plot_grid": "yes", 
  "plot_type": "mpl_2d_scatter", 
  "point_style": {
    "0": {
      "color": "#3366cc", 
      "size": 40
    }, 
    "1": {
      "color": "#000000", 
      "elinewidth": "7", 
      "size": 40
    }, 
    "2": {
      "color": "#dc3912", 
      "frontier": "yes", 
      "line_style": "--", 
      "size": 10
    }, 
    "3": {
      "color": "#007f00", 
      "elinewidth": "7", 
      "size": 40
    }
  }, 
  "size_x": 700, 
  "size_y": 400, 
  "title": "Powered by Collective Knowledge", 
  "xmax": 150000, 
  "xmin": 50000, 
  "ymax": 4, 
  "ymin": 1
}

Auto-replot graph: , seconds:

Reproducing graph:

Experiment entries:	pamela-autotune-flags-slambench-linux-i10 pamela-autotune-flags-slambench-linux-best pamela-autotune-flags-slambench-linux-i10-pareto pamela-autotune-flags-slambench-linux-best-llvm
Scripts to rebuild:	ck find script:bfd7ae44dda619dc View in CK viewer
Replay graph from CMD:	ck replay graph:3645af97abb448ab id=2d_points_time_vs_size_with_pareto

Obtain shared CK repo with all artifacts:	ck pull repo:reproduce-pamela-project
Original experiment table:	Download in JSON; Download in CSV
Embedd original image into interactive report/paper:	<img src="https://cknowledge.org/repo/web.php?template=cknowledge&action=pull&common_func=yes&cid=2d41f89bcf32d4d4:3645af97abb448ab&filename=2d_points_time_vs_size_with_pareto.png" width="700" height="400" >

View entry in raw format