Final Results

Source Repositories

 

Evaluation

We execute five complete runs of the entire query set (983 queries). For each run, we construct and deconstruct the context. We measure the runtime of each query as well as the context creation and destruction. For each server, we report the average runtime of the five runs as the server result. The overall result is the geometric mean of all eight server results.
# Team   Server Benchmarks (s)
   Result
  AMD ARM IBM Intel   Geo. Mean
  #1 #2 #1 #2 #1 #2 #1 #2  
1 SortMergeJoins   2.57 3.22 2.14 1.13 5.49 3.31 4.13 1.74   2.67
🇩🇪   TU Munich (TUM)
2 Kirara   6.86 8.79 6.95 2.62 10.42 7.33 14.5 4.88   7.03
🇨🇳   Beijing Institute of Technology and Xidian University
3 Embryo   10.32 14.51 7.55 3.25 17.69 13.7 24.53 8.44   10.8
🇨🇳   Tsinghua University
4 O.P.T.   12.26 12.21 14.23 4.39 45.98 11.74 26.4 9.71   13.77
🇬🇷   University of Athens
5 JobSeeking   20.37 33.06 16.81 5.15 71.26 31.88 37.19 16.74   23.15
🇺🇸   University of California, Riverside
6 DB-Rush   21.53 22.66 22.42 9.75 67.53 30.17 42.19 16.25   24.92
🇨🇳   School of Data Science and Engineering, East China Normal University
7 Cross-Country   24.7 41.83 24.1 10.31 101.23 35.52 37.97 18.39   29.93
🇨🇳   Beijing Institute of Technology
8 DBRabbit   30.1 33.17 23.47 9.66 176.14 26.07 60.83 19.76   32.51
🇨🇳   East China Normal University
9 ACID Trip   35.91 34.76 30.15 12.56 1468.73 29.52 60.07 27.76   49.17
🇩🇪   LMU, TU Ilmenau, TUM
10 Shiyu   56.56 67.18 42.36 14.21 182.38 50.73 114.89 48.27   57.37
🇨🇳   Zhejiang University
11 Optimus Join   127.56 115.05 208.28 84.04 556.73 97.78 201.37 113.74   154.24
🇩🇪   TU Dresden
12 NeuDB   419.53 462.77 448.13 263.71 1108.59 273.8 851.8 403.33   470.28
🇨🇳   Northeastern University
13 BetterHashJoin   981.52 1007.31 1224.06 666.6 1650.72 810.77 1984.23 1171.16   1121.86
🇨🇳   Zhejiang University
14 NanoPulse   33.95 OOM 24.73 12.23 171.61 34.79 64.13 22.96   -
🇨🇳   Nanjing University