Skip to main content

Table 4 Performance comparison: COMPSs versus Spark

From: Upgrading a high performance computing environment for massive data processing

Use case Scenario Time (s) Speedup 95% CI
Grep H3 59 2.74 (- , -101)
  S3 38 4.24 (- , -122)
  Spark 161 1 -
WC H3 226 1.59 (- , -131)
  S3 210 1.71 (- , -148)
  Spark 358 1 -
KMeans H3 905 0.48 (472, )
  H3.opt 571 0.77 (138, )
  S3.opt 438 1.00 (-6, 5)
  Spark 438 1 -
KNN H3 1426 0.52 (691, )
  H3.opt 1076 0.69 (340, )
  S3.opt 711 1.05 (- , -23)
  Spark 746 1 -
  1. Difference not statistically significant