Table 4 Performance comparison: COMPSs versus Spark
From: Upgrading a high performance computing environment for massive data processing
Use case | Scenario | Time (s) | Speedup | 95% CI |
|---|---|---|---|---|
Grep | H3 | 59 | 2.74 | (- ∞, -101) |
S3 | 38 | 4.24 | (- ∞, -122) | |
Spark | 161 | 1 | - | |
WC | H3 | 226 | 1.59 | (- ∞, -131) |
S3 | 210 | 1.71 | (- ∞, -148) | |
Spark | 358 | 1 | - | |
KMeans | H3 | 905 | 0.48 | (472, ∞) |
H3.opt | 571 | 0.77 | (138, ∞) | |
S3.opt | 438 | 1.00 | (-6, 5) † | |
Spark | 438 | 1 | - | |
KNN | H3 | 1426 | 0.52 | (691, ∞) |
H3.opt | 1076 | 0.69 | (340, ∞) | |
S3.opt | 711 | 1.05 | (- ∞, -23) | |
Spark | 746 | 1 | - |