Skip to content

Sketch based join optimisation 3#5704

Open
hmottestad wants to merge 63 commits intodevelopfrom
sketch-based-join-optimisation-3
Open

Sketch based join optimisation 3#5704
hmottestad wants to merge 63 commits intodevelopfrom
sketch-based-join-optimisation-3

Conversation

@hmottestad
Copy link
Contributor

@hmottestad hmottestad commented Feb 24, 2026

GitHub issue resolved: #

Briefly describe the changes proposed in this PR:

PR Author Checklist (see the contributor guidelines for more details):

  • my pull request is self-contained
  • I've added tests for the changes I made
  • I've applied code formatting (you can use mvn process-resources to format from the command line)
  • I've squashed my commits where necessary
  • every commit message starts with the issue number (GH-xxxx) followed by a meaningful description of the change

@hmottestad hmottestad force-pushed the sketch-based-join-optimisation-3 branch from e8dd0c2 to d11b303 Compare February 24, 2026 10:59
@hmottestad hmottestad changed the base branch from main to develop February 24, 2026 10:59
@hmottestad hmottestad added ✋ CQ-Pending requires a CQ to be approved labels Feb 24, 2026
@hmottestad
Copy link
Contributor Author

hmottestad commented Feb 24, 2026 •
edited
Loading

Main branch

Benchmark                              (themeName)  (z_queryIndex)  Mode  Cnt       Score   Error  Units
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               0  avgt           45.942          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               1  avgt          165.107          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               2  avgt           42.355          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               3  avgt           78.066          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               4  avgt          108.442          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               5  avgt           59.208          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               6  avgt           56.185          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               7  avgt           42.198          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               8  avgt           52.392          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               9  avgt          225.733          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS              10  avgt       271478.964          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               0  avgt            0.062          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               1  avgt            4.785          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               2  avgt            0.078          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               3  avgt            0.070          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               4  avgt            0.089          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               5  avgt          823.448          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               6  avgt            0.097          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               7  avgt            4.841          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               8  avgt          722.325          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               9  avgt            6.113          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA              10  avgt            2.944          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               0  avgt          659.246          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               1  avgt          265.678          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               2  avgt           37.541          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               3  avgt           41.109          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               4  avgt          121.823          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               5  avgt            9.507          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               6  avgt        27591.570          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               7  avgt          923.752          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               8  avgt           66.224          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               9  avgt          133.148          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY              10  avgt          179.687          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               0  avgt          222.655          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               1  avgt          264.347          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               2  avgt            1.116          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               3  avgt          119.420          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               4  avgt           47.834          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               5  avgt            1.825          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               6  avgt          200.862          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               7  avgt            3.924          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               8  avgt            2.282          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               9  avgt            3.320          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING              10  avgt            1.652          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               0  avgt          323.587          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               1  avgt         1017.310          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               2  avgt          494.831          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               3  avgt          104.561          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               4  avgt          223.120          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               5  avgt          110.966          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               6  avgt         1234.693          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               7  avgt          117.725          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               8  avgt         1102.583          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               9  avgt         1202.971          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED              10  avgt       155028.762          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               0  avgt           31.827          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               1  avgt           72.851          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               2  avgt            7.811          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               3  avgt          146.265          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               4  avgt          138.215          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               5  avgt           17.831          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               6  avgt           84.304          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               7  avgt           45.366          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               8  avgt          252.428          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               9  avgt          233.256          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN              10  avgt          176.787          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               0  avgt           38.446          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               1  avgt           80.332          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               2  avgt            3.429          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               3  avgt          319.164          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               4  avgt            3.371          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               5  avgt            9.394          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               6  avgt           84.834          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               7  avgt           22.758          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               8  avgt           13.457          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               9  avgt            4.255          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID              10  avgt          533.969          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               0  avgt            0.252          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               1  avgt            1.514          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               2  avgt           38.640          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               3  avgt           14.590          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               4  avgt           27.651          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               5  avgt            0.365          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               6  avgt            5.024          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               7  avgt           20.455          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               8  avgt           26.660          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               9  avgt           16.266          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA              10  avgt        17521.526          ms/op

This branch

Benchmark                              (themeName)  (z_queryIndex)  Mode  Cnt       Score   Error  Units
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               0  avgt           53.915          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               1  avgt          141.966          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               2  avgt           47.441          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               3  avgt           81.195          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               4  avgt          111.867          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               5  avgt           60.935          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               6  avgt           53.885          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               7  avgt           42.460          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               8  avgt           55.118          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS               9  avgt          255.135          ms/op
ThemeQueryBenchmark.executeQuery   MEDICAL_RECORDS              10  avgt          199.123          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               0  avgt            0.041          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               1  avgt            5.784          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               2  avgt            0.047          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               3  avgt            0.049          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               4  avgt            0.059          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               5  avgt          884.051          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               6  avgt            0.071          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               7  avgt            5.520          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               8  avgt          673.177          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA               9  avgt            5.803          ms/op
ThemeQueryBenchmark.executeQuery      SOCIAL_MEDIA              10  avgt            2.703          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               0  avgt          633.834          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               1  avgt          276.426          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               2  avgt           40.226          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               3  avgt           42.330          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               4  avgt          136.958          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               5  avgt            9.953          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               6  avgt        27246.886          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               7  avgt       102168.447          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               8  avgt           69.687          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY               9  avgt          130.076          ms/op
ThemeQueryBenchmark.executeQuery           LIBRARY              10  avgt          189.857          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               0  avgt          217.930          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               1  avgt          275.547          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               2  avgt            1.070          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               3  avgt          126.766          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               4  avgt          132.937          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               5  avgt            2.041          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               6  avgt          188.423          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               7  avgt            3.854          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               8  avgt            2.077          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING               9  avgt            3.334          ms/op
ThemeQueryBenchmark.executeQuery       ENGINEERING              10  avgt            1.579          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               0  avgt          327.801          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               1  avgt         1068.403          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               2  avgt          499.186          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               3  avgt          103.481          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               4  avgt          222.739          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               5  avgt          113.581          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               6  avgt         1258.910          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               7  avgt          112.942          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               8  avgt         1048.196          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED               9  avgt         1214.213          ms/op
ThemeQueryBenchmark.executeQuery  HIGHLY_CONNECTED              10  avgt       157711.054          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               0  avgt           38.749          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               1  avgt          161.138          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               2  avgt           24.226          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               3  avgt          451.785          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               4  avgt          302.915          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               5  avgt           65.927          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               6  avgt           96.090          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               7  avgt           48.391          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               8  avgt          217.866          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN               9  avgt          240.718          ms/op
ThemeQueryBenchmark.executeQuery             TRAIN              10  avgt          182.246          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               0  avgt           38.568          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               1  avgt           50.248          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               2  avgt            3.715          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               3  avgt          319.693          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               4  avgt            3.504          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               5  avgt            9.494          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               6  avgt           87.885          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               7  avgt           19.064          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               8  avgt           12.359          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID               9  avgt            4.398          ms/op
ThemeQueryBenchmark.executeQuery   ELECTRICAL_GRID              10  avgt          489.850          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               0  avgt            0.165          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               1  avgt            1.493          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               2  avgt        18647.381          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               3  avgt           11.941          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               4  avgt           27.443          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               5  avgt            0.338          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               6  avgt            4.892          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               7  avgt           19.479          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               8  avgt           26.459          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA               9  avgt           14.013          ms/op
ThemeQueryBenchmark.executeQuery            PHARMA              10  avgt        17618.887          ms/op

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

✋ CQ-Pending requires a CQ to be approved

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@hmottestad