[experiment] Set up per-component subtree splits

Created on 23 October 2024, about 1 month ago

Problem/Motivation

This is an issue for me to test per-component subtree splitting on GitLab CI. Don't touch it - it's mine! :)

πŸ“Œ Task
Status

Active

Component

Infrastructure

Created by

πŸ‡ΊπŸ‡ΈUnited States phenaproxima Massachusetts

Live updates comments and jobs are added and updated live.
Sign in to follow issues

Merge Requests

Comments & Activities

  • Issue created by @phenaproxima
  • πŸ‡ΊπŸ‡ΈUnited States phenaproxima Massachusetts
  • Merge request !143Subtree split project template β†’ (Merged) created by phenaproxima
  • Pipeline finished with Canceled
    about 1 month ago
    Total: 64s
    #318154
  • Pipeline finished with Canceled
    about 1 month ago
    #318159
  • Pipeline finished with Canceled
    about 1 month ago
    Total: 31s
    #318161
  • Pipeline finished with Failed
    about 1 month ago
    Total: 36s
    #318164
  • Pipeline finished with Failed
    about 1 month ago
    Total: 33s
    #318173
  • Pipeline finished with Failed
    about 1 month ago
    Total: 33s
    #318174
  • Pipeline finished with Failed
    about 1 month ago
    Total: 33s
    #318181
  • Pipeline finished with Success
    about 1 month ago
    Total: 33s
    #318191
  • Pipeline finished with Failed
    about 1 month ago
    Total: 37s
    #318193
  • Pipeline finished with Failed
    about 1 month ago
    Total: 33s
    #318194
  • Pipeline finished with Failed
    about 1 month ago
    Total: 33s
    #318205
  • Pipeline finished with Failed
    about 1 month ago
    Total: 32s
    #318207
  • Pipeline finished with Success
    about 1 month ago
    Total: 45s
    #318216
  • Pipeline finished with Success
    about 1 month ago
    Total: 33s
    #318218
  • Pipeline finished with Failed
    about 1 month ago
    Total: 33s
    #318221
  • Pipeline finished with Failed
    about 1 month ago
    Total: 33s
    #318226
  • Pipeline finished with Success
    about 1 month ago
    Total: 33s
    #318241
  • Pipeline finished with Success
    about 1 month ago
    Total: 35s
    #318250
  • Pipeline finished with Success
    about 1 month ago
    Total: 865s
    #318275
  • Pipeline finished with Failed
    about 1 month ago
    Total: 196s
    #318305
  • Pipeline finished with Canceled
    about 1 month ago
    Total: 787s
    #318321
  • Pipeline finished with Success
    about 1 month ago
    Total: 863s
    #318332
  • Pipeline finished with Canceled
    about 1 month ago
    Total: 349s
    #318358
  • Pipeline finished with Failed
    about 1 month ago
    Total: 936s
    #318367
  • Pipeline finished with Failed
    about 1 month ago
    Total: 936s
    #318387
  • Pipeline finished with Success
    about 1 month ago
    Total: 789s
    #318417
  • Pipeline finished with Running
    about 1 month ago
    #318759
  • πŸ‡ΊπŸ‡ΈUnited States phenaproxima Massachusetts

    OK - I've got this how I want it. Here's the plan:

    • We'll use the latest version of the splitsh-lite tool to generate the subtree splits. I've compiled it into a multi-architecture (arm64 and amd64) Docker image based on the work in https://github.com/splitsh/lite/pull/75, with the main difference being that I based the runtime image on alpine:latest so that it would have a minimal shell and be easier to use on CI, without having to do Docker-in-Docker weirdness.
    • The splits will be generated by the "subtree split" CI job, upon every commit to the default branch. But only if paths that match drupal_cms*/* have changed.
    • The remotes are listed in components.git, which is appended to the .git/config file in the CI environment. Every one of those remotes must correspond to the directory name of a component, and only the ones in that file are going to be pushed to their own repositories. We will push to a remote branch with the same name as the default branch, from which we are generating the subtree splits.

    I tested this on my personal GitHub and it seems to have worked beautifully.

  • πŸ‡ΊπŸ‡ΈUnited States phenaproxima Massachusetts

    This blocks a stable release of Drupal CMS, but I think that the list of components, and their permanent homes, should be finalized during beta, before we tag RC1.

    In other words, for beta we can keep using our kludgey zip file. For RC, we want to be distributing our components using Composer, the way they will actually be published out in the world.

  • πŸ‡ΊπŸ‡ΈUnited States phenaproxima Massachusetts
  • Pipeline finished with Failed
    about 1 month ago
    Total: 851s
    #318767
  • Pipeline finished with Failed
    about 1 month ago
    Total: 1109s
    #318788
  • πŸ‡ΊπŸ‡ΈUnited States phenaproxima Massachusetts
  • πŸ‡ΊπŸ‡ΈUnited States phenaproxima Massachusetts
  • Pipeline finished with Failed
    about 1 month ago
    Total: 1192s
    #318803
  • Pipeline finished with Canceled
    about 1 month ago
    Total: 123s
    #318832
  • Pipeline finished with Failed
    about 1 month ago
    Total: 872s
    #318835
  • Pipeline finished with Canceled
    about 1 month ago
    Total: 409s
    #318853
  • Pipeline finished with Failed
    about 1 month ago
    Total: 998s
    #318861
  • Pipeline finished with Failed
    about 1 month ago
    Total: 760s
    #319454
  • Pipeline finished with Success
    about 1 month ago
    Total: 993s
    #319506
  • πŸ‡ΊπŸ‡ΈUnited States phenaproxima Massachusetts
  • Pipeline finished with Canceled
    about 1 month ago
    Total: 509s
    #319520
  • Pipeline finished with Canceled
    about 1 month ago
    Total: 473s
    #319527
  • Pipeline finished with Success
    about 1 month ago
    Total: 882s
    #319536
  • Pipeline finished with Success
    about 1 month ago
    Total: 1002s
    #319572
  • Pipeline finished with Canceled
    about 1 month ago
    Total: 392s
    #319593
  • πŸ‡ΊπŸ‡ΈUnited States phenaproxima Massachusetts

    This pretty much locks in our distribution strategy, so assigning to @tim.plunkett for final review and approval. I ran it past @catch in Slack and he informally +1ed it as well.

  • Pipeline finished with Success
    about 1 month ago
    Total: 944s
    #319599
  • πŸ‡ΊπŸ‡ΈUnited States phenaproxima Massachusetts
  • Pipeline finished with Failed
    about 1 month ago
    Total: 796s
    #319791
  • Pipeline finished with Failed
    about 1 month ago
    Total: 797s
    #319827
  • Pipeline finished with Failed
    about 1 month ago
    Total: 774s
    #319852
  • Pipeline finished with Failed
    about 1 month ago
    Total: 807s
    #319860
  • Pipeline finished with Failed
    21 days ago
    #337792
  • Pipeline finished with Failed
    21 days ago
    #337794
  • Pipeline finished with Canceled
    21 days ago
    Total: 63s
    #337798
  • Pipeline finished with Canceled
    21 days ago
    Total: 184s
    #337800
  • Pipeline finished with Failed
    21 days ago
    Total: 962s
    #337803
  • Pipeline finished with Failed
    21 days ago
    Total: 287s
    #337814
  • Pipeline finished with Failed
    21 days ago
    Total: 34s
    #337820
  • Pipeline finished with Failed
    21 days ago
    Total: 34s
    #337824
  • Pipeline finished with Failed
    21 days ago
    Total: 34s
    #337829
  • Pipeline finished with Failed
    21 days ago
    Total: 34s
    #337831
  • Pipeline finished with Failed
    21 days ago
    Total: 34s
    #337836
  • Pipeline finished with Failed
    21 days ago
    Total: 34s
    #337839
  • Pipeline finished with Failed
    21 days ago
    Total: 34s
    #337857
  • Pipeline finished with Failed
    21 days ago
    Total: 34s
    #337859
  • Pipeline finished with Failed
    21 days ago
    Total: 34s
    #337861
  • Pipeline finished with Failed
    21 days ago
    Total: 45s
    #337864
  • Pipeline finished with Failed
    21 days ago
    #337884
  • Pipeline finished with Failed
    21 days ago
    Total: 693s
    #337889
  • πŸ‡ΊπŸ‡ΈUnited States phenaproxima Massachusetts
  • Pipeline finished with Skipped
    21 days ago
    #337964
  • πŸ‡ΊπŸ‡ΈUnited States phenaproxima Massachusetts

    Here we go...

  • Pipeline finished with Failed
    21 days ago
    Total: 540s
    #337960
  • Automatically closed - issue fixed for 2 weeks with no activity.

Production build 0.71.5 2024