Skip to content

Integrate gitlab-ci/yt-380-enhnce-backup-script-with-batch-processing and 8 more

Git Bot Service Account requested to merge integrate/gitlab-ci/yt-380-enhnce-backup-script-with-batch-processing/into/master into master

Commit: seco-ne/yocto/infrastructure/gitlab-ci@6ed9283d

YT-380: Use Batch Processing in gitlab_backup.py

Currently, gitlab-backup.py processes all projects in the requested backup group simultaneously. This means: The script initiates backup tasks for all projects at once on the GitLab instance. When there are a large number of subgroups and projects, this results in high load on the GitLab instance, leading to performance degradation.

Instead of initiating backup tasks for all projects at once, we group projects into chunks (e.g., 5-10 projects per batch) and then proceed each batch one by one until all projects are processed.

--

Commit: seco-ne/yocto/infrastructure/gitlab-ci@3be9fda0

[BACKUP] Integrate gitlab_logging features into gitlab_backup script

--

Commit: seco-ne/yocto/infrastructure/gitlab-ci@0ccb04f6

[BACKUP] Cleanup unused classes and extract common GitLab functions

  • Removed unused classes from backup.py that were likely left over during development.
  • Moved shared GitLab-related functions to common.py for better reusability and code organization.

--

Commit: seco-ne/yocto/infrastructure/gitlab-ci@48de066c

CI: changelog: Allow_failure because of gitlab server issues

--

Commit: seco-ne/yocto/infrastructure/gitlab-ci@24276e10

CI: changelog: Increase timeout because of gitlab server issues

--

Commit: seco-ne/yocto/infrastructure/gitlab-ci@57087972

report-image-diff: Rewrite the report image diff to use buildhistory

The old way used the gitlab UI to load the html overview for the artefacts, but this didn't worked for private repos, as the login was not implemented. Loading file from the buildhistory with known names uses the gitlab API, where the credential handling is provided.

Also replace loops and duplicated code with internal classes, which massively restructures the code.

--

Commit: seco-ne/yocto/infrastructure/gitlab-ci@9b2134aa

report-image-diff: Get target branch correctly

--

Commit: seco-ne/yocto/infrastructure/gitlab-ci@0ff7cdfd

scripts: buildartifacts: Add main and parameters for testing

Also add download for build.env

--

Commit: seco-ne/yocto/infrastructure/gitlab-ci@6b108164

CI: build: Add buildhistory/images to the artifacts, and image name to build.env

Merge request reports