73 Commits

Author SHA1 Message Date
Sebastian Dröge
57df39fb4c ci: Update to cargo-c 0.10.15
Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/9503>
2025-08-10 19:11:49 +00:00
Sebastian Dröge
78c2140db7 ci: Update to Rust 1.89
Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/9503>
2025-08-10 19:11:49 +00:00
Thibault Saunier
3fe0127a64 scripts: git-hooks: ci: Add GES children properties documentation check
Add a pre-commit hook that automatically checks if GES children properties
documentation is up to date when GES source files are modified. The hook
runs the document-children-props.py script and warns if the generated
documentation files have changes that need to be committed.

This ensures that children properties documentation stays synchronized
with code changes and prevents outdated documentation from being merged.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/5987>
2025-08-05 12:48:38 +00:00
Jordan Petridis
8ab5e5b7cb ci: Update the kernel version we use with fluster
Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/9401>
2025-07-17 22:30:37 +00:00
Olivier Crête
911fb66ce0 ci: chown the builddir
Even if it's not the project dir, this is needed when
building inside the image building stage

Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/9382>
2025-07-15 22:05:48 +00:00
Jordan Petridis
18684c6d04 ci: Replace custom toolbox image with FDO_DISTRIBUTION_POST_EXEC
We were building a different image cause we needed to do
a couple things that are not possible yet through
cbuild/ci-templates.

Now that we have FDO_DISTRIBUTION_POST_EXEC we can
do it on the same job and use the same image tag to
extend the image.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/9277>
2025-07-02 19:34:17 +00:00
Jordan Petridis
d4b7066060 ci: Run the jobs as an unprivileged non-root user
Docker/oci and thus gitlab-runner, default to a root
user inside the namespace, even if its an unprivileged
one.

This can cause issues and let permission bugs sneak in,
as we are functionally root when running the build.

Switch the build jobs to run with our new "containeruser"
so we avoid much of it.

Our user is still in the wheel/sudo group but that's fine
as long we don't elevate the privileges unintentionally.

Noticeably for the time being, we will need to chown the
CI_PROJECT_DIR checkout as the gitlab runner might try
to reuse pre-existing and cached volumes of the project
checkout.

Additionally we need to change the ccache path, so we
will avoid the existing cache owned by "root".

Close https://gitlab.freedesktop.org/gstreamer/gstreamer/-/issues/2433

Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/8763>
2025-07-02 12:18:01 +00:00
Jordan Petridis
fafd2bc844 ci: override python user-base location
We are currently running pip as root which will cause it
to install into /root/.local cause it wants to do a user install
Set the user-base in the gloabl config, /etc/pip.conf, so pip will
both install there and subsequently look there if we invoke it
from any other user.

This makes pip install ofc require elevated permissions, as it
will be writting into /usr/local from now on

Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/8763>
2025-07-02 12:18:01 +00:00
Jordan Petridis
59faed542e ci: Move subprojects cache into /var/cache
Functionally identical, but a better location to
place them.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/8763>
2025-07-02 12:18:00 +00:00
Jordan Petridis
936a3cefcd ci: Add a metadata file into the images we build
Create a file we can check at runtime, and identify if the
environment we run against is one of our CI build images.
Useful mostly for our internal scritps so we can  match against
metadata rather than heuristics, ex. if /subprojects exists

Conceptually similar to /.flatpak-info

Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/8763>
2025-07-02 12:17:59 +00:00
Sebastian Dröge
da2da7711d ci: Update to Rust 1.88 and cargo-c 0.10.14
Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/9310>
2025-06-30 22:56:04 +00:00
Sebastian Dröge
056c6967b2 ci: Update to Rust 1.87 / cargo-c 0.10.13
Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/9038>
2025-05-30 09:48:34 +03:00
Jordan Petridis
a61ce97e48 ci: Use the existing checkout to create the subproject cache
Now that we have the monorepo, we always have a checkout
of gstreamer and we don't need to explicitly clone it again.

cbuild in ci-templates will always clone the repository in
/tmp/clone and we can use that to initialize the cache.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/8994>
2025-05-23 14:29:52 +00:00
Jordan Petridis
a74bda813b ci: Always create the subproject cache from the upstream repo
Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/8994>
2025-05-23 14:29:52 +00:00
Tim-Philipp Müller
ee0f2a0bb2 ci: check-diff: fix curl command line to handle redirects
Seems to be needed now with the new caching/bot-protection layers.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/8949>
2025-05-08 11:14:40 +01:00
Jordan Petridis
db17f54253 build: Add devcontainer manifest for our CI image
Devcontainer [1] is a popular container schema that makes
IDEs and tooling aware about the container image you want
to use and develop against.

The most popular implementation of devcontainer are Visual
Studio and VSCode and this allows us to have a out of the
box pre-defined and working build environment that is very
close to the environment CI runs against.

This also allows VSCode on Windows and Mac to setup a
Linux docker container (vm) to develop against if so
desired.

[1] https://containers.dev/

Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/7816>
2025-04-12 10:11:29 +00:00
Jordan Petridis
2aa7dcd715 install-rust.sh: Remove rust-docs from the install
We don't make use use of the html documentation in
the ci image, so it only takes space.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/7816>
2025-04-12 10:11:29 +00:00
Jordan Petridis
5ce342f8fd ci: Move containeruser creation into the main image
Doesn't need to be done only for toolbox and we will
need this when we switch the user gitlab-ci runs as.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/7816>
2025-04-12 10:11:28 +00:00
Jordan Petridis
ca44d76c4f ci: Print some metadata at the start of the build
Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/7816>
2025-04-12 10:11:28 +00:00
Jordan Petridis
b9c3e7c162 build-toolbox-image.sh: Install rust-analyzer into the image
If you develop against the image, then you can configure
your IDE to spawn rust-analyzer inside the container as well.

This works with devcontainer and vscode.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/7816>
2025-04-12 10:11:28 +00:00
Jordan Petridis
17cf7226f4 build-toolbox-image.sh: Hardcode the RUSTUP/CARGO_HOME env vars
We install the rust toolchain, but then we have to manually
source it in CI since the headless containers skip over
the shell profiles that rustup typically uses.

Ideally we'd set these as variables in the main image, but
we don't have access to the buildah instance used in
ci-templates/cbuild.

However adding them to the toolbox image is good enough to
have the toolbox setup work ootb even if it doesn't call the
ci/scripts/source_image_env.sh script like the gitlab-ci jobs
will do.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/7816>
2025-04-12 10:11:28 +00:00
Jordan Petridis
2ce8a1aea9 build-toolbox-image.sh: Only publish the latest tag on the appropriate branch
Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/7816>
2025-04-12 10:11:28 +00:00
Jordan Petridis
22a83c8db6 build-toolbox-image.sh: Change the suggested name for the toolbox
Previously the script will give you a command like:

```
toolbox create gst-toolbox ..
```

Which is a bit redundant since we are already creating
toolbox, we don't need to label it as such.

Now instead use gst-$GST_UPSTREAM_BRANCH for the name,
so we will suggest gst-main and gst-1.24 instead

Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/7816>
2025-04-12 10:11:28 +00:00
Sebastian Dröge
883ff6caaa ci: Update to Rust 1.86 and cargo-c 0.10.12
Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/8783>
2025-04-05 19:56:17 +03:00
Sebastian Dröge
3db85ca77a ci: Update to cargo-c 0.10.11
Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/8532>
2025-02-23 16:55:53 +00:00
Sebastian Dröge
f2bcd56571 ci: Update to Rust 1.85
Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/8532>
2025-02-23 16:55:53 +00:00
Nirbheek Chauhan
8a36647064 ci: Fix builddir typo in build-docs script
Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/8403>
2025-02-09 14:25:31 +00:00
Nicolas Dufresne
bb37ea168d doc: v4l2codecs: Document all decoders
Add the documentation blob and since marker for all decoders.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/5555>
2025-02-06 00:58:01 +00:00
Thibault Saunier
58939e10ee docs: Embed the gstreamer-rs documentation into our documentation in CI
Downloading the latest build of GStreamer-rs from its CI job and running a
script to embed the rustoc generated documentation into hotdoc based one.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/8317>
2025-01-23 10:52:50 +00:00
Sebastian Dröge
c513340c89 ci: Update to Rust 1.84 and cargo-c 0.10.8
Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/8285>
2025-01-11 17:38:00 +02:00
Mathieu Duponchelle
7b4e6e67d3 docs: start using custom_target instead of run_command for sitemap
Intead of passing around the output of the config generator program,
which consists of paths joined by a separator we can have the generator
simply produce an extra file containing those paths.

This commit only implements the new approach for the core plugins, as
this was needed to avoid spurious meson rebuilds when the pre-commit
hook regenerates the core plugins_cache.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/8231>
2025-01-09 16:19:39 +00:00
Sebastian Dröge
2b1e4d4038 ci: Update to cargo-c 0.10.7
Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/8002>
2024-11-30 12:38:28 +00:00
Sebastian Dröge
a91b48f5d5 ci: Update to Rust 1.83
Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/8002>
2024-11-30 12:38:28 +00:00
Matthew Waters
fc30006290 ci/abi-check: provide the header dir to abidw
Allows the abi diff check to correctly filter out private types.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/7981>
2024-11-27 14:57:48 +00:00
Matthew Waters
5b32fe7b24 ci: add an ABI check job
Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/7875>
2024-11-18 12:11:57 +11:00
Matthew Waters
76a037d29a ci: handle changing wrap file refs
Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/7821>
2024-11-05 02:38:38 +00:00
Jordan Petridis
94737cc108 ci: Install all the glbic langpacks in the fedora image
Also remove the coreutils swap from the toolbox since
it's already done in the base image

Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/7762>
2024-11-02 11:46:25 +00:00
Jordan Petridis
5ad8258a7d ci/build-toolbox-image.sh: Always print how to use fetch the image
Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/7769>
2024-10-31 05:22:26 +00:00
Jordan Petridis
19d5a58450 ci: Add a default non-root user in the toolbox image
Toolbox itself will try to make a new user and map the host
uid:gid to it, however it good to also have a default user
set in the image itself in case it needs to be used with
other tooling or debugging.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/7769>
2024-10-31 05:22:26 +00:00
Jordan Petridis
ef745265be ci/scripts/test: Place XDG_RUNTIME_DIR in /tmp when running locally
Avoid polluting the pwd/current checkout you are working from

Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/7591>
2024-10-28 13:47:18 +00:00
Jordan Petridis
e6e2653bf8 ci: Always run the tests using software rasterization
This way when run locally the environment matches what
happens in the headless CI runners without a gpu.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/7591>
2024-10-28 13:47:18 +00:00
Jordan Petridis
9c5523d529 ci: Make it easier to run the build scripts locally
* Move the exported PATH variables into a script so
we can source it in all the wrapper scripts.

* Add a guard to only copy over the cache when the
SUBPROJECTS_CACHE_DIR variable is set, which only
happens on CI by default

* Make it possible to run the scripts with default
values for some of the variables, like WERROR and MESON_ARGS.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/7591>
2024-10-28 13:47:18 +00:00
Jordan Petridis
c0357f8f8b ci: Disable avx2+ extensions for valgrind jobs
Match what valgrind supports and set the appropriate
openssl variable for it.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/7455>
2024-10-25 13:55:20 +00:00
Jordan Petridis
2cd382af73 ci: Cleanup the cargo registry in the images
Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/7455>
2024-10-25 13:55:19 +00:00
Jordan Petridis
a31c8cf370 ci: Push a dedicated toolbox image
This is mostly done to remove the hardcoded HOME
env var that ci-templates appends to the image. See [1]

[1] https://gitlab.freedesktop.org/gstreamer/gstreamer/-/issues/2433#note_2243222

But it also allows us to add extra things useful for local
development to it, as long they don't interfere with the
build enviornment.

This also means we can switch the build image to be based
on top of the normal fedora one rather than toolbox,
so it will no longer advertise the toolbox compatible labels
since it was buggy anyway.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/7455>
2024-10-25 13:55:19 +00:00
Sebastian Dröge
22e5e57d44 ci: Update to cargo-c 0.10.5
Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/7683>
2024-10-19 00:06:50 +00:00
Sebastian Dröge
d56fa94146 ci: Update to Rust 1.82
Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/7678>
2024-10-17 22:39:45 +00:00
Jordan Petridis
120f2a6b83 ci: Explicitly set the number of jobs validate-launcher will run
Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/7592>
2024-10-02 13:58:09 +00:00
Jordan Petridis
a0b561b492 ci: Pass --builddir to gst-env.py in build-docs.sh
The CI uses a builddir name that gst-env can autodetect,
but that's not always the case if you run the script locally.

Pass the builddir explicitly to avoid this.

Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/7559>
2024-09-30 20:47:44 +00:00
Sebastian Dröge
2d989058a7 ci: Update to cargo-c 0.10.4
Part-of: <https://gitlab.freedesktop.org/gstreamer/gstreamer/-/merge_requests/7458>
2024-09-05 20:05:38 +00:00