Integration tests

[zc-devs]

@6543 wrote:

can we mock the kubernetis api somehow and create a integration test for the backend (with a smal pipeline as run example (1x clone 1x service 3xstep (2xparalel and one waiting))?

In case of #3178 mocking API doesn't make sense to me - looks like writing another implementation of Kubernetes.

It would be great, though, if we have intergration-integration tests (e2e). Test pipeline can be prepared in Gitea. Then in e2e test we can call WP API to trigger that pipeline. Then just check status of steps after some delay, maybe logs also. Instead of API, perhaps, CLI can be used.
Maybe some frameworks exist for this purpose.

PS: made discussion in order to not be lost.

[anbraten]

https://playwright.dev/ is pretty solid in terms of e2e testing UI, logic and components. For the test instance we can use the same setup we use for gitpod already: https://github.com/woodpecker-ci/woodpecker/tree/main/contrib/woodpecker-test-repo/.woodpecker. For a minimal kubernetes we could have a service running k3s.

[6543]

there exist a dedicated dummy backend witch allos you to controle the step/workflow outcome

so we can be backend independent for creating an integration test for woodpecker ...
.. backend specific integration tests are also an idea but I would not focus on that one jet

https://github.com/woodpecker-ci/woodpecker/tree/main/pipeline/backend/dummy

[anbraten]

started some work some time ago: #4954

[6543]

Create "backend integration test" framework -> #3819