[zuul] Move test-operator job to stages #215

lpiwowar · 2024-10-02T09:14:56Z

The linked PR for the test-oprator role introduces the concept of
stages. This patch updates the job definition so that it is
consuming the newly defined interface. It is required because by
default only the tempest stage is enabled.

Depends-On: openstack-k8s-operators/ci-framework#2374

openshift-ci · 2024-10-02T09:15:01Z

Skipping CI for Draft Pull Request.
If you want CI signal for your change, please convert it to an actual PR.
You can still manually trigger a test run with /test all

openshift-ci · 2024-10-02T09:15:03Z

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: lpiwowar

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

~~OWNERS~~ [lpiwowar]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

softwarefactory-project-zuul · 2024-10-02T12:42:19Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/aefc6a360eef48a5a19d549fefab7a61

✔️ openstack-k8s-operators-content-provider SUCCESS in 3h 22m 08s
❌ podified-multinode-edpm-deployment-crc-test-operator TIMED_OUT in 3h 11m 42s

lpiwowar · 2024-10-14T08:35:09Z

recheck

softwarefactory-project-zuul · 2024-10-14T09:33:16Z

This change depends on a change that failed to merge.

Change openstack-k8s-operators/ci-framework#2374 is needed.

lpiwowar · 2024-10-14T09:41:30Z

recheck

softwarefactory-project-zuul · 2024-10-14T13:44:48Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/663e052708db467aa81710b3d9633e76

✔️ openstack-k8s-operators-content-provider SUCCESS in 3h 27m 31s
❌ podified-multinode-edpm-deployment-crc-test-operator TIMED_OUT in 3h 11m 54s

eshulman2 · 2024-10-15T15:54:03Z

recheck

softwarefactory-project-zuul · 2024-10-15T16:10:51Z

This change depends on a change that failed to merge.

Change openstack-k8s-operators/ci-framework#2374 is needed.

lpiwowar · 2024-10-29T09:52:21Z

recheck

softwarefactory-project-zuul · 2024-10-29T13:14:40Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/32897794f7684203afbfe336ec5faeb2

✔️ openstack-k8s-operators-content-provider SUCCESS in 3h 21m 24s
❌ podified-multinode-edpm-deployment-crc-test-operator TIMED_OUT in 3h 11m 52s

lpiwowar · 2024-10-29T13:17:40Z

@eshulman2 FYI:

Failed because of:

  Warning  InspectFailed   4m26s (x577 over 129m)  kubelet            Failed to apply default image tag "{{ _test_operator_tempest_registry }}/{{ _test_operator_tempest_namespace }}/{{ _test_operator_tempest_container }}:current-podified": couldn't parse image name "{{ _test_operator_tempest_registry }}/{{ _test_operator_tempest_namespace }}/{{ _test_operator_tempest_container }}:current-podified": invalid reference format

https://logserver.rdoproject.org/15/215/824b0bc5fcba970c32b8f5b2ffab3f368e2b0940/github-check/podified-multinode-edpm-deployment-crc-test-operator/d62d19e/controller/ci-framework-data/logs/openstack-k8s-operators-openstack-must-gather/namespaces/openstack/pods/tempest-tests-tempest-full-workflow-step-0-dtq65/tempest-tests-tempest-full-workflow-step-0-dtq65-describe

lpiwowar · 2024-11-04T13:08:35Z

recheck

softwarefactory-project-zuul · 2024-11-04T15:06:58Z

This change depends on a change that failed to merge.

Change openstack-k8s-operators/ci-framework#2374 is needed.

lpiwowar · 2024-11-05T09:04:05Z

recheck

softwarefactory-project-zuul · 2024-11-05T10:59:49Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/c5e8a32d41b44de2963956359deb0819

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 54m 21s
❌ podified-multinode-edpm-deployment-crc-test-operator FAILURE in 1h 45m 15s

lpiwowar · 2024-11-05T11:44:58Z

@eshulman2 just fyi. Failing because of:

2024-11-05 05:47:02.966540 | controller | TASK [test_operator : Create the ssh keys path={{ cifmw_test_operator_artifacts_basedir }}/id_{{ stage_vars_dict.cifmw_test_operator_tobiko_ssh_keytype }}, type={{ stage_vars_dict.cifmw_test_operator_tobiko_ssh_keytype }}, size={{ stage_vars_dict.cifmw_test_operator_tobiko_ssh_keysize }}] ***
2024-11-05 05:47:02.966558 | controller | Tuesday 05 November 2024  05:47:01 -0500 (0:00:00.389)       1:21:42.151 ******
2024-11-05 05:47:02.966582 | controller | fatal: [localhost]: FAILED! => changed=false
2024-11-05 05:47:03.349948 | controller |   msg: 'argument ''size'' is of type <class ''str''> and we were unable to convert to int: <class ''str''> cannot be converted to an int'
2024-11-05 05:47:03.350006 | controller |

The problem is here [1].

[1] https://github.com/openstack-k8s-operators/ci-framework/blob/3ca94101ceb72227cf3b0fa37334813342994f3c/roles/test_operator/tasks/tobiko-tests.yml#L51

eshulman2 · 2024-11-06T17:47:17Z

recheck

softwarefactory-project-zuul · 2024-11-06T20:21:09Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/a159fea5e7294e1cb05ba11210de9710

✔️ openstack-k8s-operators-content-provider SUCCESS in 2h 03m 36s
❌ podified-multinode-edpm-deployment-crc-test-operator FAILURE in 1h 44m 40s

eshulman2 · 2024-11-11T09:09:24Z

recheck

softwarefactory-project-zuul · 2024-11-11T11:09:11Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/c0934a5f60a540aba11dc2f7b846953b

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 58m 48s
❌ podified-multinode-edpm-deployment-crc-test-operator FAILURE in 1h 50m 04s

lpiwowar · 2024-11-12T15:56:57Z

recheck

softwarefactory-project-zuul · 2024-11-12T19:20:23Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/392e75a9c69f406fae4d32847f18828b

✔️ openstack-k8s-operators-content-provider SUCCESS in 2h 21m 36s
❌ podified-multinode-edpm-deployment-crc-test-operator FAILURE in 2h 09m 17s

eshulman2 · 2024-11-13T19:27:40Z

recheck

softwarefactory-project-zuul · 2024-11-13T21:25:06Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/e7e77d6b4c254c6788ecb2f641b1770c

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 22m 40s
❌ podified-multinode-edpm-deployment-crc-test-operator FAILURE in 1h 01m 16s

eshulman2 · 2024-11-14T08:58:17Z

recheck

softwarefactory-project-zuul · 2024-11-14T10:58:35Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/f01b4438c1ce409fa605608a33690cce

✔️ openstack-k8s-operators-content-provider SUCCESS in 1h 19m 05s
❌ podified-multinode-edpm-deployment-crc-test-operator FAILURE in 1h 02m 30s

eshulman2 · 2024-11-14T12:36:59Z

recheck

softwarefactory-project-zuul · 2024-11-14T14:51:43Z

This change depends on a change that failed to merge.

Change openstack-k8s-operators/ci-framework#2374 is needed.

eshulman2 · 2024-11-14T16:47:20Z

recheck

softwarefactory-project-zuul · 2024-11-14T21:00:53Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/3aa834c0e75b4b9c8289e889a3aef85a

✔️ openstack-k8s-operators-content-provider SUCCESS in 3h 01m 50s
❌ podified-multinode-edpm-deployment-crc-test-operator FAILURE in 2h 13m 14s

eshulman2 · 2024-11-17T08:31:26Z

recheck

softwarefactory-project-zuul · 2024-11-17T08:42:24Z

This change depends on a change that failed to merge.

Change openstack-k8s-operators/ci-framework#2374 is needed.

eshulman2 · 2024-11-17T09:23:33Z

recheck

softwarefactory-project-zuul · 2024-11-17T11:23:23Z

This change depends on a change that failed to merge.

Change openstack-k8s-operators/ci-framework#2374 is needed.

eshulman2 · 2024-11-17T11:23:38Z

recheck

softwarefactory-project-zuul · 2024-11-17T13:45:43Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/a494471680414c57b1c4e15271291550

✔️ openstack-k8s-operators-content-provider SUCCESS in 2h 20m 54s
❌ podified-multinode-edpm-deployment-crc-test-operator FAILURE in 2h 11m 40s

lpiwowar · 2024-11-19T15:52:43Z

.zuul.yaml

+            cifmw_test_operator_tempest_include_list: |
+              ^tempest.
+            cifmw_test_operator_tempest_exclude_list: |
+              # Note (lpiwowar): Unskip test_verify_hostname_allows_fqdn once the
+              #                  Details: Timeout while verifying metadata on server
+              #                  error is resolved.
+              tempest.api.compute.servers.test_create_server.ServersV294TestFqdnHostnames.test_verify_hostname_allows_fqdn
+              tempest.api.compute.admin.test_live_migration.LiveMigrationTest.test_live_migration_with_trunk
+              tempest.api.compute.admin.test_auto_allocate_network.AutoAllocateNetworkTest.test_server_multi_create_auto_allocate
+              tempest.api.compute.servers.test_server_rescue.ServerStableDeviceRescueTestIDE
+              tempest.api.compute.servers.test_device_tagging
+              tempest.api.network.admin.test_dhcp_agent_scheduler.DHCPAgentSchedulersTestJSON
+              tempest.scenario.test_minimum_basic.TestMinimumBasicScenario.test_minimum_basic_scenario
+              tempest.scenario.test_stamp_pattern
+              tempest.scenario.test_network_advanced_server_ops.TestNetworkAdvancedServerOps.test_server_connectivity_live_migration
+              tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_mtu_sized_frames
+              test_create_server_invalid_bdm_in_2nd_dict
+              tempest.api.identity.admin.v3.test_credentials.CredentialsTestJSON
+              tempest.api.identity.admin.v3.test_tokens.TokensV3TestJSON.test_rescope_token
+              tempest.api.identity.admin.v3.test_users.UsersV3TestJSON.test_update_user_password


@eshulman2 this is a correct job definition that should work with the change in the test-operator role, right?

It seems like the include_list and exclude_list values did not get propagate correctly? -> https://logserver.rdoproject.org/15/215/824b0bc5fcba970c32b8f5b2ffab3f368e2b0940/github-check/podified-multinode-edpm-deployment-crc-test-operator/909305c/controller/ci-framework-data/logs/openstack-k8s-operators-openstack-must-gather/namespaces/openstack/crs/tempests.test.openstack.org/tempest-tests-tempest.yaml

should be resolved now

eshulman2 · 2024-11-19T16:39:25Z

recheck

softwarefactory-project-zuul · 2024-11-19T16:39:37Z

Merge Failed.

This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.
Warning:
Error merging github.com/openstack-k8s-operators/test-operator for 215,824b0bc5fcba970c32b8f5b2ffab3f368e2b0940

eshulman2 · 2024-11-19T16:41:57Z

recheck

softwarefactory-project-zuul · 2024-11-19T16:42:08Z

Merge Failed.

This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.
Warning:
Error merging github.com/openstack-k8s-operators/test-operator for 215,824b0bc5fcba970c32b8f5b2ffab3f368e2b0940

softwarefactory-project-zuul · 2024-11-19T22:11:20Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/91bbfe45aec84c29a3cd2a295b2a72d3

✔️ openstack-k8s-operators-content-provider SUCCESS in 2h 07m 31s
❌ podified-multinode-edpm-deployment-crc-test-operator FAILURE in 1h 55m 11s

softwarefactory-project-zuul · 2024-11-20T12:17:13Z

This change depends on a change that failed to merge.

Change openstack-k8s-operators/ci-framework#2374 is needed.

lpiwowar · 2024-11-20T12:40:59Z

recheck

softwarefactory-project-zuul · 2024-11-20T12:41:10Z

Merge Failed.

This change or one of its cross-repo dependencies was unable to be automatically merged with the current state of its repository. Please rebase the change and upload a new patchset.
Warning:
Error merging github.com/openstack-k8s-operators/test-operator for 215,123be418237ef5e376cabd90297fbbbe46f3ad9b

The linked PR for the test-oprator role introduces the concept of stages. This patch updates the job definition so that it is consuming the newly defined interface. It is required because by default only the tempest stage is enabled. Depends-On: openstack-k8s-operators/ci-framework#2374

openshift-ci bot added the do-not-merge/work-in-progress label Oct 2, 2024

openshift-ci bot added the approved label Oct 2, 2024

lpiwowar mentioned this pull request Oct 2, 2024

Allow setting order and hooks for test role openstack-k8s-operators/ci-framework#2374

Open

lpiwowar closed this Oct 21, 2024

lpiwowar deleted the feature/update-jobs-to-stages branch October 21, 2024 14:11

lpiwowar restored the feature/update-jobs-to-stages branch October 29, 2024 09:52

lpiwowar reopened this Oct 29, 2024

lpiwowar commented Nov 19, 2024

View reviewed changes

openshift-merge-robot added the needs-rebase label Nov 19, 2024

lpiwowar force-pushed the feature/update-jobs-to-stages branch from 824b0bc to 628c836 Compare November 19, 2024 18:51

openshift-merge-robot removed the needs-rebase label Nov 19, 2024

lpiwowar force-pushed the feature/update-jobs-to-stages branch from 628c836 to 123be41 Compare November 20, 2024 10:04

lpiwowar force-pushed the feature/update-jobs-to-stages branch from 123be41 to f1d3b50 Compare November 20, 2024 12:44

[zuul] Move test-operator job to stages #215

Are you sure you want to change the base?

[zuul] Move test-operator job to stages #215

Conversation

lpiwowar commented Oct 2, 2024

openshift-ci bot commented Oct 2, 2024

openshift-ci bot commented Oct 2, 2024

softwarefactory-project-zuul bot commented Oct 2, 2024

lpiwowar commented Oct 14, 2024

softwarefactory-project-zuul bot commented Oct 14, 2024

lpiwowar commented Oct 14, 2024

softwarefactory-project-zuul bot commented Oct 14, 2024

eshulman2 commented Oct 15, 2024

softwarefactory-project-zuul bot commented Oct 15, 2024

lpiwowar commented Oct 29, 2024

softwarefactory-project-zuul bot commented Oct 29, 2024

lpiwowar commented Oct 29, 2024

lpiwowar commented Nov 4, 2024

softwarefactory-project-zuul bot commented Nov 4, 2024

lpiwowar commented Nov 5, 2024

softwarefactory-project-zuul bot commented Nov 5, 2024

lpiwowar commented Nov 5, 2024

eshulman2 commented Nov 6, 2024

softwarefactory-project-zuul bot commented Nov 6, 2024

eshulman2 commented Nov 11, 2024

softwarefactory-project-zuul bot commented Nov 11, 2024

lpiwowar commented Nov 12, 2024

softwarefactory-project-zuul bot commented Nov 12, 2024

eshulman2 commented Nov 13, 2024

softwarefactory-project-zuul bot commented Nov 13, 2024

eshulman2 commented Nov 14, 2024

softwarefactory-project-zuul bot commented Nov 14, 2024

eshulman2 commented Nov 14, 2024

softwarefactory-project-zuul bot commented Nov 14, 2024

eshulman2 commented Nov 14, 2024

softwarefactory-project-zuul bot commented Nov 14, 2024

eshulman2 commented Nov 17, 2024

softwarefactory-project-zuul bot commented Nov 17, 2024

eshulman2 commented Nov 17, 2024

softwarefactory-project-zuul bot commented Nov 17, 2024

eshulman2 commented Nov 17, 2024

softwarefactory-project-zuul bot commented Nov 17, 2024

lpiwowar Nov 19, 2024

Choose a reason for hiding this comment

eshulman2 Nov 19, 2024

Choose a reason for hiding this comment

eshulman2 commented Nov 19, 2024

softwarefactory-project-zuul bot commented Nov 19, 2024

eshulman2 commented Nov 19, 2024

softwarefactory-project-zuul bot commented Nov 19, 2024

softwarefactory-project-zuul bot commented Nov 19, 2024

softwarefactory-project-zuul bot commented Nov 20, 2024

lpiwowar commented Nov 20, 2024

softwarefactory-project-zuul bot commented Nov 20, 2024