Skip to content

Conversation

ming1013
Copy link

@ming1013 ming1013 commented Jul 3, 2025

This PR is a reference for https://docs.google.com/document/d/1zgOg4OiVEDhbJgESi9y9BXBEFcQNyNAFf8_NsxqYQmw/edit?tab=t.0
We can talk/update/comment here for more details.

The next step I plan to merge test cases from openshit-test-private repo to here by updating this PR.

@openshift-ci openshift-ci bot requested review from frobware and rfredette July 3, 2025 11:22
Copy link
Contributor

openshift-ci bot commented Jul 3, 2025

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please assign grzpiotrowski for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@ming1013
Copy link
Author

ming1013 commented Jul 3, 2025

/do-not-merge

@ming1013
Copy link
Author

ming1013 commented Jul 3, 2025

/uncc @rfredette
/uncc @frobware

@openshift-ci openshift-ci bot removed request for rfredette and frobware July 3, 2025 11:26
@ming1013
Copy link
Author

ming1013 commented Jul 3, 2025

cc @jhuttana
cc @rioliu-rh
cc @LuboTerifaj

@rioliu-rh
Copy link

what's the difference b/w your PR and example-tests in OTE repo. I don't see any code changes related to migration, I'm not sure if you want to use this example to show component team how to migrate code from openshift-tests-private repo to target repo

@rioliu-rh
Copy link

some changes suggest to be added

  1. how to init openshift-tests in OTE interface.
  2. test case and its dependent modules
  3. make file changes about how to add compressed OTE image to product image.
  4. example about binary usage, at least run-test and run-suite

@ming1013
Copy link
Author

ming1013 commented Jul 4, 2025

what's the difference b/w your PR and example-tests in OTE repo. I don't see any code changes related to migration, I'm not sure if you want to use this example to show component team how to migrate code from openshift-tests-private repo to target repo

Because Jayashree still has some questions during implementing the OTE how to guide after one war room, so I submit this PR for reference, it's more easier to discuss here then adding more elaborated steps in the guide

@ming1013
Copy link
Author

ming1013 commented Jul 4, 2025

some changes suggest to be added

  1. how to init openshift-tests in OTE interface.
  2. test case and its dependent modules
  3. make file changes about how to add compressed OTE image to product image.
  4. example about binary usage, at least run-test and run-suite

Sure. These can be added by updating this PR

@ming1013
Copy link
Author

Add awslb-operator test case with dependency resolving:
$ ./example-tests list
[
{
"name": "[sig-network-edge] Network_Edge Component_ALBO Author:hongli-ROSA-OSD_CCS-ConnectedOnly-LEVEL0-High-51189-Install aws-load-balancer-operator and controller [Serial]",
"labels": {},
"resources": {
"isolation": {}
},
"source": "openshift:payload:openshit-router",
"codeLocations": [
"/home/minl/router/test/example/awslb-operator.go:16",
"/home/minl/router/test/util/client.go:120",
"/home/minl/router/test/util/client.go:123",
"set up framework | framework.go:200",
"/home/minl/router/test/util/client.go:132",
"/home/minl/router/test/example/awslb-operator.go:25",
"/home/minl/router/test/example/awslb-operator.go:44",
"/home/minl/router/test/example/awslb-operator.go:52"
],
"lifecycle": "blocking",
"environmentSelector": {}
},
{
"name": "[sig-network-edge] Network_Edge Component_ALBO Author:hongli-ROSA-OSD_CCS-ConnectedOnly-Medium-51191-Provision ALB by creating an ingress [Serial]",
"labels": {},
"resources": {
"isolation": {}
},
"source": "openshift:payload:openshit-router",
"codeLocations": [
"/home/minl/router/test/example/awslb-operator.go:16",
"/home/minl/router/test/util/client.go:120",
"/home/minl/router/test/util/client.go:123",
"set up framework | framework.go:200",
"/home/minl/router/test/util/client.go:132",
"/home/minl/router/test/example/awslb-operator.go:25",
"/home/minl/router/test/example/awslb-operator.go:44",
"/home/minl/router/test/example/awslb-operator.go:74"
],
"lifecycle": "blocking",
"environmentSelector": {}
},
{
"name": "[router-testing] router-tests should support passing tests",
"labels": {},
"resources": {
"isolation": {}
},
"source": "openshift:payload:openshit-router",
"codeLocations": [
"/home/minl/router/test/example/example.go:8",
"/home/minl/router/test/example/example.go:9"
],
"lifecycle": "blocking",
"environmentSelector": {}
}
]

@ming1013
Copy link
Author

ming1013 commented Jul 28, 2025

Need to add InitTest test function for test cases to get cluster contexts in main.go

$ ./example-tests run-test -n "[sig-network-edge] Network_Edge Component_ALBO Author:hongli-ROSA-OSD_CCS-ConnectedOnly-LEVEL0-High-51189-Install aws-load-balancer-operator and controller [Serial]"
I0728 20:56:26.738969 52019 test_context.go:566] The --provider flag is not set. Continuing as if --provider=skeleton had been used.
Running Suite: - /home/minl/router/build

Random Seed: 1753707386 - will randomize all specs

Will run 1 of 1 specs

[sig-network-edge] Network_Edge Component_ALBO Author:hongli-ROSA-OSD_CCS-ConnectedOnly-LEVEL0-High-51189-Install aws-load-balancer-operator and controller [Serial]
/home/minl/router/test/example/awslb-operator.go:52
STEP: Creating a kubernetes client @ 07/28/25 20:56:26.739
I0728 20:56:26.740647 52019 clusters.go:327] do not know if it is external oidc cluster or not, and try to check it again
I0728 20:56:26.740870 52019 client.go:1038] showInfo is true
I0728 20:56:26.740883 52019 client.go:1040] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get authentication/cluster -o=jsonpath={.spec.type}'
I0728 20:56:27.570745 52019 clusters.go:332] Found authentication type used:
I0728 20:56:30.292513 52019 client.go:223] configPath is now "/tmp/configfile1804254659"
I0728 20:56:30.292546 52019 client.go:503] The user is now "e2e-test-awslb-zlvhh-user"
I0728 20:56:30.292564 52019 client.go:506] Creating project "e2e-test-awslb-zlvhh"
I0728 20:56:30.612005 52019 client.go:515] Waiting on permissions in project "e2e-test-awslb-zlvhh" ...
I0728 20:56:31.786858 52019 client.go:576] Waiting for ServiceAccount "default" to be provisioned...
I0728 20:56:32.098138 52019 client.go:576] Waiting for ServiceAccount "builder" to be provisioned...
I0728 20:56:32.417660 52019 client.go:576] Waiting for ServiceAccount "deployer" to be provisioned...
I0728 20:56:32.727566 52019 client.go:586] Waiting for RoleBinding "system:image-builders" to be provisioned...
I0728 20:56:33.210460 52019 client.go:586] Waiting for RoleBinding "system:deployers" to be provisioned...
I0728 20:56:33.815645 52019 client.go:586] Waiting for RoleBinding "system:image-pullers" to be provisioned...
I0728 20:56:34.377454 52019 client.go:617] Project "e2e-test-awslb-zlvhh" has been fully provisioned.
I0728 20:56:34.377606 52019 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get nodes -o=jsonpath={.items[].status.nodeInfo.architecture}'
I0728 20:56:36.396606 52019 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get infrastructure cluster -o=jsonpath={.status.platformStatus.type}'
I0728 20:56:37.223144 52019 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get infrastructure cluster -o=jsonpath={.status.platformStatus.aws.region}'
I0728 20:56:38.016299 52019 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get -n openshift-marketplace catalogsource'
I0728 20:56:38.993837 52019 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get -n aws-load-balancer-operator pod -l control-plane=controller-manager'
STEP: Ensure the operartor pod is ready @ 07/28/25 20:56:40.206
I0728 20:56:45.209462 52019 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get pod -n aws-load-balancer-operator -l control-plane=controller-manager -ojsonpath={.items[
].status.conditions[?(@.type=="Ready")].status}'
I0728 20:56:46.315647 52019 util.go:343] the Ready status of pod is True
STEP: Create CR AWSLoadBalancerController @ 07/28/25 20:56:46.315
I0728 20:56:46.315754 52019 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig create -f /tmp/fixture-testdata-dir2880002962/test/extended/testdata/router/awslb/awslbcontroller.yaml'
I0728 20:56:47.124930 52019 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get authentication cluster -o=jsonpath={.spec.serviceAccountIssuer}'
I0728 20:56:53.158510 52019 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get pod -n aws-load-balancer-operator -l app.kubernetes.io/name=aws-load-balancer-operator -ojsonpath={.items[].status.conditions[?(@.type=="Ready")].status}'
I0728 20:56:54.098139 52019 util.go:343] the Ready status of pod is
I0728 20:56:54.098169 52019 util.go:345] failed to get pod status: , retrying...
I0728 20:56:58.157466 52019 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get pod -n aws-load-balancer-operator -l app.kubernetes.io/name=aws-load-balancer-operator -ojsonpath={.items[
].status.conditions[?(@.type=="Ready")].status}'
I0728 20:56:59.016562 52019 util.go:343] the Ready status of pod is
I0728 20:56:59.016611 52019 util.go:345] failed to get pod status: , retrying...
I0728 20:57:03.155590 52019 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get pod -n aws-load-balancer-operator -l app.kubernetes.io/name=aws-load-balancer-operator -ojsonpath={.items[].status.conditions[?(@.type=="Ready")].status}'
I0728 20:57:03.948619 52019 util.go:343] the Ready status of pod is
I0728 20:57:03.948653 52019 util.go:345] failed to get pod status: , retrying...
I0728 20:57:08.154775 52019 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get pod -n aws-load-balancer-operator -l app.kubernetes.io/name=aws-load-balancer-operator -ojsonpath={.items[
].status.conditions[?(@.type=="Ready")].status}'
I0728 20:57:09.462462 52019 util.go:343] the Ready status of pod is
I0728 20:57:09.462493 52019 util.go:345] failed to get pod status: , retrying...
I0728 20:57:13.158384 52019 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get pod -n aws-load-balancer-operator -l app.kubernetes.io/name=aws-load-balancer-operator -ojsonpath={.items[].status.conditions[?(@.type=="Ready")].status}'
I0728 20:57:13.958817 52019 util.go:343] the Ready status of pod is
I0728 20:57:13.958852 52019 util.go:345] failed to get pod status: , retrying...
I0728 20:57:18.157457 52019 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get pod -n aws-load-balancer-operator -l app.kubernetes.io/name=aws-load-balancer-operator -ojsonpath={.items[
].status.conditions[?(@.type=="Ready")].status}'
I0728 20:57:19.290124 52019 util.go:343] the Ready status of pod is False
I0728 20:57:19.290155 52019 util.go:349] the pod Ready status not met; wanted True but got False, retrying...
I0728 20:57:23.154772 52019 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get pod -n aws-load-balancer-operator -l app.kubernetes.io/name=aws-load-balancer-operator -ojsonpath={.items[].status.conditions[?(@.type=="Ready")].status}'
I0728 20:57:24.327467 52019 util.go:343] the Ready status of pod is False
I0728 20:57:24.327499 52019 util.go:349] the pod Ready status not met; wanted True but got False, retrying...
I0728 20:57:28.158403 52019 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get pod -n aws-load-balancer-operator -l app.kubernetes.io/name=aws-load-balancer-operator -ojsonpath={.items[
].status.conditions[?(@.type=="Ready")].status}'
I0728 20:57:29.404837 52019 util.go:343] the Ready status of pod is True
I0728 20:57:29.404929 52019 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig delete awsloadbalancercontroller cluster'
I0728 20:57:30.777405 52019 client.go:703] Deleted {user.openshift.io/v1, Resource=users e2e-test-awslb-zlvhh-user}, err:
I0728 20:57:31.002835 52019 client.go:703] Deleted {oauth.openshift.io/v1, Resource=oauthclients e2e-client-e2e-test-awslb-zlvhh}, err:
I0728 20:57:31.218513 52019 client.go:703] Deleted {oauth.openshift.io/v1, Resource=oauthaccesstokens sha256~jgh1Q0QaAJpMdn_jiUDUTMja1HEkAyb64hgZRyz0yEo}, err:
I0728 20:57:31.218607 52019 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get authentication cluster -o=jsonpath={.spec.serviceAccountIssuer}'
STEP: Destroying namespace "e2e-test-awslb-zlvhh" for this suite. @ 07/28/25 20:57:31.965
• [65.436 seconds]

Ran 1 of 1 Specs in 65.437 seconds
SUCCESS! -- 1 Passed | 0 Failed | 0 Pending | 0 Skipped
[
{
"name": "[sig-network-edge] Network_Edge Component_ALBO Author:hongli-ROSA-OSD_CCS-ConnectedOnly-LEVEL0-High-51189-Install aws-load-balancer-operator and controller [Serial]",
"lifecycle": "blocking",
"duration": 65436,
"startTime": "2025-07-28 12:56:26.739042 UTC",
"endTime": "2025-07-28 12:57:32.175844 UTC",
"result": "passed",
"output": " STEP: Creating a kubernetes client @ 07/28/25 20:56:26.739\nI0728 20:56:26.740647 52019 clusters.go:327] do not know if it is external oidc cluster or not, and try to check it again\nI0728 20:56:26.740870 52019 client.go:1038] showInfo is true\nI0728 20:56:26.740883 52019 client.go:1040] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get authentication/cluster -o=jsonpath={.spec.type}'\nI0728 20:56:27.570745 52019 clusters.go:332] Found authentication type used: \nI0728 20:56:30.292513 52019 client.go:223] configPath is now "/tmp/configfile1804254659"\nI0728 20:56:30.292546 52019 client.go:503] The user is now "e2e-test-awslb-zlvhh-user"\nI0728 20:56:30.292564 52019 client.go:506] Creating project "e2e-test-awslb-zlvhh"\nI0728 20:56:30.612005 52019 client.go:515] Waiting on permissions in project "e2e-test-awslb-zlvhh" ...\nI0728 20:56:31.786858 52019 client.go:576] Waiting for ServiceAccount "default" to be provisioned...\nI0728 20:56:32.098138 52019 client.go:576] Waiting for ServiceAccount "builder" to be provisioned...\nI0728 20:56:32.417660 52019 client.go:576] Waiting for ServiceAccount "deployer" to be provisioned...\nI0728 20:56:32.727566 52019 client.go:586] Waiting for RoleBinding "system:image-builders" to be provisioned...\nI0728 20:56:33.210460 52019 client.go:586] Waiting for RoleBinding "system:deployers" to be provisioned...\nI0728 20:56:33.815645 52019 client.go:586] Waiting for RoleBinding "system:image-pullers" to be provisioned...\nI0728 20:56:34.377454 52019 client.go:617] Project "e2e-test-awslb-zlvhh" has been fully provisioned.\nI0728 20:56:34.377606 52019 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get nodes -o=jsonpath={.items[].status.nodeInfo.architecture}'\nI0728 20:56:36.396606 52019 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get infrastructure cluster -o=jsonpath={.status.platformStatus.type}'\nI0728 20:56:37.223144 52019 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get infrastructure cluster -o=jsonpath={.status.platformStatus.aws.region}'\nI0728 20:56:38.016299 52019 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get -n openshift-marketplace catalogsource'\nI0728 20:56:38.993837 52019 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get -n aws-load-balancer-operator pod -l control-plane=controller-manager'\n STEP: Ensure the operartor pod is ready @ 07/28/25 20:56:40.206\nI0728 20:56:45.209462 52019 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get pod -n aws-load-balancer-operator -l control-plane=controller-manager -ojsonpath={.items[].status.conditions[?(@.type=="Ready")].status}'\nI0728 20:56:46.315647 52019 util.go:343] the Ready status of pod is True\n STEP: Create CR AWSLoadBalancerController @ 07/28/25 20:56:46.315\nI0728 20:56:46.315754 52019 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig create -f /tmp/fixture-testdata-dir2880002962/test/extended/testdata/router/awslb/awslbcontroller.yaml'\nI0728 20:56:47.124930 52019 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get authentication cluster -o=jsonpath={.spec.serviceAccountIssuer}'\nI0728 20:56:53.158510 52019 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get pod -n aws-load-balancer-operator -l app.kubernetes.io/name=aws-load-balancer-operator -ojsonpath={.items[].status.conditions[?(@.type=="Ready")].status}'\nI0728 20:56:54.098139 52019 util.go:343] the Ready status of pod is \nI0728 20:56:54.098169 52019 util.go:345] failed to get pod status: \u003cnil\u003e, retrying...\nI0728 20:56:58.157466 52019 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get pod -n aws-load-balancer-operator -l app.kubernetes.io/name=aws-load-balancer-operator -ojsonpath={.items[].status.conditions[?(@.type=="Ready")].status}'\nI0728 20:56:59.016562 52019 util.go:343] the Ready status of pod is \nI0728 20:56:59.016611 52019 util.go:345] failed to get pod status: \u003cnil\u003e, retrying...\nI0728 20:57:03.155590 52019 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get pod -n aws-load-balancer-operator -l app.kubernetes.io/name=aws-load-balancer-operator -ojsonpath={.items[].status.conditions[?(@.type=="Ready")].status}'\nI0728 20:57:03.948619 52019 util.go:343] the Ready status of pod is \nI0728 20:57:03.948653 52019 util.go:345] failed to get pod status: \u003cnil\u003e, retrying...\nI0728 20:57:08.154775 52019 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get pod -n aws-load-balancer-operator -l app.kubernetes.io/name=aws-load-balancer-operator -ojsonpath={.items[].status.conditions[?(@.type=="Ready")].status}'\nI0728 20:57:09.462462 52019 util.go:343] the Ready status of pod is \nI0728 20:57:09.462493 52019 util.go:345] failed to get pod status: \u003cnil\u003e, retrying...\nI0728 20:57:13.158384 52019 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get pod -n aws-load-balancer-operator -l app.kubernetes.io/name=aws-load-balancer-operator -ojsonpath={.items[].status.conditions[?(@.type=="Ready")].status}'\nI0728 20:57:13.958817 52019 util.go:343] the Ready status of pod is \nI0728 20:57:13.958852 52019 util.go:345] failed to get pod status: \u003cnil\u003e, retrying...\nI0728 20:57:18.157457 52019 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get pod -n aws-load-balancer-operator -l app.kubernetes.io/name=aws-load-balancer-operator -ojsonpath={.items[].status.conditions[?(@.type=="Ready")].status}'\nI0728 20:57:19.290124 52019 util.go:343] the Ready status of pod is False\nI0728 20:57:19.290155 52019 util.go:349] the pod Ready status not met; wanted True but got False, retrying...\nI0728 20:57:23.154772 52019 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get pod -n aws-load-balancer-operator -l app.kubernetes.io/name=aws-load-balancer-operator -ojsonpath={.items[].status.conditions[?(@.type=="Ready")].status}'\nI0728 20:57:24.327467 52019 util.go:343] the Ready status of pod is False\nI0728 20:57:24.327499 52019 util.go:349] the pod Ready status not met; wanted True but got False, retrying...\nI0728 20:57:28.158403 52019 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get pod -n aws-load-balancer-operator -l app.kubernetes.io/name=aws-load-balancer-operator -ojsonpath={.items[].status.conditions[?(@.type=="Ready")].status}'\nI0728 20:57:29.404837 52019 util.go:343] the Ready status of pod is True\nI0728 20:57:29.404929 52019 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig delete awsloadbalancercontroller cluster'\nI0728 20:57:30.777405 52019 client.go:703] Deleted {user.openshift.io/v1, Resource=users e2e-test-awslb-zlvhh-user}, err: \u003cnil\u003e\nI0728 20:57:31.002835 52019 client.go:703] Deleted {oauth.openshift.io/v1, Resource=oauthclients e2e-client-e2e-test-awslb-zlvhh}, err: \u003cnil\u003e\nI0728 20:57:31.218513 52019 client.go:703] Deleted {oauth.openshift.io/v1, Resource=oauthaccesstokens sha256~jgh1Q0QaAJpMdn_jiUDUTMja1HEkAyb64hgZRyz0yEo}, err: \u003cnil\u003e\nI0728 20:57:31.218607 52019 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get authentication cluster -o=jsonpath={.spec.serviceAccountIssuer}'\n STEP: Destroying namespace "e2e-test-awslb-zlvhh" for this suite. @ 07/28/25 20:57:31.965\n"
}
]

@ming1013
Copy link
Author

Qualify suites with CEL expressions test:

$ ./example-tests list tests --suite openshit-router
[
{
"name": "[router-testing] router-tests should support passing tests",
"labels": {},
"resources": {
"isolation": {}
},
"source": "openshift:payload:openshit-router",
"codeLocations": [
"/home/minl/router/test/example/example.go:8",
"/home/minl/router/test/example/example.go:9"
],
"lifecycle": "blocking",
"environmentSelector": {}
}
]
$ ./example-tests list tests --suite openshit-router-connectedOnly
[
{
"name": "[sig-network-edge] Network_Edge Component_ALBO Author:hongli-ROSA-OSD_CCS-ConnectedOnly-LEVEL0-High-51189-Install aws-load-balancer-operator and controller [Serial]",
"labels": {},
"resources": {
"isolation": {}
},
"source": "openshift:payload:openshit-router",
"codeLocations": [
"/home/minl/router/test/example/awslb-operator.go:16",
"/home/minl/router/test/util/client.go:120",
"/home/minl/router/test/util/client.go:123",
"set up framework | framework.go:200",
"/home/minl/router/test/util/client.go:132",
"/home/minl/router/test/example/awslb-operator.go:25",
"/home/minl/router/test/example/awslb-operator.go:44",
"/home/minl/router/test/example/awslb-operator.go:52"
],
"lifecycle": "blocking",
"environmentSelector": {}
},
{
"name": "[sig-network-edge] Network_Edge Component_ALBO Author:hongli-ROSA-OSD_CCS-ConnectedOnly-Medium-51191-Provision ALB by creating an ingress [Serial]",
"labels": {},
"resources": {
"isolation": {}
},
"source": "openshift:payload:openshit-router",
"codeLocations": [
"/home/minl/router/test/example/awslb-operator.go:16",
"/home/minl/router/test/util/client.go:120",
"/home/minl/router/test/util/client.go:123",
"set up framework | framework.go:200",
"/home/minl/router/test/util/client.go:132",
"/home/minl/router/test/example/awslb-operator.go:25",
"/home/minl/router/test/example/awslb-operator.go:44",
"/home/minl/router/test/example/awslb-operator.go:74"
],
"lifecycle": "blocking",
"environmentSelector": {}
}
]
./example-tests run-suite openshit-router-level0
I0730 12:28:14.313684 18919 test_context.go:566] The --provider flag is not set. Continuing as if --provider=skeleton had been used.
Running Suite: - /home/minl/router/build

Random Seed: 1753849694 - will randomize all specs

Will run 1 of 1 specs

[sig-network-edge] Network_Edge Component_ALBO Author:hongli-ROSA-OSD_CCS-ConnectedOnly-LEVEL0-High-51189-Install aws-load-balancer-operator and controller [Serial]
/home/minl/router/test/example/awslb-operator.go:52
STEP: Creating a kubernetes client @ 07/30/25 12:28:14.315
I0730 12:28:14.318814 18919 clusters.go:327] do not know if it is external oidc cluster or not, and try to check it again
I0730 12:28:14.319086 18919 client.go:1038] showInfo is true
I0730 12:28:14.319116 18919 client.go:1040] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get authentication/cluster -o=jsonpath={.spec.type}'
I0730 12:28:16.808561 18919 clusters.go:332] Found authentication type used:
I0730 12:28:19.759926 18919 client.go:223] configPath is now "/tmp/configfile2938941343"
I0730 12:28:19.760012 18919 client.go:503] The user is now "e2e-test-awslb-dln5z-user"
I0730 12:28:19.760041 18919 client.go:506] Creating project "e2e-test-awslb-dln5z"
I0730 12:28:20.080823 18919 client.go:515] Waiting on permissions in project "e2e-test-awslb-dln5z" ...
I0730 12:28:21.249360 18919 client.go:576] Waiting for ServiceAccount "default" to be provisioned...
I0730 12:28:21.580036 18919 client.go:576] Waiting for ServiceAccount "builder" to be provisioned...
I0730 12:28:22.010332 18919 client.go:576] Waiting for ServiceAccount "deployer" to be provisioned...
I0730 12:28:22.420252 18919 client.go:586] Waiting for RoleBinding "system:image-builders" to be provisioned...
I0730 12:28:23.035750 18919 client.go:586] Waiting for RoleBinding "system:deployers" to be provisioned...
I0730 12:28:23.545007 18919 client.go:586] Waiting for RoleBinding "system:image-pullers" to be provisioned...
I0730 12:28:24.057390 18919 client.go:617] Project "e2e-test-awslb-dln5z" has been fully provisioned.
I0730 12:28:24.057810 18919 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get nodes -o=jsonpath={.items[].status.nodeInfo.architecture}'
I0730 12:28:26.177559 18919 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get infrastructure cluster -o=jsonpath={.status.platformStatus.type}'
I0730 12:28:27.206786 18919 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get infrastructure cluster -o=jsonpath={.status.platformStatus.aws.region}'
I0730 12:28:28.379670 18919 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get -n openshift-marketplace catalogsource'
I0730 12:28:29.809364 18919 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get -n aws-load-balancer-operator pod -l control-plane=controller-manager'
I0730 12:28:32.064731 18919 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig apply -f /tmp/fixture-testdata-dir11637070/test/extended/testdata/router/awslb/namespace.yaml'
I0730 12:28:40.092757 18919 util.go:1341] err , msg namespace/aws-load-balancer-operator created
I0730 12:28:40.093039 18919 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get authentication cluster -o=jsonpath={.spec.serviceAccountIssuer}'
I0730 12:28:41.069303 18919 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig apply -f /tmp/fixture-testdata-dir11637070/test/extended/testdata/router/awslb/operatorgroup.yaml'
I0730 12:28:44.763144 18919 util.go:1349] err , msg operatorgroup.operators.coreos.com/aws-lb-operatorgroup created
I0730 12:28:44.763422 18919 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get -n openshift-marketplace catalogsource qe-app-registry'
I0730 12:28:46.182078 18919 client.go:1022] Error running /usr/local/sbin/oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get -n openshift-marketplace catalogsource qe-app-registry:
Error from server (NotFound): catalogsources.operators.coreos.com "qe-app-registry" not found
I0730 12:28:46.182123 18919 util.go:1354] Warning: catalogsource/qe-app-registry is not installed, using redhat-operators instead
I0730 12:28:46.193733 18919 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get authentication cluster -o=jsonpath={.spec.serviceAccountIssuer}'
I0730 12:28:47.799841 18919 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig apply -f /tmp/fixture-testdata-dir11637070/test/extended/testdata/router/awslb/subscription-src-qe.yaml'
I0730 12:28:50.395013 18919 util.go:1371] err , msg subscription.operators.coreos.com/aws-load-balancer-operator created
I0730 12:29:00.400737 18919 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get sub aws-load-balancer-operator -n aws-load-balancer-operator -o=jsonpath={.status.state}'
I0730 12:29:10.402756 18919 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get sub aws-load-balancer-operator -n aws-load-balancer-operator -o=jsonpath={.status.state}'
I0730 12:29:20.395915 18919 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get sub aws-load-balancer-operator -n aws-load-balancer-operator -o=jsonpath={.status.state}'
I0730 12:29:21.462259 18919 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get sub aws-load-balancer-operator -n aws-load-balancer-operator -o=jsonpath={.status.installedCSV}'
I0730 12:29:32.379684 18919 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get csv aws-load-balancer-operator.v1.2.0 -n aws-load-balancer-operator -o=jsonpath={.status.phase}'
I0730 12:29:42.381077 18919 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get csv aws-load-balancer-operator.v1.2.0 -n aws-load-balancer-operator -o=jsonpath={.status.phase}'
I0730 12:29:52.373875 18919 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get csv aws-load-balancer-operator.v1.2.0 -n aws-load-balancer-operator -o=jsonpath={.status.phase}'
I0730 12:30:02.374331 18919 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get csv aws-load-balancer-operator.v1.2.0 -n aws-load-balancer-operator -o=jsonpath={.status.phase}'
I0730 12:30:03.748039 18919 util.go:1393] CSV check complete!!!
STEP: Ensure the operartor pod is ready @ 07/30/25 12:30:03.749
I0730 12:30:08.754355 18919 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get pod -n aws-load-balancer-operator -l control-plane=controller-manager -ojsonpath={.items[
].status.conditions[?(@.type=="Ready")].status}'
I0730 12:30:10.166588 18919 util.go:343] the Ready status of pod is True
STEP: Create CR AWSLoadBalancerController @ 07/30/25 12:30:10.166
I0730 12:30:10.166854 18919 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig create -f /tmp/fixture-testdata-dir11637070/test/extended/testdata/router/awslb/awslbcontroller.yaml'
I0730 12:30:14.046106 18919 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get authentication cluster -o=jsonpath={.spec.serviceAccountIssuer}'
I0730 12:30:20.174869 18919 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get pod -n aws-load-balancer-operator -l app.kubernetes.io/name=aws-load-balancer-operator -ojsonpath={.items[].status.conditions[?(@.type=="Ready")].status}'
I0730 12:30:22.558851 18919 util.go:343] the Ready status of pod is
I0730 12:30:22.558929 18919 util.go:345] failed to get pod status: , retrying...
I0730 12:30:25.173076 18919 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get pod -n aws-load-balancer-operator -l app.kubernetes.io/name=aws-load-balancer-operator -ojsonpath={.items[
].status.conditions[?(@.type=="Ready")].status}'
I0730 12:30:26.641857 18919 util.go:343] the Ready status of pod is
I0730 12:30:26.641942 18919 util.go:345] failed to get pod status: , retrying...
I0730 12:30:30.175700 18919 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get pod -n aws-load-balancer-operator -l app.kubernetes.io/name=aws-load-balancer-operator -ojsonpath={.items[].status.conditions[?(@.type=="Ready")].status}'
I0730 12:30:31.174303 18919 util.go:343] the Ready status of pod is
I0730 12:30:31.174347 18919 util.go:345] failed to get pod status: , retrying...
I0730 12:30:35.176554 18919 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get pod -n aws-load-balancer-operator -l app.kubernetes.io/name=aws-load-balancer-operator -ojsonpath={.items[
].status.conditions[?(@.type=="Ready")].status}'
I0730 12:30:36.166441 18919 util.go:343] the Ready status of pod is
I0730 12:30:36.166562 18919 util.go:345] failed to get pod status: , retrying...
I0730 12:30:40.176728 18919 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get pod -n aws-load-balancer-operator -l app.kubernetes.io/name=aws-load-balancer-operator -ojsonpath={.items[].status.conditions[?(@.type=="Ready")].status}'
I0730 12:30:43.330778 18919 util.go:343] the Ready status of pod is
I0730 12:30:43.330819 18919 util.go:345] failed to get pod status: , retrying...
I0730 12:30:45.173883 18919 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get pod -n aws-load-balancer-operator -l app.kubernetes.io/name=aws-load-balancer-operator -ojsonpath={.items[
].status.conditions[?(@.type=="Ready")].status}'
I0730 12:30:47.838276 18919 util.go:343] the Ready status of pod is False
I0730 12:30:47.838321 18919 util.go:349] the pod Ready status not met; wanted True but got False, retrying...
I0730 12:30:50.174845 18919 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get pod -n aws-load-balancer-operator -l app.kubernetes.io/name=aws-load-balancer-operator -ojsonpath={.items[].status.conditions[?(@.type=="Ready")].status}'
I0730 12:30:51.525254 18919 util.go:343] the Ready status of pod is False
I0730 12:30:51.525295 18919 util.go:349] the pod Ready status not met; wanted True but got False, retrying...
I0730 12:30:55.176210 18919 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get pod -n aws-load-balancer-operator -l app.kubernetes.io/name=aws-load-balancer-operator -ojsonpath={.items[
].status.conditions[?(@.type=="Ready")].status}'
I0730 12:30:56.441407 18919 util.go:343] the Ready status of pod is True
I0730 12:30:56.441537 18919 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig delete awsloadbalancercontroller cluster'
I0730 12:30:58.704561 18919 client.go:703] Deleted {user.openshift.io/v1, Resource=users e2e-test-awslb-dln5z-user}, err:
I0730 12:30:58.989091 18919 client.go:703] Deleted {oauth.openshift.io/v1, Resource=oauthclients e2e-client-e2e-test-awslb-dln5z}, err:
I0730 12:30:59.296988 18919 client.go:703] Deleted {oauth.openshift.io/v1, Resource=oauthaccesstokens sha256~f8zZ6mQqEO5kMV5NYbQ1kfG2gC_yGekbPsgwY8ccmHM}, err:
I0730 12:30:59.297266 18919 client.go:1013] Running 'oc --kubeconfig=/home/minl/openshift/auth/kubeconfig/kubeconfig get authentication cluster -o=jsonpath={.spec.serviceAccountIssuer}'
STEP: Destroying namespace "e2e-test-awslb-dln5z" for this suite. @ 07/30/25 12:31:00.435

Copy link
Contributor

openshift-ci bot commented Jul 30, 2025

@ming1013: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/okd-scos-e2e-aws-ovn 1bb719c link false /test okd-scos-e2e-aws-ovn
ci/prow/images 1bb719c link true /test images
ci/prow/e2e-metal-ipi-ovn-dualstack 1bb719c link false /test e2e-metal-ipi-ovn-dualstack
ci/prow/e2e-upgrade 1bb719c link true /test e2e-upgrade
ci/prow/okd-scos-images 1bb719c link true /test okd-scos-images
ci/prow/e2e-metal-ipi-ovn-ipv6 1bb719c link false /test e2e-metal-ipi-ovn-ipv6
ci/prow/e2e-agnostic 1bb719c link true /test e2e-agnostic
ci/prow/unit 1bb719c link true /test unit
ci/prow/e2e-metal-ipi-ovn-router 1bb719c link false /test e2e-metal-ipi-ovn-router
ci/prow/e2e-aws-serial 1bb719c link true /test e2e-aws-serial
ci/prow/verify 1bb719c link true /test verify

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants