Skip to content

Commit 29b2ea3

Browse files
NickLarsenNZNickLarsenNZ
committed
Merge remote-tracking branch 'origin/main' into improve-release-tasklist
2 parents 7ed5a81 + 4b3f111 commit 29b2ea3

5 files changed

+272
-20
lines changed

‎.github/ISSUE_TEMPLATE/pre-release-demos-nightly.md

Lines changed: 100 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,100 @@
1+
---
2+
name: Pre-Release Demo Upgrade Testing from Stable to Nightly
3+
about: This template can be used to track the upgrade testing of demos from stable to nightly leading up to the next Stackable release
4+
title: "chore(tracking): Test demos on nightly versions"
5+
labels: ['epic']
6+
assignees: ''
7+
---
8+
9+
<!--
10+
Make sure to update the link in '.github/ISSUE_TEMPLATE/release.md' when
11+
you change the front matter above.
12+
-->
13+
14+
<!--
15+
DO NOT REMOVE THIS COMMENT. It is intended for people who might copy/paste from the previous release issue.
16+
This was created by an issue template: https://github.com/stackabletech/issues/issues/new/choose.
17+
-->
18+
19+
## Pre-Release Demo Testing on Nightly
20+
21+
Part of <https://github.com/stackabletech/issues/issues/TRACKING_ISSUE>
22+
23+
For each demo, run the following commands:
24+
25+
> [!NOTE]
26+
> Record any issues or anomalies during the process in a comment on this issue.
27+
> Eg:
28+
> ```
29+
> :green_circle: **airflow-scheduled-job**
30+
>
31+
> The CRD had been updated and I needed to change the following in the manifest:
32+
> ...
33+
> ```
34+
35+
```shell
36+
# Install demo (stable)
37+
stackablectl demo install <DEMO_NAME>
38+
39+
# Get a list of installed operators
40+
stackablectl operator installed --output=plain
41+
42+
# --- OPTIONAL ---
43+
# Sometimes it is necessary to upgrade Helm charts. Look for other Helm Charts
44+
# which might need updating.
45+
46+
# First, see which charts are installed. You can ignore the stackable-operator
47+
# charts, or anything that might have been installed outside of this demo.
48+
helm list
49+
50+
# Next, add the applicable Helm Chart repositories. For example:
51+
helm repo add minio https://charts.min.io/
52+
helm repo add bitnami https://charts.bitnami.com/bitnami
53+
54+
# Finally, upgrade the Charts. For example:
55+
helm upgrade minio minio/minio --version x.x.x
56+
helm upgrade postgresql-hive bitnami/postgresql --version x.x.x
57+
# --- OPTIONAL END ---
58+
59+
# Uninstall operators
60+
stackablectl release uninstall <CURRENT_RELEASE>
61+
62+
# Update CRDs to nightly version (on main)
63+
# Repeat this for every operator used by the demo
64+
kubectl replace -f https://raw.githubusercontent.com/stackabletech/commons-operator/main/deploy/helm/commons-operator/crds/crds.yaml
65+
kubectl replace -f https://raw.githubusercontent.com/stackabletech/...-operator/main/deploy/helm/...-operator/crds/crds.yaml
66+
67+
# Install nightly version of operators (use the list from the earlier step
68+
# before deleting the operators)
69+
stackablectl operator install commons ...
70+
71+
# Optionally update the product versions in the CRDs, e.g.:
72+
kubectl patch hbaseclusters/hbase --type='json' -p='[{"op": "replace", "path": "/spec/image/productVersion", "value":"x.x.x"}]' # changed
73+
74+
```
75+
76+
<!--
77+
The following list was generated by:
78+
79+
# go to the demos repository, then run:
80+
yq '.demos | keys' demos/demos-v2.yaml \
81+
| sed -e 's/- //g' \
82+
| sort \
83+
| xargs -I {} echo "- [ ] [{}](https://docs.stackable.tech/home/nightly/demos/{})"
84+
-->
85+
86+
```[tasklist]
87+
### Testing Demos on Nightly
88+
- [ ] [airflow-scheduled-job](https://docs.stackable.tech/home/nightly/demos/airflow-scheduled-job)
89+
- [ ] [data-lakehouse-iceberg-trino-spark](https://docs.stackable.tech/home/nightly/demos/data-lakehouse-iceberg-trino-spark)
90+
- [ ] [end-to-end-security](https://docs.stackable.tech/home/nightly/demos/end-to-end-security)
91+
- [ ] [hbase-hdfs-load-cycling-data](https://docs.stackable.tech/home/nightly/demos/hbase-hdfs-load-cycling-data)
92+
- [ ] [jupyterhub-pyspark-hdfs-anomaly-detection-taxi-data](https://docs.stackable.tech/home/nightly/demos/jupyterhub-pyspark-hdfs-anomaly-detection-taxi-data)
93+
- [ ] [logging](https://docs.stackable.tech/home/nightly/demos/logging)
94+
- [ ] [nifi-kafka-druid-earthquake-data](https://docs.stackable.tech/home/nightly/demos/nifi-kafka-druid-earthquake-data)
95+
- [ ] [nifi-kafka-druid-water-level-data](https://docs.stackable.tech/home/nightly/demos/nifi-kafka-druid-water-level-data)
96+
- [ ] [signal-processing](https://docs.stackable.tech/home/nightly/demos/signal-processing)
97+
- [ ] [spark-k8s-anomaly-detection-taxi-data](https://docs.stackable.tech/home/nightly/demos/spark-k8s-anomaly-detection-taxi-data)
98+
- [ ] [trino-iceberg](https://docs.stackable.tech/home/nightly/demos/trino-iceberg)
99+
- [ ] [trino-taxi-data](https://docs.stackable.tech/home/nightly/demos/trino-taxi-data)
100+
```

‎.github/ISSUE_TEMPLATE/pre-release-getting-started-scripts.md

Lines changed: 86 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,86 @@
1+
---
2+
name: Pre-Release Getting Started Script Update
3+
about: This template can be used to track the update of the "Getting Started" scripts in this repository leading up to the next Stackable release
4+
title: "chore(tracking): Check and update getting-started scripts"
5+
labels: ['epic']
6+
assignees: ''
7+
---
8+
9+
<!--
10+
Make sure to update the link in '.github/ISSUE_TEMPLATE/release.md' when
11+
you change the front matter above.
12+
-->
13+
14+
<!--
15+
DO NOT REMOVE THIS COMMENT. It is intended for people who might copy/paste from the previous release issue.
16+
This was created by an issue template: https://github.com/stackabletech/issues/issues/new/choose.
17+
-->
18+
19+
## Pre-Release Getting Started Script Updates
20+
21+
Part of <https://github.com/stackabletech/issues/issues/TRACKING_ISSUE>
22+
23+
In each operator repository, run the following commands. If any updates are
24+
required, open a PR using the applicable link below.
25+
26+
```shell
27+
# Some of the scripts are in a code/ subdirectory
28+
# pushd docs/modules/superset/examples/getting_started
29+
# pushd docs/modules/superset/examples/getting_started/code
30+
pushd $(fd -td getting_started | grep examples); cd code 2>/dev/null || true
31+
32+
# Make a fresh cluster (~12 seconds)
33+
kind delete cluster && kind create cluster
34+
./getting_started.sh stackablectl
35+
36+
# Make a fresh cluster (~12 seconds)
37+
kind delete cluster && kind create cluster
38+
./getting_started.sh helm
39+
40+
popd
41+
```
42+
43+
> [!TIP]
44+
> Create branches with predictable names so the links below work. Remember
45+
> to replace `xx.(x)x` with the appropriate release version:
46+
>
47+
> ```sh
48+
> git stash -m "unsaved work"
49+
> git fetch origin
50+
> git checkout -b fix/getting-started-pre-xx.(x)x origin/main
51+
> ```
52+
>
53+
> Then use the links below to automatically create applicable PRs for each operator
54+
> using the PR template.
55+
56+
Replace the items in the task lists below with the applicable Pull Requests (if any).
57+
58+
<!--
59+
The following list was generated by:
60+
61+
# go to the stackable-templating repository, then run:
62+
yq '.repositories[].name' config/repositories.yaml \
63+
| sort \
64+
| xargs -I {} echo "- [ ] [Update getting-started script for {}](https://github.com/stackabletech/{}/compare/main..fix/getting-started-pre-$(date +%y.%-m)?quick_pull=1&template=pre-release-getting-started-script.md&title=fix%28docs%29%3A+Update+getting-started+script+pre-$(date +%y.%-m))"
65+
-->
66+
67+
```[tasklist]
68+
### Getting Started Script Checks and Updates
69+
- [ ] [Update getting-started script for airflow-operator](https://github.com/stackabletech/airflow-operator/compare/main..fix/getting-started-pre-24.7?quick_pull=1&template=pre-release-getting-started-script.md&title=fix%28docs%29%3A+Update+getting-started+script+pre-24.7)
70+
- [ ] [Update getting-started script for commons-operator](https://github.com/stackabletech/commons-operator/compare/main..fix/getting-started-pre-24.7?quick_pull=1&template=pre-release-getting-started-script.md&title=fix%28docs%29%3A+Update+getting-started+script+pre-24.7)
71+
- [ ] [Update getting-started script for druid-operator](https://github.com/stackabletech/druid-operator/compare/main..fix/getting-started-pre-24.7?quick_pull=1&template=pre-release-getting-started-script.md&title=fix%28docs%29%3A+Update+getting-started+script+pre-24.7)
72+
- [ ] [Update getting-started script for edc-operator](https://github.com/stackabletech/edc-operator/compare/main..fix/getting-started-pre-24.7?quick_pull=1&template=pre-release-getting-started-script.md&title=fix%28docs%29%3A+Update+getting-started+script+pre-24.7)
73+
- [ ] [Update getting-started script for hbase-operator](https://github.com/stackabletech/hbase-operator/compare/main..fix/getting-started-pre-24.7?quick_pull=1&template=pre-release-getting-started-script.md&title=fix%28docs%29%3A+Update+getting-started+script+pre-24.7)
74+
- [ ] [Update getting-started script for hdfs-operator](https://github.com/stackabletech/hdfs-operator/compare/main..fix/getting-started-pre-24.7?quick_pull=1&template=pre-release-getting-started-script.md&title=fix%28docs%29%3A+Update+getting-started+script+pre-24.7)
75+
- [ ] [Update getting-started script for hello-world-operator](https://github.com/stackabletech/hello-world-operator/compare/main..fix/getting-started-pre-24.7?quick_pull=1&template=pre-release-getting-started-script.md&title=fix%28docs%29%3A+Update+getting-started+script+pre-24.7)
76+
- [ ] [Update getting-started script for hive-operator](https://github.com/stackabletech/hive-operator/compare/main..fix/getting-started-pre-24.7?quick_pull=1&template=pre-release-getting-started-script.md&title=fix%28docs%29%3A+Update+getting-started+script+pre-24.7)
77+
- [ ] [Update getting-started script for kafka-operator](https://github.com/stackabletech/kafka-operator/compare/main..fix/getting-started-pre-24.7?quick_pull=1&template=pre-release-getting-started-script.md&title=fix%28docs%29%3A+Update+getting-started+script+pre-24.7)
78+
- [ ] [Update getting-started script for listener-operator](https://github.com/stackabletech/listener-operator/compare/main..fix/getting-started-pre-24.7?quick_pull=1&template=pre-release-getting-started-script.md&title=fix%28docs%29%3A+Update+getting-started+script+pre-24.7)
79+
- [ ] [Update getting-started script for nifi-operator](https://github.com/stackabletech/nifi-operator/compare/main..fix/getting-started-pre-24.7?quick_pull=1&template=pre-release-getting-started-script.md&title=fix%28docs%29%3A+Update+getting-started+script+pre-24.7)
80+
- [ ] [Update getting-started script for opa-operator](https://github.com/stackabletech/opa-operator/compare/main..fix/getting-started-pre-24.7?quick_pull=1&template=pre-release-getting-started-script.md&title=fix%28docs%29%3A+Update+getting-started+script+pre-24.7)
81+
- [ ] [Update getting-started script for secret-operator](https://github.com/stackabletech/secret-operator/compare/main..fix/getting-started-pre-24.7?quick_pull=1&template=pre-release-getting-started-script.md&title=fix%28docs%29%3A+Update+getting-started+script+pre-24.7)
82+
- [ ] [Update getting-started script for spark-k8s-operator](https://github.com/stackabletech/spark-k8s-operator/compare/main..fix/getting-started-pre-24.7?quick_pull=1&template=pre-release-getting-started-script.md&title=fix%28docs%29%3A+Update+getting-started+script+pre-24.7)
83+
- [ ] [Update getting-started script for superset-operator](https://github.com/stackabletech/superset-operator/compare/main..fix/getting-started-pre-24.7?quick_pull=1&template=pre-release-getting-started-script.md&title=fix%28docs%29%3A+Update+getting-started+script+pre-24.7)
84+
- [ ] [Update getting-started script for trino-operator](https://github.com/stackabletech/trino-operator/compare/main..fix/getting-started-pre-24.7?quick_pull=1&template=pre-release-getting-started-script.md&title=fix%28docs%29%3A+Update+getting-started+script+pre-24.7)
85+
- [ ] [Update getting-started script for zookeeper-operator](https://github.com/stackabletech/zookeeper-operator/compare/main..fix/getting-started-pre-24.7?quick_pull=1&template=pre-release-getting-started-script.md&title=fix%28docs%29%3A+Update+getting-started+script+pre-24.7)
86+
```

‎.github/ISSUE_TEMPLATE/pre-release-openshift-tests.md

Lines changed: 60 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,60 @@
1+
---
2+
name: Pre-Release OpenShift Integration Tests
3+
about: This template can be used to track the integration testing on OpenShift leading up to the next Stackable release
4+
title: "chore(tracking): Run integration tests on OpenShift"
5+
labels: ['epic']
6+
assignees: ''
7+
---
8+
9+
<!--
10+
Make sure to update the link in '.github/ISSUE_TEMPLATE/release.md' when
11+
you change the front matter above.
12+
-->
13+
14+
<!--
15+
DO NOT REMOVE THIS COMMENT. It is intended for people who might copy/paste from the previous release issue.
16+
This was created by an issue template: https://github.com/stackabletech/issues/issues/new/choose.
17+
-->
18+
19+
## Pre-Release OpenShift Integration Tests
20+
21+
Part of <https://github.com/stackabletech/issues/issues/TRACKING_ISSUE>
22+
23+
Make sure to run the tests using the following parameters:
24+
25+
```
26+
TEST_PLATFORM: OpenShift on replicated.com (4.15.0-okd)
27+
GIT_BRANCH_OR_TAG: origin/main
28+
OPERATOR_VERSION: 0.0.0-dev
29+
TEST_SCRIPT_PARAMS: --test-suite openshift
30+
```
31+
32+
<!--
33+
The following list was generated by:
34+
35+
# go to the stackable-templating repository, then run:
36+
yq '.repositories[].name' config/repositories.yaml \
37+
| sort \
38+
| xargs -I {} echo "- [ ] [{}](https://testing.stackable.tech/view/02%20Operator%20Tests%20%28custom%29/job/{}-it-custom/build)"
39+
-->
40+
41+
```[tasklist]
42+
### Integration Tests on OpenShift
43+
- [ ] [airflow-operator](https://testing.stackable.tech/view/02%20Operator%20Tests%20%28custom%29/job/airflow-operator-it-custom/build)
44+
- [ ] [commons-operator](https://testing.stackable.tech/view/02%20Operator%20Tests%20%28custom%29/job/commons-operator-it-custom/build)
45+
- [ ] [druid-operator](https://testing.stackable.tech/view/02%20Operator%20Tests%20%28custom%29/job/druid-operator-it-custom/build)
46+
- [ ] [edc-operator](https://testing.stackable.tech/view/02%20Operator%20Tests%20%28custom%29/job/edc-operator-it-custom/build)
47+
- [ ] [hbase-operator](https://testing.stackable.tech/view/02%20Operator%20Tests%20%28custom%29/job/hbase-operator-it-custom/build)
48+
- [ ] [hdfs-operator](https://testing.stackable.tech/view/02%20Operator%20Tests%20%28custom%29/job/hdfs-operator-it-custom/build)
49+
- [ ] [hello-world-operator](https://testing.stackable.tech/view/02%20Operator%20Tests%20%28custom%29/job/hello-world-operator-it-custom/build)
50+
- [ ] [hive-operator](https://testing.stackable.tech/view/02%20Operator%20Tests%20%28custom%29/job/hive-operator-it-custom/build)
51+
- [ ] [kafka-operator](https://testing.stackable.tech/view/02%20Operator%20Tests%20%28custom%29/job/kafka-operator-it-custom/build)
52+
- [ ] [listener-operator](https://testing.stackable.tech/view/02%20Operator%20Tests%20%28custom%29/job/listener-operator-it-custom/build)
53+
- [ ] [nifi-operator](https://testing.stackable.tech/view/02%20Operator%20Tests%20%28custom%29/job/nifi-operator-it-custom/build)
54+
- [ ] [opa-operator](https://testing.stackable.tech/view/02%20Operator%20Tests%20%28custom%29/job/opa-operator-it-custom/build)
55+
- [ ] [secret-operator](https://testing.stackable.tech/view/02%20Operator%20Tests%20%28custom%29/job/secret-operator-it-custom/build)
56+
- [ ] [spark-k8s-operator](https://testing.stackable.tech/view/02%20Operator%20Tests%20%28custom%29/job/spark-k8s-operator-it-custom/build)
57+
- [ ] [superset-operator](https://testing.stackable.tech/view/02%20Operator%20Tests%20%28custom%29/job/superset-operator-it-custom/build)
58+
- [ ] [trino-operator](https://testing.stackable.tech/view/02%20Operator%20Tests%20%28custom%29/job/trino-operator-it-custom/build)
59+
- [ ] [zookeeper-operator](https://testing.stackable.tech/view/02%20Operator%20Tests%20%28custom%29/job/zookeeper-operator-it-custom/build)
60+
```

0 commit comments

Comments
 (0)