weaviate helm chart upgraded from 16.1.0 to 16.8.8

[RogerSik]

For us worked to upgrade Weaviate to a newer version. But the main reason was that with this weaviate helm chart upgrade we are able to use

image:
  pullSecrets: []

in the weaviate chart.

[BorisPolonsky]

Hello there. We appreciate the known limitation you've identified. For customized upgrading cycles of weaviate, it's strongly recommended to deploy it as separate release and integrate them via externalWeaviate section. We won't prioritize built-in dependency update unless absolutely necessary.

[BorisPolonsky]

For the record, there are two major changes in the subsequent releases weaviate

• Upgrading to chart version 17.1.0, as stated here
• Upgrading to weaviate 1.25.x and above (i.e. chart version 17.0.0 and above) as stated in official document

Given charts released by weaviate so far:

helm search repo weaviate/weaviate -l
NAME                    CHART VERSION   APP VERSION     DESCRIPTION
weaviate/weaviate       17.6.0          1.32.7          A Helm Chart to run Weaviate with all dependencies
weaviate/weaviate       17.5.1          1.32.3          A Helm Chart to run Weaviate with all dependencies
weaviate/weaviate       17.5.0          1.32.0          A Helm Chart to run Weaviate with all dependencies
weaviate/weaviate       17.4.5          1.30.0          A Helm Chart to run Weaviate with all dependencies
weaviate/weaviate       17.4.4          1.29.2          A Helm Chart to run Weaviate with all dependencies
weaviate/weaviate       17.4.3          1.29.0          A Helm Chart to run Weaviate with all dependencies
weaviate/weaviate       17.4.2          1.28.5          A Helm Chart to run Weaviate with all dependencies
weaviate/weaviate       17.4.1          1.28.4          A Helm Chart to run Weaviate with all dependencies
weaviate/weaviate       17.4.0          1.28.4          A Helm Chart to run Weaviate with all dependencies
weaviate/weaviate       17.3.3          1.27.8          A Helm Chart to run Weaviate with all dependencies
weaviate/weaviate       17.3.2          1.27.5          A Helm Chart to run Weaviate with all dependencies
weaviate/weaviate       17.3.1          1.27.2          A Helm Chart to run Weaviate with all dependencies
weaviate/weaviate       17.3.0          1.27.0          A Helm Chart to run Weaviate with all dependencies
weaviate/weaviate       17.2.2          1.26.6          A Helm Chart to run Weaviate with all dependencies
weaviate/weaviate       17.2.1          1.26.3          A Helm Chart to run Weaviate with all dependencies
weaviate/weaviate       17.2.0          1.26.3          A Helm Chart to run Weaviate with all dependencies
weaviate/weaviate       17.1.1          1.26.1          A Helm Chart to run Weaviate with all dependencies
weaviate/weaviate       17.1.0          1.25.6          A Helm Chart to run Weaviate with all dependencies
weaviate/weaviate       17.0.0          1.25.0          A Helm Chart to run Weaviate with all dependencies
weaviate/weaviate       16.8.8          1.24.8          A Helm Chart to run Weaviate with all dependencies
weaviate/weaviate       16.8.7          1.24.3          A Helm Chart to run Weaviate with all dependencies
weaviate/weaviate       16.8.6          1.24.2          A Helm Chart to run Weaviate with all dependencies
weaviate/weaviate       16.8.5          1.24.1          A Helm Chart to run Weaviate with all dependencies
weaviate/weaviate       16.8.4          1.24.1          A Helm Chart to run Weaviate with all dependencies
weaviate/weaviate       16.8.3          1.24.1          A Helm Chart to run Weaviate with all dependencies
weaviate/weaviate       16.8.2          1.24.1          A Helm Chart to run Weaviate with all dependencies
weaviate/weaviate       16.8.1          1.23.7          A Helm Chart to run Weaviate with all dependencies
weaviate/weaviate       16.8.0          1.22.5          A Helm Chart to run Weaviate with all dependencies
weaviate/weaviate       16.7.0          1.22.3          A Helm Chart to run Weaviate with all dependencies
weaviate/weaviate       16.6.1          1.21.2          A Helm Chart to run Weaviate with all dependencies
weaviate/weaviate       16.6.0          1.21.2          A Helm Chart to run Weaviate with all dependencies
weaviate/weaviate       16.5.0          1.21.0          A Helm Chart to run Weaviate with all dependencies
weaviate/weaviate       16.4.0          1.20.0          A Helm Chart to run Weaviate with all dependencies
weaviate/weaviate       16.3.1          1.19.8          A Helm Chart to run Weaviate with all dependencies
weaviate/weaviate       16.3.0          1.19.1          A Helm Chart to run Weaviate with all dependencies
weaviate/weaviate       16.2.0          1.19.0          A Helm Chart to run Weaviate with all dependencies
weaviate/weaviate       16.1.0          1.18.0          A Helm Chart to run Weaviate with all dependencies
weaviate/weaviate       16.0.0          1.18.0          A Helm Chart to run Weaviate with all dependencies
weaviate/weaviate       15.5.0          1.15.0          A Helm Chart to run Weaviate with all dependencies
weaviate/weaviate       15.4.0          1.15.0          A Helm Chart to run Weaviate with all dependencies
weaviate/weaviate       15.3.1          1.15.0          A Helm Chart to run Weaviate with all dependencies
weaviate/weaviate       15.3.0          1.15.0          A Helm Chart to run Weaviate with all dependencies
weaviate/weaviate       15.2.0          1.15.0          A Helm Chart to run Weaviate with all dependencies
weaviate/weaviate       15.1.0          1.15.0          A Helm Chart to run Weaviate with all dependencies
weaviate/weaviate       15.0.0          1.15.0          A Helm Chart to run Weaviate with all dependencies
weaviate/weaviate       14.4.0          1.14.1          A Helm Chart to run Weaviate with all dependencies

If the built-in dependency of weaviate were to happen, we may

• directly go beyond chart version 17.1.0 to keeping up with the major change of the cluster design of weaviate, or
• upgrade to chart version 16.8.8, the solution proposed here, which up upgrade weaviate to the latest version as possible prior to the major change (1.24.8) see what's next.

Both options require further discussions and regression tests. We'll need more feedbacks from the community to proceed with such actions.

[BorisPolonsky]

Update:
We've gone through the differences between 16.8.8 and16.1.0. It seems possible to introduce imagePullSecret without changing the version of weaviate. Still, there are anticipated change to be made:

• There's an additional sysctlInitContainer enabled by default ref1, ref2. We'd better disable it in our values.yaml by default, not just to keep backward compatibility as but also let users decided if they will proceed with privileged mode that will make changes on the host.

Shall we proceed with this approach? @RogerSik

[RogerSik]

Shall we proceed with this approach? @RogerSik

Yeah, Im fine with that 👍

[BorisPolonsky]

We've tested the proposal above and there's more compatibility issues than expected for those who have already deployed with built-in 16.1.0

helm upgrade --install test charts/dify/ -n test  -f new_values.yaml
Error: UPGRADE FAILED: cannot patch "weaviate" with kind StatefulSet: StatefulSet.apps "weaviate" is invalid: spec: Forbidden: updates to statefulset spec for fields other than 'replicas', 'ordinals', 'template', 'updateStrategy', 'revisionHistoryLimit', 'persistentVolumeClaimRetentionPolicy' and 'minReadySeconds' are forbidden

Unfortunately we have to revert this feature.