Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Potential Error in k8ssandra/medusa Image for ARM Architecture #759

Closed
EmanuelSanchez opened this issue May 5, 2024 · 2 comments · Fixed by #760
Closed

Potential Error in k8ssandra/medusa Image for ARM Architecture #759

EmanuelSanchez opened this issue May 5, 2024 · 2 comments · Fixed by #760
Labels
done Issues in the state 'done'

Comments

@EmanuelSanchez
Copy link
Contributor

EmanuelSanchez commented May 5, 2024

Project board link

Describe the bug
Container health checks fails due to an "exec format error".
The k8ssandra/medusa image for ARM architecture is using the wrong grpc-health-probe binary and it makes to fail the health checks.

To Reproduce

  1. Deploy a K8ssandra cluster with medusa enabled on an ARM architecture.
  2. The medusa container will give the following error: 'Liveness probe failed: exec /bin/grpc_health_probe: exec format error'

Expected behavior
Health checks should work. And give a successful response.

Screenshots
image

Environment (please complete the following information):

  • medusa-operator version:
    imageID: docker.io/k8ssandra/medusa@sha256:cb5dd774606878148dedb3f015f3edd5f0000be2509ba85e97de1086ec8abee9

  • Helm charts version info
    k8ssandra-operator k8ssandra-operator 7 2024-05-02 08:56:51.021382029 -0500 -05 deployed k8ssandra-operator-1.15.0 1.15.0

Which could be the problem?
The image for ARM architectures list the following command in the layers:
'RUN /bin/sh -c GRPC_HEALTH_PROBE_VERSION=v0.4.25 && wget -qO/bin/grpc_health_probe https://github.com/grpc-ecosystem/grpc-health-probe/releases/download/${GRPC_HEALTH_PROBE_VERSION}/grpc_health_probe-linux-amd64 && chmod +x /bin/grpc_health_probe # buildkit'

It is using the amd64 binary version of grpc_health_probe instead of the arm64.
It should be:
'RUN /bin/sh -c GRPC_HEALTH_PROBE_VERSION=v0.4.25 && wget -qO/bin/grpc_health_probe https://github.com/grpc-ecosystem/grpc-health-probe/releases/download/${GRPC_HEALTH_PROBE_VERSION}/grpc_health_probe-linux-arm64 && chmod +x /bin/grpc_health_probe # buildkit'

image

@adejanovski
Copy link
Contributor

Good catch @EmanuelSanchez !
Let's see how we can workaround this.

@adejanovski adejanovski moved this to Assess/Investigate in K8ssandra May 6, 2024
@adejanovski adejanovski added the assess Issues in the state 'assess' label May 6, 2024
@EmanuelSanchez
Copy link
Contributor Author

Hi @adejanovski !
I just made a Pull Request with a possible solution, please let me know if there is any other way to help.

@adejanovski adejanovski moved this from Assess/Investigate to Review in K8ssandra May 24, 2024
@adejanovski adejanovski added review Issues in the state 'review' and removed assess Issues in the state 'assess' labels May 24, 2024
@github-project-automation github-project-automation bot moved this from Review to Done in K8ssandra Jun 14, 2024
@adejanovski adejanovski added done Issues in the state 'done' and removed review Issues in the state 'review' labels Jun 14, 2024
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
done Issues in the state 'done'
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants