Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

kubeadm/calico: use public IP #486

Merged
merged 3 commits into from
Nov 29, 2023
Merged

kubeadm/calico: use public IP #486

merged 3 commits into from
Nov 29, 2023

Conversation

tormath1
Copy link
Contributor

@tormath1 tormath1 commented Nov 27, 2023

On Digital Ocean, there are two network interfaces (one public and one private) - by default, Calico / Kubernetes was autodetecting the private one but doing this, the calico-node daemon set was not ready because of bgp issue.

this was not an issue until we started to have pod-to-elsewhere connections (like with NFS)


Locally tested with current stable:

$ cat _kola_temp/do-latest/test.tap
1..1
ok - kubeadm.v1.27.2.calico.base

@tormath1 tormath1 requested a review from a team November 27, 2023 16:42
@tormath1 tormath1 self-assigned this Nov 27, 2023
Noticed while debugging Calico on DO:
```
  Warning  Failed                  7m25s (x4 over 8m47s)  kubelet            Failed to pull image "ghcr.io/flatcar/calico/apiserver:v3.26.4": rpc error: code = Unknown desc = failed to pull and unpack image "ghcr.io/flatcar/calico/apiserver:v3.26.4": failed to resolve reference "ghcr.io/flatcar/calico/apiserver:v3.26.4": failed to authorize: failed to fetch anonymous token: unexpected status: 403 Forbidden
```

Signed-off-by: Mathieu Tortuyaux <mtortuyaux@microsoft.com>
Signed-off-by: Mathieu Tortuyaux <mtortuyaux@microsoft.com>
@tormath1 tormath1 changed the title kubeadm/calico: switch to VXLAN (always) kubeadm/calico: use public IP Nov 28, 2023
@tormath1 tormath1 requested a review from pothos November 28, 2023 17:35
@@ -379,6 +384,10 @@ kind: InitConfiguration
nodeRegistration:
kubeletExtraArgs:
volume-plugin-dir: "/opt/libexec/kubernetes/kubelet-plugins/volume/exec/"
{{ if eq .Platform "do" }}
# On digital ocean, the node IP is often not reachable - let's use the public one.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What means "often"?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good question. I wanted to say something else I guess.

Signed-off-by: Mathieu Tortuyaux <mtortuyaux@microsoft.com>
@tormath1
Copy link
Contributor Author

Tested again:

$ cat _kola_temp/do-latest/test.tap
1..3
ok - kubeadm.v1.26.5.calico.base
ok - kubeadm.v1.27.2.calico.base
ok - kubeadm.v1.28.1.calico.base

all pods and running / ready and NFS tests are passing.

@tormath1 tormath1 merged commit ccdd746 into flatcar-master Nov 29, 2023
@tormath1 tormath1 deleted the tormath1/calico-do branch November 29, 2023 09:27
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants