[SURE-9542] fleet apply logs from fleet job Pod do not indicate source of "no chart name found" errors in GitRepo containing multiple bundles

[kkaempf]

SURE-9542

Issue description:

fleet apply logs from fleet job Pod do not indicate source of "no chart name found" errors in GitRepo containing multiple bundles. If one (or more) charts defined by a fleet.yaml bundle in the GitRepo do no exist in the index.yaml for their configured repository, only a generic level=fatal msg="no chart name found" is logged in the Job Pod, with no indication of which chart/bundle the error originates from.

Business impact:

Makes troubleshooting of the issue a heavy lift manual task

Repro steps:

Provision a Rancher v2.9.4 instance with a single all-role node custom RKE cluster (I used github.com/axeal/tf-do-rancher2)
In fleet-default workspace of Fleet, add a GitRepo with the reposistory https://github.com/axeal/fleet-test.git and branch 01563984
Observe successful deployment of the two charts/bundles
Update the GitRepo branch to 01563984-invalid, in which the rancher-monitoring-crd chart name is updated to the invalid rancher-monitoring-crds (use of the the rancher-logging-crd and rancher-monitoring-crd charts was arbitrary for the purpose of reproduction, in customer environment they are deploying their internal applications).
Observe after a short time that the GitRepo goes into an error state with Job Failed. failed: 3/1time="2024-12-18T13:24:13Z" level=fatal msg="no chart name found"

Observe the fleet Job pods for the GitRepo contain only the following logs:

HOSTNAME=test-ec8c6-wmczp
KUBERNETES_PORT_443_TCP_PROTO=tcp
COMMIT=8d6c3473d9d1b4afe6b1d479466226c247c6783b
KUBERNETES_PORT_443_TCP_ADDR=10.43.0.1
KUBERNETES_PORT=tcp://10.43.0.1:443
PWD=/workspace/source
HOME=/fleet-home
KUBERNETES_SERVICE_PORT_HTTPS=443
KUBERNETES_PORT_443_TCP_PORT=443
KUBERNETES_PORT_443_TCP=tcp://10.43.0.1:443
SHLVL=1
KUBERNETES_SERVICE_PORT=443
PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
KUBERNETES_SERVICE_HOST=10.43.0.1
_=/usr/bin/env
time="2024-12-18T13:23:51Z" level=fatal msg="no chart name found"

Enable debug logging for fleet by Upgrading the fleet app in the local cluster and setting the value debug to true
Force Update the GitRepo
Observe there are no additional log messages in the new Job pod logs for the GitRepo

Workaround:

Is a workaround available and implemented? Yes
What is the workaround: Manually investigate each fleet.yaml bundle within the GitRepo to validate whether the specified helm chart is present within the index.yaml of the defined helm repository.

Actual behavior:

fleet apply logs from fleet job Pod do not indicate source of "no chart name found" errors in GitRepo containing multiple bundles

Expected behavior:

fleet apply logs from fleet job Pod indicate the source chart/bundle of "no chart name found" errors in a GitRepo containing multiple bundles

[mmartin24]

Verified on v2.11-1055b7d2244fa2f70350756b940e74b8ad2d1d4f-head with fleet:106.0.0+up0.12.0-alpha.15

---

After installing faulty gitrepo provided in Jira, both the UI and gitjob log now provides specifics into the failing bundle:

Log message in UI:

Job Failed. failed: 1/1time="2025-02-25T08:56:24Z" level=fatal msg="failed to process bundle: failed to resolve URL of repo=https://charts.rancher.io chart=rancher-monitoring-crds version=104.1.2+up57.0.3: no chart name found"

in cli for gitrepo:

 2025-02-25T09:09:11Z    DEBUG    gitops-status    Reconciling GitRepo status    {"controller": "GitRepoStatus", "controllerGro │cileID": "b6b92ad3-f6bb-419b-9201-294 │ │
│ up": "fleet.cattle.io", "controllerKind": "GitRepo", "GitRepo": {"name":"test-9542","namespace":"fleet-local"}, "namespace": " │","lastUpdateTime":"2025-02-25T08:46: │ │
│ fleet-local", "name": "test-9542", "reconcileID": "8425d599-9811-4f70-8e42-29f8f70ffe21", "generation": 5, "commit": "8d6c3473 │UpdateTime":"2025-02-25T08:46:07Z"},{ │ │
│ d9d1b4afe6b1d479466226c247c6783b", "conditions": [{"type":"Ready","status":"True","lastUpdateTime":"2025-02-25T08:46:40Z"},{"t │me=\"2025-02-25T08:56:24Z\" level=fat │ │
│ ype":"GitPolling","status":"True","lastUpdateTime":"2025-02-25T08:54:14Z"},{"type":"Reconciling","status":"False","lastUpdateT │=104.1.2+up57.0.3: no chart name foun │ │
│ ime":"2025-02-25T08:46:07Z"},{"type":"Stalled","status":"True","lastUpdateTime":"2025-02-25T08:56:27Z","reason":"Stalled","mes │                                      │ │
│ sage":"Job Failed. failed: 1/1time=\"2025-02-25T08:56:24Z\" level=fatal msg=\"failed to process bundle: failed to resolve URL  │, "controllerKind": "GitRepo", "GitRe │ │
│ of repo=https://charts.rancher.io chart=rancher-monitoring-crds version=104.1.2+up57.0.3: no chart name found\"\n"},{"type":"A │421-475a-accb-25564ffe1d42", "generat │ │
│ ccepted","status":"True","lastUpdateTime":"2025-02-25T08:46:07Z"}]}