XGBoost Tests

Fix incorrect input routing for models #4526

# to view logs

Run time

Learn about OS # on GitHub Actions

Job	Run time
test (3.8, ubuntu-latest)	2m 37s
test (3.9, ubuntu-latest)	2m 9s
test (3.10, ubuntu-latest)	2m 20s
	7m 6s