Library dependencies do not satisfy target MacOS version 12.0: libyaml-0.2.dylib has a minimum target of 14.0

[scott-guthridge]

Somewhat recently, the MacOS wheel builds started failing for my project: https://github.com/scott-guthridge/pylibvna. Linux and Windows are still working. The problem is that despite setting MACOSX_DEPLOYMENT_TARGET=12.0, brew install of two libraries is building them at version 14.0, and the repair wheel step now checks for version compatibility and is failing.

I read that homebrew is not intended for building redistributable software, if that's the case, then what should I use? MacPorts? Build everything from source? A convenient thing of using brew or other package tool is that it deals with dependencies without me having to chase down the source and figure out which version is latest.

More detail follows. Note that I just added the "benv" and MACOSX_DEPLOYMENT_TARGET stuff, which you won't see in github yet because I'm working in a private test repo trying to get the build working again. I believe I'm showing all relevant changes below.

.github/workflows/release.yml:

... trigger lines not shown ...

jobs:
  build_wheels:
    name: Build wheel for ${{matrix.python.cp}}-${{matrix.buildplat.sys}}
          ${{matrix.buildplat.arch}}
    runs-on: ${{ matrix.buildplat.runs_on }}
    strategy:
      matrix:
        buildplat:
        - { runs_on: ubuntu-20.04, sys: manylinux, arch: x86_64, benv: "" }
        - { runs_on: macos-12,     sys: macosx,    arch: x86_64, benv: "10.9" }
        - { runs_on: macos-14,     sys: macosx,    arch: arm64,  benv: "12.0" }
        - { runs_on: windows-2019, sys: win,       arch: AMD64,  benv: "" }
        python:
        - { cp: "cp39",   rel: "3.9" }
        - { cp: "cp310",  rel: "3.10" }
        - { cp: "cp311",  rel: "3.11" }
        - { cp: "cp312",  rel: "3.12" }
    steps:
    - name: Checkout Code
      uses: actions/checkout@v4.1.1

    - uses: actions/setup-python@v5
      with:
        python-version: 3.11

    - name: Install Python Packages
      run: |
        python -m pip install --upgrade pip
        pip install cibuildwheel requests

.... some windows-specific steps not shown ....

    - name: Build Wheels
      # uses: pypa/cibuildwheel@2.15.0
      env:
        CIBW_BUILD: ${{ matrix.python.cp }}-${{ matrix.buildplat.sys }}*
        CIBW_ARCHS: ${{ matrix.buildplat.arch }}
        CIBW_ENVIRONMENT: "MACOSX_DEPLOYMENT_TARGET=${{ matrix.buildplat.benv }}"
      run: python -m cibuildwheel --output-dir wheelhouse

... etc. ...

pyproject.toml:

[build-system]
build-backend = "mesonpy"
requires = [
    "meson-python>=0.15.0",
    "Cython>=3.0.4",
    "ninja",
    "numpy==1.22.4; python_version<='3.10'",
    "numpy==1.23.2; python_version=='3.11'",
    "numpy>=1.26.0,<1.27; python_version=='3.12'",
    "numpy>=2.0.0.dev0; python_version>='3.13'",
]

...

[tool.cibuildwheel]
build-frontend = "build"

[tool.cibuildwheel.linux]
before-build = """\
    set -e\n\
    yum install -y gcc libyaml-devel\n\
    pip install requests\n\
    python3 {project}/tools/install-libvna-rpm\n\
"""
environment-pass = "RUNNER_OS"
manylinux-aarch64-image = "manylinux2014"
manylinux-x86_64-image = "manylinux2014"

[tool.cibuildwheel.macos]
before-build = """\
    echo "before-build: ${MACOSX_DEPLOYMENT_TARGET}"\n\
    pip install numpy>=2.0.0.dev0 meson-python cython!=3.0.3 ninja\n\
    brew tap scott-guthridge/extra\n\
    brew install scott-guthridge/extra/libvna\n\
"""
repair-wheel-command = """\
    echo "repair-wheel: ${MACOSX_DEPLOYMENT_TARGET}"\n\
    DYLD_LIBRARY_PATH=/usr/local/lib delocate-listdeps {wheel} &&\n\
    DYLD_LIBRARY_PATH=/usr/local/lib delocate-wheel --require-archs \
        {delocate_archs} -w {dest_dir} {wheel}\n\
"""
... etc. ...

In the before-build section, we're building libvna (my library), which pulls in libyaml as a dependency. You can see my "before-build: 12.0" debug line showing that MACOSX_DEPLOYMENT_TARGET is getting passed down:

Running before_build...
  
  + echo "before-build: ${MACOSX_DEPLOYMENT_TARGET}"
  pip install numpy>=2.0.0.dev0 meson-python cython!=3.0.3 ninja
  brew tap scott-guthridge/extra
  brew install scott-guthridge/extra/libvna
  
  before-build: 12.0
  ==> Tapping scott-guthridge/extra
  Cloning into '/opt/homebrew/Library/Taps/scott-guthridge/homebrew-extra'...
  Tapped 1 formula (17 files, 63.1KB).
  ==> Fetching scott-guthridge/extra/libvna
  ==> Downloading https://github.com/scott-guthridge/libvna/releases/download/v0.3.12/libvna-0.3.12.tar.gz
  ==> Downloading from https://objects.githubusercontent.com/github-production-release-asset-2e65be/230959946/2bf889b4-feae-4531-9d1e-cb9d848418e9?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240609%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240609T222208Z&X-Amz-Expires=300&X-Amz-Signature=26697d7b8912125c531d8c0f5802449bce309ba1789fc67ce72cc4ee3cfd0591&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=230959946&response-content-disposition=attachment%3B%20filename%3Dlibvna-0.3.12.tar.gz&response-content-type=application%2Foctet-stream
  ==> Installing libvna from scott-guthridge/extra
  ==> ./configure --disable-silent-rules
  ==> make -j10 install
  🍺  /opt/homebrew/Cellar/libvna/0.3.12: 36 files, 1.2MB, built in 45 seconds
                                                             ✓ 62.55s

The build wheels step succeeds:

Building wheel...
  
  + python -m pip freeze --all
  + python -m build /Users/runner/work/pylibvna-cicdtest/pylibvna-cicdtest --wheel --outdir=/private/var/folders/lr/439_fwvd3m76p9vy50d57kcc0000gn/T/cibw-run-sqygwqd7/cp39-macosx_arm64/built_wheel
  * Creating isolated environment: venv+pip...
  * Installing packages in isolated environment:
    - Cython>=3.0.4
    - meson-python>=0.15.0
    - ninja
    - numpy==1.22.4; python_version<='3.10'
    - numpy==1.23.2; python_version=='3.11'
    - numpy>=1.26.0,<1.27; python_version=='3.12'
    - numpy>=2.0.0.dev0; python_version>='3.13'
  * Getting build dependencies for wheel...
  * Building wheel...
  + meson setup /Users/runner/work/pylibvna-cicdtest/pylibvna-cicdtest /Users/runner/work/pylibvna-cicdtest/pylibvna-cicdtest/.mesonpy-4yi3kty9 -Dbuildtype=release -Db_ndebug=if-release -Db_vscrt=md --native-file=/Users/runner/work/pylibvna-cicdtest/pylibvna-cicdtest/.mesonpy-4yi3kty9/meson-python-native-file.ini
  The Meson build system
  Version: 1.4.1
  Source dir: /Users/runner/work/pylibvna-cicdtest/pylibvna-cicdtest
  Build dir: /Users/runner/work/pylibvna-cicdtest/pylibvna-cicdtest/.mesonpy-4yi3kty9
  Build type: native build
  Project name: libvna
  Project version: 0.1.2
  C compiler for the host machine: cc (clang 15.0.0 "Apple clang version 15.0.0 (clang-1500.0.40.1)")
  C linker for the host machine: cc ld64 1015.7
  Cython compiler for the host machine: cython (cython 3.0.10)
  Host machine cpu family: aarch64
  Host machine cpu: aarch64
  Program python found: YES (/private/var/folders/lr/439_fwvd3m76p9vy50d57kcc0000gn/T/build-env-bahe0ygz/bin/python)
  Found pkg-config: YES (/opt/homebrew/bin/pkg-config) 0.29.2
  Run-time dependency python found: YES 3.9
  Run-time dependency libvna found: YES 0.3.12

... lots of output not shown ...

Finally, we fail in repair wheel:

Repairing wheel...
  
  + echo "repair-wheel: ${MACOSX_DEPLOYMENT_TARGET}"
  DYLD_LIBRARY_PATH=/usr/local/lib delocate-listdeps /private/var/folders/lr/439_fwvd3m76p9vy50d57kcc0000gn/T/cibw-run-sqygwqd7/cp39-macosx_arm64/built_wheel/libvna-0.1.2-cp39-cp39-macosx_12_0_arm64.whl &&
  DYLD_LIBRARY_PATH=/usr/local/lib delocate-wheel --require-archs arm64 -w /private/var/folders/lr/439_fwvd3m76p9vy50d57kcc0000gn/T/cibw-run-sqygwqd7/cp39-macosx_arm64/repaired_wheel /private/var/folders/lr/439_fwvd3m76p9vy50d57kcc0000gn/T/cibw-run-sqygwqd7/cp39-macosx_arm64/built_wheel/libvna-0.1.2-cp39-cp39-macosx_12_0_arm64.whl
  
  repair-wheel: 12.0
  /opt/homebrew/Cellar/libvna/0.3.12/lib/libvna.0.dylib
  /opt/homebrew/Cellar/libyaml/0.2.5/lib/libyaml-0.2.dylib
  Traceback (most recent call last):
    File "/private/var/folders/lr/439_fwvd3m76p9vy50d57kcc0000gn/T/cibw-run-sqygwqd7/cp39-macosx_arm64/build/venv/bin/delocate-wheel", line 8, in <module>
      sys.exit(main())
    File "/private/var/folders/lr/439_fwvd3m76p9vy50d57kcc0000gn/T/cibw-run-sqygwqd7/cp39-macosx_arm64/build/venv/lib/python3.9/site-packages/delocate/cmd/delocate_wheel.py", line 110, in main
      copied = delocate_wheel(
    File "/private/var/folders/lr/439_fwvd3m76p9vy50d57kcc0000gn/T/cibw-run-sqygwqd7/cp39-macosx_arm64/build/venv/lib/python3.9/site-packages/delocate/delocating.py", line 1004, in delocate_wheel
      out_wheel_fixed = _check_and_update_wheel_name(
    File "/private/var/folders/lr/439_fwvd3m76p9vy50d57kcc0000gn/T/cibw-run-sqygwqd7/cp39-macosx_arm64/build/venv/lib/python3.9/site-packages/delocate/delocating.py", line 839, in _check_and_update_wheel_name
      raise DelocationError(
  delocate.libsana.DelocationError: Library dependencies do not satisfy target MacOS version 12.0:
  /private/var/folders/lr/439_fwvd3m76p9vy50d57kcc0000gn/T/tmpzwigp0ye/wheel/libvna/.dylibs/libvna.0.dylib has a minimum target of 14.0
  /private/var/folders/lr/439_fwvd3m76p9vy50d57kcc0000gn/T/tmpzwigp0ye/wheel/libvna/.dylibs/libyaml-0.2.dylib has a minimum target of 14.0
Error: Command echo "repair-wheel: ${MACOSX_DEPLOYMENT_TARGET}"
DYLD_LIBRARY_PATH=/usr/local/lib delocate-listdeps /private/var/folders/lr/439_fwvd3m76p9vy50d57kcc0000gn/T/cibw-run-sqygwqd7/cp39-macosx_arm64/built_wheel/libvna-0.1.2-cp39-cp39-macosx_12_0_arm64.whl &&
DYLD_LIBRARY_PATH=/usr/local/lib delocate-wheel --require-archs arm64 -w /private/var/folders/lr/439_fwvd3m76p9vy50d57kcc0000gn/T/cibw-run-sqygwqd7/cp39-macosx_arm64/repaired_wheel /private/var/folders/lr/439_fwvd3m76p9vy50d57kcc0000gn/T/cibw-run-sqygwqd7/cp39-macosx_arm64/built_wheel/libvna-0.1.2-cp39-cp39-macosx_12_0_arm64.whl
                                                              ✕ 4.37s
 failed with code 1. None

Pretty much every time I try to push a new release, something new is failing in the build. I wish it were easier to maintain a reliable build process for Cython wheels.

I would appreciate suggestions on how to get the library versions right for MacOS. And if you see something else not best practice, feel free to comment on that, too. Thanks.

[scott-guthridge]

Neither brew nor MacPorts lets you build libraries targeted at older versions of MacOS by setting MACOSX_DEPLOYMENT_TARGET in the environment. Maybe there's a way to get MacPorts to build older versions -- I couldn't find a way to do it, though. I ended up changing my build process to build everything from source and it's working on all platforms again. It's still pretty brittle.