[Bug]: Installation not quite accurate with user/root

[gnusupport]

What happened?

I have followed installation instruction, it doesn't say that python script will try to install it on the system, so I tried as user, not as root.

  Creating /home/data1/protected/tmp/pip-target-i_2v6ayt/bin
  changing mode of /home/data1/protected/tmp/pip-target-i_2v6ayt/bin/tqdm to 755
  changing mode of /home/data1/protected/tmp/pip-target-i_2v6ayt/bin/f2py to 755
  changing mode of /home/data1/protected/tmp/pip-target-i_2v6ayt/bin/numpy-config to 755
  changing mode of /home/data1/protected/tmp/pip-target-i_2v6ayt/bin/fastavro to 755
  changing mode of /home/data1/protected/tmp/pip-target-i_2v6ayt/bin/distro to 755
  changing mode of /home/data1/protected/tmp/pip-target-i_2v6ayt/bin/normalizer to 755
  changing mode of /home/data1/protected/tmp/pip-target-i_2v6ayt/bin/huggingface-cli to 755
  changing mode of /home/data1/protected/tmp/pip-target-i_2v6ayt/bin/httpx to 755
  changing mode of /home/data1/protected/tmp/pip-target-i_2v6ayt/bin/openai to 755
  changing mode of /home/data1/protected/tmp/pip-target-i_2v6ayt/bin/datasets-cli to 755
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
poetry 1.3.2 requires poetry-plugin-export<2.0.0,>=1.2.0, which is not installed.
poetry 1.3.2 requires trove-classifiers>=2022.5.19, which is not installed.
scipy 1.10.1 requires numpy<1.27.0,>=1.19.5, but you have numpy 2.2.2 which is incompatible.
mkdocs 1.4.2 requires markdown<3.4,>=3.2.1, but you have markdown 3.4.1 which is incompatible.
poetry 1.3.2 requires dulwich<0.21.0,>=0.20.46, but you have dulwich 0.21.2 which is incompatible.
poetry 1.3.2 requires urllib3<2.0.0,>=1.26.0, but you have urllib3 2.3.0 which is incompatible.
Successfully installed aiohappyeyeballs-2.4.4 aiohttp-3.11.11 aiolimiter-1.2.1 aiosignal-1.3.2 annotated-types-0.7.0 anthropic-0.29.0 anyio-4.8.0 attrs-25.1.0 backoff-2.2.1 boto3-1.36.6 botocore-1.36.6 certifi-2024.12.14 charset-normalizer-3.4.1 cohere-5.5.8 datasets-3.1.0 dill-0.3.8 distro-1.9.0 fastavro-1.10.0 filelock-3.17.0 frozenlist-1.5.0 fsspec-2024.9.0 h11-0.14.0 httpcore-1.0.7 httpx-0.27.2 httpx-sse-0.4.0 huggingface-hub-0.27.1 idna-3.10 jiter-0.8.2 jmespath-1.0.1 multidict-6.1.0 multiprocess-0.70.16 numpy-2.2.2 ollama-0.2.1 openai-1.44.0 packaging-24.2 pandas-2.2.3 parameterized-0.9.0 pgai-0.6.0 pillow-11.1.0 propcache-0.2.1 pyarrow-19.0.0 pydantic-2.10.6 pydantic-core-2.27.2 python-dateutil-2.9.0.post0 pytz-2024.2 pyyaml-6.0.2 regex-2024.11.6 requests-2.32.3 s3transfer-0.11.2 six-1.17.0 sniffio-1.3.1 tenacity-9.0.0 tiktoken-0.7.0 tokenizers-0.21.0 tqdm-4.67.1 types-requests-2.32.0.20241016 typing-extensions-4.12.2 tzdata-2025.1 urllib3-2.3.0 voyageai-0.3.1 xxhash-3.5.0 yarl-1.18.3
ERROR: Exception:
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/pip/_internal/cli/base_command.py", line 160, in exc_logging_wrapper
    status = run_func(*args)
             ^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/pip/_internal/cli/req_command.py", line 247, in wrapper
    return func(self, options, args)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/pip/_internal/commands/install.py", line 566, in run
    self._handle_target_dir(
  File "/usr/lib/python3/dist-packages/pip/_internal/commands/install.py", line 576, in _handle_target_dir
    ensure_dir(target_dir)
  File "/usr/lib/python3/dist-packages/pip/_internal/utils/misc.py", line 106, in ensure_dir
    os.makedirs(path)
  File "<frozen os>", line 215, in makedirs
  File "<frozen os>", line 225, in makedirs
PermissionError: [Errno 13] Permission denied: '/usr/local/lib/pgai'
Traceback (most recent call last):
  File "/home/data1/protected/Downloads/pgai-pgai-v0.5.0/projects/extension/build.py", line 821, in <module>
    install()
  File "/home/data1/protected/Downloads/pgai-pgai-v0.5.0/projects/extension/build.py", line 616, in install
    install_prior_py()
  File "/home/data1/protected/Downloads/pgai-pgai-v0.5.0/projects/extension/build.py", line 501, in install_prior_py
    subprocess.run(
  File "/usr/lib/python3.11/subprocess.py", line 571, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command 'pip3 install -v --compile --target "/usr/local/lib/pgai/0.6.0" "/home/data1/protected/tmp/pgai/0.6.0/projects/extension"' returned non-zero exit status 2.

pgai extension affected

No response

pgai library affected

No response

PostgreSQL version used

17

What operating system did you use?

Debian Bookwarm

What installation method did you use?

Other (Please specify in the description of the bug)

What platform did you run on?

On prem/Self-hosted

Relevant log output and stack trace

lco@lco2:~/Downloads/pgai-pgai-v0.5.0$ projects/extension/build.py install
Using pip 23.0.1 from /usr/lib/python3/dist-packages/pip (python 3.11)
Defaulting to user installation because normal site-packages is not writeable
Collecting openai==1.30.2
  Downloading openai-1.30.2-py3-none-any.whl (320 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 320.7/320.7 kB 1.0 MB/s eta 0:00:00

Collecting tiktoken==0.7.0
  Using cached tiktoken-0.7.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.1 MB)
Collecting ollama==0.2.1
  Downloading ollama-0.2.1-py3-none-any.whl (9.7 kB)
Collecting anthropic==0.29.0
  Downloading anthropic-0.29.0-py3-none-any.whl (863 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 863.5/863.5 kB 4.0 MB/s eta 0:00:00

  Link requires a different Python (3.11.2 not in: '>=3.7,<3.11'): https://files.pythonhosted.org/packages/8c/9f/ed3329f367ec7cf15977dc085d3c7be422881e17aa6565e25a1d1a4fb0e1/cohere-4.0.0-py3-none-any.whl (from https://pypi.org/simple/cohere/) (requires-python:>=3.7,<3.11)
  Link requires a different Python (3.11.2 not in: '>=3.7,<3.11'): https://files.pythonhosted.org/packages/80/0d/2df9e39555f41777684dc64c2aeda0e564eda87c0f298fb8e07ec61100d6/cohere-4.0.0.tar.gz (from https://pypi.org/simple/cohere/) (requires-python:>=3.7,<3.11)
Collecting cohere==5.5.8
  Downloading cohere-5.5.8-py3-none-any.whl (173 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 173.8/173.8 kB 1.7 MB/s eta 0:00:00

Collecting anyio<5,>=3.5.0
  Using cached anyio-4.8.0-py3-none-any.whl (96 kB)
Requirement already satisfied: distro<2,>=1.7.0 in /usr/lib/python3/dist-packages (from openai==1.30.2->-r /home/data1/protected/Downloads/pgai-pgai-v0.5.0/projects/extension/old_requirements.txt (line 1)) (1.8.0)
Collecting httpx<1,>=0.23.0
  Using cached httpx-0.28.1-py3-none-any.whl (73 kB)
Requirement already satisfied: pydantic<3,>=1.9.0 in /usr/lib/python3/dist-packages (from openai==1.30.2->-r /home/data1/protected/Downloads/pgai-pgai-v0.5.0/projects/extension/old_requirements.txt (line 1)) (1.10.4)
Collecting sniffio
  Using cached sniffio-1.3.1-py3-none-any.whl (10 kB)
Requirement already satisfied: tqdm>4 in /usr/lib/python3/dist-packages (from openai==1.30.2->-r /home/data1/protected/Downloads/pgai-pgai-v0.5.0/projects/extension/old_requirements.txt (line 1)) (4.64.1)
Collecting typing-extensions<5,>=4.7
  Using cached typing_extensions-4.12.2-py3-none-any.whl (37 kB)
Requirement already satisfied: regex>=2022.1.18 in /usr/lib/python3/dist-packages (from tiktoken==0.7.0->-r /home/data1/protected/Downloads/pgai-pgai-v0.5.0/projects/extension/old_requirements.txt (line 2)) (2022.10.31)
Requirement already satisfied: requests>=2.26.0 in /usr/lib/python3/dist-packages (from tiktoken==0.7.0->-r /home/data1/protected/Downloads/pgai-pgai-v0.5.0/projects/extension/old_requirements.txt (line 2)) (2.28.1)
Collecting httpx<1,>=0.23.0
  Downloading httpx-0.27.2-py3-none-any.whl (76 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 76.4/76.4 kB 2.8 MB/s eta 0:00:00

Collecting jiter<1,>=0.4.0
  Using cached jiter-0.8.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (345 kB)
Collecting tokenizers>=0.13.0
  Using cached tokenizers-0.21.0-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting boto3<2.0.0,>=1.34.0
  Downloading boto3-1.36.6-py3-none-any.whl (139 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 139.2/139.2 kB 3.5 MB/s eta 0:00:00

Collecting fastavro<2.0.0,>=1.9.4
  Downloading fastavro-1.10.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.3 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.3/3.3 MB 1.5 MB/s eta 0:00:00

Collecting httpx-sse<0.5.0,>=0.4.0
  Downloading httpx_sse-0.4.0-py3-none-any.whl (7.8 kB)
Collecting parameterized<0.10.0,>=0.9.0
  Downloading parameterized-0.9.0-py2.py3-none-any.whl (20 kB)
Requirement already satisfied: types-requests<3.0.0,>=2.0.0 in /usr/lib/python3/dist-packages (from cohere==5.5.8->-r /home/data1/protected/Downloads/pgai-pgai-v0.5.0/projects/extension/old_requirements.txt (line 5)) (2.28)
Requirement already satisfied: idna>=2.8 in /usr/lib/python3/dist-packages (from anyio<5,>=3.5.0->openai==1.30.2->-r /home/data1/protected/Downloads/pgai-pgai-v0.5.0/projects/extension/old_requirements.txt (line 1)) (3.3)
Collecting botocore<1.37.0,>=1.36.6
  Downloading botocore-1.36.6-py3-none-any.whl (13.3 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 13.3/13.3 MB 1.1 MB/s eta 0:00:00

Collecting jmespath<2.0.0,>=0.7.1
  Downloading jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting s3transfer<0.12.0,>=0.11.0
  Downloading s3transfer-0.11.2-py3-none-any.whl (84 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 84.2/84.2 kB 2.1 MB/s eta 0:00:00

Requirement already satisfied: certifi in /usr/lib/python3/dist-packages (from httpx<1,>=0.23.0->openai==1.30.2->-r /home/data1/protected/Downloads/pgai-pgai-v0.5.0/projects/extension/old_requirements.txt (line 1)) (2022.9.24)
Collecting httpcore==1.*
  Using cached httpcore-1.0.7-py3-none-any.whl (78 kB)
Collecting h11<0.15,>=0.13
  Using cached h11-0.14.0-py3-none-any.whl (58 kB)
Collecting huggingface-hub<1.0,>=0.16.4
  Using cached huggingface_hub-0.27.1-py3-none-any.whl (450 kB)
Requirement already satisfied: types-urllib3<1.27 in /usr/lib/python3/dist-packages (from types-requests<3.0.0,>=2.0.0->cohere==5.5.8->-r /home/data1/protected/Downloads/pgai-pgai-v0.5.0/projects/extension/old_requirements.txt (line 5)) (1.26)
Requirement already satisfied: python-dateutil<3.0.0,>=2.1 in /usr/lib/python3/dist-packages (from botocore<1.37.0,>=1.36.6->boto3<2.0.0,>=1.34.0->cohere==5.5.8->-r /home/data1/protected/Downloads/pgai-pgai-v0.5.0/projects/extension/old_requirements.txt (line 5)) (2.8.2)
Requirement already satisfied: urllib3!=2.2.0,<3,>=1.25.4 in /usr/lib/python3/dist-packages (from botocore<1.37.0,>=1.36.6->boto3<2.0.0,>=1.34.0->cohere==5.5.8->-r /home/data1/protected/Downloads/pgai-pgai-v0.5.0/projects/extension/old_requirements.txt (line 5)) (1.26.12)
Requirement already satisfied: filelock in /usr/lib/python3/dist-packages (from huggingface-hub<1.0,>=0.16.4->tokenizers>=0.13.0->anthropic==0.29.0->-r /home/data1/protected/Downloads/pgai-pgai-v0.5.0/projects/extension/old_requirements.txt (line 4)) (3.9.0)
Collecting fsspec>=2023.5.0
  Using cached fsspec-2024.12.0-py3-none-any.whl (183 kB)
Requirement already satisfied: packaging>=20.9 in /usr/lib/python3/dist-packages (from huggingface-hub<1.0,>=0.16.4->tokenizers>=0.13.0->anthropic==0.29.0->-r /home/data1/protected/Downloads/pgai-pgai-v0.5.0/projects/extension/old_requirements.txt (line 4)) (23.0)
Requirement already satisfied: pyyaml>=5.1 in /usr/lib/python3/dist-packages (from huggingface-hub<1.0,>=0.16.4->tokenizers>=0.13.0->anthropic==0.29.0->-r /home/data1/protected/Downloads/pgai-pgai-v0.5.0/projects/extension/old_requirements.txt (line 4)) (6.0)
Installing collected packages: typing-extensions, tiktoken, sniffio, parameterized, jmespath, jiter, httpx-sse, h11, fsspec, fastavro, huggingface-hub, httpcore, botocore, anyio, tokenizers, s3transfer, httpx, openai, ollama, boto3, anthropic, cohere
  changing mode of /home/data1/protected/.local/bin/fastavro to 755
  changing mode of /home/data1/protected/.local/bin/huggingface-cli to 755
  changing mode of /home/data1/protected/.local/bin/httpx to 755
  changing mode of /home/data1/protected/.local/bin/openai to 755
Successfully installed anthropic-0.29.0 anyio-4.8.0 boto3-1.36.6 botocore-1.36.6 cohere-5.5.8 fastavro-1.10.0 fsspec-2024.12.0 h11-0.14.0 httpcore-1.0.7 httpx-0.27.2 httpx-sse-0.4.0 huggingface-hub-0.27.1 jiter-0.8.2 jmespath-1.0.1 ollama-0.2.1 openai-1.30.2 parameterized-0.9.0 s3transfer-0.11.2 sniffio-1.3.1 tiktoken-0.7.0 tokenizers-0.21.0 typing-extensions-4.12.2
Cloning into '/home/data1/protected/tmp/pgai/0.6.0'...
remote: Enumerating objects: 6204, done.        
remote: Counting objects: 100% (1609/1609), done.        
remote: Compressing objects: 100% (539/539), done.        
remote: Total 6204 (delta 1342), reused 1094 (delta 1070), pack-reused 4595 (from 3)        
Receiving objects: 100% (6204/6204), 7.19 MiB | 1.11 MiB/s, done.
Resolving deltas: 100% (3917/3917), done.
Note: switching to '77f38631b72ddf8b5a9c019e73d09aab120e06e2'.

You are in 'detached HEAD' state. You can look around, make experimental
changes and commit them, and you can discard any commits you make in this
state without impacting any branches by switching back to a branch.

If you want to create a new branch to retain commits you create, you may
do so (now or later) by using -c with the switch command. Example:

  git switch -c <new-branch-name>

Or undo this operation with:

  git switch -

Turn off this advice by setting config variable advice.detachedHead to false

Using pip 23.0.1 from /usr/lib/python3/dist-packages/pip (python 3.11)
Processing /home/data1/protected/tmp/pgai/0.6.0/projects/extension
  Running command pip subprocess to install build dependencies
  Collecting setuptools
    Using cached setuptools-75.8.0-py3-none-any.whl (1.2 MB)
  Installing collected packages: setuptools
  Successfully installed setuptools-75.8.0
  Installing build dependencies ... done
  Running command Getting requirements to build wheel
  /home/data1/protected/tmp/pip-build-env-3cfj463s/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:81: SetuptoolsWarning: `install_requires` overwritten in `pyproject.toml` (dependencies)
    corresp(dist, value, root_dir)
  running egg_info
  creating pgai.egg-info
  writing pgai.egg-info/PKG-INFO
  writing dependency_links to pgai.egg-info/dependency_links.txt
  writing requirements to pgai.egg-info/requires.txt
  writing top-level names to pgai.egg-info/top_level.txt
  writing manifest file 'pgai.egg-info/SOURCES.txt'
  reading manifest file 'pgai.egg-info/SOURCES.txt'
  writing manifest file 'pgai.egg-info/SOURCES.txt'
  Getting requirements to build wheel ... done
  Running command Preparing metadata (pyproject.toml)
  /home/data1/protected/tmp/pip-build-env-3cfj463s/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:81: SetuptoolsWarning: `install_requires` overwritten in `pyproject.toml` (dependencies)
    corresp(dist, value, root_dir)
  running dist_info
  creating /home/data1/protected/tmp/pip-modern-metadata-0998a2_3/pgai.egg-info
  writing /home/data1/protected/tmp/pip-modern-metadata-0998a2_3/pgai.egg-info/PKG-INFO
  writing dependency_links to /home/data1/protected/tmp/pip-modern-metadata-0998a2_3/pgai.egg-info/dependency_links.txt
  writing requirements to /home/data1/protected/tmp/pip-modern-metadata-0998a2_3/pgai.egg-info/requires.txt
  writing top-level names to /home/data1/protected/tmp/pip-modern-metadata-0998a2_3/pgai.egg-info/top_level.txt
  writing manifest file '/home/data1/protected/tmp/pip-modern-metadata-0998a2_3/pgai.egg-info/SOURCES.txt'
  reading manifest file '/home/data1/protected/tmp/pip-modern-metadata-0998a2_3/pgai.egg-info/SOURCES.txt'
  writing manifest file '/home/data1/protected/tmp/pip-modern-metadata-0998a2_3/pgai.egg-info/SOURCES.txt'
  creating '/home/data1/protected/tmp/pip-modern-metadata-0998a2_3/pgai-0.6.0.dist-info'
  Preparing metadata (pyproject.toml) ... done
Collecting openai==1.44.0
  Downloading openai-1.44.0-py3-none-any.whl (367 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 367.8/367.8 kB 1.0 MB/s eta 0:00:00

Collecting tiktoken==0.7.0
  Using cached tiktoken-0.7.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.1 MB)
Collecting ollama==0.2.1
  Using cached ollama-0.2.1-py3-none-any.whl (9.7 kB)
Collecting anthropic==0.29.0
  Using cached anthropic-0.29.0-py3-none-any.whl (863 kB)
  Link requires a different Python (3.11.2 not in: '>=3.7,<3.11'): https://files.pythonhosted.org/packages/8c/9f/ed3329f367ec7cf15977dc085d3c7be422881e17aa6565e25a1d1a4fb0e1/cohere-4.0.0-py3-none-any.whl (from https://pypi.org/simple/cohere/) (requires-python:>=3.7,<3.11)
  Link requires a different Python (3.11.2 not in: '>=3.7,<3.11'): https://files.pythonhosted.org/packages/80/0d/2df9e39555f41777684dc64c2aeda0e564eda87c0f298fb8e07ec61100d6/cohere-4.0.0.tar.gz (from https://pypi.org/simple/cohere/) (requires-python:>=3.7,<3.11)
Collecting cohere==5.5.8
  Using cached cohere-5.5.8-py3-none-any.whl (173 kB)
Collecting backoff==2.2.1
  Downloading backoff-2.2.1-py3-none-any.whl (15 kB)
Collecting voyageai==0.3.1
  Downloading voyageai-0.3.1-py3-none-any.whl (25 kB)
Collecting datasets==3.1.0
  Downloading datasets-3.1.0-py3-none-any.whl (480 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 480.6/480.6 kB 3.8 MB/s eta 0:00:00

Collecting anyio<5,>=3.5.0
  Using cached anyio-4.8.0-py3-none-any.whl (96 kB)
Collecting distro<2,>=1.7.0
  Using cached distro-1.9.0-py3-none-any.whl (20 kB)
Collecting httpx<1,>=0.23.0
  Using cached httpx-0.28.1-py3-none-any.whl (73 kB)
Collecting jiter<1,>=0.4.0
  Using cached jiter-0.8.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (345 kB)
Collecting pydantic<3,>=1.9.0
  Downloading pydantic-2.10.6-py3-none-any.whl (431 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 431.7/431.7 kB 11.6 MB/s eta 0:00:00

Collecting sniffio
  Using cached sniffio-1.3.1-py3-none-any.whl (10 kB)
Collecting tokenizers>=0.13.0
  Using cached tokenizers-0.21.0-cp39-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
Collecting typing-extensions<5,>=4.7
  Using cached typing_extensions-4.12.2-py3-none-any.whl (37 kB)
Collecting boto3<2.0.0,>=1.34.0
  Using cached boto3-1.36.6-py3-none-any.whl (139 kB)
Collecting fastavro<2.0.0,>=1.9.4
  Using cached fastavro-1.10.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.3 MB)
Collecting httpx-sse<0.5.0,>=0.4.0
  Using cached httpx_sse-0.4.0-py3-none-any.whl (7.8 kB)
Collecting parameterized<0.10.0,>=0.9.0
  Using cached parameterized-0.9.0-py2.py3-none-any.whl (20 kB)
Collecting requests<3.0.0,>=2.0.0
  Using cached requests-2.32.3-py3-none-any.whl (64 kB)
Collecting types-requests<3.0.0,>=2.0.0
  Using cached types_requests-2.32.0.20241016-py3-none-any.whl (15 kB)
Collecting filelock
  Downloading filelock-3.17.0-py3-none-any.whl (16 kB)
  Link requires a different Python (3.11.2 not in: '>=3.7,<3.11'): https://files.pythonhosted.org/packages/3a/be/650f9c091ef71cb01d735775d554e068752d3ff63d7943b26316dc401749/numpy-1.21.2.zip (from https://pypi.org/simple/numpy/) (requires-python:>=3.7,<3.11)
  Link requires a different Python (3.11.2 not in: '>=3.7,<3.11'): https://files.pythonhosted.org/packages/5f/d6/ad58ded26556eaeaa8c971e08b6466f17c4ac4d786cd3d800e26ce59cc01/numpy-1.21.3.zip (from https://pypi.org/simple/numpy/) (requires-python:>=3.7,<3.11)
  Link requires a different Python (3.11.2 not in: '>=3.7,<3.11'): https://files.pythonhosted.org/packages/fb/48/b0708ebd7718a8933f0d3937513ef8ef2f4f04529f1f66ca86d873043921/numpy-1.21.4.zip (from https://pypi.org/simple/numpy/) (requires-python:>=3.7,<3.11)
  Link requires a different Python (3.11.2 not in: '>=3.7,<3.11'): https://files.pythonhosted.org/packages/c2/a8/a924a09492bdfee8c2ec3094d0a13f2799800b4fdc9c890738aeeb12c72e/numpy-1.21.5.zip (from https://pypi.org/simple/numpy/) (requires-python:>=3.7,<3.11)
  Link requires a different Python (3.11.2 not in: '>=3.7,<3.11'): https://files.pythonhosted.org/packages/45/b7/de7b8e67f2232c26af57c205aaad29fe17754f793404f59c8a730c7a191a/numpy-1.21.6.zip (from https://pypi.org/simple/numpy/) (requires-python:>=3.7,<3.11)
Collecting numpy>=1.17
  Downloading numpy-2.2.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (16.4 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 16.4/16.4 MB 1.1 MB/s eta 0:00:00

Collecting pyarrow>=15.0.0
  Downloading pyarrow-19.0.0-cp311-cp311-manylinux_2_28_x86_64.whl (42.1 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 42.1/42.1 MB 1.1 MB/s eta 0:00:00

Collecting dill<0.3.9,>=0.3.0
  Using cached dill-0.3.8-py3-none-any.whl (116 kB)
Collecting pandas
  Downloading pandas-2.2.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (13.1 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 13.1/13.1 MB 940.3 kB/s eta 0:00:00

Collecting tqdm>=4.66.3
  Using cached tqdm-4.67.1-py3-none-any.whl (78 kB)
Collecting xxhash
  Using cached xxhash-3.5.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (194 kB)
Collecting multiprocess<0.70.17
  Using cached multiprocess-0.70.16-py311-none-any.whl (143 kB)
Collecting fsspec[http]<=2024.9.0,>=2023.1.0
  Using cached fsspec-2024.9.0-py3-none-any.whl (179 kB)
Collecting aiohttp
  Using cached aiohttp-3.11.11-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.7 MB)
Collecting huggingface-hub>=0.23.0
  Using cached huggingface_hub-0.27.1-py3-none-any.whl (450 kB)
Collecting packaging
  Using cached packaging-24.2-py3-none-any.whl (65 kB)
Collecting pyyaml>=5.1
  Using cached PyYAML-6.0.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (762 kB)
Collecting httpx<1,>=0.23.0
  Using cached httpx-0.27.2-py3-none-any.whl (76 kB)
Collecting regex>=2022.1.18
  Using cached regex-2024.11.6-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (792 kB)
Collecting aiolimiter
  Downloading aiolimiter-1.2.1-py3-none-any.whl (6.7 kB)
Collecting pillow
  Using cached pillow-11.1.0-cp311-cp311-manylinux_2_28_x86_64.whl (4.5 MB)
Collecting tenacity
  Downloading tenacity-9.0.0-py3-none-any.whl (28 kB)
Collecting idna>=2.8
  Using cached idna-3.10-py3-none-any.whl (70 kB)
Collecting botocore<1.37.0,>=1.36.6
  Using cached botocore-1.36.6-py3-none-any.whl (13.3 MB)
Collecting jmespath<2.0.0,>=0.7.1
  Using cached jmespath-1.0.1-py3-none-any.whl (20 kB)
Collecting s3transfer<0.12.0,>=0.11.0
  Using cached s3transfer-0.11.2-py3-none-any.whl (84 kB)
Collecting aiohappyeyeballs>=2.3.0
  Using cached aiohappyeyeballs-2.4.4-py3-none-any.whl (14 kB)
Collecting aiosignal>=1.1.2
  Using cached aiosignal-1.3.2-py2.py3-none-any.whl (7.6 kB)
Collecting attrs>=17.3.0
  Downloading attrs-25.1.0-py3-none-any.whl (63 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 63.2/63.2 kB 487.9 kB/s eta 0:00:00

Collecting frozenlist>=1.1.1
  Using cached frozenlist-1.5.0-cp311-cp311-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (274 kB)
Collecting multidict<7.0,>=4.5
  Using cached multidict-6.1.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (129 kB)
Collecting propcache>=0.2.0
  Using cached propcache-0.2.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (231 kB)
Collecting yarl<2.0,>=1.17.0
  Using cached yarl-1.18.3-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (344 kB)
Collecting certifi
  Using cached certifi-2024.12.14-py3-none-any.whl (164 kB)
Collecting httpcore==1.*
  Using cached httpcore-1.0.7-py3-none-any.whl (78 kB)
Collecting h11<0.15,>=0.13
  Using cached h11-0.14.0-py3-none-any.whl (58 kB)
Collecting annotated-types>=0.6.0
  Using cached annotated_types-0.7.0-py3-none-any.whl (13 kB)
Collecting pydantic-core==2.27.2
  Using cached pydantic_core-2.27.2-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.0 MB)
Collecting charset-normalizer<4,>=2
  Using cached charset_normalizer-3.4.1-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (143 kB)
Collecting urllib3<3,>=1.21.1
  Using cached urllib3-2.3.0-py3-none-any.whl (128 kB)
Collecting python-dateutil>=2.8.2
  Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB)
Collecting pytz>=2020.1
  Using cached pytz-2024.2-py2.py3-none-any.whl (508 kB)
Collecting tzdata>=2022.7
  Downloading tzdata-2025.1-py2.py3-none-any.whl (346 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 346.8/346.8 kB 281.9 kB/s eta 0:00:00

Collecting six>=1.5
  Using cached six-1.17.0-py2.py3-none-any.whl (11 kB)
Building wheels for collected packages: pgai
  Running command Building wheel for pgai (pyproject.toml)
  /home/data1/protected/tmp/pip-build-env-3cfj463s/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:81: SetuptoolsWarning: `install_requires` overwritten in `pyproject.toml` (dependencies)
    corresp(dist, value, root_dir)
  running bdist_wheel
  running build
  running build_py
  creating build/lib/ai
  copying ai/ollama.py -> build/lib/ai
  copying ai/load_dataset.py -> build/lib/ai
  copying ai/openai.py -> build/lib/ai
  copying ai/voyageai.py -> build/lib/ai
  copying ai/anthropic.py -> build/lib/ai
  copying ai/secrets.py -> build/lib/ai
  copying ai/utils.py -> build/lib/ai
  copying ai/__init__.py -> build/lib/ai
  copying ai/vectorizer.py -> build/lib/ai
  copying ai/cohere.py -> build/lib/ai
  running egg_info
  writing pgai.egg-info/PKG-INFO
  writing dependency_links to pgai.egg-info/dependency_links.txt
  writing requirements to pgai.egg-info/requires.txt
  writing top-level names to pgai.egg-info/top_level.txt
  reading manifest file 'pgai.egg-info/SOURCES.txt'
  writing manifest file 'pgai.egg-info/SOURCES.txt'
  installing to build/bdist.linux-x86_64/wheel
  running install
  running install_lib
  creating build/bdist.linux-x86_64/wheel
  creating build/bdist.linux-x86_64/wheel/ai
  copying build/lib/ai/ollama.py -> build/bdist.linux-x86_64/wheel/./ai
  copying build/lib/ai/load_dataset.py -> build/bdist.linux-x86_64/wheel/./ai
  copying build/lib/ai/openai.py -> build/bdist.linux-x86_64/wheel/./ai
  copying build/lib/ai/voyageai.py -> build/bdist.linux-x86_64/wheel/./ai
  copying build/lib/ai/anthropic.py -> build/bdist.linux-x86_64/wheel/./ai
  copying build/lib/ai/secrets.py -> build/bdist.linux-x86_64/wheel/./ai
  copying build/lib/ai/utils.py -> build/bdist.linux-x86_64/wheel/./ai
  copying build/lib/ai/__init__.py -> build/bdist.linux-x86_64/wheel/./ai
  copying build/lib/ai/vectorizer.py -> build/bdist.linux-x86_64/wheel/./ai
  copying build/lib/ai/cohere.py -> build/bdist.linux-x86_64/wheel/./ai
  running install_egg_info
  Copying pgai.egg-info to build/bdist.linux-x86_64/wheel/./pgai-0.6.0-py3.11.egg-info
  running install_scripts
  creating build/bdist.linux-x86_64/wheel/pgai-0.6.0.dist-info/WHEEL
  creating '/home/data1/protected/tmp/pip-wheel-g3xfeybh/.tmp-zpjq4bfe/pgai-0.6.0-py3-none-any.whl' and adding 'build/bdist.linux-x86_64/wheel' to it
  adding 'ai/__init__.py'
  adding 'ai/anthropic.py'
  adding 'ai/cohere.py'
  adding 'ai/load_dataset.py'
  adding 'ai/ollama.py'
  adding 'ai/openai.py'
  adding 'ai/secrets.py'
  adding 'ai/utils.py'
  adding 'ai/vectorizer.py'
  adding 'ai/voyageai.py'
  adding 'pgai-0.6.0.dist-info/METADATA'
  adding 'pgai-0.6.0.dist-info/WHEEL'
  adding 'pgai-0.6.0.dist-info/top_level.txt'
  adding 'pgai-0.6.0.dist-info/RECORD'
  removing build/bdist.linux-x86_64/wheel
  Building wheel for pgai (pyproject.toml) ... done
  Created wheel for pgai: filename=pgai-0.6.0-py3-none-any.whl size=9485 sha256=afa51be0579fcedecfd8b8286901117e77e0f385a234f93f5308437f6abcdadc
  Stored in directory: /home/data1/protected/tmp/pip-ephem-wheel-cache-32w6v2jw/wheels/b9/01/9c/7322cfb7ac0c87cc3d0fc92257c0b5dfd06be827dadac8e80e
Successfully built pgai
Installing collected packages: pytz, xxhash, urllib3, tzdata, typing-extensions, tqdm, tenacity, sniffio, six, regex, pyyaml, pyarrow, propcache, pillow, parameterized, packaging, numpy, multidict, jmespath, jiter, idna, httpx-sse, h11, fsspec, frozenlist, filelock, fastavro, distro, dill, charset-normalizer, certifi, backoff, attrs, annotated-types, aiolimiter, aiohappyeyeballs, yarl, types-requests, requests, python-dateutil, pydantic-core, multiprocess, httpcore, anyio, aiosignal, tiktoken, pydantic, pandas, huggingface-hub, httpx, botocore, aiohttp, tokenizers, s3transfer, openai, ollama, voyageai, datasets, boto3, anthropic, cohere, pgai
  Creating /home/data1/protected/tmp/pip-target-i_2v6ayt/bin
  changing mode of /home/data1/protected/tmp/pip-target-i_2v6ayt/bin/tqdm to 755
  changing mode of /home/data1/protected/tmp/pip-target-i_2v6ayt/bin/f2py to 755
  changing mode of /home/data1/protected/tmp/pip-target-i_2v6ayt/bin/numpy-config to 755
  changing mode of /home/data1/protected/tmp/pip-target-i_2v6ayt/bin/fastavro to 755
  changing mode of /home/data1/protected/tmp/pip-target-i_2v6ayt/bin/distro to 755
  changing mode of /home/data1/protected/tmp/pip-target-i_2v6ayt/bin/normalizer to 755
  changing mode of /home/data1/protected/tmp/pip-target-i_2v6ayt/bin/huggingface-cli to 755
  changing mode of /home/data1/protected/tmp/pip-target-i_2v6ayt/bin/httpx to 755
  changing mode of /home/data1/protected/tmp/pip-target-i_2v6ayt/bin/openai to 755
  changing mode of /home/data1/protected/tmp/pip-target-i_2v6ayt/bin/datasets-cli to 755
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
poetry 1.3.2 requires poetry-plugin-export<2.0.0,>=1.2.0, which is not installed.
poetry 1.3.2 requires trove-classifiers>=2022.5.19, which is not installed.
scipy 1.10.1 requires numpy<1.27.0,>=1.19.5, but you have numpy 2.2.2 which is incompatible.
mkdocs 1.4.2 requires markdown<3.4,>=3.2.1, but you have markdown 3.4.1 which is incompatible.
poetry 1.3.2 requires dulwich<0.21.0,>=0.20.46, but you have dulwich 0.21.2 which is incompatible.
poetry 1.3.2 requires urllib3<2.0.0,>=1.26.0, but you have urllib3 2.3.0 which is incompatible.
Successfully installed aiohappyeyeballs-2.4.4 aiohttp-3.11.11 aiolimiter-1.2.1 aiosignal-1.3.2 annotated-types-0.7.0 anthropic-0.29.0 anyio-4.8.0 attrs-25.1.0 backoff-2.2.1 boto3-1.36.6 botocore-1.36.6 certifi-2024.12.14 charset-normalizer-3.4.1 cohere-5.5.8 datasets-3.1.0 dill-0.3.8 distro-1.9.0 fastavro-1.10.0 filelock-3.17.0 frozenlist-1.5.0 fsspec-2024.9.0 h11-0.14.0 httpcore-1.0.7 httpx-0.27.2 httpx-sse-0.4.0 huggingface-hub-0.27.1 idna-3.10 jiter-0.8.2 jmespath-1.0.1 multidict-6.1.0 multiprocess-0.70.16 numpy-2.2.2 ollama-0.2.1 openai-1.44.0 packaging-24.2 pandas-2.2.3 parameterized-0.9.0 pgai-0.6.0 pillow-11.1.0 propcache-0.2.1 pyarrow-19.0.0 pydantic-2.10.6 pydantic-core-2.27.2 python-dateutil-2.9.0.post0 pytz-2024.2 pyyaml-6.0.2 regex-2024.11.6 requests-2.32.3 s3transfer-0.11.2 six-1.17.0 sniffio-1.3.1 tenacity-9.0.0 tiktoken-0.7.0 tokenizers-0.21.0 tqdm-4.67.1 types-requests-2.32.0.20241016 typing-extensions-4.12.2 tzdata-2025.1 urllib3-2.3.0 voyageai-0.3.1 xxhash-3.5.0 yarl-1.18.3
ERROR: Exception:
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/pip/_internal/cli/base_command.py", line 160, in exc_logging_wrapper
    status = run_func(*args)
             ^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/pip/_internal/cli/req_command.py", line 247, in wrapper
    return func(self, options, args)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/pip/_internal/commands/install.py", line 566, in run
    self._handle_target_dir(
  File "/usr/lib/python3/dist-packages/pip/_internal/commands/install.py", line 576, in _handle_target_dir
    ensure_dir(target_dir)
  File "/usr/lib/python3/dist-packages/pip/_internal/utils/misc.py", line 106, in ensure_dir
    os.makedirs(path)
  File "<frozen os>", line 215, in makedirs
  File "<frozen os>", line 225, in makedirs
PermissionError: [Errno 13] Permission denied: '/usr/local/lib/pgai'
Traceback (most recent call last):
  File "/home/data1/protected/Downloads/pgai-pgai-v0.5.0/projects/extension/build.py", line 821, in <module>
    install()
  File "/home/data1/protected/Downloads/pgai-pgai-v0.5.0/projects/extension/build.py", line 616, in install
    install_prior_py()
  File "/home/data1/protected/Downloads/pgai-pgai-v0.5.0/projects/extension/build.py", line 501, in install_prior_py
    subprocess.run(
  File "/usr/lib/python3.11/subprocess.py", line 571, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command 'pip3 install -v --compile --target "/usr/local/lib/pgai/0.6.0" "/home/data1/protected/tmp/pgai/0.6.0/projects/extension"' returned non-zero exit status 2.

How can we reproduce the bug?

Download source package and run as user:

projects/extension/build.py install

Are you going to work on the bugfix?

None