Can't pip install

[tkoskela]

pip-inspect.txt

Your name

Tuomas Koskela

Your affiliation

UCL

What happened? What did you expect to happen?

I am using Ubuntu-24.04 with python 3.12.3 and pip 24.0. I tried to pip install geoschem-gcpy in a venv virtual environment with

python3 -m venv python_envs/geoschem
source python_envs/geoschem/bin/activate
pip install geoschem-gcpy

Pip install fails with an error

× Getting requirements to build wheel did not run successfully.
  │ exit code: 1
  ╰─> [18 lines of output]
      Traceback (most recent call last):
        File "/home/tkoskela/python_envs/geoschem/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 353, in <module>
          main()
        File "/home/tkoskela/python_envs/geoschem/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 335, in main
          json_out['return_val'] = hook(**hook_input['kwargs'])
                                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/home/tkoskela/python_envs/geoschem/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 118, in get_requires_for_build_wheel
          return hook(config_settings)
                 ^^^^^^^^^^^^^^^^^^^^^
        File "/tmp/pip-build-env-1dnuhtgm/overlay/lib/python3.12/site-packages/setuptools/build_meta.py", line 333, in get_requires_for_build_wheel
          return self._get_build_requires(config_settings, requirements=[])
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/tmp/pip-build-env-1dnuhtgm/overlay/lib/python3.12/site-packages/setuptools/build_meta.py", line 301, in _get_build_requires
          self.run_setup()
        File "/tmp/pip-build-env-1dnuhtgm/overlay/lib/python3.12/site-packages/setuptools/build_meta.py", line 317, in run_setup
          exec(code, locals())
        File "<string>", line 35, in <module>
      ImportError: cannot import name 'convert_path' from 'setuptools' (/tmp/pip-build-env-1dnuhtgm/overlay/lib/python3.12/site-packages/setuptools/__init__.py)
      [end of output]

I've tried to fix the version of geoschem-gcpy that I'm installing, that leads to a different error

 pip install geoschem-gcpy==1.7.1
Collecting geoschem-gcpy==1.7.1
  Using cached geoschem_gcpy-1.7.1-py3-none-any.whl.metadata (1.7 kB)
Collecting cartopy==0.24.0 (from geoschem-gcpy==1.7.1)
  Using cached Cartopy-0.24.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (7.9 kB)
Collecting cf_xarray==0.10.0 (from geoschem-gcpy==1.7.1)
  Using cached cf_xarray-0.10.0-py3-none-any.whl.metadata (16 kB)
Collecting dask==2025.3.0 (from geoschem-gcpy==1.7.1)
  Using cached dask-2025.3.0-py3-none-any.whl.metadata (3.8 kB)
INFO: pip is looking at multiple versions of geoschem-gcpy to determine which version is compatible with other requirements. This could take a while.
ERROR: Could not find a version that satisfies the requirement esmf==8.8.1 (from geoschem-gcpy) (from versions: none)
ERROR: No matching distribution found for esmf==8.8.1

$ pip install geoschem-gcpy==1.6.2
Collecting geoschem-gcpy==1.6.2
  Using cached geoschem_gcpy-1.6.2-py3-none-any.whl.metadata (1.7 kB)
Collecting cartopy==0.23.0 (from geoschem-gcpy==1.6.2)
  Using cached Cartopy-0.23.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (8.0 kB)
Collecting cf_xarray==0.9.1 (from geoschem-gcpy==1.6.2)
  Using cached cf_xarray-0.9.1-py3-none-any.whl.metadata (16 kB)
Collecting dask==2025.3.0 (from geoschem-gcpy==1.6.2)
  Using cached dask-2025.3.0-py3-none-any.whl.metadata (3.8 kB)
INFO: pip is looking at multiple versions of geoschem-gcpy to determine which version is compatible with other requirements. This could take a while.
ERROR: Could not find a version that satisfies the requirement esmf==8.6.1 (from geoschem-gcpy) (from versions: none)
ERROR: No matching distribution found for esmf==8.6.1

What are the steps to reproduce the bug?

python3 -m venv python_envs/geoschem
source python_envs/geoschem/bin/activate
pip install geoschem-gcpy

Please attach any relevant configuration and log files.

No response

What GCPy version were you using?

Default from pypi, 1.7.1, 1.6.2

What environment were you running GCPy on?

Personal computer

What python environment were you using?

I start from a clean python3 venv. See the attached file pip-inspect.txt for details

Will you be addressing this bug yourself?

Yes

Additional information

No response

[tkoskela]

I get a similar error on the UCL university cluster, with RHEL 7 and python 3.9.10

[yantosca]

Thanks for writing @tkoskela. I think it is an issue with setuptools. Can you try:

$ pip install "setuptools<70.0.0"
$ pip install geoschem-gcpy

[tkoskela]

Indeed, I can see that function exists in setuptools 69 but not in 70. Installing setuptools<70 in my environment doesn't seem to fix the problem in installing geoschem-gcpy though. I wonder if this needs to be set in the dependencies of the geoschem-gcpy package

[tkoskela]

(geoschem) [tkoskela@rat ~]$ pip install "setuptools<70.0.0"
Requirement already satisfied: setuptools<70.0.0 in ./python_envs/geoschem/lib/python3.12/site-packages (69.0.0)
(geoschem) [tkoskela@rat ~]$ pip list
Package         Version
--------------- -----------
awscli          1.45.9
botocore        1.43.9
colorama        0.4.6
docutils        0.19
jmespath        1.1.0
pip             24.0
pyasn1          0.6.3
python-dateutil 2.9.0.post0
PyYAML          6.0.3
rsa             4.7.2
s3transfer      0.17.0
setuptools      69.0.0
six             1.17.0
urllib3         2.7.0
(geoschem) [tkoskela@rat ~]$ pip install geoschem-gcpy
Collecting geoschem-gcpy
  Using cached geoschem_gcpy-1.7.1-py3-none-any.whl.metadata (1.7 kB)
Collecting cartopy==0.24.0 (from geoschem-gcpy)
  Using cached Cartopy-0.24.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (7.9 kB)
Collecting cf_xarray==0.10.0 (from geoschem-gcpy)
  Using cached cf_xarray-0.10.0-py3-none-any.whl.metadata (16 kB)
Collecting dask==2025.3.0 (from geoschem-gcpy)
  Using cached dask-2025.3.0-py3-none-any.whl.metadata (3.8 kB)
INFO: pip is looking at multiple versions of geoschem-gcpy to determine which version is compatible with other requirements. This could take a while.
Collecting geoschem-gcpy
  Using cached geoschem_gcpy-1.7.0-py3-none-any.whl.metadata (1.7 kB)
  Using cached geoschem_gcpy-1.6.2-py3-none-any.whl.metadata (1.7 kB)
Collecting cartopy==0.23.0 (from geoschem-gcpy)
  Using cached Cartopy-0.23.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl.metadata (8.0 kB)
Collecting cf_xarray==0.9.1 (from geoschem-gcpy)
  Using cached cf_xarray-0.9.1-py3-none-any.whl.metadata (16 kB)
Collecting geoschem-gcpy
  Using cached geoschem_gcpy-1.6.1-py3-none-any.whl.metadata (1.7 kB)
  Using cached geoschem_gcpy-1.6.0-py3-none-any.whl.metadata (1.7 kB)
Collecting dask==2024.5.2 (from geoschem-gcpy)
  Using cached dask-2024.5.2-py3-none-any.whl.metadata (3.8 kB)
Collecting geoschem-gcpy
  Using cached geoschem_gcpy-1.5.0-py3-none-any.whl.metadata (1.9 kB)
  Using cached geoschem_gcpy-1.4.2-py3-none-any.whl.metadata (1.9 kB)
  Using cached geoschem_gcpy-1.3.2-py3-none-any.whl.metadata (1.7 kB)
Collecting cartopy==0.19.0.post1 (from geoschem-gcpy)
  Using cached Cartopy-0.19.0.post1.tar.gz (12.1 MB)
  Installing build dependencies ... done
  Getting requirements to build wheel ... error
  error: subprocess-exited-with-error
  
  × Getting requirements to build wheel did not run successfully.
  │ exit code: 1
  ╰─> [18 lines of output]
      Traceback (most recent call last):
        File "/home/tkoskela/python_envs/geoschem/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 353, in <module>
          main()
        File "/home/tkoskela/python_envs/geoschem/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 335, in main
          json_out['return_val'] = hook(**hook_input['kwargs'])
                                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/home/tkoskela/python_envs/geoschem/lib/python3.12/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 118, in get_requires_for_build_wheel
          return hook(config_settings)
                 ^^^^^^^^^^^^^^^^^^^^^
        File "/tmp/pip-build-env-5662r8zp/overlay/lib/python3.12/site-packages/setuptools/build_meta.py", line 333, in get_requires_for_build_wheel
          return self._get_build_requires(config_settings, requirements=[])
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/tmp/pip-build-env-5662r8zp/overlay/lib/python3.12/site-packages/setuptools/build_meta.py", line 301, in _get_build_requires
          self.run_setup()
        File "/tmp/pip-build-env-5662r8zp/overlay/lib/python3.12/site-packages/setuptools/build_meta.py", line 317, in run_setup
          exec(code, locals())
        File "<string>", line 35, in <module>
      ImportError: cannot import name 'convert_path' from 'setuptools' (/tmp/pip-build-env-5662r8zp/overlay/lib/python3.12/site-packages/setuptools/__init__.py)
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error

× Getting requirements to build wheel did not run successfully.
│ exit code: 1
╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.

[tkoskela]

Reading my outputs more carefully, it looks like it is failing when installing cartopy==0.19.0, which is required by geoschem_cpy-1.3.2, so possibly I don't need it at all. I'm not really sure why that is being installed in the first place, I'm not that familiar with how pip resolves dependencies.

I then have a separate issue if I install pip instasll geoschem-gcpy==1.7.1 expliticly,

ERROR: Could not find a version that satisfies the requirement esmf==8.8.1 (from geoschem-gcpy) (from versions: none)
ERROR: No matching distribution found for esmf==8.8.1

The esmf package doesn't seem to exist on pypi at all.

[yantosca]

Thanks @tkoskela. In that case, can you try installing from conda-forge for the time being? It might take me a while before I can look at this.

[tkoskela]

I'd rather not use conda if possible. Thanks for looking into it!

I can see that esmf comes with an addon python library esmpy, that you can pip install from the esmf repo. I'm not sure if that's what you need and the naming has changed at some point? https://earthsystemmodeling.org/esmpy_doc/release/latest/html/install.html

[yantosca]

@tkoskela yes, ESMF is a pain in Python. At one point they changed the package name from ESMF to esmf and it broke GCPy in doing so.

[yantosca]

@tkoskela evidently the esmf package is only available on conda but not on PyPI. I'm not sure that a workaround can be found for this.

[tkoskela]

Thanks @yantosca. I did manage to set up conda on our cluster and install GCPy. Would it be worth updating https://gcpy.readthedocs.io/en/stable/Getting-Started-with-GCPy.html#install-pip?

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. If there are no updates within 7 days it will be closed. You can add the "never stale" tag to prevent the issue from closing this issue.