Skip to content

SystemError: Parent module 'setuptools' not loaded, cannot perform relative import with setuptools 50 #2352

Closed
#2369
openreview/openreview-py
#744
Closed
SystemError: Parent module 'setuptools' not loaded, cannot perform relative import with setuptools 50#2352
#2369
openreview/openreview-py
#744
Labels
blockerbug

Description

@gavincyi
gavincyi
opened on Aug 31, 2020

After upgrading setuptools to 50.0 today, the environment fails to locate the entry points as it could not import distutils

$ python --version
Python 3.5.1
$ python -c "import distutils"
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "<frozen importlib._bootstrap>", line 969, in _find_and_load
  File "<frozen importlib._bootstrap>", line 958, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 666, in _load_unlocked
  File "<frozen importlib._bootstrap>", line 577, in module_from_spec
  File "/home/gchan/tmp/setuptools-python-3.5/lib/python3.5/site-packages/_distutils_hack/__init__.py", line 82, in create_module
    return importlib.import_module('._distutils', 'setuptools')
  File "/home/gchan/tmp/setuptools-python-3.5/lib64/python3.5/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 981, in _gcd_import
  File "<frozen importlib._bootstrap>", line 931, in _sanity_check
SystemError: Parent module 'setuptools' not loaded, cannot perform relative import

The issue could not be found in the python 3.8 environment.

Activity

  1. aaronlee-xyz commented on Aug 31, 2020

    @aaronlee-xyz
    aaronlee-xyz
    on Aug 31, 2020

    Found the same issue with python 3.6.1 (pyenv)

  2. akx commented on Aug 31, 2020

    @akx
    akx
    on Aug 31, 2020
    Contributor

    Same here, Ubuntu 16.04. Seems to be another symptom of #2350.

     SystemError: Parent module 'setuptools' not loaded, cannot perform relative import
   File "<frozen importlib._bootstrap>", line 931, in _sanity_check
   File "<frozen importlib._bootstrap>", line 981, in _gcd_import
     return _bootstrap._gcd_import(name[level:], package, level)
   File "/usr/lib/python3.5/importlib/__init__.py", line 126, in import_module
     return importlib.import_module('._distutils', 'setuptools')
   File "/usr/local/lib/python3.5/dist-packages/_distutils_hack/__init__.py", line 82, in create_module
   File "<frozen importlib._bootstrap>", line 577, in module_from_spec
   File "<frozen importlib._bootstrap>", line 666, in _load_unlocked
   File "<frozen importlib._bootstrap>", line 958, in _find_and_load_unlocked
   File "<frozen importlib._bootstrap>", line 969, in _find_and_load
     from distutils.version import StrictVersion
   File "/usr/local/lib/python3.5/dist-packages/redis/connection.py", line 2, in <module>
     from redis.connection import (ConnectionPool, UnixDomainSocketConnection,
   File "/usr/local/lib/python3.5/dist-packages/redis/client.py", line 12, in <module>
     from redis.client import Redis, StrictRedis
   File "/usr/local/lib/python3.5/dist-packages/redis/__init__.py", line 1, in <module>
     from redis import Redis
   [...]

  3. ThomasDevoogdt commented on Aug 31, 2020

    @ThomasDevoogdt
    ThomasDevoogdt
    on Aug 31, 2020

    The same can be said for Matplotlib:

    main.py:6: in <module>
    import matplotlib
../venv/lib/python3.5/site-packages/matplotlib/__init__.py:120: in <module>
    import distutils.version
<frozen importlib._bootstrap>:969: in _find_and_load
    ???
<frozen importlib._bootstrap>:958: in _find_and_load_unlocked
    ???
<frozen importlib._bootstrap>:666: in _load_unlocked
    ???
<frozen importlib._bootstrap>:577: in module_from_spec
    ???
../venv/lib/python3.5/site-packages/_distutils_hack/__init__.py:82: in create_module
    return importlib.import_module('._distutils', 'setuptools')
../venv/lib/python3.5/importlib/__init__.py:126: in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
<frozen importlib._bootstrap>:981: in _gcd_import
    ???
<frozen importlib._bootstrap>:931: in _sanity_check
    ???
E   SystemError: Parent module 'setuptools' not loaded, cannot perform relative import

  4. NicolasPA commented on Aug 31, 2020

    @NicolasPA
    NicolasPA
    on Aug 31, 2020

    Same issue.
    Worked around with downgrading and blacklisting 50.0:

    pip install "setuptools!=50.0" --force-reinstall

    and in requirements.txt:

    setuptools!=50.0
  5. chigby
    added 5 commits that reference this issue on Aug 31, 2020

    Pin setuptools to a version < 50.0 when installing pipenv

    39532a1

    Pin setuptools to a version < 50.0 when installing pipenv

    720c629

    Pin setuptools to a version < 50.0 when installing pipenv

    0467965

    Pin setuptools to a version < 50.0 when installing pipenv

    0101362

    Pin setuptools to a version < 50.0 when installing pipenv

    8af5149
  6. tfds-copybara
    added 2 commits that reference this issue on Aug 31, 2020

    Blacklist setuptool version 50.0 to fix kokoro

    50bad62

    Blacklist setuptool version 50.0 to fix kokoro

    ff0ad4b

  7. dwrensha commented on Aug 31, 2020

    @dwrensha
    dwrensha
    on Aug 31, 2020

    The workaround described in the changelog worked for me:

    export SETUPTOOLS_USE_DISTUTILS=stdlib

  8. alepinio commented on Aug 31, 2020

    @alepinio
    alepinio
    on Aug 31, 2020

    Same issue here with python 3.5.2,

    ❯ pipenv
Traceback (most recent call last):
  File "/home/apinio/.local/bin/pipenv", line 5, in <module>
    from pipenv import cli
  File "/home/apinio/.local/lib/python3.5/site-packages/pipenv/__init__.py", line 55, in <module>
    from .cli import cli
  File "/home/apinio/.local/lib/python3.5/site-packages/pipenv/cli/__init__.py", line 4, in <module>
    from .command import cli    # noqa
  File "/home/apinio/.local/lib/python3.5/site-packages/pipenv/cli/command.py", line 15, in <module>
    from .options import (
  File "/home/apinio/.local/lib/python3.5/site-packages/pipenv/cli/options.py", line 14, in <module>
    from ..utils import is_valid_url
  File "/home/apinio/.local/lib/python3.5/site-packages/pipenv/utils.py", line 16, in <module>
    from distutils.spawn import find_executable
  File "<frozen importlib._bootstrap>", line 969, in _find_and_load
  File "<frozen importlib._bootstrap>", line 958, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 666, in _load_unlocked
  File "<frozen importlib._bootstrap>", line 577, in module_from_spec
  File "/home/apinio/.local/lib/python3.5/site-packages/_distutils_hack/__init__.py", line 82, in create_module
    return importlib.import_module('._distutils', 'setuptools')
  File "/usr/lib/python3.5/importlib/__init__.py", line 126, in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
  File "<frozen importlib._bootstrap>", line 981, in _gcd_import
  File "<frozen importlib._bootstrap>", line 931, in _sanity_check
SystemError: Parent module 'setuptools' not loaded, cannot perform relative import

    Downgrading to setuptools-49.6.0 fixes the problem.

  9. matthew-brett
    added a commit that references this issue on Aug 31, 2020

    BF: work round setuptools 50.0 bug

    5d31711
  10. tfds-copybara
    added a commit that references this issue on Aug 31, 2020

    Blacklist setuptool version 50.0 to fix kokoro

    44a2c83

  11. 30 remaining items

  12. pshanbhag
    added a commit that references this issue on Sep 1, 2020

    Adjust setuptools installation to workaround upstream changes

    984486c

  13. MartinFalatic commented on Sep 1, 2020

    @MartinFalatic
    MartinFalatic
    on Sep 1, 2020

    Is this change, as implemented in 50.0.2, supposed to eliminate the need for the SETUPTOOLS_USE_DISTUTILS=stdlib workaround?

    If so, it is not working out that way. Seeing the same problem as before (without the workaround) and the build is picking up 50.0.2

    Ubuntu 18.04 with python3 (3.6.7-1~18.04) in Docker

  14. tfx-copybara
    added a commit that references this issue on Sep 1, 2020

    Fixed windows python3.6 issue.

    4715790

  15. cicconej commented on Sep 2, 2020

    @cicconej
    cicconej
    on Sep 2, 2020

    @MartinFalatic - Can you share a log/traceback? The particular exception in the original issue report was removed in Python 3.6.3 RC1+ as part of the fix for https://bugs.python.org/issue30876.

    Note the absence of https://github.com/python/cpython/blob/v3.6.2/Lib/importlib/_bootstrap.py#L920-L923 in https://github.com/python/cpython/blob/v3.6.7/Lib/importlib/_bootstrap.py#L917-L930.

  16. MartinFalatic commented on Sep 2, 2020

    @MartinFalatic
    MartinFalatic
    on Sep 2, 2020

    Using setuptools 50.0.0 without workaround:

    [14:34:24][Docker Compose Build] Step 5/18 : RUN DJANGO_SECRET_KEY=redacted ENABLE_DEBUG=1 python3 manage.py collectstatic --noinput --clear
[14:34:24][Docker Compose Build]  ---> Running in 97410cbaf12e
[14:34:25][Docker Compose Build] Traceback (most recent call last):
[14:34:25][Docker Compose Build]   File "manage.py", line 18, in <module>
[14:34:25][Docker Compose Build]     execute_from_command_line(sys.argv)
[14:34:25][Docker Compose Build]   File "/usr/local/lib/python3.6/dist-packages/django/core/management/__init__.py", line 381, in execute_from_command_line
[14:34:25][Docker Compose Build]     utility.execute()
[14:34:25][Docker Compose Build]   File "/usr/local/lib/python3.6/dist-packages/django/core/management/__init__.py", line 357, in execute
[14:34:25][Docker Compose Build]     django.setup()
[14:34:25][Docker Compose Build]   File "/usr/local/lib/python3.6/dist-packages/django/__init__.py", line 24, in setup
[14:34:25][Docker Compose Build]     apps.populate(settings.INSTALLED_APPS)
[14:34:25][Docker Compose Build]   File "/usr/local/lib/python3.6/dist-packages/django/apps/registry.py", line 91, in populate
[14:34:25][Docker Compose Build]     app_config = AppConfig.create(entry)
[14:34:25][Docker Compose Build]   File "/usr/local/lib/python3.6/dist-packages/django/apps/config.py", line 90, in create
[14:34:25][Docker Compose Build]     module = import_module(entry)
[14:34:25][Docker Compose Build]   File "/usr/lib/python3.6/importlib/__init__.py", line 126, in import_module
[14:34:25][Docker Compose Build]     return _bootstrap._gcd_import(name[level:], package, level)
[14:34:25][Docker Compose Build]   File "<frozen importlib._bootstrap>", line 994, in _gcd_import
[14:34:25][Docker Compose Build]   File "<frozen importlib._bootstrap>", line 971, in _find_and_load
[14:34:25][Docker Compose Build]   File "<frozen importlib._bootstrap>", line 953, in _find_and_load_unlocked
[14:34:25][Docker Compose Build] ModuleNotFoundError: No module named 'dal'
[14:34:25][Docker Compose Build] Service 'nginx' failed to build: The command '/bin/sh -c DJANGO_SECRET_KEY=redacted ENABLE_DEBUG=1 python3 manage.py collectstatic --noinput --clear' returned a non-zero code: 1

    Using setuptools 50.0.2 without workaround:

    [15:50:39][Docker Compose Build] Step 5/18 : RUN DJANGO_SECRET_KEY=redacted ENABLE_DEBUG=1 python3 manage.py collectstatic --noinput --clear
[15:50:39][Docker Compose Build]  ---> Running in 49057705f89d
[15:50:40][Docker Compose Build] Traceback (most recent call last):
[15:50:40][Docker Compose Build]   File "manage.py", line 18, in <module>
[15:50:40][Docker Compose Build]     execute_from_command_line(sys.argv)
[15:50:40][Docker Compose Build]   File "/usr/local/lib/python3.6/dist-packages/django/core/management/__init__.py", line 381, in execute_from_command_line
[15:50:40][Docker Compose Build]     utility.execute()
[15:50:40][Docker Compose Build]   File "/usr/local/lib/python3.6/dist-packages/django/core/management/__init__.py", line 357, in execute
[15:50:40][Docker Compose Build]     django.setup()
[15:50:40][Docker Compose Build]   File "/usr/local/lib/python3.6/dist-packages/django/__init__.py", line 24, in setup
[15:50:40][Docker Compose Build]     apps.populate(settings.INSTALLED_APPS)
[15:50:40][Docker Compose Build]   File "/usr/local/lib/python3.6/dist-packages/django/apps/registry.py", line 91, in populate
[15:50:40][Docker Compose Build]     app_config = AppConfig.create(entry)
[15:50:40][Docker Compose Build]   File "/usr/local/lib/python3.6/dist-packages/django/apps/config.py", line 90, in create
[15:50:40][Docker Compose Build]     module = import_module(entry)
[15:50:40][Docker Compose Build]   File "/usr/lib/python3.6/importlib/__init__.py", line 126, in import_module
[15:50:40][Docker Compose Build]     return _bootstrap._gcd_import(name[level:], package, level)
[15:50:40][Docker Compose Build]   File "<frozen importlib._bootstrap>", line 994, in _gcd_import
[15:50:40][Docker Compose Build]   File "<frozen importlib._bootstrap>", line 971, in _find_and_load
[15:50:40][Docker Compose Build]   File "<frozen importlib._bootstrap>", line 953, in _find_and_load_unlocked
[15:50:40][Docker Compose Build] ModuleNotFoundError: No module named 'dal'
[15:50:40][Docker Compose Build] Service 'nginx' failed to build: The command '/bin/sh -c DJANGO_SECRET_KEY=redacted ENABLE_DEBUG=1 python3 manage.py collectstatic --noinput --clear' returned a non-zero code: 1

    Those appear to be identical.

    The following does get mentioned in the log during the main pip3 install part of the build (with and without the workaround). I mention it only for completeness as this problem is certainly affected by the setuptools version being >= 50. Note that setuptools is NOT being pinned in the requirements (as that would be problematic).

    [15:48:20][Docker Compose Build]   Found existing installation: setuptools 39.0.1
[15:48:20][Docker Compose Build]     Not uninstalling setuptools at /usr/lib/python3/dist-packages, outside environment /usr

    Also, 'dal' = django-autocomplete-light.

  17. MartinFalatic commented on Sep 2, 2020

    @MartinFalatic
    MartinFalatic
    on Sep 2, 2020

    It's worth noting that this was closed as duplicate when I brought it up here... #2356 (comment)

    Similar but perhaps not quite the same problem after all, perhaps.

  18. tfds-copybara
    added a commit that references this issue on Sep 2, 2020

    Blacklist setuptool version 50.0 to fix kokoro

    d532caa
  19. wmfgerrit
    added a commit that references this issue on Sep 2, 2020

    Force docker-compose build to upgrade setuptools

    f43b6aa
  20. szha
    added a commit that references this issue on Sep 2, 2020

    [DOC][v1.7.x] Fix pip cu102link (#19054)

    0e86a91
  21. gvanrossum
    added a commit that references this issue on Sep 2, 2020

    Fix CI by avoiding setuptools 50.0

    68c1294
  22. jsugarman
    added 3 commits that reference this issue on Feb 4, 2022

    Remove workaround for setuptools issue

    322046a

    Remove workaround for setuptools issue

    fb96d65

    Remove workaround for setuptools issue

    bdf506a
  23. nsaje
    added 2 commits that reference this issue on Jan 3, 2023

    remove pinned setuptools

    b2fefce

    remove pinned setuptools (#463)

    ca8fa50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    blockerbug

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions