Skip to content

Emscripten: Get test suite passing #127146

Closed
Closed
Emscripten: Get test suite passing#127146
Labels
OS-emscriptentestsTests in the Lib/test dir

Description

@hoodmane
hoodmane
opened on Nov 22, 2024

First I'd like to get the test suite to run all the way through, then to pass.

cc @freakboy3742

Update 2025/01/30

Emscripten 4.0.2 has fixes for all of the file system bugs I've looked into. There are still problems with nonblocking I/O which I haven't looked into.

Emscripten PRs:

Linked PRs

Activity

  1. hoodmane
    added a commit that references this issue on Dec 16, 2024

    pythongh-127146: Emscripten Include compiler version in _PYTHON_HOST_…

    0c33f20
  2. freakboy3742
    added 2 commits that reference this issue on Dec 17, 2024

    gh-127146: Emscripten clean up test suite (#127984)

    1183e4c

    gh-127146: Emscripten Include compiler version in _PYTHON_HOST_PLATFO…

    b92f101
  3. hoodmane
    added 5 commits that reference this issue on Jan 6, 2025

    pythongh-127146: Fix test_sysconfidata_json in Emscripten

    6e04c6d

    pythongh-127146: Fix test_sysconfidata_json in Emscripten

    6d02cca

    pythongh-127146: skip some tests that are fixed on the main branch of…

    7e77e68

    pythongh-127146: Fix test_sysconfigdata_json for Emscripten

    a51b81d

    pythongh-127146: Strip dash from Emscripten compiler version

    272ad5c
  4. FFY00
    added a commit that references this issue on Jan 6, 2025

    gh-127146: Fix test_sysconfigdata_json for Emscripten (#128556)

    b6c919b
  5. freakboy3742
    added 2 commits that reference this issue on Jan 6, 2025

    gh-127146: Skip Emscripten tests with pending fixes (#128549)

    616692d

    gh-127146: Strip dash from Emscripten compiler version (#128557)

    61c1a24
  6. srinivasreddy
    added 8 commits that reference this issue on Jan 8, 2025

    pythongh-127146: Resolve some minor problems in Emscripten tests (pyt…

    4fe70db

    pythongh-127146: Emscripten: Skip segfaults in test suite (python#127151

    027ac70

    pythongh-127146: Some expected failures in Emscripten time tests (pyt…

    c9158b1

    pythongh-127146: Emscripten clean up test suite (python#127984)

    9d44349

    pythongh-127146: Emscripten Include compiler version in _PYTHON_HOST_…

    166fd0c

    pythongh-127146: Fix test_sysconfigdata_json for Emscripten (python#1…

    3124ddd

    pythongh-127146: Skip Emscripten tests with pending fixes (python#128549

    9c5b386

    pythongh-127146: Strip dash from Emscripten compiler version (python#…

    6834b69
  7. hoodmane
    added a commit that references this issue on Jan 27, 2025

    pythongh-127146: Update test skips for Emscripten 4.0.1

    e2a80f3
  8. freakboy3742
    added a commit that references this issue on Jan 28, 2025

    gh-127146: Update test skips for Emscripten 4.0.1 (#129375)

    8e57877
  9. hoodmane
    added 3 commits that reference this issue on Jan 28, 2025

    pythongh-127146: Skip test_readinto_non_blocking on Emscripten

    72c06e0

    pythongh-127146: Don't compare userbase in test_sysconfig_json

    7b424eb

    pythongh-127146: Don't compare userbase in test_sysconfig_json

    145549f
  10. freakboy3742
    added a commit that references this issue on Jan 28, 2025

    gh-127146: Skip test_readinto_non_blocking on Emscripten (#129421)

    7893908
  11. hoodmane
    closed this as completedon Jan 29, 2025
  12. hoodmane
    reopened this on Jan 29, 2025
  13. hoodmane
    added 2 commits that reference this issue on Jan 30, 2025

    pythongh-127146: Update test skips for Emscripten 4.0.2

    2ef8113

    Remove test skips no longer needed on Emscripten 3.1.74 (#5417)

    6f27328
  14. freakboy3742
    added a commit that references this issue on Mar 16, 2025

    gh-127146: Update test skips for Emscripten 4.0.2 (#129474)

    cf288e3
  15. plashchynski
    added a commit that references this issue on Mar 17, 2025

    pythongh-127146: Update test skips for Emscripten 4.0.2 (python#129474)

    03a9918
  16. hoodmane
    added a commit that references this issue on Mar 24, 2025

    pythongh-127146: Fix Emscripten build with --pydebug

    320e8da
  17. freakboy3742
    added a commit that references this issue on Mar 24, 2025

    gh-127146: Fix Emscripten build with --pydebug (#131672)

    97ab8fc
  18. diegorusso
    added a commit that references this issue on Apr 1, 2025

    pythongh-127146: Fix Emscripten build with --pydebug (python#131672)

    e829a2c
  19. hoodmane
    added a commit that references this issue on Apr 4, 2025

    pythongh-127146: Fix Emscripten test suite when run with -uall

    3d49b34
  20. hoodmane
    added a commit that references this issue on May 20, 2025

    pythongh-127146: xfail more Emscripten stack overflows

    44f7545
  21. freakboy3742
    added a commit that references this issue on May 20, 2025

    gh-127146: xfail more Emscripten stack overflows (#134358)

    91e6a58
  22. miss-islington
    added a commit that references this issue on May 20, 2025

    pythongh-127146: xfail more Emscripten stack overflows (pythonGH-134358)

    967887f
  23. freakboy3742
    added a commit that references this issue on May 20, 2025

    [3.14] gh-127146: xfail more Emscripten stack overflows (GH-134358) (#…

    6f1f871
  24. lkollar
    added a commit that references this issue on May 26, 2025

    pythongh-127146: xfail more Emscripten stack overflows (python#134358)

    0e4d90e
  25. hoodmane
    added 5 commits that reference this issue on Jun 17, 2025

    pythongh-127146: Allow ignored keys to be missing in test_sysconfig

    1e67559

    pythongh-127146: Emscripten: Fix pathlib glob_dotdot test

    b94fef9

    pythongh-127146: Emscripten: Fix test failure due to missing os.link

    f9f6102

    pythongh-127146: Emscripten: Skip test_url2pathname_resolve_host

    65efbf9

    pythongh-127146: Enable large files on Emscripten

    85c52c3
  26. freakboy3742
    added a commit that references this issue on Jun 18, 2025

    gh-127146: Allow ignored keys to be missing in test_sysconfig (#135622)

    28c71ee
  27. miss-islington
    added a commit that references this issue on Jun 18, 2025

    pythongh-127146: Allow ignored keys to be missing in test_sysconfig (p…

    bb84f0c
  28. freakboy3742
    added a commit that references this issue on Jun 18, 2025

    gh-127146: Emscripten: Skip test_url2pathname_resolve_host (#135634)

    2a49c54
  29. miss-islington
    added a commit that references this issue on Jun 18, 2025

    pythongh-127146: Emscripten: Skip test_url2pathname_resolve_host (pyt…

    630562b
  30. freakboy3742
    added 2 commits that reference this issue on Jun 18, 2025

    [3.14] gh-127146: Allow ignored keys to be missing in test_sysconfig (G…

    77e2ac1

    gh-127146: Emscripten: Fix test failure due to missing os.link (#135626)

    ce58afb
  31. miss-islington
    added a commit that references this issue on Jun 18, 2025

    pythongh-127146: Emscripten: Fix test failure due to missing os.link (p…

    9fc308a
  32. freakboy3742
    added a commit that references this issue on Jun 18, 2025

    gh-127146: Emscripten: Fix pathlib glob_dotdot test (#135624)

    e4ccd46
  33. miss-islington
    added a commit that references this issue on Jun 18, 2025

    pythongh-127146: Emscripten: Fix pathlib glob_dotdot test (pythonGH-1…

    d6a9841
  34. freakboy3742
    added a commit that references this issue on Jun 18, 2025

    [3.14] gh-127146: Emscripten: Skip test_url2pathname_resolve_host (GH…

    bf189d7

  35. freakboy3742 commented on Jun 18, 2025

    @freakboy3742
    freakboy3742
    on Jun 18, 2025
    Contributor

    A status update: As of the state of #135635 (based off cb39410), I'm seeing the following problems when running with Emscripten 4.0.10, on macOS.

    I get an error building libffi if the Emscripten build script is run using Python 3.14. This is caused by #135648; a workaround is described on that ticket.

    I'm getting a hard interpreter crash (stack overflow) unless I add skip_emscripten_stack_overflow to:

    • test_syntax.py, SyntaxErrorTestCase.test_error_on_parser_stack_overflow() (L3232)
    • test_exceptions.py, ExceptionTests.test_recursion_normalizing_exception() (L1449)
    • test_exceptions.py, ExceptionTests.test_recursion_in_except_handler() (L1525)

    I then get 6 failures on a full python.sh -m test -v -uall --rerun --single-process -W test run:

    • test_os; this is 100% reliable for me on macOS.
    Test failures 
    ======================================================================
FAIL: test_mode (test.test_os.MakedirTests.test_mode)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/rkm/projects/python/cpython/Lib/test/test_os.py", line 1932, in test_mode
    self.assertEqual(os.stat(parent).st_mode & 0o777, 0o775)
    ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError: 493 != 509
    • test_pathlib; this is an intermittent failure (maybe 50% of the time); it looks like there might be a granularity issue with the time check being performed.
    Test failures 
    ======================================================================
FAIL: test_touch_common (test.test_pathlib.test_pathlib.PathTest.test_touch_common)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/rkm/projects/python/cpython/Lib/test/test_pathlib/test_pathlib.py", line 2347, in test_touch_common
    self.assertGreaterEqual(st.st_mtime_ns, old_mtime_ns)
    ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError: 1750218792835000000 not greater than or equal to 1750218792836000000
    • test_shutil; this looks like it might be a macOS filesystem detail leaking through?
    Test failures 
    
======================================================================
ERROR: test_move_dir_caseinsensitive (test.test_shutil.TestMove.test_move_dir_caseinsensitive)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/rkm/projects/python/cpython/Lib/test/test_shutil.py", line 2910, in test_move_dir_caseinsensitive
    self.assertTrue(os.path.isdir(dst_dir))
    ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError: False is not true

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/Users/rkm/projects/python/cpython/Lib/test/test_shutil.py", line 2912, in test_move_dir_caseinsensitive
    os.rmdir(dst_dir)
    ~~~~~~~~^^^^^^^^^
FileNotFoundError: [Errno 44] No such file or directory: '/Users/rkm/projects/python/cpython/cross-build/wasm32-emscripten/build/python/build/test_python_worker_721831æ/TMPVBL6GF7G'
    • test_tarfile; this looks like it's a limit that might be different; it might be macOS related?
    Test failures 
    
======================================================================
ERROR: test_realpath_limit_attack (test.test_tarfile.TestExtractionFilters.test_realpath_limit_attack) [fully_trusted]
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/rkm/projects/python/cpython/Lib/test/test_tarfile.py", line 3842, in test_realpath_limit_attack
    self.expect_exception(KeyError)
    ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^
  File "/Users/rkm/projects/python/cpython/Lib/test/test_tarfile.py", line 3702, in expect_exception
    raise self.raised_exception
  File "/Users/rkm/projects/python/cpython/Lib/test/test_tarfile.py", line 3623, in check_context
    tar.extractall(self.destdir, filter=filter)
    ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/rkm/projects/python/cpython/Lib/tarfile.py", line 2415, in extractall
    self._extract_one(tarinfo, path, set_attrs=not tarinfo.isdir(),
    ~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
                      numeric_owner=numeric_owner,
                      ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
                      filter_function=filter_function)
                      ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/Users/rkm/projects/python/cpython/Lib/tarfile.py", line 2524, in _extract_one
    self._handle_fatal_error(e)
    ~~~~~~~~~~~~~~~~~~~~~~~~^^^
  File "/Users/rkm/projects/python/cpython/Lib/tarfile.py", line 2518, in _extract_one
    self._extract_member(tarinfo, os.path.join(path, tarinfo.name),
    ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
                         set_attrs=set_attrs,
                         ^^^^^^^^^^^^^^^^^^^^
                         numeric_owner=numeric_owner,
                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
                         filter_function=filter_function,
                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
                         extraction_root=path)
                         ^^^^^^^^^^^^^^^^^^^^^
  File "/Users/rkm/projects/python/cpython/Lib/tarfile.py", line 2609, in _extract_member
    self.makedir(tarinfo, targetpath)
    ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^
  File "/Users/rkm/projects/python/cpython/Lib/tarfile.py", line 2645, in makedir
    os.mkdir(targetpath, 0o700)
    ~~~~~~~~^^^^^^^^^^^^^^^^^^^
OSError: [Errno 37] Filename too long: '/Users/rkm/projects/python/cpython/cross-build/wasm32-emscripten/build/python/build/test_python_worker_517188æ/@test_42_tmpæ-tardir/outerdir/dest/dddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddd/dddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddd/dddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddd/dddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddddd'
    • test_unicode_file_functions; this looks like it might be a macOS filesystem detail leaking through?
    Test failures 
    ======================================================================
FAIL: test_normalize (test.test_unicode_file_functions.UnicodeFileTests.test_normalize)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/rkm/projects/python/cpython/Lib/test/test_unicode_file_functions.py", line 138, in test_normalize
    self._apply_failure(open, name)
    ~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^
  File "/Users/rkm/projects/python/cpython/Lib/test/test_unicode_file_functions.py", line 89, in _apply_failure
    with self.assertRaises(expected_exception) as c:
         ~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
AssertionError: FileNotFoundError not raised

======================================================================
FAIL: test_normalize (test.test_unicode_file_functions.UnicodeNFCFileTests.test_normalize)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/rkm/projects/python/cpython/Lib/test/test_unicode_file_functions.py", line 138, in test_normalize
    self._apply_failure(open, name)
    ~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^
  File "/Users/rkm/projects/python/cpython/Lib/test/test_unicode_file_functions.py", line 89, in _apply_failure
    with self.assertRaises(expected_exception) as c:
         ~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
AssertionError: FileNotFoundError not raised

======================================================================
FAIL: test_normalize (test.test_unicode_file_functions.UnicodeNFDFileTests.test_normalize)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/rkm/projects/python/cpython/Lib/test/test_unicode_file_functions.py", line 138, in test_normalize
    self._apply_failure(open, name)
    ~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^
  File "/Users/rkm/projects/python/cpython/Lib/test/test_unicode_file_functions.py", line 89, in _apply_failure
    with self.assertRaises(expected_exception) as c:
         ~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
AssertionError: FileNotFoundError not raised

======================================================================
FAIL: test_normalize (test.test_unicode_file_functions.UnicodeNFKCFileTests.test_normalize)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/rkm/projects/python/cpython/Lib/test/test_unicode_file_functions.py", line 138, in test_normalize
    self._apply_failure(open, name)
    ~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^
  File "/Users/rkm/projects/python/cpython/Lib/test/test_unicode_file_functions.py", line 89, in _apply_failure
    with self.assertRaises(expected_exception) as c:
         ~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
AssertionError: FileNotFoundError not raised

======================================================================
FAIL: test_normalize (test.test_unicode_file_functions.UnicodeNFKDFileTests.test_normalize)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/rkm/projects/python/cpython/Lib/test/test_unicode_file_functions.py", line 138, in test_normalize
    self._apply_failure(open, name)
    ~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^
  File "/Users/rkm/projects/python/cpython/Lib/test/test_unicode_file_functions.py", line 89, in _apply_failure
    with self.assertRaises(expected_exception) as c:
         ~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^
AssertionError: FileNotFoundError not raised

    As soon as #135635 merges, I'll run the same tests on the buildbot to see what is repeatable there.

  36. freakboy3742
    added 2 commits that reference this issue on Jun 18, 2025

    [3.14] gh-127146: Emscripten: Fix test failure due to missing os.link (…

    a61bd7a

    [3.14] gh-127146: Emscripten: Fix pathlib glob_dotdot test (GH-135624) (

    9f63a54
  37. miss-islington
    added a commit that references this issue on Jun 18, 2025

    pythongh-127146: Enable large files on Emscripten (pythonGH-135635)

    7cc1d8a
  38. freakboy3742
    added 2 commits that reference this issue on Jun 18, 2025

    gh-127146: Enable large files on Emscripten (#135635)

    01c80b2

    [3.14] gh-127146: Enable large files on Emscripten (GH-135635) (#135655)

    52cb287
  39. hoodmane
    added a commit that references this issue on Jun 19, 2025

    pythongh-127146: Add skip_emscripten_stack_overflow in a few places

    edfe80d
  40. freakboy3742
    added a commit that references this issue on Jun 19, 2025

    gh-127146: Add skip_emscripten_stack_overflow in a few places (#135722)

    c8c13f8
  41. miss-islington
    added a commit that references this issue on Jun 19, 2025

    pythongh-127146: Add skip_emscripten_stack_overflow in a few places (p…

    cea19ce
  42. lkollar
    added 5 commits that reference this issue on Jun 19, 2025

    pythongh-127146: Allow ignored keys to be missing in test_sysconfig (p…

    4b493f6

    pythongh-127146: Emscripten: Skip test_url2pathname_resolve_host (pyt…

    2d62401

    pythongh-127146: Emscripten: Fix test failure due to missing os.link (p…

    178f909

    pythongh-127146: Emscripten: Fix pathlib glob_dotdot test (python#135624

    f4a5615

    pythongh-127146: Enable large files on Emscripten (python#135635)

    e85b7ad
  43. freakboy3742
    added a commit that references this issue on Jun 19, 2025

    [3.14] gh-127146: Add skip_emscripten_stack_overflow in a few places (G…

    203753b

  44. freakboy3742 commented on Jun 19, 2025

    @freakboy3742
    freakboy3742
    on Jun 19, 2025
    Contributor

    On the buildbot machine, the situation is a lot better - there's only one failure, in test_os:

    ======================================================================
FAIL: test_mode (test.test_os.MakedirTests.test_mode)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/emscripten/cpython/Lib/test/test_os.py", line 1931, in test_mode
    self.assertEqual(os.stat(parent).st_mode & 0o777, 0o775)
    ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError: 493 != 509

----------------------------------------------------------------------

    Again, this is a 100% reliable failure.

  45. hoodmane
    added a commit that references this issue on Jun 20, 2025

    pythongh-127146: Skip test_os.test_mode for Emscripten

    c6848ac
  46. freakboy3742
    added a commit that references this issue on Jun 21, 2025

    gh-127146: Skip test_os.test_mode for Emscripten (#135764)

    f491125
  47. miss-islington
    added a commit that references this issue on Jun 21, 2025

    pythongh-127146: Skip test_os.test_mode for Emscripten (pythonGH-135764)

    e2bd638
  48. freakboy3742
    added a commit that references this issue on Jun 21, 2025

    [3.14] gh-127146: Skip test_os.test_mode for Emscripten (GH-135764) (#…

    2b5c904
  49. hoodmane
    added a commit that references this issue on Jul 3, 2025

    pythongh-127146: Skip test_netrc.test_security on Emscripten

    6b0c452

  50. freakboy3742 commented on Jul 9, 2025

    @freakboy3742
    freakboy3742
    on Jul 9, 2025
    Contributor

    Current status - 3 failing tests:

    test_pydoc:

    ======================================================================
FAIL: test_apropos_empty_doc (test.test_pydoc.test_pydoc.PydocImportTest.test_apropos_empty_doc)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/emscripten/buildarea/3.x.rkm-emscripten.emscripten/build/Lib/test/test_pydoc/test_pydoc.py", line 1316, in test_apropos_empty_doc
    self.assertIn('walkpkg', stdout.getvalue())
    ~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError: 'walkpkg' not found in '...

    test_netrc - (see #136227 for some discussion)

    ======================================================================
ERROR: test_security (test.test_netrc.NetrcTestCase.test_security)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/emscripten/buildarea/3.x.rkm-emscripten.emscripten/build/Lib/test/test_netrc.py", line 292, in test_security
    nrc = netrc.netrc()
  File "/home/emscripten/buildarea/3.x.rkm-emscripten.emscripten/build/Lib/netrc.py", line 88, in __init__
    self._parse(file, fp, default_netrc)
    ~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/emscripten/buildarea/3.x.rkm-emscripten.emscripten/build/Lib/netrc.py", line 155, in _parse
    self._security_check(fp, default_netrc, self.hosts[entryname][0])
    ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/emscripten/buildarea/3.x.rkm-emscripten.emscripten/build/Lib/netrc.py", line 164, in _security_check
    raise NetrcParseError(
        f"~/.netrc file owner ({fowner}) does not match"
        f" current user ({user})")
netrc.NetrcParseError: ~/.netrc file owner (uid 1002) does not match current user (uid 0) (None, line None)

----------------------------------------------------------------------
Ran 23 tests in 0.037s

FAILED (errors=1, skipped=1)

    test_sqlite3

    ======================================================================
FAIL: test_open_undecodable_uri (test.test_sqlite3.test_dbapi.OpenTests.test_open_undecodable_uri)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/emscripten/buildarea/3.x.rkm-emscripten.emscripten/build/Lib/test/test_sqlite3/test_dbapi.py", line 702, in test_open_undecodable_uri
    self.assertTrue(os.path.exists(path))
    ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^
AssertionError: False is not true

======================================================================
FAIL: test_open_with_undecodable_path (test.test_sqlite3.test_dbapi.OpenTests.test_open_with_undecodable_path)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/emscripten/buildarea/3.x.rkm-emscripten.emscripten/build/Lib/test/test_sqlite3/test_dbapi.py", line 659, in test_open_with_undecodable_path
    self.assertTrue(os.path.exists(path))
    ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^
AssertionError: False is not true

----------------------------------------------------------------------
Ran 494 tests in 2.625s

FAILED (failures=2, skipped=12)

  51. hoodmane commented on Jul 10, 2025

    @hoodmane
    hoodmane
    on Jul 10, 2025
    ContributorAuthor

    So it looks like the netrc problem is that we don't copy the uid over from the native FS to the Emscripten FS. Maybe we can fix it.

  52. hoodmane commented on Jul 10, 2025

    @hoodmane
    hoodmane
    on Jul 10, 2025
    ContributorAuthor

    getuid() in Emscripten is defined here:
    https://github.com/emscripten-core/emscripten/blob/main/system/lib/libc/emscripten_syscall_stubs.c#L153
    to always return 0, but with weak linkage so we could override it if we want.

  53. hoodmane
    added 4 commits that reference this issue on Jul 10, 2025

    pythongh-127146: Report uid in Emscripten + node as native uid

    1fc5975

    pythongh-127146: Report uid in Emscripten + node as native uid

    f2a7202

    pythongh-127146: Skip test_open_undecodable_uri on Emscripten

    bd1dbfc

    pythongh-127146: Skip test_open_undecodable_uri on Emscripten

    5588bb4

  54. hoodmane commented on Jul 10, 2025

    @hoodmane
    hoodmane
    on Jul 10, 2025
    ContributorAuthor

    I can't reproduce the test_apropos_empty_doc failure. Opened #136510 to put back the test skip for test_open_undecodable_uri and opened #136509 to fix the netrc bug.

  55. freakboy3742 commented on Jul 11, 2025

    @freakboy3742
    freakboy3742
    on Jul 11, 2025
    Contributor

    I can't reproduce the test_apropos_empty_doc test on my machine either - but interestingly, looking at the code, it's another test that uses chmod... I wonder if it might be part of the same cluster of issues.

  56. hoodmane commented on Jul 11, 2025

    @hoodmane
    hoodmane
    on Jul 11, 2025
    ContributorAuthor

    Opened upstream issue about test_open_undecodable_uri: the problem is that the UTF8ArrayToString() function used to decode the path argument to openat() has separate code paths for <= 16 bytes and > 16 bytes strings and they don't do the same thing:
    emscripten-core/emscripten#24690

  57. Pranjal095
    added 8 commits that reference this issue on Jul 12, 2025

    pythongh-127146: xfail more Emscripten stack overflows (python#134358)

    8f6e8c4

    pythongh-127146: Allow ignored keys to be missing in test_sysconfig (p…

    9c4c300

    pythongh-127146: Emscripten: Skip test_url2pathname_resolve_host (pyt…

    9aad5f7

    pythongh-127146: Emscripten: Fix test failure due to missing os.link (p…

    32c4b24

    pythongh-127146: Emscripten: Fix pathlib glob_dotdot test (python#135624

    519e55d

    pythongh-127146: Enable large files on Emscripten (python#135635)

    930ab1f

    pythongh-127146: Add skip_emscripten_stack_overflow in a few places (p…

    bae1268

    pythongh-127146: Skip test_os.test_mode for Emscripten (python#135764)

    1c1990b
  58. hoodmane
    added a commit that references this issue on Jul 13, 2025

    pythongh-127146: Fix test_open_undecodable_uri by setting `-sTEXTDECO…

    358e0a3
  59. freakboy3742
    added a commit that references this issue on Jul 13, 2025

    gh-127146: Emscripten: Fix test_open_undecodable_uri by setting `-sTE…

    283b050
  60. miss-islington
    added a commit that references this issue on Jul 13, 2025

    pythongh-127146: Emscripten: Fix test_open_undecodable_uri by setting…

    e660f71
  61. freakboy3742
    added 2 commits that reference this issue on Jul 14, 2025

    [3.14] gh-127146: Emscripten: Fix test_open_undecodable_uri by settin…

    2618180

    gh-127146: Report uid in Emscripten + node as native uid (#136509)

    e81c4e8
  62. miss-islington
    added a commit that references this issue on Jul 16, 2025

    pythongh-127146: Report uid in Emscripten + node as native uid (pytho…

    9bab16c
  63. freakboy3742
    added a commit that references this issue on Jul 16, 2025

    [3.14] gh-127146: Report uid in Emscripten + node as native uid (GH-1…

    cdf98c3
  64. hoodmane
    added 3 commits that reference this issue on Jul 16, 2025

    pythongh-127146: Emscripten: Make os.umask() actually work

    6b4911a

    pythongh-127146: Emscripten: Don't need to avoid unpaired surrogate a…

    41f0124

    pythongh-127146: Emscripten: use skip_emscripten_stack_overflow inste…

    8642a6c
  65. freakboy3742
    added a commit that references this issue on Jul 16, 2025

    gh-127146: Emscripten: Make os.umask() actually work (#136706)

    12e52ca
  66. miss-islington
    added a commit that references this issue on Jul 16, 2025

    pythongh-127146: Emscripten: Make os.umask() actually work (pythonGH-…

    fc2c113
  67. freakboy3742
    added a commit that references this issue on Jul 16, 2025

    gh-127146: Emscripten: more regular stack overflow skips (#136708)

    c730952
  68. miss-islington
    added a commit that references this issue on Jul 16, 2025

    pythongh-127146: Emscripten: more regular stack overflow skips (pytho…

    4bcd261
  69. freakboy3742
    added a commit that references this issue on Jul 16, 2025

    gh-127146: Emscripten: Don't need to avoid unpaired surrogate anymore (…

    dcd27aa
  70. miss-islington
    added a commit that references this issue on Jul 16, 2025

    pythongh-127146: Emscripten: Don't need to avoid unpaired surrogate a…

    ae27905
  71. freakboy3742
    added 3 commits that reference this issue on Jul 16, 2025

    [3.14] gh-127146: Emscripten: more regular stack overflow skips (GH-1…

    ca6db4f

    [3.14] gh-127146: Emscripten: Make os.umask() actually work (GH-136706)…

    4eee754

    [3.14] gh-127146: Emscripten: Don't need to avoid unpaired surrogate …

    9b7c418

  72. freakboy3742 commented on Jul 17, 2025

    @freakboy3742
    freakboy3742
    on Jul 17, 2025
    Contributor

    After a lot of hair pulling, I've tracked down the source of the test_pydoc.test_apropos_empty_doc failure - it's umasking again.

    When running locally, or in a code checkout on the CI machine, the test directory has 755 permissions, which L1313 of the test masks down to 655.

    However, under CI, the test folder has 700 permissions. This means the created directory isn't visible, and so it doesn't appear in the return data.

    The only reasons I can think that the test would generate 700 permissions are:

    1. A leak of test conditions from another test, or
    2. A bug in the Emscripten implementation of umask

    Or possibly a combination of 1 and 2. Given that we already know that 2 is at least partially true already, I think I'm comfortable making this a test skip (with an open ticket for CPython to resolve umask issues once Emscripten has corrected those APIs).

  73. hoodmane
    added a commit that references this issue on Jul 17, 2025

    pythongh-127146: Emscripten: Set umask to zero in python.sh

    595781e
  74. freakboy3742
    added a commit that references this issue on Jul 17, 2025

    gh-127146: Emscripten: Set umask to zero in python.sh (#136740)

    22af5d3
  75. miss-islington
    added a commit that references this issue on Jul 17, 2025

    pythongh-127146: Emscripten: Set umask to zero in python.sh (pythonGH…

    3c629d6
  76. freakboy3742
    added a commit that references this issue on Jul 17, 2025

    [3.14] gh-127146: Emscripten: Set umask to zero in python.sh (GH-136740…

    76d4a43

  77. freakboy3742 commented on Jul 17, 2025

    @freakboy3742
    freakboy3742
    on Jul 17, 2025
    Contributor

    Closing .... because all the tests are now passing!!

    Image
  78. freakboy3742
    closed this as completedon Jul 17, 2025
  79. taegyunkim
    added 14 commits that reference this issue on Aug 4, 2025

    pythongh-127146: xfail more Emscripten stack overflows (python#134358)

    44de915

    pythongh-127146: Allow ignored keys to be missing in test_sysconfig (p…

    f687ed6

    pythongh-127146: Emscripten: Skip test_url2pathname_resolve_host (pyt…

    f828d28

    pythongh-127146: Emscripten: Fix test failure due to missing os.link (p…

    0059a00

    pythongh-127146: Emscripten: Fix pathlib glob_dotdot test (python#135624

    dc2e6eb

    pythongh-127146: Enable large files on Emscripten (python#135635)

    08ddd5f

    pythongh-127146: Add skip_emscripten_stack_overflow in a few places (p…

    6ba2922

    pythongh-127146: Skip test_os.test_mode for Emscripten (python#135764)

    2cc5708

    pythongh-127146: Emscripten: Fix test_open_undecodable_uri by setting…

    69aaa91

    pythongh-127146: Report uid in Emscripten + node as native uid (pytho…

    21209bc

    pythongh-127146: Emscripten: Make os.umask() actually work (python#13…

    c25d0cd

    pythongh-127146: Emscripten: more regular stack overflow skips (pytho…

    0938289

    pythongh-127146: Emscripten: Don't need to avoid unpaired surrogate a…

    83abe8c

    pythongh-127146: Emscripten: Set umask to zero in python.sh (python#1…

    811b7d9
  80. hoodmane
    added a commit that references this issue on Aug 15, 2025

    pythongh-127146: Emscripten: Add test_sample_profiler skips where needed

    079a1d5
  81. freakboy3742
    added a commit that references this issue on Aug 17, 2025

    gh-127146: Emscripten: Add test_sample_profiler skips where needed (#…

    bc28724
  82. Agent-Hellboy
    added 14 commits that reference this issue on Aug 19, 2025

    pythongh-127146: Allow ignored keys to be missing in test_sysconfig (p…

    78a5073

    pythongh-127146: Emscripten: Skip test_url2pathname_resolve_host (pyt…

    2335745

    pythongh-127146: Emscripten: Fix test failure due to missing os.link (p…

    05f76f6

    pythongh-127146: Emscripten: Fix pathlib glob_dotdot test (python#135624

    649703f

    pythongh-127146: Enable large files on Emscripten (python#135635)

    c907ea4

    pythongh-127146: Add skip_emscripten_stack_overflow in a few places (p…

    71bc47d

    pythongh-127146: Skip test_os.test_mode for Emscripten (python#135764)

    ed3aff8

    pythongh-127146: Emscripten: Fix test_open_undecodable_uri by setting…

    77e5568

    pythongh-127146: Report uid in Emscripten + node as native uid (pytho…

    12e988c

    pythongh-127146: Emscripten: Make os.umask() actually work (python#13…

    df3cc4c

    pythongh-127146: Emscripten: more regular stack overflow skips (pytho…

    2d4d697

    pythongh-127146: Emscripten: Don't need to avoid unpaired surrogate a…

    d5e24ba

    pythongh-127146: Emscripten: Set umask to zero in python.sh (python#1…

    72d2fc3

    pythongh-127146: Emscripten: Add test_sample_profiler skips where nee…

    1971537
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    OS-emscriptentestsTests in the Lib/test dir

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions