1.6.0: pytest is failing in random units #880

kloczek · 2022-03-28T07:50:49Z

Environment data

OS: Linux x86/64
Python version: 3.8.12

Actual behavior

pytest is failing in random units especially with default parallel (-n8) settings however even if pytest is executed witj -n1 it failf in random units.

Expected behavior

pytest should not fail in random units.

Two samples of pytest summary:

================================================================ xdist: maximum crashed workers reached: 4 =================================================================
========================================================================= short test summary info ==========================================================================
SKIPPED [3] tests/debugpy/test_multiproc.py:480: job objects are specific to Windows
FAILED tests/debugpy/test_args.py::test_args[attach_pid-program] - debugpy.common.messaging.MessageHandlingError: [Errno 104] Connection reset by peer
FAILED tests/debugpy/test_args.py::test_args[attach_pid-module] - debugpy.common.messaging.MessageHandlingError: [Errno 104] Connection reset by peer
FAILED tests/debugpy/test_args.py::test_args[attach_pid-code] - debugpy.common.messaging.NoMoreMessages: No more messages
FAILED tests/debugpy/test_attach.py::test_attach_pid_client[program-int]
FAILED tests/debugpy/test_exception.py::test_systemexit[0---raised-launch(externalTerminal)-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting f...
FAILED tests/debugpy/test_exception.py::test_systemexit[0----attach_pid-module] - debugpy.common.messaging.MessageHandlingError: [Errno 104] Connection reset by peer
FAILED tests/debugpy/test_exception.py::test_systemexit[1-zero-uncaught-raised-attach_pid-program]
FAILED tests/debugpy/test_output.py::test_with_no_output[program-attach_pid]
FAILED tests/debugpy/test_exception.py::test_systemexit[1-zero-uncaught-raised-attach_pid-module]
FAILED tests/debugpy/test_output.py::test_redirect_output[program-enabled-attach_pid] - debugpy.common.messaging.MessageHandlingError: [Errno 104] Connection reset by peer
FAILED tests/debugpy/test_output.py::test_redirect_output[program-disabled-attach_pid]
========================================================== 11 failed, 171 passed, 3 skipped in 470.44s (0:07:50) ===========================================================

================================================================ xdist: maximum crashed workers reached: 4 =================================================================
========================================================================= short test summary info ==========================================================================
SKIPPED [3] tests/debugpy/test_multiproc.py:480: job objects are specific to Windows
FAILED tests/debugpy/test_args.py::test_args[attach_pid-program] - debugpy.common.messaging.NoMoreMessages: No more messages
FAILED tests/debugpy/test_args.py::test_args[attach_pid-module] - debugpy.common.messaging.MessageHandlingError: [Errno 104] Connection reset by peer
FAILED tests/debugpy/test_args.py::test_args[attach_pid-code] - debugpy.common.messaging.MessageHandlingError: [Errno 104] Connection reset by peer
FAILED tests/debugpy/test_attach.py::test_attach_pid_client[program-int]
FAILED tests/debugpy/test_exception.py::test_systemexit[1-zero-uncaught-raised-attach_pid-program]
FAILED tests/debugpy/test_output.py::test_with_no_output[program-attach_pid]
FAILED tests/debugpy/test_exception.py::test_systemexit[1-zero-uncaught-raised-attach_pid-module]
FAILED tests/debugpy/test_output.py::test_redirect_output[program-enabled-attach_pid]
=========================================================== 8 failed, 166 passed, 3 skipped in 435.56s (0:07:15) ===========================================================

When pytest is executed with default -n8 usually fails 3-5 times more units.

int19h · 2022-03-28T20:35:20Z

It doesn't appear to be doing this for me locally, and the pipelines also look good. So either this is something specific to the environment, or it's a race condition triggered by perf differences.

Judging by the list of failing tests, these all have to do with attach-by-PID. If there are any failed tests in the run, the test suite is supposed to keep the log files for those - they'll be under tests/_logs. Could you please share those?

Apteryks · 2022-04-09T21:01:08Z

Hello,

I have a similar result, attempting to package this for GNU Guix. It doesn't matter whether the tests run in a containerized environment or not.

Apteryks · 2022-04-09T21:04:11Z

Perhaps because pydevd appears to have a dependency on the GNU Debugger (GDB), which wasn't obvious and missing in my test environment (it'd also be nice to have that pydevd vendored dependency be turned into a normal python package dependency).

Apteryks · 2022-04-09T21:23:37Z

Yes, after adding GDB the failed tests count is down to 54 for me: ======= 54 failed, 1143 passed, 11 skipped, 1 error in 312.74s (0:05:12) =======.

Apteryks · 2022-04-10T15:25:17Z

24 failures were due to ~~pydevd not having access to /dev/tty~~ the lack of /bin/sh in the Guix containerized build environment (this is Guix-specific, given Guix does not follow the File Hierarchy Standard (FHS) layout). Patching to use sh taken from PATH reduces the failures to:

=========================== short test summary info ============================
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-python-None-None-launch(internalConsole)]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-python-None-None-launch(integratedTerminal)]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-python-None-None-launch(externalTerminal)]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-python-custompy-None-launch(externalTerminal)]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-pythonPath-None-None-launch(integratedTerminal)]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-python-custompy,-O-None-launch(internalConsole)]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-pythonPath-custompy-None-launch(integratedTerminal)]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-pythonPath-None-None-launch(externalTerminal)]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-pythonPath-custompy,-O-None-launch(integratedTerminal)]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-pythonPath-custompy-None-launch(externalTerminal)]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-python-custompy,-O-None-launch(integratedTerminal)]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-pythonPath-custompy,-O-None-launch(externalTerminal)]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-python-custompy,-O-None-launch(externalTerminal)]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-python-custompy-None-launch(internalConsole)]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-python-custompy-None-launch(integratedTerminal)]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-pythonPath-custompy-None-launch(internalConsole)]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-pythonPath-None-None-launch(internalConsole)]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-pythonPath-custompy,-O-None-launch(internalConsole)]
FAILED tests/debugpy/test_multiproc.py::test_autokill[program-launch(integratedTerminal)]
FAILED tests/debugpy/test_multiproc.py::test_autokill[program-launch(internalConsole)]
FAILED tests/debugpy/test_flask.py::test_flask_breakpoint_multiproc[launch]
FAILED tests/debugpy/test_flask.py::test_flask_breakpoint_no_multiproc[launch-code]
FAILED tests/debugpy/test_multiproc.py::test_autokill[program-launch(externalTerminal)]
FAILED tests/debugpy/test_multiproc.py::test_autokill_nodebug[program-launch(integratedTerminal)]
FAILED tests/debugpy/test_multiproc.py::test_autokill_nodebug[program-launch(internalConsole)]
FAILED tests/debugpy/test_flask.py::test_flask_breakpoint_no_multiproc[launch-template]
FAILED tests/debugpy/test_flask.py::test_flask_template_exception_no_multiproc[launch]
FAILED tests/debugpy/test_multiproc.py::test_autokill_nodebug[program-launch(externalTerminal)]
FAILED tests/debugpy/test_flask.py::test_flask_exception_no_multiproc[launch-unhandled]
FAILED tests/debugpy/test_flask.py::test_flask_exception_no_multiproc[launch-handled]
=========== 30 failed, 1167 passed, 11 skipped in 265.26s (0:04:25) ============

Apteryks · 2022-04-10T18:21:43Z

Updating flask from 2.0.2 to 2.1.1 further reduced the test failures to:

=========================== short test summary info ============================
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-python-None-None-launch(internalConsole)]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-python-None-None-launch(integratedTerminal)]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-python-None-None-launch(externalTerminal)]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-python-custompy-None-launch(externalTerminal)]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-pythonPath-None-None-launch(integratedTerminal)]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-python-custompy,-O-None-launch(internalConsole)]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-pythonPath-custompy-None-launch(integratedTerminal)]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-pythonPath-None-None-launch(externalTerminal)]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-pythonPath-custompy-None-launch(externalTerminal)]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-pythonPath-custompy,-O-None-launch(integratedTerminal)]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-python-custompy,-O-None-launch(integratedTerminal)]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-python-custompy-None-launch(internalConsole)]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-pythonPath-custompy,-O-None-launch(externalTerminal)]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-python-custompy,-O-None-launch(externalTerminal)]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-python-custompy-None-launch(integratedTerminal)]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-pythonPath-custompy-None-launch(internalConsole)]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-pythonPath-None-None-launch(internalConsole)]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-pythonPath-custompy,-O-None-launch(internalConsole)]
FAILED tests/debugpy/test_multiproc.py::test_autokill[program-launch(integratedTerminal)]
FAILED tests/debugpy/test_multiproc.py::test_autokill[program-launch(internalConsole)]
FAILED tests/debugpy/test_multiproc.py::test_autokill[program-launch(externalTerminal)]
FAILED tests/debugpy/test_multiproc.py::test_autokill_nodebug[program-launch(integratedTerminal)]
FAILED tests/debugpy/test_multiproc.py::test_autokill_nodebug[program-launch(internalConsole)]
FAILED tests/debugpy/test_multiproc.py::test_autokill_nodebug[program-launch(externalTerminal)]
=========== 24 failed, 1173 passed, 11 skipped in 157.25s (0:02:37) ============

Out of these 24 failures, 6 only occur when run in a the containerized build environment:

FAILED tests/debugpy/test_multiproc.py::test_autokill[program-launch(integratedTerminal)]
FAILED tests/debugpy/test_multiproc.py::test_autokill[program-launch(internalConsole)]
FAILED tests/debugpy/test_multiproc.py::test_autokill[program-launch(externalTerminal)]
FAILED tests/debugpy/test_multiproc.py::test_autokill_nodebug[program-launch(integratedTerminal)]
FAILED tests/debugpy/test_multiproc.py::test_autokill_nodebug[program-launch(internalConsole)]
FAILED tests/debugpy/test_multiproc.py::test_autokill_nodebug[program-launch(externalTerminal)]

New logs attached.
logs.tar.gz

Apteryks · 2022-04-12T15:32:45Z

I've traced the root of the problem to an error importing debugpy in the launcher:

D+00000.296: Launcher[1] --> {
                 "seq": 4,
                 "type": "event",
                 "event": "output",
                 "body": {
                     "category": "stderr",
                     "output": "  File \"/tmp/pytest-of-maxim/pytest-227/test_nodebug_program_launch_in0/code_to_debug.py\", line 2, in <module>\n    from debuggee import backchannel\n  File \"/home/maxim/src/debugpy/tests/DEBUGGEE_PYTHONPATH/debuggee/backchannel.py\", line 18, in <module>\n    from debugpy.common import fmt, log, messaging\nModuleNotFoundError: No module named 'debugpy'\n"
                 }
             }

At the time the test run in my packaging debugpy is already installed to the system location made avaible via GUIX_PYTHONPATH (which gets picked up by Guix's own sitecustomize.py, part of the Python base install). It seems debugpy is messing up with PYTHONPATH, as I can reproduce the failure in the checkout with just export PYTHONPATH=src && pytest tests/debugpy/test_run.py -k internalConsole.

Copying the built package to ~/.local/lib/python3.9/site-packages/ also allows the test to pass.

int19h · 2022-04-12T19:23:10Z

Are you running the tests using tox? We had some tests that ended up implicitly relying on tox env setup (which includes PYTHONPATH tweaking), and would break if running pytest directly. And test_nodebug was one of those: #342

Apteryks · 2022-04-12T19:25:07Z

Hmm, so I don't think I'll get to the bottom of this, but here are my final findings:

A PYTHONPATH (or a distro/user sitecustomize.py, etc.) discovered debugpy leads to these failures (non-containerized environment):

======================================== short test summary info =========================================
FAILED tests/debugpy/test_run.py::test_nodebug[program-launch(internalConsole)]
FAILED tests/debugpy/test_run.py::test_nodebug[program-launch(integratedTerminal)]
FAILED tests/debugpy/test_run.py::test_nodebug[program-launch(externalTerminal)]
FAILED tests/debugpy/test_multiproc.py::test_autokill_nodebug[program-launch(internalConsole)]
FAILED tests/debugpy/test_multiproc.py::test_autokill_nodebug[program-launch(integratedTerminal)]
FAILED tests/debugpy/test_multiproc.py::test_autokill_nodebug[program-launch(externalTerminal)]
========================= 6 failed, 1191 passed, 11 skipped in 187.39s (0:03:07) =========================

This seems to be load sensitive, as it varies between machines and with the count of processes given to xdist; here's with -n1 on the same machine (previous was with -n24):

============================================================================================= short test summary info ==============================================================================================
FAILED tests/debugpy/test_multiproc.py::test_autokill_nodebug[program-launch(internalConsole)]
FAILED tests/debugpy/test_run.py::test_nodebug[program-launch(internalConsole)]
FAILED tests/debugpy/test_multiproc.py::test_autokill_nodebug[program-launch(integratedTerminal)]
FAILED tests/debugpy/test_run.py::test_nodebug[program-launch(integratedTerminal)]
FAILED tests/debugpy/test_multiproc.py::test_autokill_nodebug[program-launch(externalTerminal)]
============================================================================== 5 failed, 1045 passed, 5 skipped in 1682.52s (0:28:02) ==============================================================================

Combined with the Guix build environment (a minimal chroot/container), the failures bubble up to:

=========================== short test summary info ============================                                                                                                                                    
FAILED tests/debugpy/test_multiproc.py::test_autokill[program-launch(internalConsole)]                    ]                                                                                                         
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-pythonPath-custompy,-O-None-launch(internalConsole)]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-pythonPath-custompy,-O-None-launch(integratedTerminal)]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-pythonPath-custompy,-O-None-launch(externalTerminal)]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-python-None-None-launch(internalConsole)]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-python-None-None-launch(integratedTerminal)]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-python-None-None-launch(externalTerminal)]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-python-custompy-None-launch(internalConsole)]                                                                                                     D 
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-python-custompy-None-launch(integratedTe [rminal)]                                                                                                  SS
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-python-custompy-None-launch(externalTermSEinal)]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-python-custompy,-O-None-launch(internalCD onsole)]                                                                                                   [
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-python-custompy,-O-None-launch(integrateD dTerminal)]                                                                                                [
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-python-custompy,-O-None-launch(externalTerminal)]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-pythonPath-None-None-launch(internalCons[ ole)]                                                                                                      1
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-pythonPath-None-None-launch(integratedTeEDrminal)]                                                                                                  D 
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-pythonPath-None-None-launch(externalTerm [inal)]                                                                                                    [ 
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-pythonPath-custompy-None-launch(internal]Console)]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-pythonPath-custompy-None-launch(integrat]edTerminal)]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-pythonPath-custompy-None-launch(external%]Terminal)]                                                                                                ]
FAILED tests/debugpy/test_multiproc.py::test_autokill[program-launch(integratedTerminal)]                 %]
FAILED tests/debugpy/test_multiproc.py::test_autokill[program-launch(externalTerminal)]                   ]
FAILED tests/debugpy/test_multiproc.py::test_autokill_nodebug[program-launch(integratedTerminal)]
FAILED tests/debugpy/test_multiproc.py::test_autokill_nodebug[program-launch(internalConsole)]
FAILED tests/debugpy/test_multiproc.py::test_autokill_nodebug[program-launch(externalTerminal)]           19
=========== 24 failed, 1172 passed, 11 skipped in 808.62s (0:13:28) ============

The problem doesn't occur when run in tox.

Apteryks · 2022-04-12T19:28:44Z

Hey @int19h, thanks, that seems related indeed! However even when setting PYTHONPATH to an absolute directory it still fails, e.g. PYTHONPATH=$PWD/src pytest -n24 tests:

================================================ FAILURES ================================================
_______________________________________ tests/debugpy/test_run.py ________________________________________
[gw22] linux -- Python 3.9.9 /gnu/store/fby6l226w8kh2mwkzpjpajmgy0q1kxli-python-wrapper-3.9.9/bin/python
worker 'gw22' crashed while running 'tests/debugpy/test_run.py::test_nodebug[module-launch(integratedTerminal)]'
_______________________________________ tests/debugpy/test_run.py ________________________________________
[gw9] linux -- Python 3.9.9 /gnu/store/fby6l226w8kh2mwkzpjpajmgy0q1kxli-python-wrapper-3.9.9/bin/python
worker 'gw9' crashed while running 'tests/debugpy/test_run.py::test_nodebug[module-launch(externalTerminal)]'
======================================== short test summary info =========================================
FAILED tests/debugpy/test_run.py::test_nodebug[module-launch(integratedTerminal)]
FAILED tests/debugpy/test_run.py::test_nodebug[module-launch(externalTerminal)]
========================= 2 failed, 1195 passed, 11 skipped in 69.33s (0:01:09) ==========================

Apteryks · 2022-04-12T19:38:29Z

OK, last data point; avoiding parallel tests (xdist) completely resolves the failures:

[env]$ rm pytest.ini
[env]$ PYTHONPATH=$PWD/src pytest tests/debugpy/test_{run,multiproc}.py
========================================== test session starts ===========================================
platform linux -- Python 3.9.9, pytest-6.2.5, py-1.10.0, pluggy-0.13.1
rootdir: /home/mcournoyer/src/debugpy
plugins: hypothesis-6.0.2, timeout-2.0.2, xdist-2.1.0, forked-1.3.0, cov-3.0.0
collected 209 items                                                                                      

tests/debugpy/test_run.py ................................

My suggestion would be to include the tests in the debugpy module; they already are organized as modules (having __init__.py files, which goes against the recommended pytest layout when tests are standalone -- c.f. https://docs.pytest.org/en/6.2.x/goodpractices.html#choosing-a-test-layout-import-rules). Having them part of the debugpy module would probably mean the whole directory would be copied without problems when using xdist.

int19h · 2022-04-12T20:45:04Z

The tests package is a package largely because it has quite a lot of helpers that the tests need to be able to import and use (Session etc), but which is strictly for tests, not for product code. So it hosts all those alongside with the actual tests.

I guess this could all become debugpy.tests tho. And if that enables toxless runs, it's something we should definitely consider.

int19h · 2022-04-12T20:49:25Z

Oh, I remember now - it was because having the tests separate means that they can be easily run against different versions of the package.

BTW, note that the recommended pytest layouts do in fact include a separate directory with packages in it, specifically in a section that covers tox ("In this situation, it is strongly suggested to use a src layout where application root package resides in a sub-directory of your root"). In fact, I believe that's where we originally got it from.

Going forward, we'll likely move to "importlib" pytest mode, making full use of namespaced tests.

Apteryks · 2022-04-13T00:35:45Z

Oh, I see; I had overlooked that part about tox and the src/ subdirectory, thanks for pointing it out. Running tests against multiple versions seems a bit niche but nice to have!

kloczek · 2022-06-29T17:47:21Z

If it is already fixed is it possible to make new release? 🤔

kloczek · 2022-07-06T22:22:00Z

Just tested 1.6.1 and now much more units are failing mostly by time outs.

========================================================================= short test summary info ==========================================================================
SKIPPED [5] tests/debugpy/test_multiproc.py:48: https://github.com/microsoft/ptvsd/issues/1887
SKIPPED [3] tests/debugpy/test_multiproc.py:476: job objects are specific to Windows
SKIPPED [3] tests/debugpy/test_run.py:233: Skipped
ERROR tests/__init__.py - FileNotFoundError: [Errno 2] No such file or directory: '/home/tkloczko/rpmbuild/BUILD/debugpy-1.6.1/tests/_logs/3.8-64/tests/debugpy/test_run....
FAILED tests/debugpy/test_args.py::test_args[attach_pid-code] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to connect.
FAILED tests/debugpy/test_args.py::test_args[attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to connect.
FAILED tests/debugpy/test_args.py::test_args[attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to connect.
FAILED tests/debugpy/test_attach.py::test_attach_pid_client[program-int] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to connect.
FAILED tests/debugpy/test_attach.py::test_attach_pid_client[program-str] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to connect.
FAILED tests/debugpy/test_django.py::test_django_breakpoint_no_multiproc[launch-template] - AssertionError: assert True == ('template' == 'code'
FAILED tests/debugpy/test_exception.py::test_systemexit[0---raised-attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server...
FAILED tests/debugpy/test_django.py::test_django_exception_no_multiproc[launch-handled]
FAILED tests/debugpy/test_django.py::test_django_exception_no_multiproc[launch-unhandled]
FAILED tests/debugpy/test_django.py::test_django_template_exception_no_multiproc[launch]
FAILED tests/debugpy/test_django.py::test_django_breakpoint_multiproc[launch]
FAILED tests/debugpy/test_exception.py::test_systemexit[1-zero-uncaught--attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug...
FAILED tests/debugpy/test_exception.py::test_success_exitcodes[django--3-attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug...
FAILED tests/debugpy/test_exception.py::test_systemexit[1--uncaught-raised-attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for deb...
FAILED tests/debugpy/test_exception.py::test_success_exitcodes[--0-attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug serve...
FAILED tests/debugpy/test_exception.py::test_systemexit[0----attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to c...
FAILED tests/debugpy/test_exception.py::test_success_exitcodes[django-break_on_system_exit_zero-0-attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Ti...
FAILED tests/debugpy/test_exception.py::test_systemexit[1-zero-uncaught--attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug ...
FAILED tests/debugpy/test_input.py::test_stdin_not_patched[program--attach_pid] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to co...
FAILED tests/debugpy/test_django.py::test_django_breakpoint_no_multiproc[launch-code]
FAILED tests/debugpy/test_exception.py::test_success_exitcodes[django--3-attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug ...
FAILED tests/debugpy/test_exception.py::test_systemexit[1--uncaught-raised-attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debu...
FAILED tests/debugpy/test_exception.py::test_success_exitcodes[--0-attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server...
FAILED tests/debugpy/test_exception.py::test_systemexit[0----attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to co...
FAILED tests/debugpy/test_exception.py::test_success_exitcodes[django-break_on_system_exit_zero-0-attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Tim...
FAILED tests/debugpy/test_input.py::test_stdin_not_patched[program-redirect_output-attach_pid] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for deb...
FAILED tests/debugpy/test_exception.py::test_systemexit[1-zero--raised-attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug s...
FAILED tests/debugpy/test_log.py::test_log_dir_env[program-attach_pid] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to connect.
FAILED tests/debugpy/test_exception.py::test_success_exitcodes[-break_on_system_exit_zero-0-attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed ou...
FAILED tests/debugpy/test_exception.py::test_systemexit[1--uncaught--attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug ser...
FAILED tests/debugpy/test_exception.py::test_success_exitcodes[--3-attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug serve...
FAILED tests/debugpy/test_exception.py::test_success_exitcodes[django-break_on_system_exit_zero-3-attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Ti...
FAILED tests/debugpy/test_exception.py::test_systemexit[1-zero-uncaught-raised-attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for...
FAILED tests/debugpy/test_exception.py::test_systemexit[1-zero--raised-attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug se...
FAILED tests/debugpy/test_input.py::test_input[program--attach_pid] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to connect.
FAILED tests/debugpy/test_exception.py::test_success_exitcodes[-break_on_system_exit_zero-0-attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out...
FAILED tests/debugpy/test_exception.py::test_systemexit[1--uncaught--attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug serv...
FAILED tests/debugpy/test_exception.py::test_success_exitcodes[--3-attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server...
FAILED tests/debugpy/test_exception.py::test_success_exitcodes[django-break_on_system_exit_zero-3-attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Tim...
FAILED tests/debugpy/test_exception.py::test_systemexit[1-zero-uncaught-raised-attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for ...
FAILED tests/debugpy/test_log.py::test_log_dir_env[module-attach_pid] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to connect.
FAILED tests/debugpy/test_input.py::test_input[program-redirect_output-attach_pid] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to...
FAILED tests/debugpy/test_exception.py::test_systemexit[1-zero---attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server ...
FAILED tests/debugpy/test_exception.py::test_systemexit[nan----attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to...
FAILED tests/debugpy/test_log.py::test_log_dir_env[code-attach_pid] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to connect.
FAILED tests/debugpy/test_exception.py::test_success_exitcodes[-break_on_system_exit_zero-3-attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed ou...
FAILED tests/debugpy/test_exception.py::test_systemexit[1---raised-attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug serve...
FAILED tests/debugpy/test_exception.py::test_success_exitcodes[django--0-attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug...
FAILED tests/debugpy/test_exception.py::test_systemexit[1-zero---attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server t...
FAILED tests/debugpy/test_exception.py::test_systemexit[nan----attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to ...
FAILED tests/debugpy/test_exception.py::test_success_exitcodes[-break_on_system_exit_zero-3-attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out...
FAILED tests/debugpy/test_exception.py::test_systemexit[1---raised-attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server...
FAILED tests/debugpy/test_exception.py::test_success_exitcodes[django--0-attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug ...
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-python-None-None-launch(internalConsole)] - assert [0, 1] == [False, False]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-python-None-None-launch(integratedTerminal)] - assert [0, 1] == [False, False]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-python-None-None-launch(externalTerminal)] - assert [0, 1] == [False, False]
FAILED tests/debugpy/test_output.py::test_with_no_output[program-attach_pid] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to connect.
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-python-custompy-None-launch(internalConsole)] - assert [0, 1] == [False, False]
FAILED tests/debugpy/test_output.py::test_redirect_output[program-disabled-attach_pid] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug serve...
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-python-custompy-None-launch(integratedTerminal)] - assert [0, 1] == [False, False]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-python-custompy-None-launch(externalTerminal)] - assert [0, 1] == [False, False]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-pythonPath-custompy,-O-None-launch(internalConsole)] - assert [1, 1] == [True, False]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-pythonPath-custompy,-O-None-launch(integratedTerminal)] - assert [1, 1] == [True, False]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-pythonPath-custompy,-O-None-launch(externalTerminal)] - assert [1, 1] == [True, False]
FAILED tests/debugpy/test_flask.py::test_flask_breakpoint_no_multiproc[launch-code]
FAILED tests/debugpy/test_run.py::test_run[code-attach_pid] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to connect.
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-python-custompy,-O-None-launch(internalConsole)] - assert [1, 1] == [True, False]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-python-custompy,-O-None-launch(integratedTerminal)] - assert [1, 1] == [True, False]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-python-custompy,-O-None-launch(externalTerminal)] - assert [1, 1] == [True, False]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-pythonPath-None-None-launch(internalConsole)] - assert [0, 1] == [False, False]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-pythonPath-None-None-launch(integratedTerminal)] - assert [0, 1] == [False, False]
FAILED tests/debugpy/test_run.py::test_nodebug[module-launch(integratedTerminal)]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-pythonPath-None-None-launch(externalTerminal)] - assert [0, 1] == [False, False]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-pythonPath-custompy-None-launch(internalConsole)] - assert [0, 1] == [False, False]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-pythonPath-custompy-None-launch(integratedTerminal)] - assert [0, 1] == [False, False]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-pythonPath-custompy-None-launch(externalTerminal)] - assert [0, 1] == [False, False]
FAILED tests/debugpy/test_output.py::test_redirect_output[program-enabled-attach_pid] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server...
FAILED tests/debugpy/test_run.py::test_frame_eval[-code-attach_pid] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to connect.
FAILED tests/debugpy/test_run.py::test_frame_eval[-program-attach_pid] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to connect.
FAILED tests/debugpy/test_run.py::test_run[program-attach_pid] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to connect.
FAILED tests/debugpy/test_run.py::test_frame_eval[yes-code-attach_pid] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to connect.
FAILED tests/debugpy/test_run.py::test_frame_eval[no-module-attach_pid] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to connect.
FAILED tests/debugpy/test_exception.py::test_systemexit[0--uncaught--attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug ser...
FAILED tests/debugpy/test_run.py::test_frame_eval[yes-program-attach_pid] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to connect.
FAILED tests/debugpy/test_run.py::test_frame_eval[-module-attach_pid] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to connect.
FAILED tests/debugpy/test_run.py::test_run[module-attach_pid] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to connect.
FAILED tests/debugpy/test_exception.py::test_systemexit[0-zero-uncaught-raised-attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for...
FAILED tests/debugpy/test_run.py::test_frame_eval[no-program-attach_pid] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to connect.
FAILED tests/debugpy/test_exception.py::test_systemexit[0---raised-attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug serve...
FAILED tests/debugpy/test_run.py::test_frame_eval[no-code-attach_pid] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to connect.
FAILED tests/debugpy/test_exception.py::test_systemexit[nan-zero--raised-attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug...
FAILED tests/debugpy/test_exception.py::test_systemexit[0-zero-uncaught--attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug...
FAILED tests/debugpy/test_run.py::test_frame_eval[yes-module-attach_pid] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to connect.
FAILED tests/debugpy/test_exception.py::test_systemexit[nan-zero---attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug serve...
FAILED tests/debugpy/test_exception.py::test_systemexit[nan-zero-uncaught--attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debu...
FAILED tests/debugpy/test_exception.py::test_systemexit[nan-zero--raised-attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug ...
FAILED tests/debugpy/test_exception.py::test_systemexit[0-zero--raised-attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug s...
FAILED tests/debugpy/test_exception.py::test_systemexit[nan-zero---attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server...
FAILED tests/debugpy/test_exception.py::test_systemexit[1----attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to c...
FAILED tests/debugpy/test_exception.py::test_systemexit[0-zero---attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server ...
FAILED tests/debugpy/test_exception.py::test_systemexit[nan-zero-uncaught-raised-attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting f...
FAILED tests/debugpy/test_exception.py::test_systemexit[nan-zero-uncaught--attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for deb...
FAILED tests/debugpy/test_exception.py::test_systemexit[0-zero-uncaught-raised-attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for ...
FAILED tests/debugpy/test_exception.py::test_systemexit[0-zero---attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server t...
FAILED tests/debugpy/test_exception.py::test_systemexit[1----attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to co...
FAILED tests/debugpy/test_exception.py::test_systemexit[0--uncaught-raised-attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for deb...
FAILED tests/debugpy/test_exception.py::test_systemexit[nan-zero-uncaught-raised-attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting fo...
FAILED tests/debugpy/test_exception.py::test_systemexit[0-zero-uncaught--attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug ...
FAILED tests/debugpy/test_exception.py::test_systemexit[0--uncaught-raised-attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debu...
FAILED tests/debugpy/test_exception.py::test_systemexit[nan--uncaught--attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug se...
FAILED tests/debugpy/test_exception.py::test_systemexit[nan--uncaught--attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug s...
FAILED tests/debugpy/test_exception.py::test_systemexit[nan--uncaught-raised-attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for d...
FAILED tests/debugpy/test_exception.py::test_systemexit[0-zero--raised-attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug se...
FAILED tests/debugpy/test_exception.py::test_systemexit[0--uncaught--attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug serv...
FAILED tests/debugpy/test_run.py::test_nodebug[module-launch(externalTerminal)]
FAILED tests/debugpy/test_exception.py::test_systemexit[nan---raised-attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug ser...
FAILED tests/debugpy/test_exception.py::test_systemexit[nan---raised-attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug serv...
FAILED tests/debugpy/test_exception.py::test_systemexit[nan--uncaught-raised-attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for de...
FAILED tests/debugpy/test_flask.py::test_flask_breakpoint_no_multiproc[launch-template]
FAILED tests/debugpy/test_flask.py::test_flask_template_exception_no_multiproc[launch]
FAILED tests/debugpy/test_flask.py::test_flask_exception_no_multiproc[launch-handled]
FAILED tests/debugpy/test_gevent.py::test_gevent[program-launch]
FAILED tests/debugpy/test_flask.py::test_flask_exception_no_multiproc[launch-unhandled]
FAILED tests/debugpy/test_flask.py::test_flask_breakpoint_multiproc[launch]
==================================================== 124 failed, 1062 passed, 11 skipped, 1 error in 593.64s (0:09:53) =====================================================

kloczek · 2022-07-08T04:59:16Z

Looks like 1.6.2 is failing in the same units

========================================================================= short test summary info ==========================================================================
SKIPPED [5] tests/debugpy/test_multiproc.py:48: https://github.com/microsoft/ptvsd/issues/1887
SKIPPED [3] tests/debugpy/test_multiproc.py:476: job objects are specific to Windows
SKIPPED [3] tests/debugpy/test_run.py:233: Skipped
FAILED tests/debugpy/test_args.py::test_args[attach_pid-code] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to connect.
FAILED tests/debugpy/test_args.py::test_args[attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to connect.
FAILED tests/debugpy/test_args.py::test_args[attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to connect.
FAILED tests/debugpy/test_attach.py::test_attach_pid_client[program-int] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to connect.
FAILED tests/debugpy/test_attach.py::test_attach_pid_client[program-str] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to connect.
FAILED tests/debugpy/test_django.py::test_django_breakpoint_no_multiproc[launch-template] - AssertionError: assert True == ('template' == 'code'
FAILED tests/debugpy/test_exception.py::test_systemexit[0---raised-attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server...
FAILED tests/debugpy/test_django.py::test_django_exception_no_multiproc[launch-unhandled]
FAILED tests/debugpy/test_django.py::test_django_exception_no_multiproc[launch-handled]
FAILED tests/debugpy/test_django.py::test_django_template_exception_no_multiproc[launch]
FAILED tests/debugpy/test_django.py::test_django_breakpoint_multiproc[launch]
FAILED tests/debugpy/test_exception.py::test_systemexit[1-zero-uncaught--attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug...
FAILED tests/debugpy/test_exception.py::test_systemexit[1--uncaught-raised-attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for deb...
FAILED tests/debugpy/test_exception.py::test_systemexit[0----attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to c...
FAILED tests/debugpy/test_exception.py::test_success_exitcodes[django-break_on_system_exit_zero-0-attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Ti...
FAILED tests/debugpy/test_input.py::test_input[program-redirect_output-attach_pid] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to...
FAILED tests/debugpy/test_exception.py::test_systemexit[1-zero-uncaught--attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug ...
FAILED tests/debugpy/test_exception.py::test_success_exitcodes[-break_on_system_exit_zero-0-attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed ou...
FAILED tests/debugpy/test_django.py::test_django_breakpoint_no_multiproc[launch-code]
FAILED tests/debugpy/test_exception.py::test_systemexit[1--uncaught-raised-attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debu...
FAILED tests/debugpy/test_exception.py::test_systemexit[0----attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to co...
FAILED tests/debugpy/test_exception.py::test_success_exitcodes[django-break_on_system_exit_zero-0-attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Tim...
FAILED tests/debugpy/test_exception.py::test_success_exitcodes[-break_on_system_exit_zero-0-attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out...
FAILED tests/debugpy/test_log.py::test_log_dir_env[code-attach_pid] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to connect.
FAILED tests/debugpy/test_exception.py::test_systemexit[1-zero--raised-attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug s...
FAILED tests/debugpy/test_exception.py::test_systemexit[1--uncaught--attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug ser...
FAILED tests/debugpy/test_log.py::test_log_dir_env[program-attach_pid] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to connect.
FAILED tests/debugpy/test_exception.py::test_success_exitcodes[django-break_on_system_exit_zero-3-attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Ti...
FAILED tests/debugpy/test_exception.py::test_systemexit[1-zero-uncaught-raised-attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for...
FAILED tests/debugpy/test_exception.py::test_systemexit[1-zero--raised-attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug se...
FAILED tests/debugpy/test_exception.py::test_success_exitcodes[-break_on_system_exit_zero-3-attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed ou...
FAILED tests/debugpy/test_flask.py::test_flask_breakpoint_no_multiproc[launch-code]
FAILED tests/debugpy/test_exception.py::test_systemexit[1--uncaught--attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug serv...
FAILED tests/debugpy/test_exception.py::test_success_exitcodes[django-break_on_system_exit_zero-3-attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Tim...
FAILED tests/debugpy/test_exception.py::test_systemexit[1-zero-uncaught-raised-attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for ...
FAILED tests/debugpy/test_exception.py::test_success_exitcodes[-break_on_system_exit_zero-3-attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out...
FAILED tests/debugpy/test_log.py::test_log_dir_env[module-attach_pid] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to connect.
FAILED tests/debugpy/test_run.py::test_run[module-attach_pid] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to connect.
FAILED tests/debugpy/test_exception.py::test_systemexit[1-zero---attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server ...
FAILED tests/debugpy/test_exception.py::test_systemexit[nan----attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to...
FAILED tests/debugpy/test_exception.py::test_systemexit[1---raised-attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug serve...
FAILED tests/debugpy/test_exception.py::test_success_exitcodes[django--0-attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug...
FAILED tests/debugpy/test_exception.py::test_systemexit[1-zero---attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server t...
FAILED tests/debugpy/test_run.py::test_run[code-attach_pid] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to connect.
FAILED tests/debugpy/test_exception.py::test_systemexit[nan----attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to ...
FAILED tests/debugpy/test_exception.py::test_success_exitcodes[--0-attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug serve...
FAILED tests/debugpy/test_output.py::test_redirect_output[program-disabled-attach_pid] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug serve...
FAILED tests/debugpy/test_exception.py::test_systemexit[1---raised-attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server...
FAILED tests/debugpy/test_run.py::test_nodebug[module-launch(integratedTerminal)]
FAILED tests/debugpy/test_exception.py::test_success_exitcodes[django--0-attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug ...
FAILED tests/debugpy/test_exception.py::test_success_exitcodes[--0-attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server...
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-pythonPath-custompy-None-launch(internalConsole)] - assert [0, 1] == [False, False]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-pythonPath-custompy-None-launch(integratedTerminal)] - assert [0, 1] == [False, False]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-pythonPath-custompy-None-launch(externalTerminal)] - assert [0, 1] == [False, False]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-pythonPath-custompy,-O-None-launch(internalConsole)] - assert [1, 1] == [True, False]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-pythonPath-custompy,-O-None-launch(integratedTerminal)] - assert [1, 1] == [True, False]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-pythonPath-custompy,-O-None-launch(externalTerminal)] - assert [1, 1] == [True, False]
FAILED tests/debugpy/test_output.py::test_with_no_output[program-attach_pid] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to connect.
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-python-None-None-launch(internalConsole)] - assert [0, 1] == [False, False]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-python-None-None-launch(integratedTerminal)] - assert [0, 1] == [False, False]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-python-None-None-launch(externalTerminal)] - assert [0, 1] == [False, False]
FAILED tests/debugpy/test_run.py::test_frame_eval[-code-attach_pid] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to connect.
FAILED tests/debugpy/test_run.py::test_run[program-attach_pid] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to connect.
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-python-custompy-None-launch(internalConsole)] - assert [0, 1] == [False, False]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-python-custompy-None-launch(integratedTerminal)] - assert [0, 1] == [False, False]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-python-custompy-None-launch(externalTerminal)] - assert [0, 1] == [False, False]
FAILED tests/debugpy/test_exception.py::test_success_exitcodes[django--3-attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug...
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-python-custompy,-O-None-launch(internalConsole)] - assert [1, 1] == [True, False]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-python-custompy,-O-None-launch(integratedTerminal)] - assert [1, 1] == [True, False]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-python-custompy,-O-None-launch(externalTerminal)] - assert [1, 1] == [True, False]
FAILED tests/debugpy/test_exception.py::test_success_exitcodes[--3-attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug serve...
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-pythonPath-None-None-launch(internalConsole)] - assert [0, 1] == [False, False]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-pythonPath-None-None-launch(integratedTerminal)] - assert [0, 1] == [False, False]
FAILED tests/debugpy/test_run.py::test_custom_python_args[program-pythonPath-None-None-launch(externalTerminal)] - assert [0, 1] == [False, False]
FAILED tests/debugpy/test_run.py::test_frame_eval[-program-attach_pid] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to connect.
FAILED tests/debugpy/test_run.py::test_frame_eval[no-code-attach_pid] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to connect.
FAILED tests/debugpy/test_run.py::test_frame_eval[yes-program-attach_pid] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to connect.
FAILED tests/debugpy/test_run.py::test_frame_eval[yes-code-attach_pid] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to connect.
FAILED tests/debugpy/test_exception.py::test_success_exitcodes[django--3-attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug ...
FAILED tests/debugpy/test_output.py::test_redirect_output[program-enabled-attach_pid] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server...
FAILED tests/debugpy/test_exception.py::test_success_exitcodes[--3-attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server...
FAILED tests/debugpy/test_run.py::test_frame_eval[-module-attach_pid] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to connect.
FAILED tests/debugpy/test_run.py::test_frame_eval[yes-module-attach_pid] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to connect.
FAILED tests/debugpy/test_run.py::test_frame_eval[no-program-attach_pid] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to connect.
FAILED tests/debugpy/test_exception.py::test_systemexit[0-zero-uncaught--attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug...
FAILED tests/debugpy/test_exception.py::test_systemexit[0-zero-uncaught-raised-attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for...
FAILED tests/debugpy/test_exception.py::test_systemexit[nan-zero-uncaught--attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debu...
FAILED tests/debugpy/test_exception.py::test_systemexit[nan-zero---attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug serve...
FAILED tests/debugpy/test_exception.py::test_systemexit[0-zero--raised-attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug s...
FAILED tests/debugpy/test_run.py::test_frame_eval[no-module-attach_pid] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to connect.
FAILED tests/debugpy/test_exception.py::test_systemexit[1----attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to c...
FAILED tests/debugpy/test_exception.py::test_systemexit[nan-zero---attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server...
FAILED tests/debugpy/test_exception.py::test_systemexit[nan-zero--raised-attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug...
FAILED tests/debugpy/test_exception.py::test_systemexit[0-zero---attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server ...
FAILED tests/debugpy/test_exception.py::test_systemexit[nan-zero-uncaught-raised-attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting f...
FAILED tests/debugpy/test_exception.py::test_systemexit[nan-zero-uncaught--attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for deb...
FAILED tests/debugpy/test_exception.py::test_systemexit[1----attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to co...
FAILED tests/debugpy/test_exception.py::test_systemexit[nan-zero--raised-attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug ...
FAILED tests/debugpy/test_exception.py::test_systemexit[0-zero-uncaught--attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug ...
FAILED tests/debugpy/test_exception.py::test_systemexit[nan-zero-uncaught-raised-attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting fo...
FAILED tests/debugpy/test_exception.py::test_systemexit[0--uncaught-raised-attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debu...
FAILED tests/debugpy/test_exception.py::test_systemexit[0--uncaught-raised-attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for deb...
FAILED tests/debugpy/test_exception.py::test_systemexit[0-zero--raised-attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug se...
FAILED tests/debugpy/test_exception.py::test_systemexit[0--uncaught--attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug serv...
FAILED tests/debugpy/test_exception.py::test_systemexit[0--uncaught--attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug ser...
FAILED tests/debugpy/test_exception.py::test_systemexit[nan--uncaught-raised-attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for de...
FAILED tests/debugpy/test_exception.py::test_systemexit[0-zero-uncaught-raised-attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for ...
FAILED tests/debugpy/test_exception.py::test_systemexit[nan--uncaught-raised-attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for d...
FAILED tests/debugpy/test_exception.py::test_systemexit[nan--uncaught--attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug s...
FAILED tests/debugpy/test_exception.py::test_systemexit[0-zero---attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server t...
FAILED tests/debugpy/test_exception.py::test_systemexit[0---raised-attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug serve...
FAILED tests/debugpy/test_exception.py::test_systemexit[nan--uncaught--attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug se...
FAILED tests/debugpy/test_exception.py::test_systemexit[nan---raised-attach_pid-program] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug ser...
FAILED tests/debugpy/test_input.py::test_stdin_not_patched[program--attach_pid] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to co...
FAILED tests/debugpy/test_exception.py::test_systemexit[nan---raised-attach_pid-module] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug serv...
FAILED tests/debugpy/test_run.py::test_nodebug[module-launch(externalTerminal)]
FAILED tests/debugpy/test_input.py::test_stdin_not_patched[program-redirect_output-attach_pid] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for deb...
FAILED tests/debugpy/test_input.py::test_input[program--attach_pid] - debugpy.common.messaging.MessageHandlingError: Timed out waiting for debug server to connect.
FAILED tests/debugpy/test_flask.py::test_flask_breakpoint_no_multiproc[launch-template]
FAILED tests/debugpy/test_flask.py::test_flask_template_exception_no_multiproc[launch]
FAILED tests/debugpy/test_flask.py::test_flask_exception_no_multiproc[launch-handled]
FAILED tests/debugpy/test_flask.py::test_flask_exception_no_multiproc[launch-unhandled]
FAILED tests/debugpy/test_flask.py::test_flask_breakpoint_multiproc[launch]
FAILED tests/debugpy/test_gevent.py::test_gevent[program-launch]
========================================================= 124 failed, 1062 passed, 11 skipped in 526.75s (0:08:46) =========================================================

int19h · 2022-07-08T09:02:13Z

Again, I see a lot of attach-by-PID tests failing, which is certainly not something that shows up in any of the pipelines, so it's likely to be specific to your environment. More tests might be failing for you now because we've re-enabled native code optimizations by default.

I think there's something going on here that basically causes all the native code helpers to not work - weird libc version, perhaps? What kind of Linux are you running?

Also, can you check that /proc/sys/kernel/yama/ptrace_scope is set to 0? Attach-to-PID cannot work otherwise.

kloczek · 2022-07-08T09:07:43Z

[tkloczko@devel-g2v SPECS]$ cat /proc/sys/kernel/yama/ptrace_scope
0

More tests might be failing for you now because we've re-enabled native code optimizations by default.

Please don't things like that.
Hardcoding optomisttion flags and/or ignore what is passed in $CFLAGS. $CXXFLAGS, $LDFLAGS is packagers like me one of the biggest nightmares.

If it is anything what I can try to do to diagnose that issue please let me know.

fabioz · 2022-07-08T10:31:06Z

More tests might be failing for you now because we've re-enabled native code optimizations by default.
Please don't things like that.

This is done at the debugger level meaning that we're using the frame evaluation by default when possible (which is the fastest debugger level, but it needs additional machinery and not just the plain tracing... also, it needs to do some bytecode manipulation and native extensions, so, it's more complex in general) -- this was once enabled by default and was disabled due to a bug and it's now enabled by default again-- i.e.: 1b568ab

-- you can still set PYDEVD_USE_FRAME_EVAL to 0 to force running without it if you want.

int19h added the test issue Test failures and other issues with test runs and CI. label Apr 13, 2022

int19h closed this as completed Jun 22, 2022

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

1.6.0: pytest is failing in random units #880

1.6.0: pytest is failing in random units #880

kloczek commented Mar 28, 2022

int19h commented Mar 28, 2022

Apteryks commented Apr 9, 2022 •

edited

Loading

Apteryks commented Apr 9, 2022 •

edited

Loading

Apteryks commented Apr 9, 2022

Apteryks commented Apr 10, 2022 •

edited

Loading

Apteryks commented Apr 10, 2022

Apteryks commented Apr 12, 2022 •

edited

Loading

int19h commented Apr 12, 2022

Apteryks commented Apr 12, 2022

Apteryks commented Apr 12, 2022

Apteryks commented Apr 12, 2022

int19h commented Apr 12, 2022

int19h commented Apr 12, 2022

Apteryks commented Apr 13, 2022

kloczek commented Jun 29, 2022

kloczek commented Jul 6, 2022

kloczek commented Jul 8, 2022

int19h commented Jul 8, 2022

kloczek commented Jul 8, 2022

fabioz commented Jul 8, 2022

1.6.0: pytest is failing in random units #880

1.6.0: pytest is failing in random units #880

Comments

kloczek commented Mar 28, 2022

Environment data

Actual behavior

Expected behavior

int19h commented Mar 28, 2022

Apteryks commented Apr 9, 2022 • edited Loading

Apteryks commented Apr 9, 2022 • edited Loading

Apteryks commented Apr 9, 2022

Apteryks commented Apr 10, 2022 • edited Loading

Apteryks commented Apr 10, 2022

Apteryks commented Apr 12, 2022 • edited Loading

int19h commented Apr 12, 2022

Apteryks commented Apr 12, 2022

Apteryks commented Apr 12, 2022

Apteryks commented Apr 12, 2022

int19h commented Apr 12, 2022

int19h commented Apr 12, 2022

Apteryks commented Apr 13, 2022

kloczek commented Jun 29, 2022

kloczek commented Jul 6, 2022

kloczek commented Jul 8, 2022

int19h commented Jul 8, 2022

kloczek commented Jul 8, 2022

fabioz commented Jul 8, 2022

Apteryks commented Apr 9, 2022 •

edited

Loading

Apteryks commented Apr 9, 2022 •

edited

Loading

Apteryks commented Apr 10, 2022 •

edited

Loading

Apteryks commented Apr 12, 2022 •

edited

Loading