Address Sanitizer: libasan dead lock in pthread_create() (test_multiprocessing_fork.test_get() hangs)

[terryjreedy]

BPO	45200
Nosy	@terryjreedy, @vstinner, @pablogsal
PRs	bpo-45020: Don't test IDLE with frozen module. #28344 bpo-45200: Ignore test_multiprocessing_* in ASAN build due to false positives #28492 bpo-45200: GHA Address Sanitizer skips 3 slowest tests #30797
Files	bisect10

^{Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.}

Show more details

GitHub fields:

assignee = None
closed_at = <Date 2022-01-22.18:17:15.960>
created_at = <Date 2021-09-15.04:17:40.678>
labels = ['tests', 'type-bug', 'library', '3.11']
title = 'Address Sanitizer: libasan dead lock in pthread_create() (test_multiprocessing_fork.test_get() hangs)'
updated_at = <Date 2022-01-22.18:17:15.960>
user = 'https://github.com/terryjreedy'

bugs.python.org fields:

activity = <Date 2022-01-22.18:17:15.960>
actor = 'vstinner'
assignee = 'none'
closed = True
closed_date = <Date 2022-01-22.18:17:15.960>
closer = 'vstinner'
components = ['Library (Lib)', 'Tests']
creation = <Date 2021-09-15.04:17:40.678>
creator = 'terry.reedy'
dependencies = []
files = ['50284']
hgrepos = []
issue_num = 45200
keywords = ['patch']
message_count = 15.0
messages = ['401808', '402075', '402085', '402094', '402095', '402097', '402148', '402152', '402155', '402157', '402205', '402223', '402323', '411273', '411274']
nosy_count = 3.0
nosy_names = ['terry.reedy', 'vstinner', 'pablogsal']
pr_nums = ['28344', '28492', '30797']
priority = 'normal'
resolution = 'fixed'
stage = 'resolved'
status = 'closed'
superseder = None
type = 'behavior'
url = 'https://bugs.python.org/issue45200'
versions = ['Python 3.11']

Linked PRs

• gh-89363: Skip threading test_is_alive_after_fork() if ASAN #109835
• [3.12] gh-89363: Skip threading test_is_alive_after_fork() if ASAN (GH-109835) #109855
• [3.11] gh-89363: Skip threading test_is_alive_after_fork() if ASAN (GH-109835) #109856

[terryjreedy]

https://github.com/python/cpython/pull/28344/checks?check_run_id=3605759743
All tests pass until test_multiprocessing_fork timed out after 25 min. On the rerun: refail with timeout.

test_get (test.test_multiprocessing_fork.WithProcessesTestQueue) ... Timeout (0:20:00)!
Thread 0x00007f176a71ebc0 (most recent call first):
File "/home/runner/work/cpython/cpython/Lib/multiprocessing/synchronize.py", line 261 in wait
File "/home/runner/work/cpython/cpython/Lib/multiprocessing/synchronize.py", line 349 in wait
File "/home/runner/work/cpython/cpython/Lib/test/test_multiprocessing.py", line 1001 in test_get
File "/home/runner/work/cpython/cpython/Lib/unittest/case.py", line 549 in _callTestMethod
File "/home/runner/work/cpython/cpython/Lib/unittest/case.py", line 593 in run
File "/home/runner/work/cpython/cpython/Lib/unittest/case.py", line 652 in __call_
File "/home/runner/work/cpython/cpython/Lib/unittest/suite.py", line 122 in run
File "/home/runner/work/cpython/cpython/Lib/unittest/suite.py", line 84 in __call__
File "/home/runner/work/cpython/cpython/Lib/unittest/suite.py", line 122 in run
File "/home/runner/work/cpython/cpython/Lib/unittest/suite.py", line 84 in __call__
File "/home/runner/work/cpython/cpython/Lib/unittest/suite.py", line 122 in run
File "/home/runner/work/cpython/cpython/Lib/unittest/suite.py", line 84 in __call__
File "/home/runner/work/cpython/cpython/Lib/unittest/runner.py", line 206 in run
File "/home/runner/work/cpython/cpython/Lib/test/support/init.py", line 998 in _run_suite
File "/home/runner/work/cpython/cpython/Lib/test/support/init.py", line 1124 in run_unittest
File "/home/runner/work/cpython/cpython/Lib/test/libregrtest/runtest.py", line 261 in _test_module
File "/home/runner/work/cpython/cpython/Lib/test/libregrtest/runtest.py", line 297 in _runtest_inner2
File "/home/runner/work/cpython/cpython/Lib/test/libregrtest/runtest.py", line 340 in _runtest_inner
File "/home/runner/work/cpython/cpython/Lib/test/libregrtest/runtest.py", line 215 in _runtest
File "/home/runner/work/cpython/cpython/Lib/test/libregrtest/runtest.py", line 245 in runtest
File "/home/runner/work/cpython/cpython/Lib/test/libregrtest/main.py", line 337 in rerun_failed_tests
File "/home/runner/work/cpython/cpython/Lib/test/libregrtest/main.py", line 715 in _main
File "/home/runner/work/cpython/cpython/Lib/test/libregrtest/main.py", line 658 in main
File "/home/runner/work/cpython/cpython/Lib/test/libregrtest/main.py", line 736 in main
File "/home/runner/work/cpython/cpython/Lib/test/main.py", line 2 in <module>
File "/home/runner/work/cpython/cpython/Lib/runpy.py", line 86 in _run_code
File "/home/runner/work/cpython/cpython/Lib/runpy.py", line 196 in _run_module_as_main

[vstinner]

test_multiprocessing_fork also failed on the GitHub Action "Address sanitizer" job:
#28419

test_get (test.test_multiprocessing_fork.WithProcessesTestQueue) ... Timeout (0:20:00)!
Thread 0x00007f732679bbc0 (most recent call first):
File "/home/runner/work/cpython/cpython/Lib/multiprocessing/synchronize.py", line 261 in wait
File "/home/runner/work/cpython/cpython/Lib/multiprocessing/synchronize.py", line 349 in wait
File "/home/runner/work/cpython/cpython/Lib/test/_test_multiprocessing.py", line 1001 in test_get

[vstinner]

Sometimes, WithProcessesTestProcess.test_error_on_stdio_flush_1() hangs.

[vstinner]

I'm able to reproduce the issue in a reliable way using attached bisect10 file and the command:

$ ./python -m test test_multiprocessing_fork --timeout=40 -v --matchfile=bisect10
(...)
test_fork (test.test_multiprocessing_fork.WithProcessesTestQueue) ... ok
test_get (test.test_multiprocessing_fork.WithProcessesTestQueue) ... 
Timeout (0:00:40)!
Thread 0x00007fd0552025c0 (most recent call first):
 File "/home/vstinner/python/main/Lib/multiprocessing/synchronize.py", line 261 in wait
 File "/home/vstinner/python/main/Lib/multiprocessing/synchronize.py", line 349 in wait
 File "/home/vstinner/python/main/Lib/test/_test_multiprocessing.py", line 1003 in test_get
(...)

bisect10 contains 68 tests.

[vstinner]

I'm able to reproduce the issue in a reliable way using attached bisect10 file and the command:

I'm talking about a Python built with Address Sanitizer:

$ ./configure --with-address-sanitizer --without-pymalloc
$ make