gh-110152: regrtest handles cross compilation and HOSTRUNNER

[vstinner]

• _add_python_opts() now handles cross compilation and HOSTRUNNER.
• display_header() now tells if Python is cross-compiled, display HOSTRUNNER, and get the host platform.
• Remove Tools/scripts/run_tests.py script.
• Remove "make hostrunnertest": use "make buildbottest" or "make test" instead.

• Issue: regrtest: handle cross compilation and HOSTRUNNER in libregrtest, avoid Tools/scripts/run_tests.py #110152

[vstinner]

!buildbot wasm

[bedevere-bot]

🤖 New build scheduled with the buildbot fleet by @vstinner for commit cd4bf78 🤖

The command will test the builders whose names match following regular expression: wasm

The builders matched are:

• wasm32-emscripten browser (dynamic linking, no tests) PR
• wasm32-wasi PR
• wasm32-emscripten node (pthreads) PR
• wasm32-emscripten node (dynamic linking) PR

[vstinner]

wasm32-emscripten node (pthreads) PR:

make buildbottest 'TESTOPTS=-j2 --junit-xml test-results.xml -j2 ${BUILDBOT_TESTOPTS}' TESTPYTHONOPTS= TESTTIMEOUT=1200 (...) _PYTHON_HOSTRUNNER='/opt/emsdk/node/current/bin/node --experimental-wasm-bigint --experimental-wasm-threads --experimental-wasm-bulk-memory' _PYTHON_PROJECT_BASE=/opt/buildbot/bcannon-wasm/pull_request.bcannon-wasm.emscripten-node-pthreads/build/build_oot/host _PYTHON_HOST_PLATFORM=emscripten-wasm32 PYTHONPATH=/opt/buildbot/bcannon-wasm/pull_request.bcannon-wasm.emscripten-node-pthreads/build/build_oot/host/build/lib.emscripten-wasm32-3.13:../../Lib _PYTHON_SYSCONFIGDATA_NAME=_sysconfigdata__emscripten_wasm32-emscripten ../build/python -m test --slow-ci --timeout=1200 -j2 --junit-xml test-results.xml -j2 + ../build/python -u -W default -bb -m test --slow-ci --timeout=1200 -j2 --junit-xml test-results.xml -j2 --python '/opt/emsdk/node/current/bin/node --experimental-wasm-bigint --experimental-wasm-threads --experimental-wasm-bulk-memory python.js' --dont-add-python-opts == CPython 3.13.0a0 (heads/refs/pull/110156/merge-dirty:752dc07d2d, Sep 30 2023, 20:25:56) [GCC 9.4.0] == Linux-5.15.0-1019-azure-x86_64-with-glibc2.31 little-endian == Python build: release == cwd: /opt/buildbot/bcannon-wasm/pull_request.bcannon-wasm.emscripten-node-pthreads/build/build_oot/host/build/test_python_worker_1799820æ == CPU count: 8 == encodings: locale=UTF-8, FS=utf-8 == resources (10): audio, cpu, curses, decimal, gui, largefile, network, subprocess, urlfetch, walltime == cross compiled: Yes == host python: /opt/emsdk/node/current/bin/node --experimental-wasm-bigint --experimental-wasm-threads --experimental-wasm-bulk-memory python.js == host platform: Emscripten-3.1.22-wasm32-32bit 

wasm32-emscripten node (dynamic linking) PR:

make buildbottest 'TESTOPTS=-j2 --junit-xml test-results.xml -j2 ${BUILDBOT_TESTOPTS}' TESTPYTHONOPTS= TESTTIMEOUT=1200 (...) _PYTHON_HOSTRUNNER='/opt/emsdk/node/current/bin/node --experimental-wasm-bigint' _PYTHON_PROJECT_BASE=/opt/buildbot/bcannon-wasm/pull_request.bcannon-wasm.emscripten-node-dl/build/build_oot/host _PYTHON_HOST_PLATFORM=emscripten-wasm32 PYTHONPATH=/opt/buildbot/bcannon-wasm/pull_request.bcannon-wasm.emscripten-node-dl/build/build_oot/host/build/lib.emscripten-wasm32-3.13:../../Lib _PYTHON_SYSCONFIGDATA_NAME=_sysconfigdata__emscripten_wasm32-emscripten ../build/python -m test --slow-ci --timeout=1200 -j2 --junit-xml test-results.xml -j2 + ../build/python -u -W default -bb -m test --slow-ci --timeout=1200 -j2 --junit-xml test-results.xml -j2 --python '/opt/emsdk/node/current/bin/node --experimental-wasm-bigint python.js' --dont-add-python-opts == CPython 3.13.0a0 (heads/refs/pull/110156/merge-dirty:752dc07d2d, Sep 30 2023, 20:22:43) [GCC 9.4.0] == Linux-5.15.0-1019-azure-x86_64-with-glibc2.31 little-endian == Python build: release == cwd: /opt/buildbot/bcannon-wasm/pull_request.bcannon-wasm.emscripten-node-dl/build/build_oot/host/build/test_python_worker_1786909æ == CPU count: 8 == encodings: locale=UTF-8, FS=utf-8 == resources (10): audio, cpu, curses, decimal, gui, largefile, network, subprocess, urlfetch, walltime == cross compiled: Yes == host python: /opt/emsdk/node/current/bin/node --experimental-wasm-bigint python.js == host platform: Emscripten-3.1.22-wasm32-32bit 

[vstinner]

Oh, wasm32-wasi PR failed on test.pythoninfo:

Checked 106 modules (74 built-in, 0 shared, 19 n/a on wasi-wasm32, 1 disabled, 12 missing, 0 failed on import) wasmtime run --env PYTHONPATH=/build_oot/host/build/lib.wasi-wasm32-3.13:/Lib --mapdir /::../.. -- ./python.wasm -m test.pythoninfo Fatal Python error: _Py_HashRandomization_Init: failed to get random numbers to initialize Python Python runtime state: preinitialized make: *** [Makefile:1990: pythoninfo] Error 1 

[vstinner]

Oh, wasm32-wasi PR failed on test.pythoninfo

Fixed by PR gh-110161.