gh-109700: fix interp finalization while handling memory error

[kumaraditya303]

• Issue: test_interpreters: test_create_many_threaded() failed on FreeBSD: log: RuntimeError: interpreter creation failed #109700

[kumaraditya303]

!buildbot refleak*

[bedevere-bot]

🤖 New build scheduled with the buildbot fleet by @kumaraditya303 for commit ba1e603 🤖

Results will be shown at:

https://buildbot.python.org/all/#/grid?branch=refs%2Fpull%2F136342%2Fmerge

The command will test the builders whose names match following regular expression: refleak*

The builders matched are:

• AMD64 RHEL8 Refleaks PR
• AMD64 Fedora Rawhide NoGIL refleaks PR
• AMD64 CentOS9 Refleaks PR
• s390x RHEL9 Refleaks PR
• s390x Fedora Stable Refleaks PR
• s390x Fedora Rawhide NoGIL refleaks PR
• s390x Fedora Rawhide Refleaks PR
• PPC64LE CentOS9 Refleaks PR
• aarch64 Fedora Rawhide Refleaks PR
• AMD64 Windows11 Refleaks PR
• PPC64LE Fedora Rawhide Refleaks PR
• AMD64 Fedora Stable Refleaks PR
• PPC64LE Fedora Stable Refleaks PR
• PPC64LE Fedora Rawhide NoGIL refleaks PR
• AMD64 FreeBSD Refleaks PR
• s390x RHEL8 Refleaks PR
• AMD64 Fedora Rawhide Refleaks PR
• aarch64 RHEL8 Refleaks PR
• ARM64 MacOS M1 Refleaks NoGIL PR
• PPC64LE RHEL8 Refleaks PR
• aarch64 CentOS9 Refleaks PR
• AMD64 CentOS9 NoGIL Refleaks PR
• aarch64 Fedora Stable Refleaks PR
• aarch64 Fedora Rawhide NoGIL refleaks PR

[serhiy-storchaka]

LGTM in principle. I afraid that calling Py_EndInterpreter() can introduce other crashes, because more clean up code can now be executed for not yet initialized parts. There are two ways to solve this:

• Make Py_EndInterpreter() super robust.
• Only call these clean up procedures which are necessary after each error.

In any way, it would be better to fix all potential crashes in one go. But if you prefer, you can merge this PR.

[kumaraditya303]

Make Py_EndInterpreter() super robust.

I would prefer to do that, it is better for user code too as it is public API but can be done after this.

[miss-islington-app]

Thanks @kumaraditya303 for the PR 🌮🎉.. I'm working now to backport this PR to: 3.13, 3.14.
🐍🍒⛏🤖

[bedevere-app]

GH-136352 is a backport of this pull request to the 3.14 branch.

[bedevere-app]

GH-136353 is a backport of this pull request to the 3.13 branch.