Zipfile lib overwrites the extra field during closing when the archive size is more then ZIP64_LIMIT

[shaanbhaya]

BPO	44067
Nosy	@Yhg1s, @serhiy-storchaka
Files	zip_bug.zip

^{Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.}

Show more details

GitHub fields:

assignee = None
closed_at = None
created_at = <Date 2021-05-07.08:18:55.383>
labels = ['type-bug', '3.8', '3.9', '3.10', '3.11', '3.7', 'library']
title = 'Zipfile lib overwrites the extra field during closing when the archive size is more then ZIP64_LIMIT'
updated_at = <Date 2021-11-07.00:34:59.007>
user = 'https://bugs.python.org/shaanbhaya'

bugs.python.org fields:

activity = <Date 2021-11-07.00:34:59.007>
actor = 'anadius'
assignee = 'none'
closed = False
closed_date = None
closer = None
components = ['Library (Lib)']
creation = <Date 2021-05-07.08:18:55.383>
creator = 'shaanbhaya'
dependencies = []
files = ['50025']
hgrepos = []
issue_num = 44067
keywords = []
message_count = 3.0
messages = ['393178', '393179', '405760']
nosy_count = 5.0
nosy_names = ['twouters', 'alanmcintyre', 'serhiy.storchaka', 'shaanbhaya', 'anadius']
pr_nums = []
priority = 'normal'
resolution = None
stage = None
status = 'open'
superseder = None
type = 'behavior'
url = 'https://bugs.python.org/issue44067'
versions = ['Python 3.6', 'Python 3.7', 'Python 3.8', 'Python 3.9', 'Python 3.10', 'Python 3.11']

Linked PRs

• gh-88233: zipfile: handle extras after a zip64 extra #96161
• gh-88233: zipfile: refactor _strip_extra #102083
• gh-88233: zipfile: refactor _strip_extra #102084
• [3.11] gh-88233: zipfile: handle extras after a zip64 extra (GH-96161) #102086
• [3.10] gh-88233: zipfile: handle extras after a zip64 extra (GH-96161) #102087

[shaanbhaya]

The current zipFile implementation supports the allowZip64,which can make large zip files.
There is a bug in the current implementation of close method, where the extra field is overwritten.

To reproduce it:

1. Create a directory with more then 4 GB of data(spread over many files).
2. Make the zip of those files using the any rar achiever which adds NTFS metadata (mtime, atime, and ctime) of files in the zip.
3. Append a new file to the zip using the zip library .

When I open the zip again, the files processed after the ZIP64_LIMIT is reached will have their extra fields overwritten.

I have attached the zip that contained the python used to add the new file and the images of zip archive before adding new files and after.