Now we have the file structure like this and
and each zip file contains only 1 file, but some file in zipfile is more than 5GB.
I use the zipfile module in python to unzip them, and it takes 1 hour to unzip a single aip file. How to accelerate the speed? And I want to cut the data into 4 parts as limit by the storage. Any advice will be appreciated! Thanks a lot!