Django / Python: How to start a new process in Python?

Question

After the client uploads the image, I want to resize the image to 8 different sizes, and then send them to S3 and save them in the file system. Obviously, this can take a lot of time (in seconds), and I would like to do it using the “multithreaded” method (I quote this because I don't care if it really is multithreaded or has some other functions). I understand that because of the GIL in Python, you cannot successfully use multithreading for such things because it uses the same process and therefore works exactly the same as if you were doing it in a normal code stream (against multithreading) . Is there any other, better way to open a new process in Python for this kind of task?

Answer 1

If you want to call an external process, use the module subprocess.

If, on the other hand, you want to rotate the GIL and run some Python task, use the module multiprocessing. It provides an interface very similar to a package threading, but uses subprocesses, so you are not bound by GIL restrictions.