Run php script from php script without blocking

Question

I create a spider that will navigate through various sites and their intellectual analysis.

Since I need to get each page separately, it can take a VERY long time (maybe 100 pages). I already set set_time_limit to 2 minutes per page, but it seems that apache will kill the script in 5 minutes no matter what.

This is usually not a problem, as it will work from cron or something similar that does not have this time limit. However, I would also like administrators to be able to run the selection manually through the HTTP interface.

It doesn't matter if apache is maintained for the full duration, I am going to use AJAX to start fetching and validation after a while using AJAX.

My problem is how to start fetching from a PHP script without completing the extraction at the end of the script call.

Maybe I could use a system ('script.php &'), but I'm not sure if this will do the trick. Any other ideas?

Answer 1

$cmd = "php myscript.php $params > /dev/null 2>/dev/null &"; # when we call this particular command, the rest of the script # will keep executing, not waiting for a response shell_exec($cmd); 

What this means is sending all STDOUT and STDERR to / dev / null, and your script continues to run. Even if the "parent" script ends before myscript.php, myscript.php will exit.

Answer 2

If you do not want to use exec, you can use the built-in php function!

 ignore_user_abort(true); 

this will tell the script to resume even if the connection between the browser and the server is removed;)