Scrambling data from Flash (games)

Question

I saw this video, and I'm really curious how it was done. Does anyone have any ideas? My intuition is that he scratched the pixels from the screen (one per “field”), and then submitted it to some program to determine the next move.

Is clearing pixel by pixel a way to do this, or is there a better way? I want to do something similar with Java or Python.

thank

Answer 1

, . , , - , - , -, -, ​​ . "" exe, .

, , , , - , , . , (, ), , () .

, , , . , Tetris , 1:1 , , , - " ", , , , - , .

, , , 3 4 .

Answer 2

, , . , . AI.