Monday, August 01, 2011

bejeweled blitz bot

His code scrapes the screen image as input.  Identifies all of the game pieces then plays the game.

http://hackaday.com/2011/07/30/bejeweled-blitz-bot-makes-your-high-score-look-just-sad/

Screen Scraping is  capturing the screen as a source of still images as input, almost like video.
Then image processing is applied to identify all of the game pieces. This is then used to play the game and inject mouse clicks in to the event queue as if a user had click on the game.

Brilliant work, First time I've seen this done for Flash.  It's an old technique we used it at Well Fargo to get data out of the old IBM 3270 Dumb terminal screens to import in to Unix.

No comments: