f#cking spiders

I’ve been interested in the concept of web bots & spiders for a while, finally found time to investigate top level.
Here’s a brief bit of code showing Reddit front page images, will share as I have more