INTERESTING.JPG: deep-learning AI looking at news photographs

January 26, 2015 1:32 PM

INTERESTING.JPG: deep-learning AI looking at news photographs
@INTERESTING_JPG is a twitter bot that takes news photographs and runs them through a computer-vision caption generating system.

This is powered by a demo from the Universty of Toronto's deep learning group; I've been curious about what a system like this (which "learns" by analyzing a large set of human-captioned images) produces when pointed at images outside of its training set. In a similar vein there is also @NSFW_JPG (WARNING: graphic, unscreened, not safe for humans) which does the same with porn. Matthew Plummer-Fernandez also built off some of my code to create Novice Art Blogger, which uses the same process with images of abstract art.

Role: Creator

posted by cmyr (5 comments total)

This project was posted to MetaFilter by cortex on February 3, 2015: "a picture of a person walking through the sky", and other errors

I really liked Novice Art Blogger. This is fascinating, too!
posted by ignignokt at 4:29 PM on January 26, 2015

OMG - this is great. "a man performing a dance jump on a runway" !

(My day job is the photo editor for the Atlantic, so this tickles me to no end.)
posted by kokogiak at 3:11 PM on January 29, 2015

This is all grand, but I am terrified of clicking the NSFW one.
posted by Literaryhero at 7:55 PM on January 30, 2015

Ok I conquered my fear and the nsfw bot is by far the funniest thing I have seen in ages.
posted by Literaryhero at 7:58 PM on January 30, 2015

This is fantastic!
posted by cortex at 10:10 AM on February 2, 2015