Janelle Shane+ Your Authors @JanelleCShane I blog at aiweirdness.com/. My book "You Look Like a Thing and I Love You" is out Nov 5th! Research Scientist in optics. she/her. wandering.shop/@janellecshane Oct. 14, 2019 1 min read + Your Authors

Need a Halloween costume idea? Here are some ideas generated by a neural net

In 2017 I tried to generate Halloween costumes with a neural net that didn't have any prior knowledge of English words. Its costumes often made no damn sense.

In 2018 I tried generating Halloween costumes with a slightly bigger dataset, but the neural net still couldn't do more than remix letter combinations.

But @susanthesquark of @nytimes arranged for a Professional Illustrator & Jessia Ma nailed it:

My 2019 Halloween costume attempt uses the same dataset, but a neural net (GPT-2-355M) that has picked up a lot of context from the internet.

This is most obvious here. It grabbed words like bitcoin & titmouse that weren't in the example costumes. Compare to 2017 (conchpaper??)

When I increase neural net sampling temperature, the output conforms less closely to the training data.

In 2017/2018 that meant more nonsense words.

The 2019 neural net reverts to its internet training data, introducing more Game of Thrones, Frozen, and racism. Oh, internet.

It is super interesting to see the form chaos takes in a small vs huge neural net.

Unfiltered text from 2017 char-rnn vs 2019 GPT-2, both trained on the same dataset of halloween costumes & sampled at chaotic 1.4 temperature.

reverting to nonsense vs to celebrity references

i have been looking for an excuse to post this and it's friday night so

You can follow @JanelleCShane.


Tip: mention @threader_app on a Twitter thread with the keyword “compile” to get a link to it.

Enjoy Threader? Sign up.

Since you’re here...

... we’re asking visitors like you to make a contribution to support this independent project. In these uncertain times, access to information is vital. Threader gets 1,000,000+ visits a month and our iOS Twitter client was featured as an App of the Day by Apple. Your financial support will help two developers to keep working on this app. Everyone’s contribution, big or small, is so valuable. Support Threader by becoming premium or by donating on PayPal. Thank you.

Follow Threader