Janelle Shane @JanelleCShane Research Scientist in optics. Plays with neural networks. Avid reader, writer, and player of Irish flute. she/her. wandering.shop/@janellecshane Jul. 05, 2019 1 min read

nothing to worry about. it's only mutant fly strains invented by a neural net

the neural net's most intense fly mutants are a bit beyond my artistic abilities but I would love to know what they look like

the neural net's task was to add to a list of 4 example mutations. This is the 1st task where I've seen a noticeable difference between 117M and 345M GPT-2. 117M doesn't get it. (via  https://minimaxir.com/apps/gpt2-small/ )
The larger 345M often manages. (via  http://talktotransformer.com )

here's what another neural net, Grover, does when prompted to generate fruit fly mutants. Here the prompt is different since I just gave it the article titles, so Grover is free to do more elaborate descriptions.
(via  https://grover.allenai.org/ )

You can follow @JanelleCShane.


Tip: mention @threader_app on a Twitter thread with the keyword “compile” to get a link to it.

Enjoy Threader? Sign up.

Threader is an independent project created by only two developers. The site gets 500,000+ visits a month and our iOS Twitter client was featured as an App of the Day by Apple. Running this space is expensive and time consuming. If you find Threader useful, please consider supporting us to make it a sustainable project.