Sudowrite: Steadily better at failing

Thanks to the artificial intelligence of Sudowrite, my story of a reluctant and reclusive Dark Lord turned into an instant romantasy.

Sudowrite, the original Artificial Intelligence writing assistant, has picked up new tricks since last I tested it. The most impressive is the ability to import manuscripts in common formats like text, rich text format, or Microsoft Word format. (Not yet PDF, unfortunately.) While importing the text, it will create an outline and populate its “story bible” (a collection of the places, people, and key events mentioned in the manuscript). It even tries to make notes about the local culture and religion, if given enough information, and about magic if writing fantasy. This extraction of information is pretty impressive. You can see that artificial intelligence has become more capable.

All the more disappointing, then, that it fails miserably at the next logical steps in the process. Letting it do any heavy lifting in the writing process will inevitably lead to a parody of the book one would reasonably expect to read.

***

For instance, I imported the first three chapters of a fantasy novel in which an introverted and cynical young atheist is transported to a fantasy world, where he gains dark powers patterned on those in City of Heroes. (The comparison to the game is not mentioned in the text.) Like in the game, these powers are not inherently evil and are mainly used for defense, though they will damage enemies that come too close. There was some fantasy worldbuilding, like dungeons and magical rifts leaking magic and monsters into the world. Sudowrite correctly read through the manuscript and created entries for the places, people, and powers (although I think naming the unnamed town “Crack Town” was going a bit too far…)

Unfortunately, Sudowrite decided to complete the story by adding three more chapters which deviated greatly from the original text in both tone and style. The two supporting characters disappeared without a trace; instead, we got a rapidly budding romance with the young woman he rescued from the dungeon. His introversion and wariness around people were replaced with a longing for acceptance and the normalcy of family life. A hurried magical confrontation with the minor bad guy (now a supervillain) led the book toward its premature conclusion.

***

Don’t get me wrong, I was amused the whole time. The highest quality writing available from Sudowrite (so far) is good for a barrel of laughs, although if you don’t drink beer (as I don’t) you may want to read it late at night to get the most out of the involuntary comedy.

Artificial Intelligence may be a threat to some professional artists and musicians. But as long as Sudowrite is the closest we come to automating the writing process, I think writers can feel safe for a couple of years yet. If I live and find the time, I shall try to keep you updated.

Sudowrite scores a new point

Not a G.I.R.L. (Guy In Real Life) – illustration loosely based on the female main character of my test project.

This week, I tested Sudowrite on a project that should be hard for an automaton without real intelligence: A modern romantic comedy that takes place partly in an online roleplaying game and partly in real life. The online character has a different name, appearance, and behavior from the physical player. Mixing these up should be really easy if you don’t actually understand the text, and would be catastrophic for the storytelling. In this story, there is actually a hint of a third layer, as the female main character is a woman both offline and online, but online claims to be a man in real life to avoid sexual harassment.

To my amazement, the artificial intelligence was quite good at keeping track of dual identities. There was the occasional slip-up with the female character, whose online name (Manilla) was similar to her real name (Magnhild). I have still not found any such confusion with the male main character, who is more different in both name and appearance from his character. As expected, the AI seems to have given up on the subplot of the female in real life whose female online character pretended to be male in real life. Hey, I am not even sure if you, noble reader, can wrap your head around this without effort. Probably, if you’re here in the first place. But the AI seems to have just decided to skip it, and I can’t blame it. I am impressed it did as well as it did.

***

The other problems remain. The AI is amazing at making a chapter-by-chapter outline of the whole novel, but struggles with getting from chapter to scene. In one of the early chapters, it wrote the same scene three times in a row but slightly different each time. It goes through an intermediate stage called story beats, and these are short and fairly generic by default. You can go in and heavily edit and expand them to avoid this kind of slip-up, but it is clear that the AI struggles with the process of creating a scene from its own story beats. This is kind of ironic, since you would think it was easier for it to write a good scene based on its own story beats rather than those of another, but the opposite is true. Rewriting the story beats constitutes by far most of the work of creating an AI draft with Sudowrite. I am not impressed with the prose either, but it is not outright embarrassing like the scene composition. It is low-grade commercial prose, I’d say. Like the Amazon novels that cost $0.99 to $1.99. If you want to sell for $2.99, you should probably write better.

But my message today was actually meant to be positive. I am impressed that an AI can keep track of dual identities reliably. Online romance is not the only category where this would be useful. Superhero stories usually feature secret identities, and so may spy stories and shapeshifter stories like werewolf or vampire supernatural romance or drama. I guess the AI has been trained with so many books that it recognizes this trope innately.

***

If there are still people who have read my immense archives, they may recall that I made fun of early versions of the speech recognition Dragon NaturallySpeaking, comparing it to a homesick high school exchange student for its limited command of the English language. But a few years later it would pick up my Scandinavian-accented English better than some native English speakers. I fully expect something similar to happen to AI writing tools. They may be involuntarily amusing now, but in a few years – if we manage to avoid a global disaster – they may surpass amateur writers like me in pretty much every aspect.