Browsed by
Category: Uncategorized

ChatGPT is changing the game

ChatGPT is changing the game

Recently, I was writing about the great changes brought upon by two events in the mid-1400s: firstly, the fall of Constantinople and, secondly, the European (re-)invention of the movable-type printing press by Johannes Gutenberg.

Whereas the fall of Constantinople has a well-defined date—29 May 1453—it is hard to say when the innovation of the printing press in itself took place. Gutenberg is known to have worked on his concept for more than a decade before his Magnum Opus was printed: the Gutenberg 42-line Bible, known as the first known book to be printed using mass-produced movable metal type in Europe. Unfortunately, it has no specific publishing date; we only know that finished copies were available in 1454-55.

When it comes to Natural Language Generation, though, the history books of the future may propose a very specific date when the game was changed regarding mankind’s use of written language: 30 November 2022.

Sure — many still see ChatGPT and its underlying technology as a toy and laugh at its shortcomings. But, as the Nobel Prize winner Bob Dylan once wrote, “it will soon shake your windows and rattle your walls”. Personally, I am just as fascinated as I am disgusted and just as curious as I am scared.

 

 

How to Live with the Robots –  a reflection by a professional writer

How to Live with the Robots –  a reflection by a professional writer

The text robots are here, bringing significant disruption, for better or for worse. Services based on Natural Language Generation, NLG, are popping up like mushrooms on the web—automated news writing, computer-generated product descriptions, and tools for creative writing are just some of the applications. The time has come for human writers to ask themselves: ”What makes my texts so unique compared to the output from well-written algorithms and powerful machine learning”?

To be honest, I didn’t see this coming. But, sitting at the computer typing away, I get distracted by a disturbing thought. Although I have been a paid writer for three decades, a little voice in my head keeps asking this stinging question: “Would this writing task be performed better by a text robot?”

What I am referring to is a digital tool—or AI, model, robot, or whatever you choose to call it – which produces natural language. State of the art is stunning: in all kinds of genres, the text generators are spewing out tailor-made texts which are perfectly coherent and icy logical, with no errors whatsoever when it comes to spelling and grammar. Undoubtedly, this technology has climbed out of its cradle and is entering the commercial arena – not toddling but rather swaggering across the floorboards.

Automated writing = skillful writing?

Accordingly, a growing number of companies are serving their customers with tools for automatic text generation. Here are some examples:

  • Game reports in sports
  • Weather forecasts
  • Real estate descriptions
  • Product copy
  • Financial reports, and analysis

When it comes to this kind of content, the reader doesn’t expect any creativity or “out-of-the-box thinking”–quite the contrary! The British writing consultant Susannah Ross once wrote that ”Effective writing is writing that does its job.” Thus, for these texts to serve their purpose, they should be brief, well-structured, and written in clear, plain language. 

The writing coach within me doesn’t have much to put up against this. Reluctant as I may be, I have to admit that this new generation of clever text algorithms is apparently based on the same writing type of instructions and advice I am trying to convey during workshops and courses. As a matter of fact, I am very much for boilerplate-based communication! In the box below, there is an example of a manual protocol that ”mechanically” gives a useful output in a reliable way. It would be straightforward to demonstrate a similar recipe for a press release or a web page.

The elevator pitch—using a pre-NLG “manual algorithm”

I often give courses about practical communication skills to early-career scientists and young entrepreneurs, and one of the most popular topics is ”The elevator pitch.” During the research for this article, I realized that I had used an approach similar to the one you use for automated, data- and questionnaire-based journalism and marketing.

This is what the protocol looks like:

1. Regarding your project, reply to the following questions. (Be spontaneous and don’t think about the purpose or the end result!):

  • What is it about?
  • What problems does it solve?
  • How is it different?
  • Why should I care?

2. Go and fetch a coffee and sit down with your replies. Edit them into a coherent text, about 100 words long.

3. Read your written text aloud and make the changes needed to give it some personality and some flow. 

4. Congratulations – you now have a text you can use not only as an elevator pitch but also as a LinkedIn summary or a bio! (Of course, you should always adopt the text for any new context in which it is used.)

Acknowledgment: the method described here is based on the teachings of the American communication coach Carmine Gallo, for example, in his book Presentation Secrets of Steve Jobs (2009).

 

GPT-3 brings “creativity” to automated writing

But how about creative writing? With this, I mean texts that should show a particular style, tonality, or originality to fulfill their purpose. For example, it could be a cover letter that should mirror the applicant’s personality in order to land them their job. Or it could be marketing or PR copy that should affect the feelings and attitudes of the reader—and ultimately, the reader’s behavior. What about literature? Would it be possible to automize the generation of customized romance novels, where the reader is the love object, or weekly episodes of a never-ending fantasy series, where the reader has designed the main characters like in an RPG (role-playing game)? To explore these questions (as time is still too early for proper answers), we must bring GPT-3 to the discussion. 

You’ve probably heard about GPT-3. This digital super toy from OpenAI—a California-based AI research and deployment company—has created quite a rave since its launch in May 2020. The acronym stands for ’Generative Pre-trained Transformer 3’, which doesn’t say much to most people. Techies would describe it as an “autoregressive language model that uses deep learning to produce human-like text.”

Basically, GPT-3 works like this. If you feed it with a prompt, for example, a couple of sentences, it will return sentence after sentence of natural language. As the model thoroughly has studied how humans tend to combine words in millions of example texts, the output will, in many cases, be flawlessly well-written and make perfect sense. 

Hence, the first minutes with freeform GPT-3 exercises are mind-blowing for text professionals. If you simulate a conversation, it will return interesting replies which are eerily human-like. If you use a piece of Eliot’s or Dickinson’s poetry as the prompt, something surprisingly engaging will emerge. If you add marketing copy, GPT-3 will play the role of a gifted junior colleague delivering the first drafts, ready for human refinement.

However, the problem with GPT-3 soon breaks the surface of this river of words and stares us in the face. The darn thing is not only a chatterbox but a compulsory liar. Without hesitation, it makes statements that are just not true. It’s a beast, no doubt about it, but a beast that should be shackled – just as the Norse gods put a magical chain around the neck of the monstrous Fenrir wolf.

Some useful yet ethical ways of using natural language technology

There is no doubt that NLP technologies in general (where “P” stands for “processing—see fact box) are very useful for professional writers. As a matter of fact, we use it all the time, for instance, when we let Google or Facebook translate other’s web pages or our own snippets of text. Another example is when typing assistants like Grammarly review spelling, punctuation, grammar, clarity, and engagement.

NLP – a caleidoscope of applications

NLP, Natural language processing, is “a subfield of linguistics, computer science, and artificial intelligence concerned with the interactions between computers and human language” (Wikipedia). It is often divided into NLU, where “U” stands for “Understanding,” and NLG, where “G” stands for ”Generation.”

NLP has become a vast area when it comes to applications:

  • Autocompletion & -correction
  • Grammar checkers
  • Voice assistants
  • Information search 
  • Translation
  • Data mining
  • Chatbots
  • Automated journalism
  • Targeted advertising
  • Text analytics & summarization
  • Social media monitoring
  • Recruitment
  • and so on …

 

Here are some situations—wherein my personal opinion—text robots can be our friends without us crossing any lines regarding neither work ethics nor professional dignity.

Just putting the words together.
Probably, there are very few writers who feel passionate about writing standardized texts where the data and information are served from the beginning, the format is set, the style should lack all traces of personality, and no creative initiatives are allowed. Accordingly, I do not see it as a sign of a decaying civilization if we let robots write weather reports, product descriptions, and commonplace local news.

Rewriting short fact texts.
Let’s be honest: as writers, we all need to write short captions or dry fact boxes sometimes, where the most effective way to proceed is to copy-paste from a trusted source and just knead the prose a little so that your version clearly differs from the original. Personally, I think it would be ok to let a text robot do these kinds of tasks as the texts in question are there just to convey facts and not to bring along a style, an attitude, or a story.

Creating varieties of headers, slogans, and taglines
Some of the new tools are designed to spew out a number of different versions of the same text snippet. This can, for example, be used for brainstorming suggestions for headers or to perform so-called A/B testing of an internet advertisement (“Which alternative, A or B, gives the highest number of clicks?”)

Paraphrasing styles
Let’s say you need placeholder text in the form of sloppy business writing or teenager lingo in social media. Here, text robots can serve as intelligent boilerplate text (“lorem ipsum”) generators.

Literary inspiration and exploration
For centuries, authors have experimented with different ways to create poetry, prose, and drama. A number of these experimental methods are based on imitation, appropriation, free associations (sometimes under the influence of drugs), and so-called aleatoricism – that is, artistic compositions resulting from “actions made by chance.” An example of the latter is the so-called cut-up technique, in which a book page is cut up with a pair of scissors and rearranged in new ways. Obviously, authors and artists will find new ways to create literature and art with NLP-based technology.

Getting ready to face change

As of 2022, how should we, professional writers, approach this development? Obviously, it is hard to make any confident predictions as we are rushing into uncharted territory with a few similar scenarios from history to learn from. In addition,  the professional discourse still is restricted within the tech field, and the practical and professional body of experience is minimal. Still, I dare to contribute my 50 cents in the form of some reflections.

Automated texts will be a part of everyday life. We will read a lot of texts written by robots without knowing it; the output of a well-programmed NLG system may just be as clear and structured as a text written by a rushed junior at a news office – if not better!

There will be a tidal wave of shallow and pointless “content.” Marketers and SEO consultants will boost their output of texts that pull us into some kind of sales funnel. Probably there will soon be tools that on a day-by-day basis can spot trending subjects in the same way as, for example, Twitter spots trending hashtags. From these observations, the device can instantly collect text material from all over the web and put together utterly short-lived articles that no one cares about, but many skim-read anyway.

Plagiarism will explode. NLG tools make it extremely easy to rewrite texts—same factual content, same structure, and disposition, but everything reordered and re-formulated. This will be a nightmare for a number of professions—from journalists to university teachers.  

We will get rid of poorly translated product descriptions. As any speaker of a small language has noted, many web shops use poor machine translation from English instead of proper sales copy and item descriptions. Hopefully, the customer experience will be enhanced by automated product descriptions generated by language-specific algorithms.

For the human writer, who takes pride in being a person of letters, style, clarity, and knowledge, the message should be: “Get ready to change your mindset!” NLP technology will not go away, but it will change the way you look at different types of text assignments. To end this on a positive note, I think NLP can serve the same purpose as the lamp-based pacing system used in athletics: to perform at our best, we must make sure that we keep at least one step ahead of technology. 

So, be open-minded and keep learning new tools & techniques. In addition, stay eager to define, produce & identify quality. Your most enviable traits as a skilled writer are still tough to imitate: a context-based sense of style, purposeful imagination, and sound judgment at all times. And perhaps most important of all: being a human writer, you also understand the human reader – the person we all serve in the end.

Thanks to:

  • Jakob Klöfver, Cowrite, and Jonas Jaani for valuable explanations and enlightening discussion. 



NO ROBOTS

Please note: all texts on this blog are produced by me, Olle Bergman, and invited human writers. The only AI-based language tool used is Grammarly – the smartest typing assistant you can imagine. When robot-written sections are added to serve as examples or to demonstrate a point, this is clearly indicated.

“We have weaved a 2000-year rhetorical tradition into our algorithm” – an interview with Magnus Paues, co-founder of Cowrite

“We have weaved a 2000-year rhetorical tradition into our algorithm” – an interview with Magnus Paues, co-founder of Cowrite

Stockholm-based Cowrite has created an NLG platform for what they call “augmented writing”. Their Cover Letter Builder, which is founded on wisdom from classical rhetoric, has been quite a success; according to one of the biggest clients, their users get employed 48 days faster than average.

Friends, contacts, and students who follow me, know that I am energized by the forcefield between tradition and novelty, between the enduring and the disruptive. Or as Swedish poet Gunnar Ekelöf once put it: “Det bestående är bra. Oppositionen mot det bestående är bra.” (‘The established is good. The opposition towards the established is good.”). Accordingly, I am fascinated by the way the NLG-focused tech companies are creating alliances between, on the one hand, computer techies and, on the other hand, linguists and rhetoricians.

After studying Cowrite’s template-based Cover Letter Builder and finding it very cool, I got in touch with co-founder Magnus Paues for some questions.

Hi Magnus! Please tell me the background story about Cowrite!
Cowrite started in 2014 with the objective to solve the problem of writer’s block. So much content is written in the world every day, and so many people think it is really hard. We wanted to provide a service to help them overcome the obstacles. We started out with real estate ads and recruitment ads and added cover letters and CVs after the outbreak of Covid-19.

What is your most popular service today, and why?
By far, it is our Cover Letter Builder that is the most popular service. It is provided in both English and Swedish, thus directed to a huge market. And, it solves a big problem. People, in general, seem to have an issue with describing themselves in a positive way. Also, few people know how to structure a text in order for it to be sold. Our Cover Letter Builder helps them with that.

Please tell me how the Cover Letter Builder came to be!
In March 2020, the world came to change in a very short time with the outbreak of Covid-19. Momentarily (thank god), our existing business areas more or less stopped dead in their tracks and we needed to find an alternative that produced revenue quickly. We realized that the unemployment rates rose, and therefore also the need for people to get help with job applications. We released the service to the Swedish and international markets in May 2020. And, wow, what a journey we were in for. Even with our former business areas back on their feet, the Cover Letter Builder came to be our biggest business area, and it just keeps on growing.

How does the CLB work from a user perspective?
Easy! The user answers questions about herself/himself, chooses tonality, and the cover letter magically appears in the adjacent document, in real-time. The cover letter is divided into text blocks that can be varied, which means that no two cover letters will be alike. The user can, of course, edit the text anytime in the process.

Please tell me about the structure of the letter created and how it is connected to classical rhetoric.
We have weaved a 2000-year rhetorical tradition into our algorithm, which means the text will be structured in the classical rhetoric disposition. The user’s cover letter will be built on the same building bricks that Aristotle used to persuade his fellow Greek citizens to believe whatever he had in mind when he woke up on a particular day. In short, the text has a background, an introduction, a statement of facts, arguments (proof of the fact), and a conclusion.

How do you think services like this will influence professional life and society in general? What do you see in the crystal ball in, for example, ten years?
I think there will be a lot of really great, automatically written content out there. Regarding cover letters: I think that our service will render cover letters obsolete in the long run. Today, cover letters are generally used as a “Sorting Hat” for candidates who can’t write. Many jobs don’t require writing skills, but your writing skills (or lack thereof) are what makes you miss or gain your opportunity. I think our service will make recruiters realize that the interview is the only forum where they can make a real assessment of a candidate since all cover letters will be absolutely perfect. So, less discrimination and more interaction, that’s what we aim for in the long run.

Please note: all texts on this blog are produced by me, Olle Bergman, and invited human writers. The only AI-based language tool used is Grammarly. When robot-written sections are added to serve as examples or to demonstrate a point, this is clearly indicated.

Some links for the participants of TIPPA 2022 (24–25 March)

Some links for the participants of TIPPA 2022 (24–25 March)

For the third time in a row, I was a presenter at the yearly TIPPA meeting, which is The Annual International Publication Planning Meeting. This time, I gave a brief overview of what’s happening in the NLG field and tried to analyze how this development will affect us, our professions, and the society we live in.

For this presentation, I picked out three companies as interesting examples:

  • Sweden-based United Robots because it has quickly become an exciting player on both sides of the Atlantic, not least in the field of automated journalism.
  • Sweden-based Cowrite as I find their cover letter builder intriguing; with a template based on classical rhetoric, it has apparently proved itself effective.
  • Germany-based AX Semantics as they are one of the companies that are focusing on the pharmaceutical sector. For example, they claim that 30% of the work on clinical study reports can now be automated.

I welcome all participants to stay in touch, perhaps even drop me a line! Take care! //O.

Some starting points

NLG in Pharma

Some companies that are working on NLG-based tools and solutions for the pharmaceutical field:

NLG services for science writing

Using NLG services for literature review

 

Please note: all texts on this blog are produced by me, Olle Bergman, or invited human writers. When robot-written sections are added to serve as examples or to demonstrate a point, this is clearly indicated.

 

The exploration starts …

The exploration starts …

My name is Olle, and I miss the wider discussion about how NLG technology (Natural Language Generation) will affect media, marketing, work-life, business, education, research, society, and—ultimately—the human condition.

To address that, I created this blog. My intention is to learn, explore, and discuss in order to help my readers gain insights, discover new possibilities (as well as threats), and be prepared for disruptive change—wherever that will take us. My approach will be open-minded and optimistic, but I will also give voice to my concerns.

Today, I work as a freelance writer in the fields of science, tech, and medicine. In addition, I also teach early-career scientists how to communicate more effectively. Finally, I am a non-fiction author in the field of popular history; in this professional role, I also evaluate the writing of others, being a member of one of Sweden’s most influential scholarship boards.

Please note: all texts on this blog are produced by me, Olle Bergman, or invited human writers. When robot-written sections are added to serve as examples or to demonstrate a point, this is clearly indicated.