View all newsletters
Sign up for our free email newsletters

Fighting for quality news media in the digital age.

  1. News
February 18, 2019updated 30 Sep 2022 7:31am

AI research firm holds back on release of text generator over fears it could create fake news

By James Walker

A Silicon Valley research company will not release a new tool that can generate coherent text using artificial intelligence, including news articles, over fears it could be used to create fake news.

But, non-profit firm Open AI has released a smaller version of its GPT-2 text generator for researchers along with a technical paper on its tool.

The tool, which the firm says was trained on a dataset of 8m web pages (equal to 40GB) to predict the next word in a sentence can produce “realistic and coherent” text following a prompt written by a human.

Open AI said that, while tools like its own could be used for unsupervised translation and other societal benefits, AI language tools could also be used to create fake news as well as automated spam and abusive content.

The firm provided samples of articles its bot had written after being fed short prompts written by humans.

These included articles about the election of a resurrected John F Kennedy, scientists finding a herd of unicorns in the Andes and a thief stealing a train carriage with nuclear material on board.

In a blog post about the text generator, Open AI said: “Due to concerns about large language models being used to generate deceptive, biased, or abusive language at scale, we are only releasing a much smaller version of GPT-2 along with sampling code.

Content from our partners
MHP Group's 30 To Watch awards for young journalists open for entries
How PA Media is helping newspapers make the digital transition
Publishing on the open web is broken, how generative AI could help fix it

“We are not releasing the dataset, training code, or GPT-2 model weights.”

It added: “We are aware that some researchers have the technical capacity to reproduce and open source our results.

“We believe our release strategy limits the initial set of organisations who may choose to do this, and gives the AI community more time to have a discussion about the implications of such systems.”

Open AI said it would review its limited release strategy in six months time.

The AI research firm was co-founded by Tesla chief executive Elon Musk three years ago and announced it was conducting “large-scale experiments” on Microsoft’s Azure platform in November 2016.

Musk left Open AI last year, saying in a tweet: “I had to focus on solving a painfully large number of engineering & manufacturing problems at Tesla (especially) & SpaceX.

“Also, Tesla was competing for some of same people as OpenAI & I didn’t agree with some of what Open AI team wanted to do. Add that all up and it was just better to part ways on good terms.”

Open AI said that its text generator was able to produce decent samples “about 50 per cent of the time” when prompted with popular subjects, such as Brexit, but was not as effective when fed “highly technical” content.

Other faults in the tool included repetitive text, “unnatural topic switching” and making errors such as writing about fires underwater.

Picture: Pexels

Topics in this article :

Email pged@pressgazette.co.uk to point out mistakes, provide story tips or send in a letter for publication on our "Letters Page" blog

Select and enter your email address Weekly insight into the big strategic issues affecting the future of the news industry. Essential reading for media leaders every Thursday. Your morning brew of news about the world of news from Press Gazette and elsewhere in the media. Sent at around 10am UK time. Our weekly does of strategic insight about the future of news media aimed at US readers. A fortnightly update from the front-line of news and advertising. Aimed at marketers and those involved in the advertising industry.
  • Business owner/co-owner
  • CEO
  • COO
  • CFO
  • CTO
  • Chairperson
  • Non-Exec Director
  • Other C-Suite
  • Managing Director
  • President/Partner
  • Senior Executive/SVP or Corporate VP or equivalent
  • Director or equivalent
  • Group or Senior Manager
  • Head of Department/Function
  • Manager
  • Non-manager
  • Retired
  • Other
Visit our privacy Policy for more information about our services, how New Statesman Media Group may use, process and share your personal data, including information on your rights in respect of your personal data and how you can unsubscribe from future marketing communications.
Thank you

Thanks for subscribing.

Websites in our network