Model Releases

OpenAI releases language understanding model based on unsupervised pretraining, achieving SOTA results

Original title:Improving language understanding with unsupervised learning

AI summary

OpenAI achieved state-of-the-art results on multiple language tasks with a general, task-agnostic system combining a Transformer with unsupervised pretraining, and released the system as open source. OpenAI said the results validate combining supervised learning with unsupervised pretraining and expressed hope that they will drive further research on larger and more diverse datasets.

Key Takeaways

  • OpenAI achieved state-of-the-art results on multiple language tasks with a general,task-agnostic…
  • and released the system as open source.
  • OpenAI said the results validate combining supervised learning with unsupervised pretraining and…

Quick Facts

Published
Updated
Source
OpenAI:官网动态(RSS · 排除企业/客户案例)
Category
Model Releases
AI score
75
Read the original Read the full article at the original source
Why it matters

原文说明了方法组合与开放发布,读者可以据此理解无监督预训练思路在多项语言任务上的效果。

Related entities

Source & copyright

This article is based on curated titles and AI summaries from the AIHOT public API, with attribution and links back. Original copyright remains with the original publishers and authors; this site does not mirror full texts.

Original article · AIHOT entry

How to Cite

When citing this article, keep the title, date, and permalink, and credit Orange News as the source.

Orange News: OpenAI releases language understanding model based on unsupervised pretraining, achieving SOTA results. June 11, 2018. https://new.nat6.net/en/news/kqw3u0zsdrdahfl69kk21gyhw/

View all →