TOPBOTS

The Best of Applied Artificial Intelligence, Machine Learning, Automation, Bots, Chatbots

NLP Research Papers

Reformer, Longformer, and ELECTRA: Key Updates To Transformer Architecture In 2020

by

The leading pre-trained language models demonstrate remarkable performance on different NLP tasks, making them a much-welcomed tool for a number of applications, including sentiment analysis, chatbots, text summarization, and so on. However, good performance usually comes at the cost of enormous computational resources that are not accessible by most researchers and business … [Read more...] about Reformer, Longformer, and ELECTRA: Key Updates To Transformer Architecture In 2020

What Are Major NLP Achievements & Papers From 2019?

by

UPDATE: We’ve also summarized the top 2020 NLP research papers.  In 2018 we saw a number of landmark research breakthroughs in the field of natural language processing (NLP). The introduction of transfer learning and pretrained language models in NLP pushed forward the limits of language understanding and generation. These also dominated NLP progress this … [Read more...] about What Are Major NLP Achievements & Papers From 2019?

Top NLP Research Papers With Business Applications From ACL 2019

by

This year’s annual meeting of the Association for Computational Linguistics (ACL 2019) was bigger than ever. Although the conference received 75% more submissions than last year, the quality of the research papers remained high, and so the acceptance rates are almost the same. It is becoming more and more challenging to keep track of the latest research advances in your area … [Read more...] about Top NLP Research Papers With Business Applications From ACL 2019

XLNet, ERNIE 2.0, And RoBERTa: What You Need To Know About New 2019 Transformer Models

by

Large pretrained language models are definitely the main trend of the latest research advances in natural language processing (NLP). While lots of AI experts agree with Anna Rogers’s statement that getting state-of-the-art results with just more data and computing power is not research news, other NLP opinion leaders also see some positive moments in the current trend. For … [Read more...] about XLNet, ERNIE 2.0, And RoBERTa: What You Need To Know About New 2019 Transformer Models

Novel Methods For Text Generation Using Adversarial Learning & Autoencoders

by

Just two years ago, text generation models were so unreliable that you needed to generate hundreds of samples in hopes of finding even one plausible sentence. Nowadays, OpenAI's pre-trained language model can generate relatively coherent news articles given only two sentence of context. Other approaches like Generative Adversarial Networks (GANs) and Variational … [Read more...] about Novel Methods For Text Generation Using Adversarial Learning & Autoencoders

State-Of-The-Art Methods For Neural Machine Translation & Multilingual Tasks

by

The quality of machine translation produced by state-of-the-art models is already quite high and often requires only minor corrections from professional human translators. This is especially true for high-resource language pairs like English-German and English-French. So, the main focus of recent research studies in machine translation was on improving system performance for … [Read more...] about State-Of-The-Art Methods For Neural Machine Translation & Multilingual Tasks

We Summarized 14 NLP Research Breakthroughs You Can Apply To Your Business

by

UPDATE: We've also summarized the top 2019 and top 2020 NLP research papers. Language understanding is a challenge for computers. Subtle nuances of communication that human toddlers can understand still confuse the most powerful machines. Even though advanced techniques like deep learning can detect and replicate complex language patterns, machine learning models still lack … [Read more...] about We Summarized 14 NLP Research Breakthroughs You Can Apply To Your Business

  2. 1
  3. 2