UPDATE: We’ve also summarized the top 2020 NLP research papers. In 2018 we saw a number of landmark research breakthroughs in the field of natural language processing (NLP). The introduction of transfer learning and pretrained language models in NLP pushed forward the limits of language understanding and generation. These also dominated NLP progress this … [Read more...] about What Are Major NLP Achievements & Papers From 2019?
Natural Language Processing
Productionizing NLP Models
Problem statement 💰 Lately, I have been consolidating my experiences of working in different ML projects. I will tell this story from the lens of my recent NLP project to classify phrases into categories — A multiclass single label problem. Team structure 👪 Making AI teams is quite tricky. If you don’t have the skillsets inside your company, you have to plan … [Read more...] about Productionizing NLP Models
Top NLP Research Trends From ACL 2019
This year, I had the chance to attend the ACL 2019 conference in Florence. It was my first NLP academic conference, and I was eager to attend as many sessions as possible. In contrast to most of the attendees, I was not interested in any particular research area. Instead, I wanted to pick up on the general NLP trends - so I was happy to hear about the latest advances in … [Read more...] about Top NLP Research Trends From ACL 2019
Top NLP Research Papers With Business Applications From ACL 2019
This year’s annual meeting of the Association for Computational Linguistics (ACL 2019) was bigger than ever. Although the conference received 75% more submissions than last year, the quality of the research papers remained high, and so the acceptance rates are almost the same. It is becoming more and more challenging to keep track of the latest research advances in your area … [Read more...] about Top NLP Research Papers With Business Applications From ACL 2019
XLNet, ERNIE 2.0, And RoBERTa: What You Need To Know About New 2019 Transformer Models
Large pretrained language models are definitely the main trend of the latest research advances in natural language processing (NLP). While lots of AI experts agree with Anna Rogers’s statement that getting state-of-the-art results with just more data and computing power is not research news, other NLP opinion leaders also see some positive moments in the current trend. For … [Read more...] about XLNet, ERNIE 2.0, And RoBERTa: What You Need To Know About New 2019 Transformer Models
Getting Started with Text Preprocessing for Machine Learning & NLP
Based on some recent conversations, I realized that text preprocessing is a severely overlooked topic. A few people I spoke to mentioned inconsistent results from their NLP applications only to realize that they were not preprocessing their text or were using the wrong kind of text preprocessing for their project. With that in mind, I thought of shedding some light around … [Read more...] about Getting Started with Text Preprocessing for Machine Learning & NLP
Building NLP Classifiers Cheaply With Transfer Learning and Weak Supervision
Introduction There is a catch to training state-of-the-art NLP models: their reliance on massive hand-labeled training sets. That’s why data labeling is usually the bottleneck in developing NLP applications and keeping them up-to-date. For example, imagine how much it would cost to pay medical specialists to label thousands of electronic health records. In general, having … [Read more...] about Building NLP Classifiers Cheaply With Transfer Learning and Weak Supervision
OpenAI’s GPT-2: Results, Hype, and Controversies
The nonprofit AI research company, OpenAI, recently released a new language model, called GPT-2, which is capable of generating realistic texts in a wide range of styles. In fact, the company stated that the model is so good at automatic text generation that it can be used for nefarious purposes; therefore, it did not publicize the trained model. The dangerous-to-release … [Read more...] about OpenAI’s GPT-2: Results, Hype, and Controversies
Why Bots Are So Difficult to Get Right
Most of today’s biggest companies have begun experimenting with chatbots, and many others are poised to follow suit. A recent survey found 56% of service leaders were actively looking for ways to integrate artificial intelligence, including chatbots. This surge in interest reflects the significant benefits this technology can offer: bots can save human agents time by providing … [Read more...] about Why Bots Are So Difficult to Get Right
New Approaches For Leveraging NLP in Marketing & Advertising
Natural Language Processing (NLP) is one of the longest-standing areas of AI research. The idea of being able to speak to a computer and be understood, whether verbally or in writing, has been around for as long as the idea of artificial intelligence. These days, NLP has gone far beyond being merely a better input method - we’re able to use machine learning algorithms to … [Read more...] about New Approaches For Leveraging NLP in Marketing & Advertising