It took me a long time to realise that search is the biggest problem in NLP. Just look at Google, Amazon and Bing. These are multi-billion dollar businesses possible only due to their powerful search engines. My initial thoughts on search were centered around unsupervised ML, but I participated in Microsoft Hackathon 2018 for Bing and came to know the various ways a … [Read more...] about Semantic Search: Theory And Implementation
Natural Language Processing
Better Sentiment Analysis with BERT
Imagine you have a bot answering your clients, and you want to make it sound a little bit more natural, more human. To achieve that, you have to make the answers more personalized. One way to learn more about the customers you’re talking to is to analyze the polarity of their answers. By polarity here I mean detecting if the sentence (or group of sentences) is written with … [Read more...] about Better Sentiment Analysis with BERT
An Ultimate Guide To Transfer Learning In NLP
Natural language processing is a powerful tool, but in real-world we often come across tasks which suffer from data deficit and poor model generalisation. Transfer learning solved this problem by allowing us to take a pre-trained model of a task and use it for others. Today, transfer learning is at the heart of language models like Embeddings from Language … [Read more...] about An Ultimate Guide To Transfer Learning In NLP
10 Important Research Papers In Conversational AI From 2019
Conversational AI is becoming an integral part of business practice across industries. More companies are adopting the advantages chatbots bring to customer service, sales, and marketing. Even though chatbots are becoming a “must-have” asset for leading businesses, their performance is still very far from human. Researchers from major research institutions and tech leaders … [Read more...] about 10 Important Research Papers In Conversational AI From 2019
What Are Major NLP Achievements & Papers From 2019?
UPDATE: We’ve also summarized the top 2020 NLP research papers. In 2018 we saw a number of landmark research breakthroughs in the field of natural language processing (NLP). The introduction of transfer learning and pretrained language models in NLP pushed forward the limits of language understanding and generation. These also dominated NLP progress this … [Read more...] about What Are Major NLP Achievements & Papers From 2019?
Productionizing NLP Models
Problem statement 
Lately, I have been consolidating my experiences of working in different ML projects. I will tell this story from the lens of my recent NLP project to classify phrases into categories — A multiclass single label problem.
Team structure 
Making AI teams is quite tricky. If you don’t have the skillsets inside your company, you have to plan … [Read more...] about Productionizing NLP Models
Top NLP Research Trends From ACL 2019
This year, I had the chance to attend the ACL 2019 conference in Florence. It was my first NLP academic conference, and I was eager to attend as many sessions as possible. In contrast to most of the attendees, I was not interested in any particular research area. Instead, I wanted to pick up on the general NLP trends - so I was happy to hear about the latest advances in … [Read more...] about Top NLP Research Trends From ACL 2019
Top NLP Research Papers With Business Applications From ACL 2019
This year’s annual meeting of the Association for Computational Linguistics (ACL 2019) was bigger than ever. Although the conference received 75% more submissions than last year, the quality of the research papers remained high, and so the acceptance rates are almost the same. It is becoming more and more challenging to keep track of the latest research advances in your area … [Read more...] about Top NLP Research Papers With Business Applications From ACL 2019
XLNet, ERNIE 2.0, And RoBERTa: What You Need To Know About New 2019 Transformer Models
Large pretrained language models are definitely the main trend of the latest research advances in natural language processing (NLP). While lots of AI experts agree with Anna Rogers’s statement that getting state-of-the-art results with just more data and computing power is not research news, other NLP opinion leaders also see some positive moments in the current trend. For … [Read more...] about XLNet, ERNIE 2.0, And RoBERTa: What You Need To Know About New 2019 Transformer Models
Getting Started with Text Preprocessing for Machine Learning & NLP
Based on some recent conversations, I realized that text preprocessing is a severely overlooked topic. A few people I spoke to mentioned inconsistent results from their NLP applications only to realize that they were not preprocessing their text or were using the wrong kind of text preprocessing for their project. With that in mind, I thought of shedding some light around … [Read more...] about Getting Started with Text Preprocessing for Machine Learning & NLP