To help you stay well prepared for 2021, we have summarized the latest trends across different research areas, including natural language processing, conversational AI, computer vision, and reinforcement learning. We also suggest key research papers in different areas that we think are representative of the latest advances. Subscribe to our AI Research mailing list at the … [Read more...] about Leading AI & Machine Learning Research Trends 2021
Top
TOPBOTS Guide to NeurIPS 2020
This year’s Annual Conference on Neural Information Processing (NeurIPS 2020) is held 100% virtually from December 6th to 12th, 2020. Historically NeurIPS sells out quickly and can be a challenge to register for. But, this year’s virtual format welcomes everyone with an affordable ticket price of $100. 2020 is our third year of TOPBOTS covering the conference. To … [Read more...] about TOPBOTS Guide to NeurIPS 2020
2020’s Top AI & Machine Learning Research Papers
Despite the challenges of 2020, the AI research community produced a number of meaningful technical breakthroughs. GPT-3 by OpenAI may be the most famous, but there are definitely many other research papers worth your attention. For example, teams from Google introduced a revolutionary chatbot, Meena, and EfficientDet object detectors in image recognition. Researchers … [Read more...] about 2020’s Top AI & Machine Learning Research Papers
GPT-3 & Beyond: 10 NLP Research Papers You Should Read
NLP research advances in 2020 are still dominated by large pre-trained language models, and specifically transformers. There were many interesting updates introduced this year that have made transformer architecture more efficient and applicable to long documents. Another hot topic relates to the evaluation of NLP models in different applications. We still lack evaluation … [Read more...] about GPT-3 & Beyond: 10 NLP Research Papers You Should Read
Novel Computer Vision Research Papers From 2020
Will transformers revolutionize computer vision like they did with natural language processing? That’s one of the major research questions investigated by computer vision scientists in 2020. The first results indicate that transformers achieve very promising results on image recognition tasks. Beyond transformers in vision applications, we also noticed a continuous … [Read more...] about Novel Computer Vision Research Papers From 2020
Graph Convolutional Networks (GCN)
In this post, we’re gonna take a close look at one of the well-known graph neural networks named Graph Convolutional Network (GCN). First, we’ll get the intuition to see how it works, then we’ll go deeper into the maths behind it. Why Graphs? Many problems are graphs in true nature. In our world, we see many data are graphs, such as molecules, social … [Read more...] about Graph Convolutional Networks (GCN)
Evaluation Metrics For Dialog Systems
Evaluation is a crucial part of the dialog system development process. Human judgment is considered a gold standard for the evaluation of dialog agents. However, this is also a very expensive and time-intensive approach. Thus, researchers mostly rely on automatic metrics when developing dialog systems. In this article, we’ll introduce a brief overview of the key evaluation … [Read more...] about Evaluation Metrics For Dialog Systems
Key Dialog Datasets: Overview and Critique
To build a state-of-the-art dialog system, you need challenging tasks for model training and evaluation. There are numerous dialog datasets that assist researchers in building task-oriented and chit-chat dialog agents. In particular, the Facebook Research team has introduced a framework, called ParlAI (pronounced par-lay), where they’ve gathered together 80+ popular dialog … [Read more...] about Key Dialog Datasets: Overview and Critique
Task-Oriented Dialog Agents: Recent Advances and Challenges
Hotel bookings, weather queries, restaurant reservations – chatbots and virtual assistants seem to be the perfect solution for these kinds of routine inquiries. Not surprisingly, task-oriented dialog systems that support these chatbots have become a hot topic in the AI and NLP research community. In this article, we will review the recent research breakthroughs in … [Read more...] about Task-Oriented Dialog Agents: Recent Advances and Challenges
The Latest Breakthroughs in Conversational AI Agents
2020 is the breakthrough year for conversational agents. First, Google’s chatbot Meena and Facebook’s chatbot Blender demonstrated that dialog agents can achieve close to human-level performance in certain tasks. Then, OpenAI’s GPT-3 model made lots of people wonder whether Artificial General Intelligence (AGI) is already here. While we are still a long way off true AGI, … [Read more...] about The Latest Breakthroughs in Conversational AI Agents