This article was originally published on the author’s blog and re-published to TOPBOTS with permission from the author. Large language models such as ChatGPT process and generate text sequences by first splitting the text into smaller units called tokens. In the image below, each colored block represents a unique token. Short or common words such as “you”, “say”, “loud”, and … [Read more...] about All Languages Are NOT Created (Tokenized) Equal
Natural Language Processing
Four LLM Trends Since ChatGPT And Their Implications For AI Builders
In October 2022, I published an article on LLM selection for specific NLP use cases , such as conversation, translation and summarisation. Since then, AI has made a huge step forward, and in this article, we will review some of the trends of the past months as well as their implications for AI builders. Specifically, we will cover the topics of task selection for … [Read more...] about Four LLM Trends Since ChatGPT And Their Implications For AI Builders
Beyond ChatGPT: Open-Source Projects in Generative AI
In the realm of generative AI, open-source projects have emerged as powerful tools that democratize access to cutting-edge models and foster collaborative development. They enable researchers, developers, and enthusiasts to experiment, improve upon existing models, and create novel applications that benefit society as a whole. In this article, I want to briefly review the … [Read more...] about Beyond ChatGPT: Open-Source Projects in Generative AI
Exploring Creativity in Large Language Models: From GPT-2 to GPT-4
Creativity as envisioned by Midjourney. Generated by the author This article was originally published on the author’s blog and re-published to TOPBOTS with permission from the author. In recent weeks, people have used large language models (LLMs) to generate a variety of creative content, such as books, flash fiction, rap battles, and music chords. But is it possible to … [Read more...] about Exploring Creativity in Large Language Models: From GPT-2 to GPT-4
Does AI Have Political Opinions?
This article was originally published on the author's blog and re-published to TOPBOTS with permission from the author. There’s a quote about how in polite society, you should never talk about three things: politics, religion, and money. In this article, I break polite conventions to determine how an AI would respond to all three of those topics. As AI tools become more and … [Read more...] about Does AI Have Political Opinions?
Overcoming The Limitations Of Large Language Models
How popular LLMs score along human cognitive skills (source: semantic embedding analysis of ca. 400k AI-related online texts since 2021) Disclaimer: This article was written without the support of ChatGPT. In the last couple of years, Large Language Models (LLMs) such as ChatGPT, T5 and LaMDA have developed amazing skills to produce human language. We are quick to … [Read more...] about Overcoming The Limitations Of Large Language Models
Choosing The Right Language Model For Your NLP Use Case
Large Language Models (LLMs) are Deep Learning models trained to produce text. With this impressive ability, LLMs have become the backbone of modern Natural Language Processing (NLP). Traditionally, they are pre-trained by academic institutions and big tech companies such as OpenAI, Microsoft and NVIDIA. Most of them are then made available for public use. This plug-and-play … [Read more...] about Choosing The Right Language Model For Your NLP Use Case
DALL·E 2, Explained: The Promise And Limitations Of A Revolutionary AI
DALL·E 2 is the newest AI model by OpenAI. If you’ve seen some of its creations and think they’re amazing, keep reading to understand why you’re totally right — but also wrong. OpenAI published a blog post and a paper entitled “Hierarchical Text-Conditional Image Generation with CLIP Latents” on DALL·E 2. The post is fine if you want to get a glimpse at the results … [Read more...] about DALL·E 2, Explained: The Promise And Limitations Of A Revolutionary AI
Transformers And Multimodal: The Same Key For All Data Types
The world of Machine Learning is undoubtedly fascinating, constantly growing, and capable of touching the most diverse sectors, from medicine to space racing, from catering to big manufacturing. There are countless fields of application for this technology and just as many techniques that have been developed over the decades, but they all have one thing in common: … [Read more...] about Transformers And Multimodal: The Same Key For All Data Types
10 Leading Language Models For NLP In 2022
UPDATE: We have published the updated version of this article with the top 10 transformative LLM research papers from 2023. The introduction of transfer learning and pretrained language models in natural language processing (NLP) pushed forward the limits of language understanding and generation. Transfer learning and applying transformers to different downstream NLP tasks … [Read more...] about 10 Leading Language Models For NLP In 2022