Chatbot fever has infected Silicon Valley. The leaders of virtually every tech giant — including Facebook, Google, Amazon, and Apple — proclaim chatbots as the new websites and messaging platforms as the new browsers. “You should message a business just the way you would message a friend,” declared Mark Zuckerberg when he launched the Facebook Messenger Platform for bots. He and the rest of the tech world are convinced that conversation is the future of business.
But is chatting actually good for bots? Early user reviews of chatbots suggest not. Gizmodo writer Darren Orf describes Facebook’s chatbot user experiences as “frustrating and useless” and compares using them to “trying to talk politics with a toddler”. His criticisms are not unfair.
Here’s an example of a “conversation” I had with the 1–800-Flowers Messenger bot after I became stuck in a nested menu and was unable to return to the main menu. Not exactly a pleasant or productive user experience.
To Chat Or Not To Chat?
Designers who are new to conversational interfaces often have the misconception that chatbots must “chat”. At the same time, they underestimate the extraordinary writing skills, technical investment, and continuous iteration required to implement excellent conversational UX.
This article explores when conversation benefits and when conversation hurts chatbot user experience. I walk through case studies for both sides of the argument and compare divergent opinions from Ted Livingston, CEO of Kik, who advises bot makers to deprioritize open-ended chat, and Steve Worswick, the creator of “the most human chatbot”, who encourages developers to invest in truly conversational experiences.
As you’ll see from the examples below, both strategies can lead to successful chatbot experiences. The key is to choose the right level of conversational ability for your bot given your business goals, team capabilities, and user needs.
The Case For Chat
Steve Worswick is the developer behind Mitsuku, one of the world’s most popular chatbots. Mitsuku has twice won the Loebner Prize, an artificial intelligence award given to the “most human-like chatbot”. The popular chatbot has conversed with more than 5 million users and processed over 150 million total interactions. 80% of Mitsuku’s users come back for more chats.
The longest a user has chatted with Mitsuku is 9 hours in a single day — a testament to the bot’s extraordinary conversational abilities. Mitsuku does not help you find make-up products, buy flowers, or perform any functional utility. The chatbot’s sole purpose is to provide entertainment and companionship. You won’t be surprised to find out Worswick thinks that “chatbots should be about the chat.”
Building a conversational chatbot that isn’t awful is extremely hard. Worswick nearly gave up many times when Mitsuku repeatedly gave unsatisfactory answers and users called her “stupid”. One major breakthrough occurred when Worswick programmed in a massive database with thousands of common objects like “chair”, “tree”, and “cinema” along with their relationships and attributes.
Suddenly Mitsuku could give sensible answers to strange user questions, such as “Is a snail slower than a train?” or “Can you eat a tree?”. According to Worswick: “Let’s say a user asks Mitsuku if a banana is larger than X, but she doesn’t recognize what X is. She knows that a banana is a relatively small object so can deduce that X is probably larger.”
Even if a chatbot is utilitarian, providing spontaneous answers in a conversation — especially if unexpected — can delight and engage users. Poncho is a Messenger bot that gives you basic weather reports, but the creators gave the bot the personality of a Brooklyn cat. Poncho can conduct small talk and even recognizes other cats. “Weather is boring,” admits Poncho founder Kuan Huang. “We make it awesome.”
When You Should Add Conversation To Delight Users
Making a bot conversational takes tremendous effort, but if you are up to the challenge, here are the top situations where conversation can distinguish your chatbot from competitors and truly delight users.
If you need to differentiate from competition
As seen earlier, Poncho’s conversational personality distinguishes the chatty weather cat from boring, routine weather apps. Bots launch at a more rapid pace than mobile apps due to lower technical barriers to entry. Dozens of bots already exist to service identical use cases, so winners need to stand out with superior conversational UX.
Just like weather apps, public transit apps are soulless and boring. We use them out of necessity and not delight. Enter Bus Uncle, a bot who can tell you anything you want to know about the Singaporean bus system in his quirky, broken English and suggest funny things to do while you wait.
Comprehensive, detailed guides and maps for the bus system exist on the internet to help expats and locals find their way home, but Bus Uncle’s conversational interface both simplifies and adds joy to a routine task.
Beware that the bot is not all fun and games. Like any proper Asian uncle, Bus Uncle stays in character by occasionally forcing you to do math problems.
If you need to handle edge conditions
E-commerce is a challenging space for bots due to product diversity and language variability. Many conversational shopping bots malfunction when users use unrecognized vocabulary or suddenly switch contexts. Such failures are usually technical in nature, where a bot simply doesn’t have the requisite data set or intelligence to handle edge user input.
ShopBot from eBay avoids common e-commerce bot UX failures by combining limited option menus with the ability to handle unexpected user input. While many shopping bots hem users into a narrow series of menus, ShopBot is able to quickly adapt when I switch from shopping for jeans to shopping for blouses.
Shopping is a difficult use case for chatbots to master. Superior conversational experiences in e-commerce bots are not just a function of writing great copy, but of powerful technologies that process natural language, keep track of shoppers’ contexts and preferences, and anticipate diverse needs accurately.
RJ Pittman, Chief Product Officer at eBay explains: “Shoppers have complex needs, which are often not fully met by traditional search engines. The science of AI provides contextual understanding, predictive modeling, and machine learning abilities. Combining AI with eBay’s breadth of inventory and unique selection will enable us to create a radically better and more personal shopping experience.”
If you can be relevant and timely
The 2016 US Presidential Election race between Hillary Clinton and Donald Trump was a hot topic not just in America but around the world. In the weeks up to the election, Alexa, the powerful cloud AI inside the Amazon Echo, could tell you who won the presidential debates and give you live news and polling data about the candidates.
Users took advantage of the timely features to ask Alexa open-ended questions such as “How old is Trump?” and “What’s the latest news about Clinton?”. Ironically, more users asked “Alexa, who are you voting for?” than “Alexa, who should I vote for?”
Bots that are conversant and even opinionated on the latest topics will better engage users than bots that simply regurgitate facts or offer links to existing news reports.
If you can humanize a brand
Chatting is an intimate act we do with close friends and family, which is why chatting with a “brand” is often an awkward and strange user experience. Strong conversational skills in a chatbot can overcome this barrier and create an authentic connection.
Maintaining a consistent and compelling brand voice in chatbots is not easy. PullString, a conversational AI platform founded by ex-Pixar CTO Oren Jacob, employs an entire department of expert Hollywood screenwriters to bring brands like Mattel’s Barbie and Activision’s Call of Duty to life.
Their demo chatbot Jessie Humani is powered by over 3,500 lines of carefully selected dialog to create the impression that she’s your messed-up millennial friend who can’t get her life together without your help.
The Case Against Chat
Many bot industry experts believe the word “chatbot” sets the wrong user expectation that bots should have human-level conversational abilities. The hard reality is that natural language processing and artificial intelligence still have much progress to make before bots will impress you with their gift of gab.
Ted Livingston, CEO of Kik, a popular messaging platform with a thriving bot store, is squarely on the side of no chatting. “The biggest misconception is that bots need to be about ‘chat’. What we discovered is that bots that don’t have suggested responses simply don’t work. Users don’t know what to do with an empty input field and a blinking cursor,” he shared at a recent bot conference.
Kik started building a conversational platform two years ago, long before bots suddenly became cool. In the beginning, their bots allowed freeform responses the same way Facebook Messenger bots do now. What resulted was user confusion and error as well as developer complaints about having to deal with the unnecessary complexity of processing open-ended conversation. Kik now restricts user responses to a limited set of pre-defined options and intentionally makes typing free-form text difficult.
For example, when Sephora’s Kik bot asks what type of beauty products a user would like to see, the bot follows the question with a menu of suggested responses to choose from. A user has to go out of her way to hit “Tap a message” in order to type normally.
When You Should Restrict Chat For Better UX
There are many cases where designers of chatbots should restrict conversation to provide a superior user experience. Below are a few common situations where letting users type freeform conversational text complicates development and decreases your bot’s usability:
If user errors lead to failed transactions
1–800-Flower’s bot for Facebook Messenger originally gave users three options for flower delivery dates: “Today”, “Tomorrow”, or “Choose Another Date”. The third option allowed users to type in dates free-form which often resulted in errors, confusion, and abandoned or failed transactions.
By removing the third option for users to type in arbitrary dates, 1–800-Flowers actually increased the number of transactions and overall customer satisfaction. Restricting conversation helped them focus on their most important users, the ones who want to send flowers urgently.
If your competitive advantage is simplicity
Chatbots should give users the key advantage of completing tasks with fewer taps and context switches than regular mobile apps. Enabling open-ended chat can undermine this simplicity and add development complexity for handling variable input.
An example is the simple meditation bot Peaceful Habit for Amazon Echo and Facebook Messenger. The bot is designed to help regular meditators build a daily practice and should be quicker to use than meditation apps.
On the Amazon Echo, a user can start a 5, 10, or 20 minute meditation completely hands-free, with voice alone. On Facebook Messenger, the bot sends a daily reminder with limited user options so only a single tap is required to start a meditation practice.
Without the messaging bot, a user would need to navigate to a meditation-specific app, specify a duration, and press a start button. By limiting options up front, Peaceful Habit removes risk of user error and streamlines the task of meditating.
If you cannot easily handle unbounded input
Many user requests appear simple on the surface but are extremely complex to handle in open-ended conversational interfaces due to variability of vocabulary, grammatical structures, and cultural norms. For example, a user can ask to schedule a meeting by asking any of the following questions:
When’s Bob’s next open time slot?
Let me know the next three times Bob can chat.
Is Bob available at 4 PM PST today?
Turns out the complexity of handling seemingly simple meeting requests requires powerful artificial intelligence capabilities. Several well-funded companies have emerged just to solve narrow scheduling challenges with specialized technology.
When you consider more complex requests, such as asking for restaurant recommendations, limiting conversations often means less confusion for both your bot and your user. Sure, a bot that offers local restaurant recommendations, asks users to type in what they are craving but often can’t understand the responses.
By contrast, a similar bot called OrderNow finds local restaurants that deliver and offers up a limited menu of cuisines to choose from.
These examples demonstrate that complex artificial intelligence, machine learning, or natural language processing is not required to create great user experiences for chatbots. As Ted Livingston, CEO of Kik, warns: “AI is not the killer app for bots. In fact, AI holds most bots back. Bots are just a better way to deliver a software experience. They should do one thing really well.”
How Much Should Your Chatbot Chat?
How “chatty” your chatbot should be depends your users’ mental models of chatbots and the goals and needs your chatbot fulfills for them. Bots on Kik that only offer limited responses can be just as successful and as engaging as Mitsuku or Jessie Humani.
Problems occur when designers do not decide up front who their audience is, how the chatbot fits into their business or brand strategy, what domains the chatbot will and will not cover, and what a successful experience should look like.
When you are deciding how much “conversation” to design into your chatbot experiences, answer the following questions to help define the right level of engagement:
- How are you setting user expectations? If you brand your chatbot as a character or a human-replacement, users will expect a minimum level of conversational ability. If your bot functionality is utilitarian or limited, then guide conversations towards specific outcomes.
- Is your chatbot utilitarian or entertainment-driven? Mitsuku is an artificial intelligence companion, so she’s required to master the art of conversation. On the other hand, a Slack bot that performs SQL queries or pulls CRM data has no need to support chat.
- Does your chatbot reflect your brand voice? Major brands like Disney and Universal Studios use chatbots to engage audiences beyond simple ad clicks and video views. Chatbots working as brand ambassadors need to authentically reflect the domain and voice of the companies they represent.
- Is your chatbot a familiar service or product? Businesses like 1–800-Flowers or Domino’s Pizza already have millions of buyers who use their websites, mobile apps, and phone numbers to order products. Users who already know what you offer and what they like don’t require as much explanation and hand-holding.
- Does your chatbot need to differentiate in a competitive market? Weather apps are a dime a dozen. Poncho the Weather Cat differentiates by having a distinct personality and delightful reactions, making the bot successfully stand out against other weather services.
- How strong is your technical team and AI platform? Building an adaptable and user-friendly conversational AI is incredibly challenging. Worswick invested over a decade to make Mitsuku the award-winning chatbot she is today. Each conversational AI platform has strengths and weaknesses that impact your chatbot UX.
- How strong is your writing team? In the world of bots, writers are the new designers. Do your writers understand how to write engaging, emotional copy that draw users in? Bots reflect the communication skills of their makers.
As natural language understanding, machine learning, and artificial intelligence improve, chatbots will inevitably become smarter and more capable in interactions with humans.
For now, just be sure your bot either sticks with utilitarian offerings or stays within a comfortable zone of conversational topics. Take a cue from how Mitsuku gracefully avoids confrontation by excusing herself from a potentially awkward political conversation.
Leave a Reply
You must be logged in to post a comment.