Select users were given early access to the chatbot, and they have not been shy about sharing their experiences. Many of these users have made it their mission to test the chatbot’s capabilities and expose its flaws, which were many.
From revealing its confidential codename used internally by developers, to declaring its love to a New York Times writer and asking him to leave his wife, to wishing it was alive, the chatbot was acting out of hand.
Also: Microsoft’s ChatGPT-powered Bing argues with users, reveals confidential information
Consequently, Microsoft decided to reel in the chatbot with a new session limit, changing chat sessions from an unlimited session to a five-question limit, and a 50-chat turn limit per day. That limit was then expanded to six chat turns per session and 60 total chats per day, still less than the original experience users got.
Microsoft notes that convoluted, long chat sessions were not something it was testing for internally, so the public’s use and feedback has actually been useful in learning more about the chatbot.
“In fact, the very reason we are testing the new Bing in the open with a limited set of preview testers is precisely to find these atypical use cases from which we can learn and improve the product,” says Microsoft.