think that theartificial intelligence can only be used to generate content (text, images, and so on) is a big mistake. In fact, it can also be used in other areas, including that of videogame entertainment. About that, Activision has announced that it will soon introduce the real-time voice chat moderation based on AI. The debut is set for November 10, 2023, with Call of Duty: Modern Warfare III.
Activision against toxic language in its video games: the new AI-based moderation tool
The giant of the gaming industry is collaborating with Modulate to implement the AI feature, and more precisely the technology called ToxMod. This will be able to identify and oppose all violations of the code of conduct (hate speech, bullying, harassment, discrimination, etc.).
Il “toxic language” it’s not a problem that only affects Activision and its games, but it was the US company that confirmed that this phenomenon has found fertile ground in its hugely successful franchise. Indeed, the Call of Duty franchise matters millions of playerswho can also try their hand at the shooter for free with the battle royale Warzone.
ToxMod will provide support to Activision’s already robust “anti-toxicity” system. According to the Santa Monica company, it has already restricted voice or text chat for more than a million accounts that violate its code of conduct. Another interesting fact is that 20% of those who received an initial warning then did not commit other violations, confirming the usefulness of the measure to moderate the behavior of gamers.
Real-time moderation via AI is a big step towards making games even more fun, however AI-based detection systems can make mistakes, in one sense or another. Activision is aware of this and for this reason has decided to include a human being inside the circuit:
Detection happens in real time, with the system classifying and flagging toxic language based on the Call of Duty Code of Conduct. However, violations may require additional registration reviews before the recall is enforced. Therefore, the actions taken will not be instantaneous. Then, in the future, our processes and response times will evolve.
The new moderation system is under testing already for a few days in North America and only in games already available on the market, such as Call of Duty: Modern Warfare e Call of Duty: Warzone. The launch of the AI technology is expected to coincide with the release of Modern Warfare III, but starting only from the English language. Support for other languages will be added later.
