#discord

Discord admits AI moderation bug wrongfully banned users over harmless images

Discord has admitted that a bug in its AI moderation system wrongfully banned over 8,000 users across two months. The system incorrectly flagged harmless images — including spreadsheets, chessboards, and grid-patterned backgrounds — as harmful content. A human review step was bypassed due to the bug, resulting in immediate permanent bans. Discord has since fixed the issue and is restoring affected accounts. Users speculate the AI became overly sensitive to grid patterns because such patterns have been used to disguise illegal content. The incident adds to a growing list of AI moderation failures across platforms including Instagram, Facebook, and Tumblr, raising broader concerns about automated bans lacking due process and transparency.