In their recent Cloud Next conference held in San Francisco, Google announced that they’ve partnered with various companies in the AI, telecommunications, and cloud computing sectors to create an AI software for call centers.
Once, during a meeting, my colleagues got into a heated discussion, not because they were on opposing sides, but because they misconstrued the tone each other used. Emotions inevitably rose, and an argument exploded—one that could’ve been avoided had both parties used friendlier tones.
Content moderation isn’t something we could just rely on automation to accomplish. Despite the speed advantage that it can provide, there’s nothing safer than the conscious judgment of the human mind because of one thing: context.
When it comes to content moderation, consider the butterfly effect. In a sense, one mistake can make a ripple and affect everything. And sometimes, one mistake can cost a business relationship.
Earlier this year, image-sharing social media apps Instagram and Snapchat had integrated the animated GIF aggregator GIPHY into their apps as stickers for snaps and stories. Just months later, they’re now cutting ties with the GIF database after a content moderation mishap. This comes after one racist GIF wasn’t scrubbed from their library, and was therefore available for use for the apps. The GIF in question is a “death counter” of sorts for black people. Thus, their parting of the ways with GIPHY.