What can we learn about the GIPHY content moderation slip-up?

What can we learn about the GIPHY content moderation slip-up?

James Glenn Gomez Published on March 16, 2018

When it comes to content moderation, consider the butterfly effect. In a sense, one mistake can make a ripple and affect everything. And sometimes, one mistake can cost a business relationship.

Earlier this year, image-sharing social media apps Instagram and Snapchat had integrated the animated GIF aggregator GIPHY into their apps as stickers for snaps and stories. Just months later, they’re now cutting ties with the GIF database after a content moderation mishap. This comes after one racist GIF wasn’t scrubbed from their library, and was therefore available for use for the apps. The GIF in question is a “death counter” of sorts for black people. Thus, their parting of the ways with GIPHY.

While the GIF aggregator blamed a glitch in their code that allowed for the tasteless moving image to be available as a sticker, it doesn’t change the fact that this has strained their online reputation. Such things happen when content moderation goes awry. In retrospect, you can learn many things from this mishap, including the following.

  1. Automation isn’t foolproof
    inverted color robots working in office

    It’s not every day that one game-changing bug like this occurs to a website. However, if you’re hosting user-generated content—images, videos, audio, or what have you—it’s important to take note that artificial intelligence won’t catch objectionable content 100% of the time. GIPHY has a gigantic library of GIFs; an offensive one went past their radar. Content moderation still needs a human moderator’s subjective eye to discern what is and what isn’t acceptable.

  2. Implement a foolproof content moderation strategy
    business team developing content moderation strategy on white board by glass wall

    Sometimes, it takes a bit of a reality check like this one to know that something’s wrong with your moderation policies. Your content moderation strategy must be stringent enough to prevent objectionable content from spilling out into anyone’s dashboards but accommodating enough to encourage creation of user-generated content (UGC). Whether you’re going to use AI, human moderators, or both, your content moderation strategy must be reliable.

  3. Be thorough and proactive
    stylish gentleman with robot in dark

    Your content won’t clean itself. You must take a thorough and proactive approach in preventing the prevalence of objectionable content on your website. Take, for instance, GIF database alternative Gfycat. In order to combat “deepfakes” (AI-assisted face-swap pornography), it uses two kinds of AI that identify fakery if they see one. Since AI’s not foolproof, they use human moderators and review a GIF’s metadata—all just to combat deepfakes. This preemptive strike on such malicious content allows Gfycat to maintain the safety of their database.

  4. Consider outsourcing your content moderation services
    content moderation analyst being assisted by call center team leader

    If you feel that your company’s lacking in its reviewing efforts, maybe it’s time to consider moving your content moderation services to a provider. Now, there’s nothing wrong with an in-house team of reviewers. However, outsourcing presents an economical and scaling advantages without a drop in quality, letting you maintain a pristine website at a fraction of the cost.

  5. Sometimes, one mistake can be too little too late when it comes to content moderation. Such is what happened to the app integration of GIPHY with Instagram and Snapchat. Prevent such mistakes by taking a holistic and proactive approach to reviewing content.

Leave a Reply

JOIN US ON FACEBOOK
Open Access BPO
Open Access BPO2 days ago
How do you make your customers feel special?

1. Speak your customer’s language
2. Call back when you say you will
3. Say “please” and “thank you”

Here are seven more ways #CustomerService experts enhance customer experience and win customers' trust: https://buff.ly/3gZWV20

#WeSpeakYourLanguage
Open Access BPO
Open Access BPO6 days ago
An agile #CallCenter can turn interactions in the most competitive industries into long-lasting relationships. This allows brands, especially #startups, to meet the rapidly changing demands of their market.

See what other advantages it offers: https://buff.ly/3e3uNZT

#WeSpeakYourLanguage
Open Access BPO
Open Access BPO7 days ago
73% of customers prefer #LiveChat as their go-to channel for #CustomerSupport. This saves businesses time and expenses for higher productivity.

See how experienced #BPO providers offer excellent #CustomerService via live chat: https://buff.ly/3muh698

#WeSpeakYourLanguage
Open Access BPO
Open Access BPO7 days ago
Open Access BPO's #IT infrastructure was designed to adapt and integrate new technologies and features to meet market demands and client needs.

Learn more about how we can future-proof your #offshore operations: https://buff.ly/3e3uAWV

#WeSpeakYourLanguage #SmartRedundancy
Open Access BPO
Open Access BPO2 weeks ago
Maintaining regular communication with customers can help you earn their trust. This is essential when delivering value-added #CustomerService.

Here are tips to make #CustomerCare even more special for your consumers: https://buff.ly/3xjM2h9

#WeSpeakYourLanguage
Open Access BPO
Open Access BPO2 weeks ago
Open Access BPO adopts #DataSecurity solutions and adheres to #InfoSec industry standards to proactively face emerging digital threats.

Ensure frictionless customer journeys through #SmartRedundancy: https://buff.ly/3xitA8E

#WeSpeakYourLanguage
Do NOT follow this link or you will be banned from the site!