Blog

Facebook’s AI Might Be Able To Find Offensive Memes

Share
Tweet
Share

Facebook recently released an intriguing research paper called “The Hateful Memes Challenge: Detecting Hate Speech in Multimodal Memes.”

It’s well worth the read and a closer look at the database developed over the course of the research. The idea is simple: Use machine learning to help identify ‘mean’ and hateful memes.

If such a tool could be developed, it would help not just Facebook. It would help the entire online ecosystem better police the internet, stopping a significant portion of hate speech in its tracks.

Unfortunately, as the research shows, the AI still has a ways to go before it can truly be considered effective.

To conduct the search, the company compiled a data set consisting of a million samples of memes from all across the web. They eliminated any that were in clear violation of Facebook’s Terms of Service, which left them with 162,000 samples.

They re-created those memes by copying the text onto a new image, sourced via a partnership with Getty Images. That done, they had human reviewers judge whether the memes were “hateful”. Once a consensus was reached, they culled the remaining memes down to a final data set of 10,000, using these to attempt to “teach” the AI to identify hateful memes.

The result? The human reviewers had an average accuracy rate of 84.7 percent, versus the AI’s 64.73 percent accuracy rate. It was a good effort by the AI, especially since this was the first attempt. Clearly, much more work needs to be done before the AI routine can be said to be truly effective.

A researcher involved in the project had this to say about the results:

If we knew what is missing, it would be easy to fix and the gap between AI and humans would be lower. Generally speaking, we need to work on improving multimodal understanding and reasoning.”

One thing you can be sure of is this: The company will keep hammering away at the problem, and the AI’s percentages will increase in time. It’s an interesting, challenging project that could have an enormous impact. Kudos to Facebook for their work to this point.

Used with permission from Article Aggregator

FREE BUSINESS GUIDE

 

Don’t even think about calling a computer consultant before you read this!

If you are a small to medium business owner looking for computer support, then it’s critical that you read this business guide about IT services: This Business Advisory Guide Will Arm You With 18 Revealing Questions You Should Ask Any Computer Consultant Before Giving Them Access To Your Company’s Network.

Important! We hate spam as much (or more!) than you and promise to NEVER rent, share, or abuse your e-mail address and contact information in any way.

“Be Your Own Best Defense Against Cybercrime”

Sign Me Up For The Free Assessment

Book My Brief 10-15 Minute Initial Consultation