Tech

Facebook builds AI system to understand memes

Facebook builds AI system to understand memes

While text-based posts and videos have done their bit in spreading such content, memes have been a large part of the brigade aiding the spread of such malicious content.

The social media giant isn't intending to just use this information for memes, of course.

"Taking into account the sheer volume of photos shared each day on Facebook and Instagram, the number of languages supported on our global platform, and the variations of the text, the problem of understanding text in images is quite different from those solved by traditional optical character recognition (OCR) systems, which recognize the characters but don't understand the context of the associated image", Facebook said in a blog post.

Facebook (NASDAQ:FB) is bringing out the big guns in its new battle against hate speech.

The system is called Facebook Rosetta, and it's an impressively intelligent A.I. that uses a multi-layer model (seen below) to read text on image and video content, analyze its contents, and then interpret if it should be filtered.

More news: Cartoonist defends portrayal of Serena Williams

It will be important to note that Facebook in the past has tried to use AI for the goal. Such tools are being used on various platforms and, the technology isn't new. That's where the company's Rosetta machine learning system comes in.

[Rosetta] extracts text from more than a billion public Facebook and Instagram images and video frames (in a wide variety of languages), daily and in real time, and inputs it into a text recognition model that has been trained on classifiers to understand the context of the text and the image together.

Rosetta is already being used by teams at Facebook and Instagram to improve the quality of photo search, improve the accuracy of photos in the News Feed, and to identify hate speech.

Later on, Facebook says it could apply a similar innovation toward understanding content that shows up in video also, however that requires a more mind boggling framework.

Apart from being a technological milestone for Facebook, Rosetta is also important for Mark Zuckerberg and Co in other ways. Both have contributed to the loss of life, money and have even helped worsen one of the worst humanitarian crises of the current decade.


  • Supernatural Video Game Alan Wake Is Becoming A TV Show

    Supernatural Video Game Alan Wake Is Becoming A TV Show

    Contradiction has brought other videogame adaptations to life in the past, including projects like Mortal Kombat: Legacy and Dead Rising: Watchtower .

    SC coastline battered as Hurricane Florence lands

    Wild horses in the Rachel Carson Reserve in Beaufort, North Carolina will fend for themselves during Hurricane Florence. American Airlines said it had canceled more than 800 flights from Wednesday through Sunday because of the storm.
    Big Machine Vodka 400 postponed — NASCAR at Indianapolis

    Big Machine Vodka 400 postponed — NASCAR at Indianapolis

    In the NASCAR Cup Series, the race serves as the final event before the playoffs start September 16 at Las Vegas Motor Speedway. This almost became an issue in last year's Brickyard 400 after a one-hour, 47-minute rain delay took place during the race .
  • Multiple Final Fantasy Titles Announced for Nintendo Switch, PS4, Xbox One

    Multiple Final Fantasy Titles Announced for Nintendo Switch, PS4, Xbox One

    X-2 HD Remaster, and Final Fantasy XII The Zodiac Age are all scheduled to release in 2019. Unbeknownst to Noctis, however, the journey ahead is fraught with perils...
    Arsenal Boss Keen To Scupper Barcelona's Interest In Gunners Star

    Arsenal Boss Keen To Scupper Barcelona's Interest In Gunners Star

    He is very convinced about that in my conversations with him about it. "[For] Mesut it is these two positions". He can improve, he can do more.
    Mets' Wright to return for final game September  29

    Mets' Wright to return for final game September 29

    It isn't the way he wanted to end his career, but David Wright will be taking one last set of swings as the third baseman for the New York Mets .
  • Bombing in Afghanistan Kills at Least 68 at Quiet Yell

    Bombing in Afghanistan Kills at Least 68 at Quiet Yell

    Khogyani said the suicide bomber detonated his vest as he approached a tent where protesters had gathered. A number of wounded people are in critical condition, he said.
    United States  identifies remains of two servicemen killed in the Korean War

    United States identifies remains of two servicemen killed in the Korean War

    North Korea returned 55 boxes of remains as part of a denuclearization agreement reached between its leader Kim Jong-un and U.S. Forensic anthropologists have been examining the remains at a facility on Joint Base Pearl Harbor-Hickam, Reuters reported .
    Hurricane Florence is a

    Hurricane Florence is a "horrific nightmare" for meteorologists tracking the storm

    The Weather Channel 's forecast video shows the potential damage such surges could inflict on the southern states. Henry McMaster said no one will be able to save at-risk residents if they choose to ride out the storm.
  • New Snailfish Species Found in Deep Pacific Ocean

    New Snailfish Species Found in Deep Pacific Ocean

    Part of the Liparidae family, these snailfish look distinct from other deep sea creatures , albeit they're no less unusual . For instance, instead of giant teeth and a menacing frame, these snailfish are small, translucent, bereft of scales.

    Pochettino confirms Lloris will remain Spurs captain

    But of course we're not God, that we can judge people. "He said "Gaffer it's a massive lesson for me". He made a mistake and he's suffering all the punishment of society.

    'Monster' Hurricane Florence Barrels Toward the Carolinas

    Hurricane watches are in place around most of the SC coast, and tropical storm warnings were in effect in southern Virginia. Current forecasts call for Florence to be at least a Category 3 storm when it arrives at the Carolinas.