Facebook Just Revealed Its Secret Strategy for Taking Down Hate Groups

The company recently removed a small network of the “worst racists” in America.

Josh Edelson/ZUMA Wire

Fight disinformation: Sign up for the free Mother Jones Daily newsletter and follow the news that matters.

The members of Northwest Front have been called the “worst racists” in America, amid stiff competition. On Wednesday, Facebook told Mother Jones that it had used a new enforcement strategy to take down a network of Northwest Front accounts that tried to circumvent the platform’s ban on white nationalists.

“This organization has been banned on Facebook for years now. We recently identified that they had tried to reestablish a presence on the platform. What we decided to do is identify as many of their assets as we could, identities of their supporters and members, groups, pages, and then take them all down at once,” Brian Fishman, Facebook’s director of counterterrorism and dangerous organizations policy, explained on the phone.

The action against the Northwest Front that Fishman outlined is a strategy that Facebook occasionally uses to stop the most egregious and dangerous groups from using its tools. Until Wednesday, the company had not shared any details of that strategy publicly.

The group had been organizing on Facebook and attempting to use the platform to recruit potentially sympathetic minds into the neo-Nazi group. 

Typically, Fishman explained, most content that violates Facebook’s terms of service is reviewed and taken down as quickly as the company can manage it; the takedowns are accompanied by messages to violators about how they’d breached platform rules. In the case of the recent move against Northwest Front, though, the company instead opted to monitor accounts of individuals associated with the Northwest Front, in the hopes of finding a larger chunk of the network and taking it all down at once, with no explanations given.

“This is different than our normal operations. The reason for doing things like this is to make it more difficult to rebuild a network,” Fishman said. “If you take out one piece or consistently takedown pieces, then they still can try to rebuild.”

Fishman emphasized that Facebook was not ignoring normal policy violations while monitoring the group. “If something came into standard enforcement flows, it would come down,” he said.

“Also if we recognize something that was an imminent threat, we wouldn’t delay. If we identify something that indicated that there’s potential for harm, we’ll take enforcement action,” Sarah Pollack, a spokesperson for Facebook, added. 

Facebook would contact law enforcement if the group posed an imminent threat, Fishman said. It would also work with its lawyers to loop in law enforcement, the military, or other government groups if its investigators came across any white nationalists working in their ranks.

Facebook has been deliberately opaque about its strategy in the past. That’s because the company wanted to make it harder for groups like the Northwest Front to understand what was happening and figure out how to dodge detection in the future. Fishman was light on a lot of details about what Facebook looks for in monitoring these types of groups. Often, he said, Facebook won’t say that it took action on a set of accounts, leaving users puzzled as their accounts, pages, and groups are deleted without explanation. 

“Sometimes these groups are confused about actions. That’s a positive effect from my perspective,” he said. “When we’re talking about terror groups and hate groups, ambiguity can be a useful tool.”

The overall scope of the takedown was small, at 36 Facebook users, 10 Instagram users, nine groups, and nine pages.

Fishman said that this isn’t the first time Facebook has taken action of this kind. He and Pollack explained that the company had used the same strategy against other American right-wing hate organizations, including The Right Stuff and Identity Dixie, two alt-right podcasts, as well as the Revolutionary Armed Forces of Colombia (aka FARC), a leftist rebel group in Columbia. 

“We’ve always wanted to explain that we’re using this approach,” Pollack said, “but we wanted to do it now to highlight [that] our work on dangerous organizations continues even in this moment where Facebook and the world is focused on COVID-19.”

WE'LL BE BLUNT.

We have a considerable $390,000 gap in our online fundraising budget that we have to close by June 30. There is no wiggle room, we've already cut everything we can, and we urgently need more readers to pitch in—especially from this specific blurb you're reading right now.

We'll also be quite transparent and level-headed with you about this.

In "News Never Pays," our fearless CEO, Monika Bauerlein, connects the dots on several concerning media trends that, taken together, expose the fallacy behind the tragic state of journalism right now: That the marketplace will take care of providing the free and independent press citizens in a democracy need, and the Next New Thing to invest millions in will fix the problem. Bottom line: Journalism that serves the people needs the support of the people. That's the Next New Thing.

And it's what MoJo and our community of readers have been doing for 47 years now.

But staying afloat is harder than ever.

In "This Is Not a Crisis. It's The New Normal," we explain, as matter-of-factly as we can, what exactly our finances look like, why this moment is particularly urgent, and how we can best communicate that without screaming OMG PLEASE HELP over and over. We also touch on our history and how our nonprofit model makes Mother Jones different than most of the news out there: Letting us go deep, focus on underreported beats, and bring unique perspectives to the day's news.

You're here for reporting like that, not fundraising, but one cannot exist without the other, and it's vitally important that we hit our intimidating $390,000 number in online donations by June 30.

And we hope you might consider pitching in before moving on to whatever it is you're about to do next. It's going to be a nail-biter, and we really need to see donations from this specific ask coming in strong if we're going to get there.

payment methods

WE'LL BE BLUNT.

We have a considerable $390,000 gap in our online fundraising budget that we have to close by June 30. There is no wiggle room, we've already cut everything we can, and we urgently need more readers to pitch in—especially from this specific blurb you're reading right now.

We'll also be quite transparent and level-headed with you about this.

In "News Never Pays," our fearless CEO, Monika Bauerlein, connects the dots on several concerning media trends that, taken together, expose the fallacy behind the tragic state of journalism right now: That the marketplace will take care of providing the free and independent press citizens in a democracy need, and the Next New Thing to invest millions in will fix the problem. Bottom line: Journalism that serves the people needs the support of the people. That's the Next New Thing.

And it's what MoJo and our community of readers have been doing for 47 years now.

But staying afloat is harder than ever.

In "This Is Not a Crisis. It's The New Normal," we explain, as matter-of-factly as we can, what exactly our finances look like, why this moment is particularly urgent, and how we can best communicate that without screaming OMG PLEASE HELP over and over. We also touch on our history and how our nonprofit model makes Mother Jones different than most of the news out there: Letting us go deep, focus on underreported beats, and bring unique perspectives to the day's news.

You're here for reporting like that, not fundraising, but one cannot exist without the other, and it's vitally important that we hit our intimidating $390,000 number in online donations by June 30.

And we hope you might consider pitching in before moving on to whatever it is you're about to do next. It's going to be a nail-biter, and we really need to see donations from this specific ask coming in strong if we're going to get there.

payment methods

We Recommend

Latest

Sign up for our free newsletter

Subscribe to the Mother Jones Daily to have our top stories delivered directly to your inbox.

Get our award-winning magazine

Save big on a full year of investigations, ideas, and insights.

Subscribe

Support our journalism

Help Mother Jones' reporters dig deep with a tax-deductible donation.

Donate