Where Did Extremists Go When Twitter and Other Social Media Platforms Cracked Down?

by | Aug 19, 2022 | Racism (Us vs Them)

A tweet by former President Donald Trump is displayed at a hearing of the House committee investigating the Jan. 6 Capitol riot. Credit: Jabin Botsford/The Washington Post via Getty Images

Where Did Extremists Go When Twitter and Other Social Media Platforms Cracked Down?

by | Aug 19, 2022 | Racism (Us vs Them)

A tweet by former President Donald Trump is displayed at a hearing of the House committee investigating the Jan. 6 Capitol riot. Credit: Jabin Botsford/The Washington Post via Getty Images
A former intelligence officer and data scientist explains how extremists, conspiracy theorists and violent racists fled to smaller platforms. Once there, their remarks continued to fester and spread.

Since Donald Trump’s election in 2016, an entire ecosystem of right-wing social media platforms has come into existence — from Gab (where the alleged Pittsburgh synagogue shooter posted hateful screeds) to Parler (a hot spot for insurrectionary activities in the run-up to Jan. 6) to the former president’s own Truth Social (which was frequented by a fan of his who was recently shot to death after attacking a Cincinnati FBI office). This new wave of apps and sites follows in the footsteps of 4chan and 8kun, older internet message boards that continue to attract a sizable audience of conspiracy theorists and violent racists.

Welton Chang knows this corner of the digital world well. A former Army intelligence officer and human rights activist, Chang runs Pyrra, a small tech startup dedicated to identifying and tracking the extremist ideas circulating in these spaces. Pyrra, which launched in early 2022 with $1.3 million in funding, monitors more than 20 alternative social media sites and online forums, scanning some 100 million messages per week.

Chang, a data scientist, says increased content moderation at major social media platforms — including the ouster of figures ranging from Trump to Alex Jones — has driven a sizable contingent of users to the spaces Pyrra tracks, which tend toward an absolutist view of free speech.

This conversation has been edited for length and clarity.

Can you tell me in simple terms what Pyrra does?

Pyrra is a threat intelligence company. We do three things: We collect content — publicly available information — from alternative social media sites. We use machine learning and advanced algorithms to detect violent threats, hate speech and disinformation that are popping up on these platforms. And then we display that information for our clients, either through reports or through a platform that we have.

We got our start in the human rights community. We were a project inside of Human Rights First [a U.S.-based advocacy group]. … We spun out of HRF as our own company in December 2021 and launched our platform earlier this year.

In general, what are the big extremist threats that you’re following these days? What worries you?

One is just the death of critical thinking and the amount of evidence-free speculation that becomes the truth, small-t truth, on these platforms. It can be something as innocuous as something done by some celebrity all the way to things that really have impacts on the health of our democracy.

But it’s also just the general lack of confidence in institutions writ large. … We’re at an all-time low in terms of government trust, based on all the different metrics that are out there. …

[This brings us to] the inherent incoherence of conspiracy theories and these really outlandish ideas about how the world actually works. People believe that the government is simultaneously totally incompetent and also all-knowing and all-seeing and capable of pulling off a massive effort like helping Bill Gates spread the COVID vaccine through mind control via 5G technology.

These are diametrically opposed ideas, yet folks are simultaneously believing both of them and saying, “This is what is happening in the world today.”

I’ve been really immersed in this stuff since 2016, and I’m still routinely appalled, surprised and taken aback by some of the things I read on these platforms. And maybe the day I become inured to this stuff is the day I need to leave the biz. But I’m still really shocked by the things I read.

Look at the Pew Research polls that are out there about how many people believe the core tenets of QAnon. I think we’ve entered a new phase in which social media has altered and warped how we encounter information, how we process it, how we internalize what counts as the truth. It’s having significant impacts on our democracy.

I really do believe that social media is an accelerator. …

An accelerator of societal disintegration?

Yes, yes, exactly.

You had an interesting Twitter thread about the disinformation you’re seeing around the Jan. 6 committee. Can you tell me about that?

On these alternative social media platforms, the narrative about Jan. 6 started getting pushed on Jan. 7. People started by saying it was antifa that was responsible. That got amplified by more mainstream characters, even Tucker Carlson talked about antifa maybe having a role in Jan. 6.

Right off the bat they were trying to deflect blame. You had card-carrying members of the MAGA community like [Jan. 6 protester] Ray Epps getting falsely accused of being FBI informants and being responsible for pushing people into the Capitol. He came out and said, “I was one of them [the pro-Trump movement], and they just kind of turned on me.”

All it takes is a single user on one of these platforms to write something outlandish without any factual basis or evidence. They’re not citing anything, they’re not looking at any hardcore piece of information or they’re taking things out of context. And that just gets endlessly amplified by other users. People who are not sophisticated consumers of information see that on these platforms, and they go: “I agree with that. That sounds plausible. It’s now the truth for me.”

If you ask people, “Who was responsible for Jan. 6?” significant numbers of people will tell you antifa had a role in Jan. 6. Multiple credible investigations have shown that antifa had no role in Jan. 6. … Yet this maintains a consistent narrative, and that narrative started spinning basically as soon as people were cleared from the Capitol building.

In the past that’s the kind of thing that would’ve happened on Twitter. But now it starts on the smaller platforms. It may eventually migrate to Twitter. But Twitter and the larger platforms actually do some content moderation, making it harder for this stuff to gain traction or get picked up.

These smaller places either don’t have the resources to do content moderation or don’t have the will to do it. They are allowing these narratives to fester and gain traction and eventually jump hosts.

Out of all the alternative social media apps and sites, which seem to be the most successful? Where is the energy?

It’s still 4chan. … One secret about 4chan is they actually have to do a significant amount of content moderation now — where they remove posts because of how bad and violent they are. There’s a massive amount of people on 4chan on a regular basis, who are frequent flyers on the boards. It’s still crazy there.

More than Telegram, an instant messenger service?

Telegram is also huge. Right now we track thousands of Telegram channels, but that’s just a drop in the bucket.

Republished with permission from ProPublica, by

ProPublica

ProPublica

ProPublica is an independent, nonprofit newsroom that produces investigative journalism with moral force. They dig deep into important issues, shining a light on abuses of power and betrayals of public trust — and they stick with those issues as long as it takes to hold power to account.

With a team of more than 100 dedicated journalists, ProPublica covers a range of topics including government and politics, business, criminal justice, the environment, education, health care, immigration, and technology. They focus on stories with the potential to spur real-world impact. Among other positive changes, their reporting has contributed to the passage of new laws; reversals of harmful policies and practices; and accountability for leaders at local, state and national levels.

0 Comments

Submit a Comment

Your email address will not be published.

Related Articles

Sep 24 2022

White Nationalism: A Political Ideology Centered on Racism and Conspiracy Theories

Aside from inflammatory anti-immigration rhetoric and Qanon fantasies, the conspiracy theory white nationalist are pushing in campaigns across the country is Trump’s...
Sep 19 2022

Racist Governors Are Engaged in Human Trafficking

Racist governors Abbott and DeSantis are not even original in their mistreatment of immigrants. The same cruel scam was perpetrated on black families in the 1960s by...
Sep 13 2022

Voter Suppression: The Fight Against an Age-Old Effort to Block Black Americans From Voting

As a new wave of voter suppression restrictions makes voting harder for people who struggle to read — now 1 in 5 Americans — people like Olivia Coley-Pearson have taken...
1936: A flag hanging outside the headquarters of the NAACP (National Association for the Advancement of Coloured People) at 69 Fifth Avenue, New York City, bearing the words “A Man was Lynched Yesterday.” (Photo by MPI/Getty Images)
Sep 11 2022

Congress Considers Adding Lynching Sites to the National Park System

Preserving pieces of history has taken on added importance amid a heated national debate about how the nation’s history of centuries of slavery and oppression of Black...
Aug 28 2022

America’s Right Wing Is Itching To Erase Our History of Racism and Slavery

Right-wing zealots are intent on hiding our history with a state-sponsored, Orwellian purging of knowledge. Last year, 1,586 books were banned in 86 school districts,...
A Texas law says slavery cannot be taught as part of the ‘true founding’ of the United States. Tamir Kalifa/Getty Images
Aug 12 2022

Conservative Politicians Seek to Revise History Lessons About Slavery in the United States

A Texas proposal to “redefine” slavery grew out of work done under a Texas law that says slavery and racism can’t be taught as part of the “true founding”...
Jul 26 2022

Texas Republicans Work to Redefine Slavery as “Involuntary Relocation”

Truth in America is under seize. There has been a concerted, intentional effort to bury our history, with the purpose of hiding crimes against humanity, acts of horror,...
Jul 26 2022

The Boosting of Antisemitic Hate Speech by Social Media Algorithms

Antisemitism on social media platforms is fueled by algorithms, which are programmed to register engagement. This ensures that the more engagement a post receives, the...
Jul 16 2022

Conservative Partnership Institute: Building Out an “America First” White Supremacist Infrastructure

“America First” has been the slogan of white supremacist factions for about 100 years and has now been adopted by various right wing groups, insurrectionist...
Jul 15 2022

A Former Member of Oath Keepers Reveals the Group’s Racist, Antisemitic Beliefs — And Their Plans to Start a Civil War

White nationalists in the United States, including the Oath Keepers, Proud Boys, Three Percenters and other attempted a collective coup on Jan. 6, 2021. And they wanted...
Subscribe for Updates!

Subscribe for Updates!

Join our mailing list to receive the latest news and updates from our team.

You have Successfully Subscribed!

Pin It on Pinterest

Share This