Earlier this month, Meta announced that it would be shutting down CrowdTangle, the social media monitoring and transparency tool that has allowed journalists and researchers to track the spread of mis- and disinformation. It will cease to function on August 14, 2024—just months before the US presidential election.
Meta’s move is just the latest example of a tech company rolling back transparency and security measures as the world enters the biggest global election year in history. The company says it is replacing CrowdTangle with a new Content Library API, which will require researchers and nonprofits to apply for access to the company’s data. But the Mozilla Foundation and 140 other civil society organizations protested last week that the new offering lacks much of CrowdTangle’s functionality, asking the company to keep the original tool operating until January 2025.
Meta spokesperson Andy Stone countered in posts on X that the groups’ claims “are just wrong,” saying the new Content Library will contain “more comprehensive data than CrowdTangle” and be made available to nonprofits, academics, and election integrity experts. But Meta did not respond to questions about why commercial newsrooms, like WIRED, are to be excluded.
Brandon Silverman, cofounder and former CEO of CrowdTangle, who continued to work on the tool after Facebook acquired it in 2016, says it’s time to force platforms to open up their data to outsiders. The conversation has been edited for length and clarity.
Vittoria Elliott: CrowdTangle has been incredibly important for journalists and researchers trying to hold tech companies accountable for the spread of mis- and disinformation. But it belongs to Meta. Could you talk a little bit about that tension?
Brandon Silverman: I think there’s a bit too much of a public narrative that frustration with [New York Times columnist] Kevin Roose’ tweets is why they turned their back on CrowdTangle. I think the truth is that Facebook is moving out of news entirely.
When CrowdTangle joined Facebook, they were all in on news and bought us to help the news industry. Fast forward three years later, they are like, “We’re done with that project.” There is a lot of responsibility that comes with hosting news on a platform, especially if you exist in essentially every community on Earth. I think that they made a calculus at some point that it just wasn’t worth what it would cost to do responsibly.
My takeaway when I left was that if you want to do this work in a way that really serves civil society in the way we need it to, you can’t do it inside the companies—and Meta was doing more than almost anyone else. It’s abundantly clear that we need our regulators and elected officials to decide what we, as a society, want and expect from these platforms and to make those [demands] legally required.
What would that look like?
I think we’re at the very beginning of an entire ecosystem of better tools doing this work. The European Union’s sweeping Digital Services Act has a bunch of transparency requirements around data sharing. One of those they sometimes call the CrowdTangle provision—it requires qualifying platforms to provide real-time access to public data.
Over a dozen platforms now have new programs that allow outside researchers to get access to real-time public content. Alibaba, TikTok, YouTube—which has been a black box forever—are now spinning up these programs. It’s been very quiet, because they don’t necessarily want a ton of people using them. In some cases companies add these programs to their terms of service but don’t make any public announcement.
I think there is a universe in which we’re actually on the cusp of way more data being available than has ever been available before. The next thing we need is funding and philanthropic efforts and civil society efforts to start building open source tools that can take that data and build useful analytic features on top for election-protection groups and fact-checking disinformation.
You mentioned making data available to researchers, but what does that mean in practice? Do you have to be attached to an academic institution? Do journalists count? European researchers are going to get mandated access to social media data. Will we see lawsuits if that data gets shared with a US nonprofit or regulator?
The way the EU law was written gives too much power to the platforms to make a lot of those decisions. It’s essentially up to each platform to figure out a lot of the details, including everything you mentioned. I think we need international standards, and we need to raise awareness that these programs are available and researchers can start applying for them, and pressure testing them, and send feedback to the European Commission about what’s working and what isn’t.
I’ve had many conversations with different governments who also want to require this sort of thing but need more detail on these questions you just asked. I think as we start to get these programs off the ground and there starts to be consensus on how to answer some of those questions, we can go to places like New Zealand and Canada and the US, and saying, “Hey, we know what works and what doesn’t. And either you can just watch as Europe gets to study all this stuff, or you can start bringing some of those same regulations here.”
At the time CrowdTangle was founded, Twitter was making a lot of its data public. Now we’re seeing a decrease in transparency from tech companies all around, whether it’s not publishing transparency reports at the same rate or not making data readily available.
If you’re a researcher who relies on data access from these platforms, it’s been a dark two years. Twitter, for all intents and purposes, has completely shut down data access to academics. It’s available, but it starts at like $42,000 a month. Meta has largely turned off most of their data sharing things. They had a big US 2020 election research project, but they’re not redoing that for the US election in 2024, let alone other countries around the world. All of the voluntary efforts that used to exist have essentially been, for all intents and purposes, shut down.
The flip side is I think you’re beginning to see attempts to comply with new laws coming online. Anytime you make data available, it can be politicized, it can be misunderstood, it can be misused. One of the toughest parts with mandating this is how do you do it in a way that’s as privacy-protecting as possible and prevent abuse by governments. The more people we get on board to respond to the bad arguments and to have a public debate, the better, versus trying to kind of like defensively respond by limiting access. Sunlight was always the best disinfectant.
Updated 3/25/2024, 4:05 pm EDT: More than 140 organizations have now signed the open letter calling on Meta to keep CrowdTangle operating.
