Media & Entertainment

Following suicides and lawsuits, Snapchat restricts apps building on its platform with new policies

Comment

logo of mobile app Snapchat
Image Credits: Denis Charlet / AFP / Getty Images

After a bullied teen died by suicide, a grieving mother last year sued the platform where the abuse had taken place — Snapchat — for not doing enough to protect its younger users. Another lawsuit, related to another suicide, followed last month. In response to the former, Snap banned the anonymous messaging apps that had facilitated online bullying and vowed to revamp its policies to address what sort of Snapchat-connected experiences could be built using its developer tools. Today, the company announced the results of its policy review and the changes it’s making.

Effective immediately for new developers building on its Snap Kit platform, Snap is banning anonymous messaging apps and will require anyone building friend-finding apps to limit those apps to users 18 and up. Existing developers are being given 30 days to come into compliance with the new policies.

These changes are limited to third-party apps integrated with Snapchat and are not intended to address other child safety issues on Snap’s platform.

Snap says the policy update will impact a small subset of their community of over 1,500 developers. Only around 2% of developers will be impacted by the prohibition on anonymous messaging apps, while another 3% will be impacted by the new requirement to age-gate their apps. The company also noted that developers who remove anonymous messaging from their apps can have their apps re-reviewed and remain a Snap Kit partner.

One app that greatly benefited from the earlier ban on anonymous messaging apps YOLO and LMK, Sendit, is among those that will need to make changes in order to continue to work with Snapchat. In a matter of months following the bans, Sendit had gained millions more downloads from teens who still wanted a way to post anonymous Q&As.

Sendit gains 3.5M downloads after Snapchat suspends top anonymous apps YOLO and LMK

The draw of anonymous social apps is unquestionable, especially for young people. But over the years, time and again, it’s been proven that such apps cannot be used responsibly –but can result in devastating consequences. From the early MySpace days to the teen suicides linked to Ask.fm to the unfortunately well-funded anonymous apps like Secret and Yik Yak (neither of which lasted), anonymity in the hands of young people has been tested and consistently failed. Considering this history, it was arguably irresponsible to permit this sort of activity on Snapchat in the first place, given its core demographic of teens and young adults.

In addition to the anonymous messaging ban, Snap will also now limit friend-finding apps to adult users ages 18 and up.

Friend-finding apps are designed to connect users with strangers on Snapchat, can encourage people to share their personal information, and are a common avenue for child predators to reach younger, vulnerable Snapchat users. Often, the apps are used for dating purposes or sexting, not “friend-finding,” and can be filled with porn bots. For years, law enforcement officials and child safety experts have warned about child predators on Snapchat and dubbed friend-finding apps as “Tinder for teens.”

Issues with these apps continue today. For example, an investigation published last month by The Times detailed the rampant sexual abuse and racism taking place on one of these apps, Yubo.

The anonymous messaging ban and restrictions on friend-finding apps are the only two major changes being made to Snap’s policies today, but the company notes that developers’ apps will still have to go through a review process where they have to answer questions about their use cases and demo their proposed integrations. Snap also said it will conduct periodic reviews every six months to ensure the functionality of the apps hasn’t changed in a way that would violate its policies. Any developer who intentionally seeks to deceive Snap will be removed from Snap Kit and the developer platform altogether, it added.

“As a platform that works with a wide range of developers, we want to foster an ecosystem that helps apps protect user safety, privacy and well-being while unlocking product innovation for developers and helping them grow their businesses,” a Snap spokesperson said in reference to the policy updates. “We believe we can do both, and will continue to regularly evaluate our policies, monitor app compliance, and work with developers to better protect the well-being of our community.”

Snap’s platform safety still needs work

While the changes impact third-party apps integrating with Snapchat, the company has yet to address child safety issues on its platform through something like an age-gated experience for minors, similar to TikTok, or through the launch its promised parental controls, which Instagram and TikTok now have.

However, the company, whose app is rated 13+, has restricted the visibility and findability of minors’ profiles, provides tools and reminders to maintain your friend list, requires mutual friending before messaging (if under 18), and provides links to safety resources, like mental health lines.

Despite those efforts, today’s changes come ahead of what’s still a lot more work to be done in terms of child safety.

In hearing with Snap, TikTok and YouTube, lawmakers tout new rules to protect kids online

Platform safety is already top of mind for social media companies industry-wide as regulatory pressure heats up. In its case, Snap was hauled before Congress last fall to answer lawmakers’ questions over various safety issues impacting minors and young adults using its app, including the prevalence of eating disorder content and adult-oriented fare that’s inappropriate for Snapchat’s younger teenage users but not blocked by an age gate.

Snap was also sued this January alongside Meta by another family that lost their child to suicide after she succumbed to pressure to send sexually explicit photos that were later leaked among her classmates. The complaint states that Snapchat’s lack of verification of the child’s age and its use of disappearing messages contributed to her death. In addition, the suit mentions how anonymous messaging played a role, though it doesn’t directly reference the use of third-party anonymous apps.

Snapchat says it’s getting better at finding illicit drug dealers before users do

In the same month, Snap addressed other issues with its friend recommendation feature to make it harder for drug dealers to connect with teens on the app. The problem had been the subject of an NBC News investigation that connected Snapchat with the sale of fentanyl-laced pills that had killed teens and young adults in over a dozen states.

Prior to that, the company faced lawsuits for its “speed filter” that let users take photos that showed how fast they were going. The filter contributed to numerous car accidentsinjuries, and even deaths over the years. It was later disabled at driving speed initially, then taken down in 2021. (Snap declined to comment on this matter because litigation is pending.)

Now that lawmakers are finally looking to rein in the Wild West days of Big Tech, where growth and engagement were consistently prioritized over user safety, Snap has been preparing to make changes. It hired its first-ever head of platform safety, Jacqueline Beauchere, in September.

YouTube and Snapchat were asked to defend their apps’ age ratings in Senate hearing

Snap CEO Evan Spiegel in October also said the company was developing parental control tools. These tools — which would follow the launch of parental controls on TikTok and, just this week, Instagram — will allow parents to see who their teens are talking to on the app.

Snap hasn’t said if the tools will address parents’ other concerns — including a way for parents to disable the child’s access to sending or receiving disappearing messages, restrict friend requests or require approvals, block the child from sharing photos and other media, or hide the adult-oriented (and often clickbait-y) content that features prominently in the app’s Discover section.

“We want to help provide ways for parents and teens to partner together to ensure their safety and well-being online — similar to the ways parents help prepare their kids in real life,” a Snap spokesperson said of the parental controls. “We hope that these new tools will serve as a conversation starter between parents and their teens about how to be safe online.”

The company said its initial suite of parental controls is on track for a launch this year. The developer policy changes are live now.

If you or someone you know is struggling with depression or has had thoughts of harming themselves or taking their own life, The National Suicide Prevention Lifeline (1-800-273-8255) provides 24/7, free, confidential support for people in distress, as well as best practices for professionals and resources to aid in prevention and crisis situations.

Snapchat to introduce family safety tools to protect minors using its app

Correction, 3/17/22 2:45 PM ET: Snapchat’s speed filter was initially disabled at car speeds, but not fully removed from the platform until 2021. 

More TechCrunch

Copilot, Microsoft’s brand of generative AI, will soon be far more deeply integrated into the Windows 11 experience.

Microsoft wants to make Windows an AI operating system, launches Copilot+ PCs

Some startups choose to bootstrap from the beginning while others find themselves forced into self funding by a lack of investor interest or a business model that doesn’t fit traditional…

VCs wanted FarmboxRx to become a meal kit, the company bootstrapped instead

Uber and Lyft drivers in Minnesota will see higher pay thanks to a deal between the state and the country’s two largest ride-hailing companies. The upshot: a new law that…

Uber’s and Lyft’s ride-hailing deal with Minnesota comes at a cost

Andreessen Horowitz’s American Dynamism fund has established a new fellowship program aimed at introducing top engineers and technologists to venture investing, a move that could help the firm identify less…

a16z’s American Dynamism team launches program to introduce technical minds to VC

Another fintech startup, and its customers, has been gravely impacted by the implosion of banking-as-a-service startup Synapse. Copper Banking, a digital banking service aimed at teens, notified its customers on…

Teen fintech Copper had to abruptly discontinue its banking, debit products

Autodesk — the 3D tools behemoth — has acquired Wonder Dynamics, a startup that lets creators quickly and easily make complex characters and visual effects using AI-powered image analysis. The…

Autodesk acquires AI-powered VFX startup Wonder Dynamics

Farcaster, a blockchain-based social protocol founded by two Coinbase alumni, announced on Tuesday that it closed a $150 million fundraise. Led by Paradigm, the platform also raised money from a16z…

Farcaster, a crypto-based social network, raised $150M with just 80K daily users

Microsoft announced on Tuesday during its annual Build conference that it’s bringing “Windows Volumetric Apps” to Meta Quest headsets. The partnership will allow Microsoft to bring Windows 365 and local…

Microsoft’s new ‘Volumetric Apps’ for Quest headsets extend Windows apps into the 3D space

The spam reached Bluesky by first crossing over two other decentralized networks: Mastodon and Nostr.

The ‘vote Trump’ spam that hit Bluesky in May came from decentralized rival Nostr

Welcome to TechCrunch Fintech! This week, we’re looking at the continued fallout from Synapse’s bankruptcy, how Layer wants to disrupt SMB accounting, and much more! To get a roundup of…

There’s a real appetite for a fintech alternative to QuickBooks

The company is hoping to produce electricity at $13 per megawatt hour, which would be more than 50% cheaper than traditional onshore wind.

Bill Gates-backed wind startup AirLoom is raising $12M, filings reveal

Generative AI makes stuff up. It can be biased. Sometimes it spits out toxic text. So can it be “safe”? Rick Caccia, the CEO of WitnessAI, believes it can. “Securing…

WitnessAI is building guardrails for generative AI models

It’s not often that you hear about a seed round above $10 million. H, a startup based in Paris and previously known as Holistic AI, has announced a $220 million…

French AI startup H raises $220M seed round

Hey there, Series A to B startups with $35 million or less in funding — we’ve got an exciting opportunity that’s tailor-made for your growth journey! If you’re looking to…

Boost your startup’s growth with a ScaleUp package at TC Disrupt 2024

TikTok is pulling out all the stops to prevent its impending ban in the United States. Aside from initiating legal action against the U.S. government, that means shaping up its…

As a US ban looms, TikTok announces a $1M program for socially driven creators

Microsoft wants to put its Copilot everywhere. It’s only a matter of time before Microsoft renames its annual Build developer conference to Microsoft Copilot. Hopefully, some of those upcoming events…

Microsoft’s Power Automate no-code platform adds AI flows

Build is Microsoft’s largest developer conference and of course, it’s all about AI this year. So it’s no surprise that GitHub’s Copilot, GitHub’s “AI pair programming tool,” is taking center…

GitHub Copilot gets extensions

Microsoft wants to make its brand of generative AI more useful for teams — specifically teams across corporations and large enterprise organizations. This morning at its annual Build dev conference,…

Microsoft intros a Copilot for teams

Microsoft’s big focus at this year’s Build conference is generative AI. And to that end, the tech giant announced a series of updates to its platforms for building generative AI-powered…

Microsoft upgrades its AI app-building platforms

The U.K.’s data protection watchdog has closed an almost year-long investigation of Snap’s AI chatbot, My AI — saying it’s satisfied the social media firm has addressed concerns about risks…

UK data protection watchdog ends privacy probe of Snap’s GenAI chatbot, but warns industry

U.S. cell carrier Patriot Mobile experienced a data breach that included subscribers’ personal information, including full names, email addresses, home ZIP codes and account PINs, TechCrunch has learned. Patriot Mobile,…

Conservative cell carrier Patriot Mobile hit by data breach

It’s been three years since Spotify acquired live audio startup Betty Labs, and yet the music streaming service isn’t leveraging the technology to its fullest potential — at least not…

Spotify’s ‘Listening Party’ feature falls short of expectations

Alchemist Accelerator has a new pile of AI-forward companies demoing their wares today, if you care to watch, and the program itself is making some international moves into Tokyo and…

Alchemist’s latest batch puts AI to work as accelerator expands to Tokyo, Doha

“Late Pledge” allows campaign creators to continue collecting money even after the campaign has closed.

Kickstarter now lets you pledge after a campaign closes

Stack AI’s co-founders, Antoni Rosinol and Bernardo Aceituno, were PhD students at MIT wrapping up their degrees in 2022 just as large language models were becoming more mainstream. ChatGPT would…

Stack AI wants to make it easier to build AI-fueled workflows

Pinecone, the vector database startup founded by Edo Liberty, the former head of Amazon’s AI Labs, has long been at the forefront of helping businesses augment large language models (LLMs)…

Pinecone launches its serverless vector database out of preview

Young geothermal energy wells can be like budding prodigies, each brimming with potential to outshine their peers. But like people, most decline with age. In California, for example, the amount…

Special mud helps XGS Energy get more power out of geothermal wells

Featured Article

Sonos finally made some headphones

The market play is clear from the outset: The $449 headphones are firmly targeted at an audience that would otherwise be purchasing the Bose QC Ultra or Apple AirPods Max.

9 hours ago
Sonos finally made some headphones

Adobe says the feature is up to the task, regardless of how complex of a background the object is set against.

Adobe brings Firefly AI-powered Generative Remove to Lightroom

All cars suffer when the mercury drops, but electric vehicles suffer more than most as heaters draw more power and batteries charge more slowly as the liquid electrolyte inside thickens.…

Porsche Ventures invests in battery startup South 8 to boost cold-weather EV performance