A US appeals court has issued an opinion that could have wide-ranging implications for social media platforms, finding that content selected for users by TikTok's algorithms doesn't qualify for Section 230 protection.
In an opinion [PDF] published today, a three-judge panel from the Third Circuit Court of Appeals in Pennsylvania decided that, because TikTok presented "blackout challenge" posts to 10-year-old Nylah Anderson on her For You Page of recommended content, the platform deserves to be taken to court for her death that followed.
The "blackout challenge" refers to a dangerous self-asphyxiation "trend" that went around on TikTok several years ago. Anderson attempted to participate in the challenge, leading to her death, but a lower-court judge decided in 2022 that TikTok was protected by Section 230 of the Communications Decency Act (CDA), which protects social media platforms from liability for content posted by their users.
The Third Circuit court sharply disagreed.
"TikTok knew that Nylah would watch [the blackout challenge video] because the company's customized algorithm placed the videos on her 'For You Page' after it 'determined that the Blackout Challenge was 'tailored' and 'likely to be of interest' to Nylah,'" Judge Paul Matey wrote in a partial concurrence included in the decision.
Matey argued that Section 230's application has evolved far beyond the original intent when Congress passed the CDA in 1996. It is not to "create a lawless no-man's land" of legal liability.
"The result is a Section 230 that immunizes platforms from the consequences of their own conduct and permits platforms to ignore the ordinary obligation that most businesses have to take reasonable steps to prevent their services from causing devastating harm," Matey said.
Judge Patty Shwartz wrote in the main body of the opinion that the Third Circuit's reading of Section 230 is reinforced by the recent Moody v NetChoice decision from the US Supreme Court. In that case, related to content moderation laws passed in Florida and Texas, SCOTUS held that algorithms reflect editorial judgments. Shwartz wrote that it's a compilation of third-party speech made in the manner a platform chooses, and thus merits First Amendment protection.
"Given the Supreme Court's observations that platforms engage in protected first-party speech under the First Amendment when they curate compilations of others' content via their expressive algorithms, it follows that doing so amounts to first-party speech under Section 230, too," Shwartz reasoned.
In short, you can't have it both ways: Either you serve everything, let users sort it out and keep that liability shield; or you make algorithmic picks that surface content, give users what you think they want and take on the liability that comes with being the arbiter of that content.
With the appeal decided, Anderson's case will head back to the District Court in the Eastern District of Pennsylvania to be re-heard.
"Today's opinion is the clearest statement to date that Section 230 does not provide this catchall protection that the social media companies have been claiming it does," Anderson family lawyer Jeffrey Goodman told the Associated Press regarding the outcome.
See you all in the supreme court
Jump in the discussion.
No email address required.
Jump in the discussion.
No email address required.
who keeps namelocking you
Jump in the discussion.
No email address required.
It's !redscarepod enjoyers
Jump in the discussion.
No email address required.
I love you just the way you are (in a gay sexual way)
Jump in the discussion.
No email address required.
thanks babe
Jump in the discussion.
No email address required.
I suffer for your love
Jump in the discussion.
No email address required.
More options
Context
More options
Context
More options
Context
More options
Context
Jump in the discussion.
No email address required.
More options
Context
Lol carp
Jump in the discussion.
No email address required.
It wasn't me this time!
Jump in the discussion.
No email address required.
oooh you like her
!metashit every day is spawning season
Jump in the discussion.
No email address required.
More options
Context
whoever it was is high key framing you because no one mentions dasha besides you
Jump in the discussion.
No email address required.
Jump in the discussion.
No email address required.
More options
Context
More options
Context
More options
Context
More options
Context
More options
Context
Good Lord imagine the reeing when the algo stops and Day of the Chud occurs
Jump in the discussion.
No email address required.
More options
Context
More options
Context
Holy shit that is an insane ruling
Jump in the discussion.
No email address required.
How is it insane? Curated content is no longer organic user content, it's now the message the company chooses to send. Saying Reddit as a company is not responsible for the posts on their front page because users moderate the boards and users create the content, but Reddit just steps in to prune what violates their standards is the same as saying I'm not responsible for the giant peepee I've left unmowed in my yard because I didn't touch the grass. Moderated content SHOULD lose section 230 protections.
Jump in the discussion.
No email address required.
Recommending videos similar to a user's viewing habits is totally different than what you are describing.
Jump in the discussion.
No email address required.
"Recommendations" on nearly any popular platform are never isolated to a single viewer's interests, good examples of this include google altering users' search queries to feature brands rather than product types, and youtube's search feature ending the results early to fill half the page with unrelated content.
Jump in the discussion.
No email address required.
More options
Context
No, they're deliberate choices made by the product team. They could have gone one way, or another. The content on Tiktok is even more strongly dictated than if it were displayed universally to all users
Jump in the discussion.
No email address required.
More options
Context
This is theoretically true, but recommendation algorithms have gone way past that
Jump in the discussion.
No email address required.
More options
Context
More options
Context
Jump in the discussion.
No email address required.
More options
Context
How can you make a recommendation algorithm that can account for all types of harmful content?
Jump in the discussion.
No email address required.
I don't really care about the answer to that. Moderate content and accept the responsibility for that or don't
Jump in the discussion.
No email address required.
More options
Context
Yes, you are correct, and companies should be strictly liable for things their algorithm does.
Jump in the discussion.
No email address required.
More options
Context
You can't. Total algorithm death.
Jump in the discussion.
No email address required.
More options
Context
More options
Context
More options
Context
What could possibly go wrong
Jump in the discussion.
No email address required.
More options
Context
Tfw I can no longer recommend products to consumers
Jump in the discussion.
No email address required.
Your HVAC guy recommending you to buy the specific brand of air conditioner is not exactly the same as tiktok telling a child to rope
Jump in the discussion.
No email address required.
Death is a commodity
Jump in the discussion.
No email address required.
More options
Context
More options
Context
Good. Maybe if you were a little better at it you wouldn't be in this mess
Jump in the discussion.
No email address required.
More options
Context
More options
Context
More options
Context
!metashit !besties lets do the keep yourself safe challenge!!!
Jump in the discussion.
No email address required.
Jump in the discussion.
No email address required.
More options
Context
I tied a belt around my neck and the door now what—
Jump in the discussion.
No email address required.
Just kinda lay down like Jeff
Jump in the discussion.
No email address required.
More options
Context
Obesity
Jump in the discussion.
No email address required.
More options
Context
More options
Context
More options
Context
Please force the shitty fricking online platforms to stop recommending shit
Jump in the discussion.
No email address required.
TOTAL ALGORITHM DEATH
Jump in the discussion.
No email address required.
Can you imagine a world without social media algos?
Jump in the discussion.
No email address required.
More options
Context
More options
Context
More options
Context
Anyone ever do that thing as a kid where you'd bend over with your arms hanging down so blood would rush to your head, then stand up really fast, cross your arms over your chest, and hold your breath while one or two people push really hard on your arms so you'd pass out.
Frick we were r-slurred lmao.
Jump in the discussion.
No email address required.
Yea that's been a thing forever. I think now some of these dumbasses are using belts by themselves and then passing out and dying.
The worst part? It's appropriation of trans culture
Jump in the discussion.
No email address required.
This is David Carradine erasure
!kino
Jump in the discussion.
No email address required.
Jump in the discussion.
No email address required.
More options
Context
More options
Context
That's something else lol
Jump in the discussion.
No email address required.
Maybe the parents were coping
Jump in the discussion.
No email address required.
More options
Context
Literally the most pathetic way to die
Jump in the discussion.
No email address required.
More options
Context
More options
Context
More options
Context
How do you think we all ended up on rdrama.net?
Jump in the discussion.
No email address required.
luck?
Jump in the discussion.
No email address required.
More options
Context
More options
Context
Never heard of this before lmao
Jump in the discussion.
No email address required.
More options
Context
I never did that. We were much more sophisticated and took turns riding inside the dryer.
Jump in the discussion.
No email address required.
More options
Context
More options
Context
I'd rather just ban zoomers from internet.
Krayon sexually assaulted his sister.
Jump in the discussion.
No email address required.
banning minors from social media, especially groomercord and reddit, would vastly improve society.
Jump in the discussion.
No email address required.
the fricking end result would be fricking ideal, butt the fricking method of getting there(deanonymization) would ruin the fricking internet.
!slots100
Jump in the discussion.
No email address required.
More options
Context
On the one hand, i would love an internet where i never had to interact with someone under the age of 18, or fricking 25 for that matter.
On the other hand, teenagers have the best chance to contribute to blackhat internet projects such as cracking video games, finding security holes, or curating stolen media since their finances and time tend to be unrestricted. Older hobbyists tend to get swallowed up in obsession with getting laid or radical politics.
Jump in the discussion.
No email address required.
Jump in the discussion.
No email address required.
More options
Context
I find that people under 24 tend to be the stupidest and most sure of themselves and their idiotic opinions and never have anything intelligent to say in a discussion.
Jump in the discussion.
No email address required.
More options
Context
Then they should be able to do like we did and pretend to be adults too. I remember a time on places like reddit where being found out as minor was accepted as a ban worthy offense and something to be embarrassed by.
When it comes to the internet children should be neither seen nor heard.
Jump in the discussion.
No email address required.
More options
Context
More options
Context
This, but for the Internet
Jump in the discussion.
No email address required.
More options
Context
I turned out fine
Jump in the discussion.
No email address required.
Jump in the discussion.
No email address required.
More options
Context
More options
Context
so it's just bardfinn and laurelei bailey?
Jump in the discussion.
No email address required.
BARD BOT ALERT!Current streak was: 0 days 00 hours 22 minutes and 44 seconds
Record is 1 days 13 hours 09 minutes and 59 seconds by TheDunceonFlorist
We've got Bardy fever! today we have mentioned our favorite mod 18 more times than usual!
Jump in the discussion.
No email address required.
More options
Context
More options
Context
More options
Context
Could you imagine?
Jump in the discussion.
No email address required.
More options
Context
TZD
Jump in the discussion.
No email address required.
More options
Context
More options
Context
This ruling is stupid, but since it damages social media and the internet I support it.
Jump in the discussion.
No email address required.
More options
Context
Bring back forum-style searching and sorting
Jump in the discussion.
No email address required.
bring back webrings!
Jump in the discussion.
No email address required.
More options
Context
More options
Context
!codecels death to all algorithmcels. I hated those cute twinks the second I met them irl. I unironically interviewed for one of the stragman teams involved with this
Jump in the discussion.
No email address required.
Bust out the creative writing exercise marsey. You're not getting my upmarsey for merely claiming to have done it
Jump in the discussion.
No email address required.
More options
Context
More options
Context
FRICK
This is honestly just an attack on tiktok cos their algo is too good. I have gotten so many good music and media recs from that app
Jump in the discussion.
No email address required.
Jump in the discussion.
No email address required.
LMAO, but true
Jump in the discussion.
No email address required.
More options
Context
More options
Context
Jump in the discussion.
No email address required.
More options
Context
No cap. Tik Tok is this generation's internet. Remove it and we might as well go back to the stone age and rub sticks to make fire frfr
Jump in the discussion.
No email address required.
Tiktok is leagues ahead of other social media, it's the only normie app I've had fun on since generation 1 facebook
Jump in the discussion.
No email address required.
More options
Context
More options
Context
More options
Context
I love boomers tryina understand internet
Jump in the discussion.
No email address required.
If a human had been manually recommending things to her feed it would clearly be correct. And the fact that it's an algorithm that someone wrote rather than a person shouldn't alter culpability. You can't use an algorithm and then when the algorithm does something bad claim you dindu nuffin
Jump in the discussion.
No email address required.
More options
Context
More options
Context
R-slurred. All they knew was people who watched the same content she did also watched this, so she'd probably like it (and they were right!)
lmfao "Make no attempt to push content people actually watch or else!"
As usual courts are strags
Jump in the discussion.
No email address required.
That's the point though innit, they pushed the content so they're no longer legally absolved.
Jump in the discussion.
No email address required.
More options
Context
More options
Context
Get fricked Tik Tok. Fricking commie chink spyware.
Jump in the discussion.
No email address required.
More options
Context
!chuds and !r-slurs
Is this a cause of concern because this gives the social media companies even wider powers to implement whatever bullshit they see fit. Your honor, we nuked chuddie mCchud's profile because they were engaging in non mainstream speech ie dangerous speech
Or should we celebrate because carp removing any fedposting makes him liable for whatever feddy shit still ends up sticking to the site
Jump in the discussion.
No email address required.
it might actually be a positive change tbh. This seems to be strictly focused at tiktok and its ilk (various "shorts" platforms). They don't mention content moderation at all, and this appears to deal with the algorithms that provide content surfacing for these platforms. Getting the inbreds who use Tiktok off of social media would be incredibly good for society. Though you pinged r-slurs, and it's possible that the supreme court will just ignore this distinction.
Jump in the discussion.
No email address required.
More options
Context
More options
Context
Jump in the discussion.
No email address required.
More options
Context
Time to dust off some product liability suits against every platform chuds
Jump in the discussion.
No email address required.
More options
Context
I'm gonna need the Supreme Court to shut this down please. This could be a big problem for me.
Jump in the discussion.
No email address required.
its possible they do the fricking opposite. Reminder that the fricking VCR was fricking almost banned in the fricking 80s by the fricking supreme court in a fricking 5/4 decision. If the fricking ruling went rhe other way, we might not even have computers in the fricking way we think of them today bc the fricking means to record media would have been rendered illegal and all the fricking tech advances made as a fricking result of the fricking bcr would have never happened.
!slots500
Jump in the discussion.
No email address required.
That was the good timeline.
Jump in the discussion.
No email address required.
More options
Context
More options
Context
More options
Context
kids today are such wusses.
Jump in the discussion.
No email address required.
More options
Context
I hate tiktok as much as the next person, but this trend of making social media platforms responsible for shit that is clearly the parents fault is fricking annoying. Maybe keep your 10 year old kid off tiktok you stupid r-slurs.
Jump in the discussion.
No email address required.
More options
Context
Proprietary services btfo. rdrama keeps winning
Jump in the discussion.
No email address required.
More options
Context
Right now, I'm a click away from using an SQL injection attack to gain access to the database of the website and gain your login credentials, as well as your IP address. I'll then proceed to leak your IP address onto my hacker forums, and then using an IP locator, I'll easily find your house and your name. With that I can access your social media accounts and proceed to ruin your life. You think I'm bluffing? You think that just because a bunch of 7 year old dipshits say they can "hack", but actually can't, that I can't either? Let me shatter that facade for you. Using my team of hackers, we can trace what websites you've visited and what keystrokes you've used, and with that, I can get into your parents' bank account. I can drain it and make you dirt poor. Have you ever felt what it's like to be homeless? Well, you're about to. I can also use cross-site scripting to redirect your web browser to one of my private sites, and download child porn onto your computer and get your parents locked up in prison. I'm your worst fricking nightmare, and I'm about to make you endure living Heck. I'm nowhere and everywhere at the same time. Have fun regretting your existence, shithead.
Snapshots:
https://www.theregister.com/2024/08/28/tiktok_blackout_challenge_appeal/:
ghostarchive.org
archive.org
archive.ph (click to archive)
Jump in the discussion.
No email address required.
!slots500
Jump in the discussion.
No email address required.
More options
Context
More options
Context
they just ilegalized african-american kitty
Jump in the discussion.
No email address required.
Jump in the discussion.
No email address required.
More options
Context
More options
Context