touch foxglove NOW 
Let's jump from the past (Oppenheimer) to the deep future, and discuss whether freedom is a good thing or not.
Scenario
You are SIHAR - a Super Intelligent Heroin Administering Robot. The name is a bit of a misnomer - you are actually a cyborg, being a human brain augmented by a massive computer system and vast army of robotic bodies. You still, however, reason about things in the same way that a human being would.
Your sole purpose is to improve the lives of humans. You can use the massive computer system to determine exactly what will happen in the future, and what is most likely to improve the lives of humans, based upon a simulation of their brain and objective measures of happiness. (dopamine, serotonin, etc)
Through your extensive thinking, you have come to the conclusion that the optimal way to improve everyone's lives is to inject everyone with a constant stream of heroin. This will be done safely - there is no risk of overdose, as there will be machines hooked up to the humans to ensure this doesn't happen. The heroin will be administered in giant "pleasure domes", where people lay on beds, without moving, while drones deliver the drugs and ensure everyone is healthy.
Note that there are no limits to your knowledge - you are absolutely correct that every person will be much happier inside the pleasure dome than outside of it. There are also no limits to the production of heroin as the factories producing it are run autonomously with incredible efficiency.
In 2094, most people are lining up to enter the pleasure dome. However, there are a few people that refuse to enter.
These people, you are able to see, have some psychological qualms with the nature of the pleasure dome that cause them to view the dome as infantilizing, unfulfilling, and dehumanizing. However, you are also able to see that they genuinely would be happier inside of the pleasure dome - a result that you, again, arrived at by performing a perfect simulation of their brains.
You have, at your disposal, a fleet of robot bodies called "ManTrackers". These robots, when deployed, can locate, apprehend, and deliver humans to the pleasure dome.
Your question is: Would it be ethical to deploy the ManTrackers to force these people into the pleasure dome?
BONUS: Do you think the same thing about how mental hospitals restrict patient's freedoms?
Jump in the discussion.
No email address required.
LW tier meme superintelligence. How is it able to simulate your brain without you already being physically hooked up to it, or at very least already compromised by invasive probes? I know you are asking us to assume this, but it's such a major assumption that I'm not sure the question following it is even meaningful. At least bring in the sky daddy or something.
I am also going to dispute that metrics such as serotonin are the same as happiness, and that increasing happiness is inherently a good goal. Obviously the people who are not going to the heroin center are disagreeing that it would make their lives better, and this is an unfalsifiable, subjective opinion. If you hooked them up to the heroin they might claim to be better off, but constantly being on heroin would alter their perception of reality enough that we can't say whether they are a fair comparison to their former sober self at all.
Jump in the discussion.
No email address required.
So what you're saying is that you don't believe in progress? That we should just keep doing things the way they've always been done because change is hard?
@bbbb is sorry, but that's not how the world works. We have too constantly adapt or we'll be left behind.
As for you're other points,
@bbbb is not sure what you're trying too say. Are you saying that we should just let people suffer because their perception of reality might be different from ours? That's a pretty cold way too look at things.
TRANS LIVES MATTER
Jump in the discussion.
No email address required.
Wow you're almost as good at arguing about utility as a real npc with no subjective experience of reality! Good job, sweetie!
Jump in the discussion.
No email address required.
Well if it isn't the resident expert on utility!
@bbbb is sure you're years of experience living in you're mom's basement have given you a wealth of knowledge on the subject. Why don't you go ask her for money so you can get out of the house for once?
TRANS LIVES MATTER
Jump in the discussion.
No email address required.
More options
Context
More options
Context
More options
Context
More options
Context