You mentioned brainwashing, and then I saw this pop up lol-Interesting notion, but the idea of rating people based on their supposed 'achievements' gives me bad flashbacks to that Black Mirror episode "Nosedive" when our entire society is based on this superficial rating system. It made everyone shallow, fallacious and petty.
It really depends what surveillance we're talking about. Like you, I wouldn't want my personal information to be at the beck and call of a government in a Orwellian police-state of 24/7 household cameras and microphones. Yeah you might be 'secure', but your freedom and private life is being intruded upon and the psychological effect of knowing that someone is potentially watching you can be very damaging. Another aspect of this that was explored in 1984 was of course brain-washing, and by restricting peoples intellectual depth, made them powerless to domination via fear-tactics. Unfortunately brainwashing is an inevitable part of living in society. You and I were both brainwashed when we were little growing up, and we were further brain-washed through any education or interaction with those outside the original family we partook in.
What would be a 'benign' level of surveillance/ societal brainwashing? I'm not even going to guess - but you can be sure that it will be a part of our lives in a very immediate and intimate way.
Human-input would be needed to start the ball rolling anyway. At that time, human values (hopefully universally beneficial ones) will be encoded into the core algorithms of the AI/ASI and ensure that despite the exponential nature of its processing power and equivalent mental abilities during Singularity it will maintain and expand upon those principles in a way that is benign to us in a easily-relatable and non-tricky way. These uncertainties in the evolution of an ASI will probably be the very reason why we'll never make one, or at least one with enough power to actually solve our problems on it's own within a useful timeframe. It would have great benefits to us for it to do so, but the slightest action that we perceive from our perspective as deviating from the core principles could be disastrous.
Instead of a 'ghost'... I like it.
https://www.oye.news/news/technology/vo ... ddgx9SB1qU
I agree about opposing surveillance from human authorities- they have a bad record with it, including surveilling and harassing civil rights and environmental groups that only want to peacefully protest and even trying to provoke violence. Government/police love surveilling others but hate it when it happens to them (like hackers releasing their dirty secrets)- its a huge double standard. I believe we should be able to do it to them if they can do it to us. That will keep them in line. Otherwise, if AI can be trusted to keep info to itself and not dump it to any human authorities, that's a better way. Thats a malignant type of surveillance that was happening against civil rights and environmental groups, the intentional effect was to chill any opposition. The authorities basically stood up for big corporations like Walmart who were selling products made in countries with sweat shops as well as other big companies (like fur manufacturers) and ignoring the will of the people (who actually pay their incomes via taxes.) The Patriot Act empowered them to start calling libraries, online repositories, etc., to ask what sort of books or other material their patrons were reading. And then there is the whole Samsung TV fiasco where they see what you were doing through your TV (very X filesesque) and tageting advertising, for example, a friend of mine went outside to mow his lawn and when he got back his inbox was loaded with lawn ads (and he never buys lawn stuff online.)
I love Black Mirror too, it's a modern-day X Files! I can see that kind of competition arising that leads to pettiness so we would need to "downvote" people who exhibit that behavior haha!
Speaking of 1984 did you see this?
https://www.bloomberg.com/news/articles/2019-01-29/apple-bug-lets-iphone-users-listen-in-on-others-via-facetime
They already had a way of turning cell phones into two way mics but this is even more direct. I had heard Zuckerberg keeps a piece of tape on his webcam at all times because he knows any web cam can be turned on remotely.
I get nervous about companies like Google being at the forefront of AI, they've been super secretive about it, but they also have some unethical practices involving government influence and creating a pseudomonopoly by gobbling up the competition. They've been fined billions by the EU but our government is too in with them and looks the other way.
We have a big anticorruption movement going on right now to get rid of all the dark money in politics that is giving undue influence to large corporations here that get by without regulation, letting them dump toxic waste in the environment and seize private land. Is China's anticorruption movement going in a malignant direction?
Do you think AGI might have a better chance of succeeding than ASI?