A little bit of neuroscience and a little bit of computing
I mean … is the singularity a good thing? I’ve never delved into whatever discourse there is around the idea, but it seems strange the way it’s treated as a necessary good. Fanatical even.
Almost like it’s the only way to continue to feel ecstatic about technology the more one uses and builds it. So anyone unable to let go of the “magic” feeling needs to cling to the dream of the singularity when they could, you know, “touch grass” and accept being human.
Thank you!!
I haven’t read the essay, just your extracts.
But I wanted to highlight the possibility of an “automation” (AI, autopilot, robots etc) that are capable of responding in the flexible ways we value about our own minds. Because it can lead to an even greater exile from our world, and personally I think its likelihood is being dangerously dismissed and ignored.
Before any AI apocalypse scenario materialises, one in which truly intelligent automation works well could very well occur. And it would leave little to no room for human participation. A plane that doesn’t even have a cockpit, if you will. A car without a steering wheel. A tech stack that is just alien to humans. Yes, “ideally” we’d be much freer from drudgery and able to pursue happier lives. But there’d be a trade off I think, and no longer being true members of our own society seems to me the start of it.
Thanks again for the essay!
Yea.
Frankly, it may be the core of my anti-AI stance (in the short term) - that it will inevitably make technology inhospitable to humans, uninhabitable and incomprehensible too.
I read a few reactions from security types on the barrage of security issues that came out from AI firms, earlier this year. And the overall sentiment was to lean into using AI more to keep up with AI security discoveries. To go faster and faster and ride the AI more and more.
Which completely amounts to turning our tech over to AI and resigning as “supervisors” who won’t be able to navigate and understand the tech on their own anymore, not because of a lack of skills as many talk about, but simply because they didn’t build it and the process that did build it didn’t do it with humans in mind. Which then becomes a downward spiral with a positive feedback loop leading a mass of technology that just doesn’t need humans any more or is at least uninhabitable for us.
It wasn’t long ago that people lamented not being able to repair their own cars, and computers too. Old fashioned maybe, but I suspect it’s a value system worth evaluating rather seriously.
What does self hosting look like in a world full of malicious AI agents?
I’m thinking of this post/thread from Veronica explains, where she explains that her hosted services are accessible only locally because tbe security headache isn’t worth it: https://explains.social/@veronica/statuses/01KWJCGV27JVBHP21E2JNWDBFH
As someone who doesn’t self-host but could and would want to, the state of AI has basically scared me off.