this post was submitted on 12 Aug 2024
249 points (100.0% liked)
Technology
68672 readers
3248 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related news or articles.
- Be excellent to each other!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
- Check for duplicates before posting, duplicates may be removed
- Accounts 7 days and younger will have their posts automatically removed.
Approved Bots
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Why this soft-spoken tone?
Killer robots must be banned, period.
Whoever bans them will be at a disadvantage militarily. They will never be banned for this one reason alone.
I think you're conflating a ban to include banning their production (not an unreasonable assumption). As we've seen with nukes, however, possession of a banned weapon is sometimes as good as using it.
I'm guessing the major countries will ban them, but still develop the technology, let other countries start using it, then say "well everyone else is using it so now we have to as well". Just like we're seeing with mini drones in Ukraine. The US is officially against automated attacks, but we're supporting a country using them, and we're developing full automation for our own aircraft.
...and exactly this way of thinking will one day create "Skynet".
We need to be (or become) smarter than that!
Otherwise mankind is doomed.
Unfortunately this is basic game theory, so the “smart” thing is to have the weapons, but avoid war.
Once we’ve grown past war, we can disarm, but it couldn’t happen in the opposite order.
But what until then? Your ideas do not provide any solutions. You just say that it is unavoidable as it is.
Because there’s no solution that we know of.
But now you know it because I have told you in the first comments.
Game theory says your idea isn’t a solution because the actors will disobey.
And I say this is no child's play. We need to get serious, and maybe we need to get smarter than anybody else before us.
I don’t think I’m smart enough to solve “world peace” lol.
The process of collective disarming is the path towards growing past war. And that first step is the collective banning of manufacturing such weapons.
I disagree. War isn’t caused by weapons. It’s caused by racism, religious strife, economic hardship, natural resource exploitation, and more. Those need fixed before anyone will be willing to put away their weapons.
It's enabled by weapons.
And there are people who want to use weapons when they exist, simply because they exist.
And there are people - for example weapons manufacturers - who want other people to use weapons.
Obviously it’s enabled by weapons. But that strengthens my point further - the nation who reduces their weapons first loses.
When has a nation completely set down their weapons, and what was the effect? One obvious case that comes to mind is Ukraine, who fully denuclearized. Ever since that moment they have repeatedly been invaded by Russia (the nation who maintained the weapons).
What you suggest is asking for this to repeat over and over again. The only truly viable path to eradicating war, is to first eradicate the problems that cause war, then to abolish weapons.
If you have factual evidence that your method works, please present it. I shared hard evidence of my perspective.
You seem not to know much. It has happened often, and in very different ways.
Start your studying about Switzerland, because it is easy.
Then try to understand Afghanistan. But beware, it is already a little complicated, and you need to read about 4 - 8 decades of history, and you should not read only sources from one country (they all lie, and you need to overcome that - or stay ignorant).
Last, go for some of the African countries. They are harder to understand, the what and the why. But coincidentially :) our current topic starts there, so it may be important.
Well Switzerland does obsessively stay neutral, which is badass… Sadly that is mostly an anomaly in the world right now. I’d love for everyone to be the same, but I don’t think it’s likely - good luck convincing the US, Russia, or China to be neutral.
Not sure what you mean by the others. Afghanistan has been destabilized repeatedly by a bunch of big nations with big weapons, and they couldn’t do much about it. That fairly well strengthens my point again - the only nations whose rights are respected are the ones with the biggest guns, and everyone else gets trampled by them.
Heck, Africa is also embroiled in proxy wars caused in part (mostly? It’s complicated) by big, militarized nations.
I think very few people would call militarization good. In fact I’d call it explicitly evil. I would also label it as necessary in the modern world dynamic. I desperately hope that people learn to respect each other so we have the option of demilitarization.
Life doesn't adhere to waterfall methodology: we don't have to do one first, and then the other. We can progressively disarm as we're addressing the problems you mentioned..
Fair enough, but there’s still far too much conflict to begin demilitarization at this point in time. What the world can mostly agree on is to limit itself to being destroyed 55 times over by nuclear weapons (by UN estimates). And that’s in a world where nobody has actually used nuclear weapons (offensively) in 90 years.
These kinds of things take so many generations because the fundamental conflict between humans is not resolved. If there had been no Cold War, maybe we would have totally denuclearized by now, but I still doubt it.
"Basic game theory" says we should destroy this wacko system. jfc.
TBH these kinds of sloppy arguments are a big part of why game theory is a joke. It's fine as math (apart from misleading terminology) but a major problem is applying it to situations that are definitely not "games".
For example killer robots are not a game in any mathematically meaningful sense. The situation has been to be maximally simplified into a game between two people in order to reduce the situation into a simplistic analogy. This is neither science nor math. It's no reason to condone killer robots.
Once combat AI exceeds humans:
A ban to all war, globally. Those that violate the ban will have autonomous soldier deployed on their soil.
This is the only way it will work, no other path leads to a world without autonomous warbots. We can ban them all we want but there will be some terrorist cell with access to arduinos that can do the same in a garage. And China will never follow such a ban
Ban the state first. Every state. These wacko cultists are literally destroying the planet so they can control people with killer robots.
Yeah totally agree. The general population almost never wants to go to war - the plutocrats do.
Once we take care of our own corrupt governance I suspect wars will rapidly disappear, and then weapons will likewise disappear.
Reward models (aka reinforcement learning) and preference optimization models can come to some conclusions that we humans find very strange when they learn from patterns in the data they’re trained on. Especially when those incentives and preferences are evaluated (or generated) by other models. Some of these models could very well could come to the conclusion that nuking every advanced-tech human civilization is the optimal way to improve the human species because we have such rampant racism, classism, nationalism, and every other schism that perpetuates us treating each other as enemies to be destroyed and exploited.
Sure, we will build ethical guard rails. And we will proclaim to have human-in-the-loop decision agents, but we’re building towards autonomy and edge/corner-cases always exist in any framework you constrain a system to.
I’m an AI Engineer working in autonomous agentic systems—these are things we (as an industry) are talking about—but to be quite frank, there are not robust solutions to this yet. There may never be. Think about raising a teenager—one that is driven strictly by logic, probabilistic optimization, and outcome incentive optimization.
It’s a tough problem. The naive-trivial solution that’s also impossible is to simply halt and ban all AI development. Turing opened Pandora’s box before any of our time.
The worst problem of arms control treaties is that Usa never adheres to one.
Ok so we ban them, and some incel terminally online hacker on steroids turns 20 arduinos into bombs.
I agree killer robots are dangerous and ethically problematic, just I don't think banning them will keep asshats from making them, including on large scale.
China could pump them out by the billions and we'd probably not know till they were deployed.
For you as well: https://lemmy.world/comment/11728594
I'm pretty sure that anti-human AI is basically a guarantee at some point.