I must say that the paperclipping thing sounds incredibly dumb - dangerously so - but everyone's allowed to have one shit opinion (which is what it is - until we have AIs we won't know if it's an opinion or not).
Huh, that's interesting.
IIRC that one was an illustration of how a poorly-defined fitness metric could result in disaster, if that fitness metric is the only guide to behavior.
I read it not as a likely scenario, but rather as a commentary on fitness metrics -- which are IMHO all currently pretty poorly-defined. In that regard, it's also a commentary on utilitarianism in general, because "happiness" is poorly-defined.
But maybe I'm not remembering correctly. I certainly can't defend this position from someone who cares more than I do, so I'm just offering it as one data point.
~ ~ ~ Meanwhile, in on-topic land ... ~ ~ ~
Zach: "Well, shit. I spent hours on that Lisa material, and now it's useless."
Emma: "Yeah, but now you have Dragon. You said you love computer science jokes."
Zach: "For whatever reason, computer stuff is a really easy target. Hard drives, software, floppy disks, silicone implants, root access... it's like shooting fish in a barrel."
Emma: "What if that's the plan? What if the fish in the barrel are intended as a distraction?"
Zach: "So it's like... a trojan barrel of fish?"
Emma: "You have to look a gift horse in the mouth, because it might be full of fish."
Zach: "Have I told you lately that I love you?"