Here's the first 1200 words of a short story about death, taxes, counterfeiting, the Pointers Problem (the most vexing aspect of alignment IMO), outcome pumps, and (a misunderstanding of) the Yoneda Lemma. Apologies to Scott Alexander. I plan to continue working on & editing this story, but wanted to submit something by Sep 1.
While I'm at it, might as well submit my other sort-of-AI-related, (very) short story. It's about a world where eliminativism is true, but a (rather cartoonish) rogue AI doesn't believe it.
https://unoriginal.blog/cremate-yourself-immediately/