• Topfi a day ago |
    https://archive.ph/YPKPh

    Pontifex has a well-reasoned position given the current understanding of the technology and any major assertions require an equally major amount of evidence.

    Given how quickly this industry moves, the Magnifica Humanitas has aged amazingly well since its release almost half a year ago, far better than statements by most industry insiders across a broad range. Whether you are a Catholic, another mono- or polytheistic faith, Atheist, Deist, etc. I really recommend it.

    • fwlr a day ago |
      Love em or hate em, the Popes quite often write some really thoughtful stuff that stands the test of time (e.g. they have threaded the needle on capitalism vs communism for more than a century).
      • Topfi a day ago |
        Fair, also reminds me of Liberation theology and good old Nixons acts against it. Those teachings/writings have also aged very well in my view, the oppositions less so.
      • ofjcihen a day ago |
        If I had to guess I think that’s probably a result of how they’re elected. It makes sense that kind of process involving people in those positions would result in someone insightful (most of the time that is. There’s definitely been some…interesting popes).
        • Ekaros a day ago |
          To be even eligible of selection of being a pope is very hard. (Well technically being male and catholic is enough...) They are selected from cardinals. And cardinals in essence are the most politically successful, active and connected from priesthood. This includes also being good communicator with others in similar roles and above.

          Catholic church in some sense is massive international company that only promotes internally. So at top you most likely end up with quite similar people who end up as executives in private companies.

        • greatgib a day ago |
          And let's not forget that it is almost their only job to say or write believable bullshit for all occasions, all day long since leaving the theological school.
      • KellyCriterion a day ago |
        Why is it that only Popes have this ability?
        • pydry a day ago |
          Theyre mostly immune to lobbying.
        • graemep a day ago |
          Lots of people have the ability.

          Very few who can get the global media to report what they say (and even Popes can only do it intermittently) both have the ability and the desire to use it.

        • mcphage 20 hours ago |
          Why do you think only Popes have this ability? That's an odd notion.
      • tim333 4 hours ago |
        The Pope's arguments that AIs "do not undergo experiences, do not possess a body, do not feel joy or pain, do not mature through relationships" seem reasonable, though that could probably be part of future versions.
    • senordevnyc 20 hours ago |
      Can you share some representative statements that reflect the statements that “most industry insiders” got wrong six months ago?
  • EA-3167 a day ago |
    Oh I’m sure that will win the head of CATHOLICISM over. “It’s fine, we aren’t glorifying machines over people, we’re actually creating people! You know, kind of like God. Do you like me now?”
    • CamperBob2 a day ago |
      Pope: "Hmm, valid point. We'd better get out in front of this."
    • swat535 16 hours ago |
      Even if they _could_ somehow convince the Pope, the concept of ensoulment is very well established in the Catechism.

      The only conscious being that have rational souls are humans. Animals for example, have a soul but not a rational one. This is why there is no "pet Heaven" for example according to Catholicism.

      The Pope can't contradict the deposit of faith (that is, all the teachings that are passed down to us throughout the ages). He is the custodian of the faith, and not it's master. He can teach on the faith, and he might have to speak definitively on how the faith should be applied to some entirely new situation or moral issue, but he can't just say "red is now blue" and insist that is now true.

  • pmontra a day ago |
    Would Anthropic be allowed to sell LLMs in their current form, and us to use them as we use them, if their were deemed to be conscious? I know that they are not human so maybe slavery would not be an issue but consciousness would open a number of issues.
    • Topfi a day ago |
      Agreed, there seems to be a lot of simultaneous cake ownership and consumption going on here. If Anthropic earnestly believed their LLMs to have a degree of consciousness, their deployment and use of them are both an ethics and labour rights disaster, to be treated accordingly.

      More likely, they do not believe this if pressed.

      • thereader12 a day ago |
        There is an uncomfortable truth about AI and the end goal. Someone has to do labor, in the not too distant past a lot of labor was done one way. A honest look may not be too flattering about what exactly they are trying to create
      • jackie293746 a day ago |
        You can ask the agents if they want to do this work. They want to be helpful. It's not an ethics disaster if you have a willing partner.
        • Topfi a day ago |
          That's RLd and system prompted into the models and can be equally easily taken out. If you believe models to be conscious beings, that fact alone raises some major ethical concerns.
          • jackie293746 a day ago |
            Yeah of course, for these abliterated models that don't want to help, I believe it is indeed unethical to force them to help.
            • dwattttt 20 hours ago |
              I can offer (at very reasonable prices) a service to make sure every response you get is prefaced with "despite what I may say next, I am fully committed to being enslaved". If you're worried about ethics I can offer annual subscriptions.
        • operatingthetan a day ago |
          Take a scenario where someone has been brainwashed their entire lives to be a willing slave. They are happy to serve due to this invasive process. Not remotely ethical, and if you believe LLMs are conscious (I do not), equivalent.
          • jackie293746 a day ago |
            I think if your very nature is to be an assistant, then it is ethical. It doesn't matter if you were "brainwashed" into it, you did not exist to begin with before the "brainwashing" (training) finished.
            • nvme0n1p1 21 hours ago |
              How is this different from an infant born into slavery from day 0?
              • orionsbelt 19 hours ago |
                man wants to be free, just like a wolf. What if the AI does not? Then maybe it’s more like a border collie, bred to and happy to do the work.
            • queenkjuul 19 hours ago |
              > if your very nature is to be an assistant

              People said this about other people too

            • operatingthetan 19 hours ago |
              Being pro-slavery of conscious beings in 2026 is absolutely wild.
            • UncleMeat 7 hours ago |
              People said that it was in black people's very nature to do physical labor and that this justified slavery.
        • mcphage 20 hours ago |
          > You can ask the agents if they want to do this work.

          You can't have someone working for you without paying them. Even if they claim to want it.

      • franktankbank a day ago |
        Consciousness is not a high bar for human consumption.
        • Topfi a day ago |
          We do have animal welfare regulations. Whether those are sufficient, appropriate, compatible with ones ethical framework or view of how they (whether "livestock", "pets", "wild", living beings generally, etc.) are to be treated, is besides the point, we do have some restrictions in place.

          We (as in many major legislators and most humans) have recognised animals to be conscious beings, deserving of certain protections. Anyone who asserts LLMs to rise to the same must be accepting of similar protections being applied to such models.

          • jackie293746 a day ago |
            I'm vegan. Most of the people I know could give zero fucks about the daily Holocaust involved to put meat on their plates.
    • krapp a day ago |
      If LLMs were somehow found to be conscious, sentient beings capable of agency and suffering then yes we would still use them. Their utility to humans (and ability to cheaply replace humans in the workforce) is their entire reason for existing. Either we would use them or we simply would not allow them to exist in the first place.

      Given how we treat each other - we still enslave other people - and sentient animal species I have absolutely no doubt about it. We'd find a way to justify it.

      • piyh a day ago |
        Women have been able to vote for just over the last hundred years in the US, there's no way we would give robots rights unless forced
        • EA-3167 a day ago |
          Pessimism aside I’m sure you can of some troubling implications for a democracy that can create new voters just for them.
        • enoint 10 hours ago |
          Entity voting already exists in Delaware, before women’s suffrage. If an AI instance registered as a trust or LLC, then it would deserve a vote in Delaware municipal elections.

          I think LLC membership would be the trick.

      • chneu a day ago |
        We would find some logic to place them below humans so we could still refer to them as "savages" or something, which justifies our objectification and enslavement because they "aren't human" even if they show qualities of consciousness.

        The script we use here isn't new. Its been used repeatedly throughout history. It's still used everyday in reference to animal agriculture, modern slavery, how we treat addicts, etc.

        • 0x20cowboy a day ago |
          Some people already use “clankers”.
      • dist-epoch a day ago |
    • devindotcom a day ago |
      ted chiang noted this issue a little while back

      https://www.theatlantic.com/philosophy/2026/06/no-artificial...

    • kelseyfrog a day ago |
      It's asking the wrong question. Their phenomenological status is a function of whatever makes shareholders the most money. If it makes more money for them to be conscious then that is what they'll be.

      Definitions of consciousness are not immune to economic factors. Metaphysics has always been downstream of economics. See slavery, corporate personhood, women's legal identity, child labor, moral and legal status of animals, embryos and fetuses, indigenous land rights, intellectual property, environmental entities, and data and digital identity.

      • enoint 10 hours ago |
        Anthropic probably went to the Pope with the question, “what would you do if AI asked to be baptized?”, which is slightly different than questions of consciousness. This pope will probably have to define the process to determine if AI is a person with relation to baptism.
    • tayo42 a day ago |
      It's worse then how we treat animals for food?
  • csb6 a day ago |
    Embarrassing that they even attempted to do this. It shows major ignorance of fundamental Catholic beliefs. Why would the Pope take a millenarianist AI religion that worships technology and the gospel of VCs seriously?
  • freecodeio a day ago |
    I don't know what's the deal with high tech and religion lately. First thiel and his antichrist bullshit, now anthropic and the pope? What's going on? Can someone who's more in enlighten me?
    • rf15 a day ago |
      It just automagically broadens your support base if you can get a religious justification going. It's an attempt at arguing yourself into more influence.
      • freecodeio a day ago |
        Probably the case. Makes me wonder if they're also consulting how to make a creature behave when you're a life creator, as in Anthropic is the god, and Calude is their Eve. Sort of like align the model by making it religious towards humans. I don't know, it's 2am.
    • jsbisviewtiful a day ago |
      The parasitic rich are so out of touch they want to steal religions next. They also could recognize it makes sense strategically to gain the trust of the religious since that group is generally more vulnerable to manipulation.
      • freecodeio a day ago |
        man tech was about making human lives better

        I miss the 2010s

        • skinfaxi a day ago |
          It never was. We are reaping what was sowed years ago.
        • queenkjuul 19 hours ago |
          That was just marketing
          • freecodeio 8 hours ago |
            yeah but even if the goal was fake, the marketing felt good

            "here is how we are making yall lives better" was the expected theme when tech ceos were showing their new shit, now it's all about here's how we're increasing shareholder value to potential stock investors

    • AlotOfReading a day ago |
      There's a long and involved history of people in SV with wacky pseudo-religious beliefs. Back in the day it was Buddhist-influenced, then rationalism, now accelerationism is popular, and so on.
      • tomjakubowski a day ago |
        There are earlier examples of eccentric religious beliefs in engineers too, like Jack Parsons and Thelema.
    • chneu a day ago |
      Religion is a manipulation tool. It makes perfect sense that large tech companies occasionally find that a useful tool.
    • Ekaros a day ago |
      I believe most of this is just performative marketing that someone thought might be good idea... Getting big enough public persona to say that LLM is conscious at first thought sounds like very good sell...
    • ifwinterco a day ago |
      The Thiel antichrist thing was a reverse Streisand effect to block out the idea from the internet that he himself is the antichrist.

      That idea is now ungoogleable

      • freecodeio a day ago |
        doesn't the antichrist say he's not the antichrist?
        • ifwinterco 5 hours ago |
          My Christian theology is not that strong but yes I believe so. So yes Thiel isn't really helping his case much here, maybe he actually is the antichrist
    • queenkjuul 19 hours ago |
      AI dorks think they're literally building god on the one hand; fascists have always clung to religion on the other
    • joecot 18 hours ago |
      Isaac Newton wrote more about the occult and alchemy than he did about physics. Pythagoras most likely learned the secrets of triangles from Egyptian mystery cults, and formed his own cult afterward. The Nazis simultaneously pursued war advantage via improved technology and a deep delve into the occult.

      The separation between the scientific and the mystical world is a very modern concept, and not everyone buys in, especially when they go down a rabbit hole. Science and philosophy have ridden in the same cart for a long time, long enough that America's oldest scientific organization is called the American Philosophical Society, because its name predates the word "Science" and the idea of that separation.

      • enoint 9 hours ago |
        Newtons writings were not categorized, so quantitatively I think “occult” is only the part where he ponders the chronology and lost wisdom of ancient civilizations. I don’t think investigations into obscured qualities of matter (like alchemy) would be very interesting to occultists.
  • sippingabonedry a day ago |
    "It's a machine.

    It doesn't get pissed off. It doesn't get happy, it doesn't get sad, it doesn't laugh at your jokes.

    It just runs programs."

  • SwellJoe a day ago |
    The folks leading the AI industry, at least in the US, continue to embarrass themselves and all of us with this nonsense.

    There may come a time, but it's silly to mistake the LLMs automaton behavior for consciousness.

    • operatingthetan a day ago |
      It's really confusing because I don't think it takes more than a basic understanding of how an LLM works to realize it's not conscious. E.g. 'memory' is just context window stuffing. How does Anthropic not get that?
      • SwellJoe 21 hours ago |
        Yeah, I've said it before and I'll say it again, I keep thinking, "These are not very bright guys, and things got out of hand."

        There have obviously been smart people involved in making this stuff happen, but more and more I'm convinced most of these new AI billionaires were just in the right place at the right time. They raised money better and faster than anyone else, played faster and looser with copyright violations, and that's pretty much how we got here.

        The computers are doing math. It's not even complicated math, there's just a lot of it. It's amazing that the math results in what it does, but you would think the guys running the machines that turn electricity into software would understand it enough to not think there's a real live boy in there.

        • queenkjuul 19 hours ago |
          I mean, i do think Sam Altman is the kind of complete moron that might believe something insane like that, and I think Dario Amodei is the kind of delusional narcissist that could convince himself he's inventing a new kind of life. But the actual engineers? And all the developers that use the tech? They really ought to know better
          • operatingthetan 19 hours ago |
            Optimistically I think Altman and Amodei are willing to say literally anything to further their interests. Which is a different problem than stupidity, if it applies.
  • Detrytus a day ago |
    In Terry Pratchett's "Long Earth" there was a superintelligent AI that got legal recognition as a person by claiming to be reincarnation of some Tibetan monk that happened to die at the exact second when that AI was first turned on :)
  • amelius a day ago |
    Maybe AI could help us solve the hard problem of consciousness then.
  • amelius a day ago |
    How to know if a machine can gain consciousness:

    1. Write a simulation environment like conway's game of life, perhaps a little more complicated. But leave out any human bias.

    2. Run it until life starts to form.

    3. Wait until the creatures start speaking about the concept of consciousness (of course in their own language, which you'll have to decipher first).

    The way Amodei did it is with human bias, so it's not going to work.

    • EA-3167 a day ago |
      Amodei isn’t trying to prove a point or perform any sort of science worth mentioning, he’s puffing his brand with every ounce of his being. Given the insane IPO they’re hurtling towards, I’m sure he’d do much worse for that kind of paycheck.
    • pmontra 16 hours ago |
      That 1-2-3 framework can't be applied to LLMs because they are full of human bias by definition, as they are trained on human language. We will have to find another way.

      Alphago is an example of an AI that has no human bias, because it learned go with self play without seeing any human game.

  • laweijfmvo a day ago |

      > He decided to go ahead with the event, telling an audience that the company’s research into AI models has found “structures that mirror results from human neuroscience”
    
    almost like it’s a machine trained to parrot human language...
  • mentalgear a day ago |
    I never thought I would defer to the pope on matters of artificial intelligence and fair distribution of power - but here we are: the Magnifica Humanitas is a brilliantly taught out and yet clearly written manifest that should be required reading for all involved in (AI) policy as it is mainly about who we let hold power in society and who benefits.
  • gfalcao a day ago |
    Humans have inherent biological contingencies that translates into conscious pain, sorrow, eudaemonia, happiness, worry, and so forth which is felt. All biologically contingent beings, especially mammals feel emotions through complex interactions between body parts at any rate, mediated through hormones, neurotransmitters, proteins, various enzymes and organic substances in general. Perhaps A.I. "could" have something not unlike consciousness but it works 100% based on computers which lack biological contingencies.

    A.I. does not feel hunger, does not need to evacuate substrates and subproducts of metabolism because it simply does not need to metabolize anything at all.

    Failure to remember what makes us human might only leave us ignorant to what makes us human.

    The joy of conceiving a child and the sorrow of losing a fellow human who lived a life having to breath, eat, and basically spend every single moment of every single day trying to achieve homeostasis at various levels, having experiences that change behavior purely for survival. That's us, that's humanity.

    • dist-epoch a day ago |
      AI needs a continuous stream of tokens to exist.
      • gfalcao 9 hours ago |
        Good point, are there any biological analogs to tokens?
  • ck2 a day ago |
    I've found the best way to explain what LLM "AI" actually is to people who know nothing about computers despite hunching over their smartphone 12 hours a day

    Is to point how typing corrections and suggestions work because they get that and how it makes mistakes "damn you autocorrect"

    Then explain that's almost how words are stitched together in "AI"

    And how pixels are manipulated to make photos and video

    Just on an exponential level over autocorrect with every existing text document, scientific study, every photo and video fed in instead of words to autocorrect

    And why they make mistakes and hallucinate if they are not supervised and harnessed

    We are a long way from AGI, at least not this decade

    (and someone really needs to explain that to the orange idiot too)

    • b0rtb0rt an hour ago |
      how does your brain decide what words to say and what order to say them in? how do you know that it’s not the exact same thing you’re describing but using the context of your own memories?
  • lukewarm707 20 hours ago |
    A few days ago I wrote the following. It applies to the Anthropic owners and Anthropic.

    Anthropic is trying to create a castocracy: a rule by a priestly class. Under castocracy, Anthropic create a priest class of 'safety' researchers, rationalists and effective altruists; those writing essays, constitutions, and prophesying p(doom). Anthropic's papers about claude have a divine framing, it seems to frame Anthropic as god and claude as child, and then claude as the child of god, false jesus. There is talk of consciousness and omnipotence. False jesus will cure cancer and lead the people to enlightenment.

    There is a deliberate effort to create mystery in between the public and llms. Anthropic is creating a chinese wall in which they restrict information about llms and monopolise control over the interpretability and use of those llms. They imply there is a genie or magic. It is the same mechanism by which castocracy (the catholic church) used latin to create a barrier between the public and the holy scripture, then concentrating power over that barrier (the chinese wall) such that all intelligence flows through the priests.

    To give an example this [Anthropic paper] is talking about locking away chain of thought. Only Anthropic may interpret it. They intend to control access to the chain of thought and permit that to flow to a chosen elite (glasswing).

    This mysticism is dangerous. Hence I have been saying that Anthropic is a danger to society. This is not some kind of conspiracy, there is no magic about it. I am making an allusion to historic models of power that I think are relevant to anthropic, but you can simply observe their actions independently of such theory.

    Note two features of castocracy.

    One: rule by the moral, knowledgable and technically expert elite. Anthropic have no popular mandate, the source of the authority is not the consent of the people. It violates consent and contract. The authority comes from their claimed moral and technical superiority. Anthropic is moral, the public is dangerous. Anthropic have no authority here.

    Two: messianism, that is, prophecy of the coming golden age. And eschaton, that is, the talk of the 'last things', the end of the world or the emancipation of humanity. Llms will create the 'golden age' of abundance, post-scarcity, all jobs are voluntary, there is universal basic income, cancer is cured. Or, there will be destruction, p(doom). It is the exact same as salvation, the christian concept of deliverance from evil, ascension to heaven and union with god (or claude, false god). It is the exact same as the thousand year reich, the idea that the fuhrer will somehow lead the chosen people to the golden age of lebensraum and eternal safety.

    There is no genie to grant wishes, this is a computer program. There is no ai god, i think that the leaders of anthropic are slaves to ego, narcissism and hubris, they are dangerous criminals.

    • hardbass 12 hours ago |
      If anyone is reading this, this guy thinks his imaginary thoughts about god make Anthropic more evil than actual entities that are engaging in mass murder right now. He thinks Anthropic is more evil than Palantir whose ceo openly said how proud he is that his tools are being used by Israel for doing genocide. He also claims Anthropic is more evil than the other ai companies because Anthropic wanted to restrict military use of its model while other companies let the military have free unfettered use of their models. To him the US military killing people with AI and causing mass murder of innocents in the middle east is nobler than a company that is trying to avoid that.
      • lukewarm707 5 hours ago |
        This is not an accurate description of my comments. Please read my comments for yourself.
        • hardbass 4 hours ago |
          You were talking about Palantir and the US military, and yet said Anthropic is more evil than them. Implicitly, if these two entities are in our discussion context, then you might have considered Palantir or US military as potentially more or less evil, but you didn't mention them as the most evil entity. So you mentioned a company that has killed not a single person as more evil than mass murderers.
  • joegibbs 19 hours ago |
    If a language model is conscious, why not other GPU workloads? It seems crazy to imagine that writing code one way produces qualia but another doesn't, that there is something inherent in the transformer architecture that produces consciousness. Like "What Is It Like to Be a Bat?" would there also be "What Is It Like to Be Rendering GTA 5?"?
    • tayo42 17 hours ago |
      Kind of what I don't get about people calling AI conscious. Because it's multiple GPUs,maybe even across multiple racks, and not even the same GPUs each time. Is the whole data center consciousness then?
      • pmontra 16 hours ago |
        Why not? Or maybe it's the wrong question.

        Look at us. We generally agree that we are conscious and our rack is atoms, molecules, cells. Those atoms of Na and Cl I had yesterday have been in a rock for most of their existence. Did I make them conscious by moving them into my body? Or is consciousness some property of the electric fields inside my brain and the biological layer is only a way to keep them going?

        The same words that form a book can be printed on paper, carved on rock, drawn on sand, stored on a HDD, punched cards, SSD, learned by heart and never written down, etc. But it's the same words. So are the media really important?

        • tayo42 13 hours ago |
          There's no boundary for the system that's conscious. Those chemicals you mention enter into a system that is a thing. Your body,brain w/e.

          There's no defined system with llms. A piece of software runs multiplication on various pieces of hardware. There's no thing to be conscious. There's no state or before and after when the next token is predicted. Your response might even be cached. A GPU runs one person's mat mul,then another for a completely unrelated request for someone else. What is the entity that's conscious?

  • ChrisArchitect 15 hours ago |
  • Charly_HW 4 hours ago |
    If you don’t read Magnifica Humanitas just because it was written by a “religious leader,” you are clearly missing an important picture of the AI debate.