From Aleteia:

Exactly two weeks to the day after the publication of his encyclical Magnifica Humanitas, which highlighted the opportunities and risks of artificial intelligence, Pope Leo XIV took advantage of his trip to Madrid, Spain, to provide quite an insightful — if humorous — example of its dangers.
The Pope, laughing and relaxed as he has generally been for the whole of this historic tour in Spain, recounted that before leaving on his trip, he consulted AI out of curiosity. He asked it, “What should the pope say to the Spanish bishops?” The artificial intelligence chat bot replied, “Pope Francis would say…” So, he interrupted it and said, “Ah, but I think there is another pope now.” The AI then replied, “Oh, that’s true, sorry, it’s now Pope Leo.”