Large models, especially language models, sometimes store exact sequences from their training data rather than just learning patterns. This is especially true for unique or infrequent content with structured patterns - like credit card numbers or unusual names!
