Seems simple enough to guard against to me. Fact is, if a human can easily detect a pattern, a machine can very likely be made to detect the same pattern. Pattern matching is precisely what NNs are good at. Once the pattern is detected (I.e. being asked to repeat something forever), safeguards can be initiated (like not passing the prompt to the language model or increasing the probability of predicting a stop token early).

That might seem plausible until you read deeply into the latest cognitive science. Nowadays, the growing consensus is around “predictive coding” theory of cognition, and the idea is that human cognition also works by minimizing prediction error. We have models in our brains that reflect input that we’ve been trained on. I think anyone who understands human cognition and LLMs cannot confidently say that LLMs are or are not intelligent yet.

After hearing the results of several antitrust cases, the standard of evidence for anti competitive behavior seems impossibly high with current laws and precedents.