I have also experienced this; I'm not saying LLMs are great or infallible. Just saying that they are generally a reasonable replacement for L1 support. They are worthless for L2 or above.