Yes, some good ones and some garbage, and the LLMs had no idea which was which. The good solutions were arrived at by an iterative procedure which depended on the scoring function written by the mathematicians, and it seems plenty of other ingenuity besides.

It's a fascinating use of LLMs by mathematicians to produce new results, but the LLMs are just one component of the tools used to get the results.