If user data would become such a key ingredient (which it might, i actually remember noam shazeer talking about the importance of user data), i think chinese labs can still get it from china, as keep in mind it ahs a billion people behind the great firewall banned from using us llms. And btw broadly for any gap like this, you really gotta consider that if its becoming a bottleneck, chinese labs will find a way to buy it from one of the labs unless theres strict regulation at the government level
Is lack of inference chips due to the trading blocks by trump administration? What if Trump agrees to sell chips to china, would they collapse then? That's not a very strong position to be at
Most discussion in recent years about chip fabrication shortages, expansion, etc has focussed on leading nodes (<7nm) and AI/computer chips. But perhaps more quietly in the background, China has been rapidly building other semiconductor capacity such as power semiconductors used in electric vehicles, wind turbines, solar modules, train traction systems, etc. For example, Chinese-produced motor vehicles (37% of global motor vehicle production in 2025) in a year or two are targeted to use 100% domestically produced chips, and this production is decreasingly dependent on imports, even for factory tooling.
The report at [1] is a good summary of long term trends for China's rise in domestic self-sufficiency for semiconductor manufacturing. The report predicts "At current pace, China may achieve self-sufficiency in semiconductor manufacturing by 2027-2028, though trailing at leading-edge nodes". By contrast, before the first Trump presidency in 2017, a chart shows China importing 30% of all globally manufactured semiconductors (and increasing). Other reports on semiconductor fabrication equipment sales show the means, which is China having been and continuing to be in number (1) position for expenditure on semiconductor fabrication equipment.
The reports at [2] and [3] are also a good summary of long term trends for semiconductor foundry capacity predictions to 2031. A prediction is made that China's current 12% global semiconductor foundry supply capacity (across all semiconductor categories) in 2025 will expand to ~30% by 2031.
I don't think they explain it in the paper, do they? They just mention the result it seems. I am really curious to know too. Maybe they imply it's the result of their Mixture Of Experts architecture? Or maybe they just don't wanna say, idk
I'm not sure what's allowed. Can use current seconds in someone's watch, for example? Or maybe ask some random person to say a random word, and then use the position of the first letter of that word in the alphabet?
This sounds like a really fun problem but I'm certain about the rules.
reply