Apparently they do at least intentionally disengage, often with little time to react. When they could instead start braking and alert the driver.

https://futurism.com/tesla-nhtsa-autopilot-report

I also don't trust the motives of a company that names something "Full Self Driving" knowing it's not fully self driving. Never mind their shenanigans around avoiding or disregarding regulations and reporting requirements.