The problem is that they don't make the LLM better at instruction following, they just make it unable to product furry erotica even if Amazon wants it to.