Generative AI and ethics

So recently I used an AI chat app, and the bot started spewing violent words and recommendations. Do software developers have an ethical frame or requirement per regulation to protect safety of users? What can users do to make sure how to educate people about generative ai safety?