An unintended consequence is a sociological term used to describe when someone or a group takes an action and it has outcomes that were not intended or predicted prior to taking the action.
For example, a passport photo system that thinks that people of Asian descent’s eyes are closed when they are not may be an unintended consequence of not testing the service with diverse groups.