Would a developer of safety-critical software try to anticipate all potential problems ?

Cadbury or Cadbury Schweppes or other producer of canned drinks would notice that sometimes the automatic canning machines malfunction. So they would train special staff to try to notice. The equivalent of this can happen in an organization supposedly producing safety-critical software. But I don’t think an organization will have trained itself to notice.