there are a lot of things that mastodon could do better, overriding instance-wide silence when you're directly talking to a person is one of them.
e.g.
A posts something mentioning B,
 B replies to A,
 A doesn't know, because B is silenced.
this is bad #UX. not that mastodon cares about UX.