there are a lot of things that mastodon could do better, overriding instance-wide silence when you're directly talking to a person is one of them.
e.g.
A posts something mentioning B,
B replies to A,
A doesn't know, because B is silenced.
this is bad #UX. not that mastodon cares about UX.