criticizing someone's ideas for being liberal, or more or less being a part of keeping oppressed people down doesn't mean "stop fighting" -- it means "fight better". it also is not an accusation.
the fight for disability justice is at the same place that trans rights were in the 1990s, if not before -- ignoring that, or dismissing people's concerns, means that you're enabling the kinds of people who are oppressors in other kinds of ways as well.