the government labeling anti-fascism (antifa) as a "terrorist organization" was explicitly put in-place in order to allow the government to label anyone they deem anti-fascist (or even, against their bad decisions), a terrorist
If you care about free speech this should be a huge issue to you