@HerraBRE I would say that while network effects to play a factor, probably most of your community didn't find you on Github (it is nearly impossible to find stuff there). They found you through other means and then went to your Github page.
Now that doesn't say you should go to the effort of moving. But don't be scared of it.
Your community is people who care about your project, not about Github.