Just do "pop ins" from time to time. No need to quit.
I go off the grid for long periods then come back. It's not my life, and I have all the same hobbies that you do, plus 2 dogs, 2 kids, a house, yard, full time job and a wife.
You can make it work man!!
Stay, just don't let it take over your time.