It's a tough choice to make but kudos to you for the self-reflection.
I gave up a crested and bearded dragon years ago because I felt they were not thriving with me (they were surviving fine but it is different), it's sad but now I feel like it was the best decision for them at that time.
Best of luck with whatever course of action you take!