Yep, no drilling holes in the water bottle... They work by gravity and pressure. Just drill a hole in the side of the container the size of the metal tube of the water bottle, put the metal tube through the hole, and either tape or use one of those metal hangers that comes with the water bottle and latch it to the top of the container. I like using the tape though, more convenient. Works pretty good, and I'll try to get a picture of how I rigged mine up soon. The mice don't chew the water bottle all up and you don't have water spilled all over the place. Bowls just don't work with them, they don't seem to understand the concept.

I would either get another water bottle(the blue ones at Petsmart seem to work the best for me as they are very cheap and have a spring inside to keep the water from leaking out) or you can caulk the holes in the other one.

If you need help, you can post pictures of your setup and I can show you where to drill, how big of a hole, etc. Just let me know