Snap traps work great. Mice are INCREDIBLY stupid. I set some snap traps at my cottage. I ran out of almonds, but I was too lazy to go inside for more, so for the last trap I just used an acorn. Sure enough, it caught a mouse. With thousands of acorns all over my yard.

A bucket with a free-spinning dowel across it works very well too. Although, where I live they are illegal to use unless you empty them twice daily. And any use of water or chemicals with them is illegal.