Isn't the feng shui in the house where the neighbors have moved out good?
Since you are willing to lend him your house, it proves that you used to have a harmonious neighborhood. Now you don't want to lend the house to him. Maybe there is a problem near your home, or maybe you need the house for other purposes now. But in any case, even if it's your neighbor's fault, I suggest you tell your objective reasons and ask your neighbor to understand, so maybe he will move away. If you don't move, you can only rely on administrative law enforcement agencies.