In principle, a village or several villages can only have one land temple. (Otherwise, which land temple should I report to when I die? Several local tyrants are going to fight). Moreover, in geomantic omen, the land temple belongs to yin, which is not conducive to geomantic omen. Yang house (even Yin house) should be far away from the land temple.
For reference.