First, there are many kinds of government departments. If it is a public security department, it can be said that it is suffocating, but if it is just an ordinary office building, it is not much different from other ordinary buildings.
Second, you only said it was behind the house. It depends on how far it is from your home, whether there are other buildings between them, the height difference between them and so on. We can't generalize. Generally speaking, if you are 50 meters away, it won't have much impact.