What you are talking about is a typical inflammatory cyst, mostly a furuncle formed after sebaceous gland infection. After the bacterial inflammation is inhibited by antibiotics, the injured sebaceous gland squeezed by you still has non-infectious inflammation (similar to the swelling after being forcibly twisted, but not caused by bacterial infection) that does not heal to form a small bag, which is the small bag you can touch now. As long as this situation doesn't interfere with your daily life, you don't need to care at all. It will disappear automatically after about a month or two.
In addition, your situation is definitely not "pus under the scab"; Hair follicle infection is not a big problem to squeeze the skin, and it is unlikely to easily lead to "septicemia". This is especially true in your case, otherwise you would have had a high fever because of systemic infection and need continuous infusion for several days for anti-infection treatment!
For reference only.