Keep specific contacts out of an active segment

Short answer

HubSpot's KB on excluding records from segments: exclude a segment of disqualified contacts, use property filters like Lifecycle stage is none of Customer, or turn on Exclude non-marketing contacts. Active segments can also be converted to static, after which members are only added or removed manually.