Detecting PII in API Traffic with a Small BERT Model: Training Notes and Pitfalls
Replacing an LLM with a 307M encoder for tagging personal data in API traffic, at 0.93 macro-AP. Covers data splits, sliding windows, DAPT, long context vs. windows, a GPU memory fix, and the label-suppression problem I only found right before release.