Thunder-DeID+: Boundary-Aware Korean De-identification from Court Judgments to Broader Sensitive Documents
Thunder-DeID+, which integrates a refined three-tier PII taxonomy with a boundary-aware tokenizer, is introduced, which enhances a pretrained BPE vocabulary by incorporating N-gram and boundary-scoring components to better align token and PII span boundaries.
Gyuseong Lee, Gyeongje Cho, Jongmin Kim et al.
· 0 citations