Text boundaries and Unicode normalization
Text equality and character counts depend on the declared representation and convention.
Key knowledge
A grapheme cluster can contain several code points and approximates a user-perceived character. NFD canonically decomposes Unicode text; NFC additionally canonically composes it. Canonically equivalent strings share their chosen canonical normalized form, while compatibility forms NFKD/NFKC can remove meaningful distinctions.
Conditions and scope
- Declare whether length counts octets, code points or grapheme clusters.
- Segmentation may need script or locale tailoring; normalization does not define font glyphs or every culturally appropriate comparison.
Script/locale tailoring may be needed; no font rendering guarantee. Compatibility forms can remove meaningful distinctions; no transliteration/case-folding claim. Encoding definition, not all Unicode text-processing or glyph behavior.
Sources · 3
References
Sources retain their recorded scope. A source link alone does not establish verification of every statement.
- UAX #29: Unicode Text Segmentation, revision 49, Unicode 18.0.0Josh Hadley / Unicode ConsortiumReference guide
- UAX #15: Unicode Normalization Forms, revision 58, Unicode 18.0.0Ken Whistler / Unicode ConsortiumReference guide
- RFC 3629: UTF-8, November 2003, sections 1 and 3–4François Yergeau / IETF RFC EditorReference guide
Evidence and review
Checked the stated text boundaries and unicode normalization and restrictions against the listed primary sections; exact inspected boundaries are in the author receipt.
2026-10-10 · Independent Physics and Measurement reference editor (AI editorial bounded review). Independent AI editorial review of this entry's statements, equations, applicability conditions and source coverage. Source checks apply to these claims within their stated limits.
Entry details
Permanent link to this entry ↗- Record identity
- foundation-info-text-segmentation-normalization
- Revision
- foundations-refresh.1
- Structured reference record
- Foundational reference additions