Word_Break Chart

Unicode Version: 13.0.0

Date: 2019-11-20, 22:27:23 GMT

This page illustrates the application of the Word_Break specification. The material here is informative, not normative.

The first chart shows where breaks would appear between different sample characters or strings. The sample characters are chosen mechanically to represent the different properties used by the specification.

Each cell shows the break-status for the position between the character(s) in its row header and the character(s) in its column header. The × symbol indicates no break, while the ÷ symbol indicated a break. The cells with × are also shaded to make it easier to scan the table. For example, in the cell at the intersection of the row headed by “CR” and the column headed by “LF”, there is a × symbol, indicating that there is no break between CR and LF.

After the heavy blue line in the table are additional rows, either with different sample characters or for sequences, such as “ALetter MidLetter”. Some column headers may be composed, reflecting “treat as” or “ignore” rules.

If your browser handles titles (tooltips), then hovering the mouse over the row header will show a sample character of that type. Hovering over a column header will show the sample character, plus its abbreviated general category and script. Hovering over the intersected cells shows the rule number that produces the break-status. For example, hovering over the cell at the intersection of ExtendNumLet and ALetter shows ×, with the rule 13.2. Checking below the table, rule 13.2 is “ExtendNumLet × (AHLetter | Numeric | Katakana)”, which is the one that applies to that case. Note that a rule is invoked only when no lower-numbered rules have applied.

Table

OtherCRLFNewlineKatakanaALetterMidLetterMidNumMidNumLetNumericExtendNumLetRIHebrew_LetterDouble_QuoteSingle_QuoteExtPictWSegSpaceFormat_FEExtend_FEZWJ_FE
Other÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷×××
CR÷÷×÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷
LF÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷
Newline÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷
Katakana÷÷÷÷×÷÷÷÷÷×÷÷÷÷÷÷×××
ALetter÷÷÷÷÷×÷÷÷××÷×÷÷÷÷×××
MidLetter÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷×××
MidNum÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷×××
MidNumLet÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷×××
Numeric÷÷÷÷÷×÷÷÷××÷×÷÷÷÷×××
ExtendNumLet÷÷÷÷××÷÷÷××÷×÷÷÷÷×××
RI÷÷÷÷÷÷÷÷÷÷÷×÷÷÷÷÷×××
Hebrew_Letter÷÷÷÷÷×÷÷÷××÷×÷×÷÷×××
Double_Quote÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷×××
Single_Quote÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷×××
ExtPict÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷×××
WSegSpace÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷××××
Format_FE÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷×××
Extend_FE÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷×××
ZWJ_FE÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷×÷×××
 
ALetter Format_FE÷÷÷÷÷×÷÷÷××÷×÷÷÷÷×××
ALetter MidLetter÷÷÷÷÷×÷÷÷÷÷÷×÷÷÷÷×××
ALetter Single_Quote÷÷÷÷÷×÷÷÷÷÷÷×÷÷÷÷×××
ALetter Single_Quote Format_FE÷÷÷÷÷×÷÷÷÷÷÷×÷÷÷÷×××
ALetter MidNum÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷×××
Numeric MidLetter÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷÷×××
Numeric Single_Quote÷÷÷÷÷÷÷÷÷×÷÷÷÷÷÷÷×××
Numeric MidNum÷÷÷÷÷÷÷÷÷×÷÷÷÷÷÷÷×××
Numeric MidNumLet Format_FE÷÷÷÷÷÷÷÷÷×÷÷÷÷÷÷÷×××

Rules

This section shows the rules. They are mechanically modified for programmatic generation of the tables and test code, and thus do not match the UAX rules precisely. In particular:

  1. The rules are cast into a form that is more like regular expressions.
  2. The rules “sot ÷”, “÷ eot”, and “÷ Any” are added mechanically, and have artificial numbers.
  3. The rules are given decimal numbers using tenths, and are written without prefix. For example, rule WB13a is given the number 13.1.
  4. Any “treat as” or “ignore” rules are handled as discussed in UAX #29, and thus reflected in a transformation of the rules usually not visible here. In addition, final rules like “Any ÷ Any” may be recast as the equivalent expression “÷ Any”.
  5. In some cases, the numbering and form of a rule is changed due to “treat as” rules.

For the original rules and the macro values they use, see UAX #29.

0.2sot ÷
0.3÷ eot
3.0CR × LF
3.1(Newline | CR | LF) ÷
3.2÷ (Newline | CR | LF)
3.3ZWJ × ExtPict
3.4WSegSpace × WSegSpace
4.0[^ Newline CR LF ] × [Format Extend ZWJ]
5.0AHLetter × AHLetter
6.0AHLetter × (MidLetter | MidNumLetQ) AHLetter
7.0AHLetter (MidLetter | MidNumLetQ) × AHLetter
7.1Hebrew_Letter × Single_Quote
7.2Hebrew_Letter × Double_Quote Hebrew_Letter
7.3Hebrew_Letter Double_Quote × Hebrew_Letter
8.0Numeric × Numeric
9.0AHLetter × Numeric
10.0Numeric × AHLetter
11.0Numeric (MidNum | MidNumLetQ) × Numeric
12.0Numeric × (MidNum | MidNumLetQ) Numeric
13.0Katakana × Katakana
13.1(AHLetter | Numeric | Katakana | ExtendNumLet) × ExtendNumLet
13.2ExtendNumLet × (AHLetter | Numeric | Katakana)
15.0^ (RI RI)* RI × RI
16.0[^RI] (RI RI)* RI × RI
999.0÷ Any

Sample Strings

The following samples illustrate the application of the rules. The blue lines indicate possible break points. If your browser supports titles (tooltips), then positioning the mouse over each character will show its name, while positioning between characters shows the number of the rule responsible for the break-status.

1       a    ◌̈  
2   a  ◌̈  
3        ن  
4   ن       
5   A  A  A  
6   A  :  A  
7   A  :  :  A  
8   א  '  
9   א  "  א  
10   A  0  0  A  
11   0  ,  0  
12   0  ,  ,  0  
13       
14   A  _  0  _    _  
15   A  _  _  A  
16   🇦  🇧  🇨  b  
17   a  🇦  🇧  🇨  b  
18   a  🇦  🇧    🇨  b  
19   a  🇦    🇧  🇨  b  
20   a  🇦  🇧  🇨  🇩  b  
21   👶  🏿  👶  
22   🛑    🛑  
23   a    🛑  
24         
25   a      
26   👶  🏿  ◌̈    👶  🏿  
27   🛑  🏿  
28     🛑  🏿  
29     🛑  
30     🛑  
31   🛑  🛑  
32   a  ◌̈    ◌̈  b  
33   a        b  

Access to Copyright and terms of use