Kestrel-3

Check-in [82629340d1]
Login

Many hyperlinks are disabled.
Use anonymous login to enable hyperlinks.

Overview
Comment:Relocate tokens beyond ASCII/UTF-8 boundaries
Downloads: Tarball | ZIP archive | SQL archive
Timelines: family | ancestors | descendants | both | trunk
Files: files | file ages | folders
SHA3-256:82629340d12682efeadd64af041dc602b23e19105c72dcbf60208f02b55fb22b
User & Date: kc5tja 2019-09-02 22:27:29
Context
2019-09-02
23:11
First parser integration test check-in: 9688a01a13 user: kc5tja tags: trunk
22:27
Relocate tokens beyond ASCII/UTF-8 boundaries check-in: 82629340d1 user: kc5tja tags: trunk
22:25
Unrecognized punctuation are their own symbols. check-in: 09e88c1248 user: kc5tja tags: trunk
Changes
Hide Diffs Unified Diffs Ignore Whitespace Patch

Changes to dev/src/bcpl/assemrv/manifest.h.

51
52
53
54
55
56
57

58
59
60
61
62
63
64
65
    sc_ch;
    sc_label;
    sc_value;
    sc_keywords;
    sc_sizeof;

    // Scanner symbol types

    scs_identifier = 0;
    scs_byte;
    scs_2byte;
    scs_4byte;
    scs_8byte;
    scs_half;
    scs_word;
    scs_dword;







>
|







51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
    sc_ch;
    sc_label;
    sc_value;
    sc_keywords;
    sc_sizeof;

    // Scanner symbol types
    scs_char_upb = 255;
    scs_identifier;
    scs_byte;
    scs_2byte;
    scs_4byte;
    scs_8byte;
    scs_half;
    scs_word;
    scs_dword;