Skip to content

consider wasm based lexers #23

@ratmice

Description

@ratmice

Currently this requires file based actionless lexing in #21 I would really rather use rust-like raw string literals,
e.g. where r##"r#""#"## is the string "r#""#" than toml

To lex these we need a moded lexer which is currently difficult to dogfood, for dogfooding we'd either need some form of actionless moded lexer .l file format capable of this context sensitivity, or find a way to compile and execute actions or manually implemented lexers, e.g. by compiling them to wasm.

The alternate option here is to just use crimson, and either:

  • hack the grammar in a way which isn't correct and wouldn't allow nested quotes within strings, but would still be usable with nimbleparse_lsp.
  • just not be able to use crimson from nimbleparse_lsp because it depends on a lexer not representable with nimbleparse_lsp's limitations.

In the short term, the last option is most palatable. But you couldn't use the combination of crimson + nimbleparse_lsp until this is fixed.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions