diff options
| author | franck cuny <franck@fcuny.net> | 2020-01-11 13:32:55 +0100 |
|---|---|---|
| committer | franck cuny <franck@fcuny.net> | 2020-01-11 13:32:55 +0100 |
| commit | a4260f907f740bb57246832ee7aca75899bf4aff (patch) | |
| tree | d33d11238031b991f4d11a2466f3edfc2d73d04c /users/fcuny/exp/monkey/pkg/lexer/lexer_test.go | |
| parent | go.mod: create the module 'monkey' (diff) | |
| download | infra-a4260f907f740bb57246832ee7aca75899bf4aff.tar.gz | |
token: initial tokenizer.
This is the initial tokenizer for the monkey language. For now we
recognize a limited number of tokens.
We only have two keywords at this stage: `fn` and `let`. `fn` is used to
create function, while `let` is used for assigning variables.
The other tokens are mostly to parse the source code, and recognize
things like brackets, parentheses, etc.
Diffstat (limited to 'users/fcuny/exp/monkey/pkg/lexer/lexer_test.go')
0 files changed, 0 insertions, 0 deletions