aboutsummaryrefslogtreecommitdiff
path: root/users/fcuny/exp/monkey/pkg/token/token.go (unfollow)
Commit message (Collapse)AuthorFilesLines
2022-10-27ref(users/fcuny): and just like that ...Franck Cuny1-71/+0
2021-05-10lint: fix a few issuesFranck Cuny1-0/+1
2020-01-11token: add tokens for equal and not equal.franck cuny1-0/+3
2020-01-11token: support more keywordsfranck cuny1-2/+13
Add support for a few more keywords (`true`, `false`, `if`, `else`, `return`). All keywords are grouped together in the constant declaration.
2020-01-11token: rewrite documentation for `LookupIdent`.franck cuny1-3/+4
2020-01-11token: support more operator tokensfranck cuny1-3/+10
Support additional tokens for operators (`-`, `*`, etc). This change only adds the tokens to the list of constants, and group all the tokens related to operators together.
2020-01-11token: initial tokenizer.franck cuny1-0/+48
This is the initial tokenizer for the monkey language. For now we recognize a limited number of tokens. We only have two keywords at this stage: `fn` and `let`. `fn` is used to create function, while `let` is used for assigning variables. The other tokens are mostly to parse the source code, and recognize things like brackets, parentheses, etc.