🧪 Improve and extend unit tests in lexer.test.c 🧪

[BaseMax]

As you know LEXER stage is mostly ready-to-production and we already defined all and most keywords. so we need so many more unit tests at the lexer.test.c file.

https://github.com/One-Language/One/blob/master/test/lexer.test.c#L75

I already defined some unit tests there, so you can take a look to understand how this test system work.

[BaseMax]

If you need and want to learn more about the LIST OF ALL TOKENS you can read here:

• https://github.com/One-Language/One/blob/master/src/lexer/tokenizer/token.h#L20
• https://github.com/One-Language/One/blob/master/src/lexer/tokenizer/token.c#L285

[abdorah]

Hi! I am interested in this issue.

[jbampton]

I have assigned you now to this issue