vlib: add toml module + tests #11964

larpon · 2021-09-24T10:05:29Z

V + TOML = ❤️

toml module with ~99.9% TOML 1.0 format compatibility written in pure V.

I'll work on ironing out more checker errors to make it pass all (or most) of the invalid test suite TOML docs from here https://github.com/BurntSushi/toml-test/). The parser currently pass almost all of the valid tests which is why I think it's a good time to contribute it to vlib. To check against the test suite I've added a small CI job to make sure we can catch regressions.

In the future it'd be nice to make the value retrieval tests pass by testing against the json files - but there's still a little way to go.

It can currently parse TOML files and retrieve values correctly, except for >2 level array-table-array constructs looking like this:

[[a]]
    [[a.b]]
        [a.b.c]
            d = "val0"
    [[a.b]]
        [a.b.c]
            d = "val1"

It can be fixed over time along with the rest of the test suite files.

Happy TOMLing 🙂

vlib/toml/toml.v

vlib/toml/parser/parser.v

…py-paste method documentation

vlib/toml/tests/json_test.v

vlib/toml/tests/toml_test.v

vlib/toml/toml.v

vlib/toml/util/util.v

vlib/toml/scanner/scanner.v

spytheman

Excellent work, @larpon !

larpon · 2021-09-24T13:35:45Z

Excellent work, @larpon !

Thanks a lot!

larpon added 30 commits September 24, 2021 11:40

vlib: add toml support

da1f39f

toml: add types and position

d46ae81

toml: switch to heap based node tree

7946481

toml: parse assignment

c357c7e

toml: add identifier and assign parser support

ad899ed

toml: rewrite parsing logic

9fd04c6

toml: add missing util module

7967ca3

toml: run v fmt over all files

4031d5c

toml: don't use Table and Array type aliases

0c4fbed

toml: add parsing of boolean values

8001d67

toml: simplify boolean parse logic

507642c

toml: prepare parsing of time in date time

e96f129

toml: parse arrays

58e0703

toml: add value extraction, add more tests

53f4bb3

toml: rename test file

1945bec

toml: add test that should pass

5795546

toml: initial map value retrieval

b44dd0d

toml: improve value retrieval, fix double key parsing code paths

956cc66

ast: remove unused scope

18872b2

toml: remove unused walker module

8f46bfc

toml: add Null type as sumtype value for dead ends

a8c1990

toml: fix key scanning, add excerpt function

28811bd

toml: fix recent compile warnings, edit panic messages

614ab6c

toml: add test for single letter key values

d181f53

examples: add simple toml example

6e894f7

toml: add more functions for converting toml.Any type(s)

6ff39a2

time: add rfc3339 parsing

b801e2d

toml: add some documentation

b483b89

toml: add documentation, re-structure a bit

6bd11df

toml: add more tests

b0c710d

larpon added 10 commits September 24, 2021 11:40

toml: run vfmt over files

c524419

ci: add TOML tests for external testsuite

52e7837

ci: add -stats to TOML tests

a1688bc

toml: run vfmt over tests

54eca8b

toml: move from vlib/x to vlib

511f5d8

toml: fix README.md example

e088d45

toml: fix checker comment

8a241c1

toml: house keeping

ef446c8

toml: fix house keeping glitch, more coffee needed

5a014dd

toml: run vfmt over types, can I have one more coffee please...

b1e10c0

larpon commented Sep 24, 2021

View reviewed changes

vlib/toml/toml.v Outdated Show resolved Hide resolved