diff options
| author | Kaz Kylheku <kaz@kylheku.com> | 2011-10-01 20:10:50 -0700 |
|---|---|---|
| committer | Kaz Kylheku <kaz@kylheku.com> | 2011-10-01 20:10:50 -0700 |
| commit | d3cf94ea8a6edda25d9b330d3a6523bd5e28dedc (patch) | |
| tree | 916e307d85a7fbf8bb30c256f10988851aa96bb3 /tests/008/tokenize.txr | |
| parent | 2e7542a6b590e4662cff1ab1eab62945b7bbccad (diff) | |
| download | txr-d3cf94ea8a6edda25d9b330d3a6523bd5e28dedc.tar.gz txr-d3cf94ea8a6edda25d9b330d3a6523bd5e28dedc.tar.bz2 txr-d3cf94ea8a6edda25d9b330d3a6523bd5e28dedc.zip | |
Tokenizing test case, exercising for @(coll :gap 0)
and horizontal @(choose :shortest ...).
* Makefile: Defined TXR_ARGS for tests/008 directory.
* tests/008/data: New file.
* tests/008/tokenize.expected: New file.
* tests/008/tokenize.txr: New file.
Diffstat (limited to 'tests/008/tokenize.txr')
| -rw-r--r-- | tests/008/tokenize.txr | 12 |
1 files changed, 12 insertions, 0 deletions
diff --git a/tests/008/tokenize.txr b/tests/008/tokenize.txr new file mode 100644 index 00000000..39211ba9 --- /dev/null +++ b/tests/008/tokenize.txr @@ -0,0 +1,12 @@ +@(collect) +@(coll :gap 0)@(choose :shortest tok)@\ + @tok@{sep /==/}@\ + @(or)@\ + @tok@{sep /!=/}@\ + @(or)@\ + @tok@{sep /=/}@\ + @(end)@(end)@tail +@(output) +@(rep)"@tok" {@sep} @(end)"@tail" +@(end) +@(end) |