You can get the contents of this directory bundled as a zip file.
| Identifier | Caption |
|---|---|
| tex2tok | Convert a TeX source file into tokens. |
| Name | Size* | Date UTC | Notes |
|---|---|---|---|
| README | 453 bytes | 2005-Jun-29 | Shown below |
| _tex2tok.tex | 4 KiB | 2005-Jun-29 | |
| helper.py | 5 KiB | 2005-Jun-29 | |
| tex2tok.tex | 20 KiB | 2005-Jun-29 |
*File sizes in kibibytes.
# Copyright (c) 2005 Jonathan Fine <jfine@pytex.org>
# License: GPL version 2 or (at your option) any later version.
# $Source: /cvsroot/pytex/pytex/tex2tok/README,v $
tex2tok: convert a TeX source file into tokens
usage:
$ tex '&tex2tok' '\LEX{story}'
This will create a file story.tok.
This file will contain one line for each token.
installation:
$ ./helper.py # create tex2tok.tex from _tex2tok.tex
$ initex tex2tok.tex # create 'tex2tok.fmt'