Can we create a grammar that takes ABNF language descriptions and converts them to ts bin blobs for use in gotreesitter?
| Filename | Latest commit message | Latest commit date |
|---|---|---|
Centralised research hub for tree-sitter binary formats and the Go-native grammar pipeline. Links all related tree-sitter repos. Research doc migrated from the standalone go-tsbin-docs repo. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com> |
||
| docs | ||
| README.md | ||
go-tsbin
Centralised research for tree-sitter binary formats and the Go-native grammar pipeline.
The goal is to replace the multi-tool chain (grammar.js → tree-sitter CLI → parser.c → ts2go) with a pure Go path from human-readable extended ABNF directly to binary blobs.
Related Repositories
| Repository | Description |
|---|---|
| gotreesitter | Pure Go tree-sitter runtime — loads binary blobs and parses. Currently experimenting with a full Go grammar pipeline. |
| tree-sitter2abnf | Lossless round-trip conversion between grammar.json and extended ABNF |
| tree-sitter-pta | Tree-sitter grammar for plain-text accounting files |
| tree-sitter-goluca | Tree-sitter grammar for Go-Luca document format |
| tree-sitter-abnf | Tree-sitter grammar for ABNF notation |
| tree-sitter-yabnf | Tree-sitter grammar for extended ABNF (YABNF) |
| plain-text-accounting-formats | PTA format documentation — uses tree-sitter grammars and is the primary area of interest for go-tsbin |
The grammars above are document-oriented (accounting ledgers, structured text) rather than general-purpose programming languages. Gotreesitter is closer to the upstream tree-sitter runtime but extended with a handful of these extra grammars.
Research
See docs/DOC-RESEARCH.md for the detailed feasibility study covering the current vs proposed pipeline, format choices, and phased implementation plan.