Can we create a grammar that takes ABNF language descriptions and converts them to ts bin blobs for use in gotreesitter?
Find a file
Repository files (latest commit first)
Filename Latest commit message Latest commit date
Humphrey Drummond 1a8486774e Add README and migrate DOC-RESEARCH from go-tsbin-docs
Centralised research hub for tree-sitter binary formats and the
Go-native grammar pipeline. Links all related tree-sitter repos.
Research doc migrated from the standalone go-tsbin-docs repo.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-25 07:31:32 +00:00
docs Add README and migrate DOC-RESEARCH from go-tsbin-docs 2026-03-25 07:31:32 +00:00
README.md Add README and migrate DOC-RESEARCH from go-tsbin-docs 2026-03-25 07:31:32 +00:00

go-tsbin

Centralised research for tree-sitter binary formats and the Go-native grammar pipeline.

The goal is to replace the multi-tool chain (grammar.js → tree-sitter CLI → parser.c → ts2go) with a pure Go path from human-readable extended ABNF directly to binary blobs.

Repository Description
gotreesitter Pure Go tree-sitter runtime — loads binary blobs and parses. Currently experimenting with a full Go grammar pipeline.
tree-sitter2abnf Lossless round-trip conversion between grammar.json and extended ABNF
tree-sitter-pta Tree-sitter grammar for plain-text accounting files
tree-sitter-goluca Tree-sitter grammar for Go-Luca document format
tree-sitter-abnf Tree-sitter grammar for ABNF notation
tree-sitter-yabnf Tree-sitter grammar for extended ABNF (YABNF)
plain-text-accounting-formats PTA format documentation — uses tree-sitter grammars and is the primary area of interest for go-tsbin

The grammars above are document-oriented (accounting ledgers, structured text) rather than general-purpose programming languages. Gotreesitter is closer to the upstream tree-sitter runtime but extended with a handful of these extra grammars.

Research

See docs/DOC-RESEARCH.md for the detailed feasibility study covering the current vs proposed pipeline, format choices, and phased implementation plan.