Automatically build tree-sitter-langs from source instead of downloading binaries on arm64 (m1) machines

[shaunsingh]

Hi, loving the idea (and treesitter on my x86 machine) so far. If emacs is running on an arm64 machine, would it be possible to have tree-sitter-langs automatically download the source and compile the parsers, insetad of download the binary and failing with no warning?

[ubolonton]

Yes, all the low-level building blocks are already in tree-sitter-langs-build.el, but they currently assume a cloned git repository. Some additional code to handle source downloading is needed.

[Mic92]

In the meantime I think you can also use nix to download the grammars: https://github.com/Mic92/dotfiles/blob/3c99578315d30cd23ed2d4f7d8dbf560daaf2820/nixpkgs-config/modules/emacs/default.nix#L79

If that is not your cup of cake you can still configure emacs-tree-sitter to load grammars from a custom directory: https://github.com/Mic92/dotfiles/blob/3c99578315d30cd23ed2d4f7d8dbf560daaf2820/home/.doom.d/config.el#L187

[shaunsingh]

I don't actually use nix on my m1/darwin machine, but I have compiled the parsers locally and am already loading them from a custom directory! This issue was just raised in the doom emacs server so I thought it would be nice to openan issue here

[shaunsingh]

@Mic92 have you run into an issue where tsc is build for the wrong architecture? (tsc-dyn.dylib' mach-o file, but is an incompatible architecture (have 'x86_64', need 'arm64e')

If so, do you have a nix way to solve it

[Mic92]

No. But nix would also not have this issue on darwin/arm64.

[morphykuffour]

I have the tsc-dyn.aarch64-apple-darwin.dylib file downloaded how do I load the dynamic library in order to get emacs to (require 'tree-sitter). I have added the core, lisp, and langs to the load path. I am still getting the tsc-dyn error when I try to evaluate the load the tree-sitter plugin. See images below.

[ubolonton]

You will need to rename it to tsc-dyn.dylib and put it into core/.

[morphykuffour]

yeah did not work. I renamed the file and I put in the core directory of the elisp-tree-sitter git repo cloned on my manchine.

[ubolonton]

There’s not enough information to troubleshoot currently. Please describe what happened in more details, e.g. errors/backtraces. Minimal reproduction steps would be helpful.