Huggingface GGUF Editor #9268
Replies: 2 comments
-
I have just added support for easily editing individual tokenizer.ggml.scores/token_type entries with quick and easy lookup of every token, making this the most advanced GGUF Editor currently available. :) This comes in real handy when models are released with incorrect metadata just like the recent Yi-Coder models that had incorrect token_type/score for the <|im_start|> token (as well as incorrect EOS token), there are still GGUFs with wrong metadata available... |
Beta Was this translation helpful? Give feedback.
-
Unfortunately there was an oversight that could cause unaligned tensors, this should now be fixed. If you experienced nonsensical results from an edited GGUF, please grab a new copy, sorry for the inconvenience! :( |
Beta Was this translation helpful? Give feedback.
-
The Huggingface GGUF Editor
🎉 Check out my latest project 🌍✨
A powerful editor designed specifically for editing GGUF metadata and downloading the result directly from any Huggingface repository you have access to (you must sign in for access to gated or private ones).
With its user-friendly design, you can effortlessly edit any GGUF metadata through the GGUF Editor hosted on Huggingface Spaces! 🌍✨🎉
Here are some basic usage examples:
Missing Pre-Tokenizer: If you notice that there's missing/incorrect metadata like the crucial Pre-Tokenizer name, Fill-in-Middle tokens, or any other metadata based feature, edit/create GGUF metadata in a flash! 📝✨🔗
Chat Template Editing: Suppose you want to fix an issue with the chat template(s) by updating them directly in the GGUF before downloading it, go ahead! Edit the existing template(s) or even add new ones for RAG, Tools, etc... 🗣️👥
Downloading Edited Files: Once you've made your edits using the GGUF Editor, download your edited file directly from the Huggingface repository, no need to learn how to install and use complicated scripts! 🚀✨
Beta Was this translation helpful? Give feedback.
All reactions