Skip to content

Issues: ndif-team/nnsight

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

24 Open 62 Closed
24 Open 62 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Is it possible to deal with the activations before exiting the tracing context?
#281 opened Oct 26, 2024 by Shiroha-Offical
nnsight with multithreading
#280 opened Oct 25, 2024 by lithafnium
1
Standardize terminology
#275 opened Oct 14, 2024 by arunasank
Typing error using LanguageModel.trace() as a context manager
#273 opened Oct 12, 2024 by chanind
Which models are currently hosted on NDIF?
#262 opened Oct 8, 2024 by tombewley
Allow user to disable gradient when doing remote execution
#251 opened Sep 30, 2024 by Butanium
NNsight status page does not work consistently
#246 opened Sep 25, 2024 by Butanium
LogitsProcessor not working when remote=True
#241 opened Sep 17, 2024 by LouisHernandez17
2
nnsight model.trace vs AutoModelForCausalLM produce different argmax values for the same prompt
#239 opened Sep 13, 2024 by arunasank
5
Writing the NDIF section of the NNsight/NDIF Paper
#238 opened Sep 11, 2024 by JadenFiotto-Kaufman
Writing the design section of the NNsight/NDIF Paper
#237 opened Sep 11, 2024 by JadenFiotto-Kaufman
Unrecognized configuration class when using nnsight to load new LLMs
#211 opened Aug 30, 2024 by ruizheliUOA
4
In-place editor calls repeat when the modified model is run
#210 opened Aug 30, 2024 by mitroitskii
@JadenFiotto-Kaufman @AdamBelfki3
5
Remote Execution Exception: Unprocessable Entity
#191 opened Aug 13, 2024 by ShichangZh
1
Issue with eos_token_id in LanguageModel.generate() when using local models
#177 opened Jul 20, 2024 by zzn-nzz
2
IndexError when flat inputs are concatenated during trace
#176 opened Jul 20, 2024 by austinleedavis
Make positional args optional
#172 opened Jul 15, 2024 by ericwtodd
Remote Execution handle_request should not hang when raising an exception
#161 opened Jun 26, 2024 by JadenFiotto-Kaufman
Calling an Envoy outside of a tracing context should work
#156 opened Jun 13, 2024 by JadenFiotto-Kaufman
NNsight should fail when an Unset proxy from a previous trace / future computation is used in a patching experiment
#143 opened May 25, 2024 by Butanium
[Feature Request] Make token indexing work for batched input and UnifiedTransformer
#138 opened May 21, 2024 by Butanium
2
Error when using stopping_criteria in .generate if remote=True
#137 opened May 20, 2024 by Butanium
5
Expand pytest tests enhancement New feature or request help wanted Extra attention is needed
#133 opened May 9, 2024 by JadenFiotto-Kaufman
1
Dispatch Error When Using Quantisation bug Something isn't working help wanted Extra attention is needed
#106 opened Apr 7, 2024 by Xmaster6y
1
ProTip! Type g i on any issue or pull request to go back to the issue listing page.