SQLAlchemy model N+1 debugger.
NOTE: This is a debugging tool that is not meant to be deployed in production.
This module will help identify N+1 DB calls made through SQLAlchemy. It takes advantage of the SQLAlchemy event listener for do_orm_execute
.
QueryCounter will provide insights into which model DB calls are made multiple times, with optional tracebacks and heuristics to determine where these calls originate.
By default, QueryCounter will log results with an optional config to raise an Exception.
pip install query-counter
Usage: Create QueryCounter with a SQLalchemy session, an optional config, and initialize
when you would like to start tracking requests:
from query_counter import QueryCounter
query_counter = QueryCounter(session=session)
query_counter.initialize()
Run analyze
to dig into queries that ran since initialization:
query_counter.analyze()
This also works as a context manager:
with QueryCounter(
session=session, config=QueryAnalysisConfig(alert_threshold=0)
) as counter:
session.query(User).first()
counter.analyze()
Setting a breakpoint in the analyze function will allow you to inspect all of the queries and their stack traces.
QueryCounter
accepts an optional config
kwarg of type QueryAnalysisConfig
.
QueryAnalysisConfig
is a dataclass with the following specifications/defaults:
# QueryCounter analyze will not log or raise exceptions if the number
# of duplicated DB calls is less than the alert_threshold
alert_threshold: int = 10
# QueryCounter analyze will raise an exception if True
raise_if_exceeds: bool = False
# QueryCounter analyze will info log if no DB calls
# exceed the threshold
log_no_alert: bool = False
# QueryCounter will store the stacktrace relevant to the DB call
traceback_enabled: bool = False
# QueryInstance will inspect frames and filter the stack down
# to codepaths specified in heuristic_paths
heuristics_enabled: bool = False
# Requires heuristics_enabled=True - filters stack down to
# these codepaths
heuristic_paths: list = field(default_factory=list)
- Linting
- Tests
- Pipeline
QueryCounter is distributed under the MIT License.