Closing a process's stdout when there's more data to be read results in internal asyncio error #490

jwodder · 2022-11-03T14:34:14Z

When using anyio with asyncio (This works fine with trio), if a subprocess is started with piped stdout and the stdout is closed (either explicitly or via context manager) before all data is read, asyncio will crash with a horrible traceback.

MVCE:

import sys
import anyio

CODE = """\
import sys
for _ in range(1000):
    sys.stdout.buffer.write(bytes(range(256)))
"""

async def amain():
    async with await anyio.open_process([sys.executable, "-c", CODE]) as p:
        print(repr(await p.stdout.receive()))
        await p.stdout.aclose()  # The error even happens if you comment out this line!

if __name__ == "__main__":
    anyio.run(amain)

Output (after skipping the print's output)

handle: <Handle SubprocessStreamProtocol.pipe_data_received(1, b'\x00\x01\x0...c\xfd\xfe\xff')>
Traceback (most recent call last):
  File "/usr/local/Cellar/[email protected]/3.10.8/Frameworks/Python.framework/Versions/3.10/lib/python3.10/asyncio/events.py", line 80, in _run
    self._context.run(self._callback, *self._args)
  File "/usr/local/Cellar/[email protected]/3.10.8/Frameworks/Python.framework/Versions/3.10/lib/python3.10/asyncio/subprocess.py", line 72, in pipe_data_received
    reader.feed_data(data)
  File "/usr/local/Cellar/[email protected]/3.10.8/Frameworks/Python.framework/Versions/3.10/lib/python3.10/asyncio/streams.py", line 456, in feed_data
    assert not self._eof, 'feed_data after feed_eof'
AssertionError: feed_data after feed_eof
Exception in callback SubprocessStreamProtocol.pipe_data_received(1, b'\x00\x01\x0...c\xfd\xfe\xff')
handle: <Handle SubprocessStreamProtocol.pipe_data_received(1, b'\x00\x01\x0...c\xfd\xfe\xff')>
Traceback (most recent call last):
  File "/usr/local/Cellar/[email protected]/3.10.8/Frameworks/Python.framework/Versions/3.10/lib/python3.10/asyncio/events.py", line 80, in _run
    self._context.run(self._callback, *self._args)
  File "/usr/local/Cellar/[email protected]/3.10.8/Frameworks/Python.framework/Versions/3.10/lib/python3.10/asyncio/subprocess.py", line 72, in pipe_data_received
    reader.feed_data(data)
  File "/usr/local/Cellar/[email protected]/3.10.8/Frameworks/Python.framework/Versions/3.10/lib/python3.10/asyncio/streams.py", line 456, in feed_data
    assert not self._eof, 'feed_data after feed_eof'
AssertionError: feed_data after feed_eof
Exception in callback SubprocessStreamProtocol.pipe_data_received(1, b'\x00\x01\x0...c\xfd\xfe\xff')
handle: <Handle SubprocessStreamProtocol.pipe_data_received(1, b'\x00\x01\x0...c\xfd\xfe\xff')>
Traceback (most recent call last):
  File "/usr/local/Cellar/[email protected]/3.10.8/Frameworks/Python.framework/Versions/3.10/lib/python3.10/asyncio/events.py", line 80, in _run
    self._context.run(self._callback, *self._args)
  File "/usr/local/Cellar/[email protected]/3.10.8/Frameworks/Python.framework/Versions/3.10/lib/python3.10/asyncio/subprocess.py", line 72, in pipe_data_received
    reader.feed_data(data)
  File "/usr/local/Cellar/[email protected]/3.10.8/Frameworks/Python.framework/Versions/3.10/lib/python3.10/asyncio/streams.py", line 456, in feed_data
    assert not self._eof, 'feed_data after feed_eof'
AssertionError: feed_data after feed_eof
Exception in callback SubprocessStreamProtocol.pipe_data_received(1, b'\x00\x01\x0...c\xfd\xfe\xff')
handle: <Handle SubprocessStreamProtocol.pipe_data_received(1, b'\x00\x01\x0...c\xfd\xfe\xff')>
Traceback (most recent call last):
  File "/usr/local/Cellar/[email protected]/3.10.8/Frameworks/Python.framework/Versions/3.10/lib/python3.10/asyncio/events.py", line 80, in _run
    self._context.run(self._callback, *self._args)
  File "/usr/local/Cellar/[email protected]/3.10.8/Frameworks/Python.framework/Versions/3.10/lib/python3.10/asyncio/subprocess.py", line 72, in pipe_data_received
    reader.feed_data(data)
  File "/usr/local/Cellar/[email protected]/3.10.8/Frameworks/Python.framework/Versions/3.10/lib/python3.10/asyncio/streams.py", line 456, in feed_data
    assert not self._eof, 'feed_data after feed_eof'
AssertionError: feed_data after feed_eof
Exception in callback SubprocessStreamProtocol.pipe_data_received(1, b'\x00\x01\x0...c\xfd\xfe\xff')
handle: <Handle SubprocessStreamProtocol.pipe_data_received(1, b'\x00\x01\x0...c\xfd\xfe\xff')>
Traceback (most recent call last):
  File "/usr/local/Cellar/[email protected]/3.10.8/Frameworks/Python.framework/Versions/3.10/lib/python3.10/asyncio/events.py", line 80, in _run
    self._context.run(self._callback, *self._args)
  File "/usr/local/Cellar/[email protected]/3.10.8/Frameworks/Python.framework/Versions/3.10/lib/python3.10/asyncio/subprocess.py", line 72, in pipe_data_received
    reader.feed_data(data)
  File "/usr/local/Cellar/[email protected]/3.10.8/Frameworks/Python.framework/Versions/3.10/lib/python3.10/asyncio/streams.py", line 456, in feed_data
    assert not self._eof, 'feed_data after feed_eof'
AssertionError: feed_data after feed_eof

This behavior has been observed in the following environments:

macOS 11.6.8, Python 3.10.8, anyio 3.6.2
Debian 11 (bullseye), Python 3.8.13, anyio 3.6.1

The text was updated successfully, but these errors were encountered:

dolamroth · 2024-02-14T11:48:53Z

I have the same error with:
Windows 10, Python 3.9.2, anyio==4.2.0
Ubuntu 22, Python 3.10.12, anyio==4.2.0

P.S. For me that happened, when I had exception in my code, that processed output from BufferedByteStream(process.stdout).receive_until. An exception message was swallowed, and there was spam of AssertionError: feed_data after feed_eof messages

Fixes #490.

agronholm · 2024-06-29T09:31:06Z

@dolamroth would you mind validating the fix PR (see above for the link)?

Fixes #490.

Bumps [anyio](https://github.com/agronholm/anyio) from 4.4.0 to 4.5.0. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/agronholm/anyio/releases">anyio's releases</a>.</em></p> <blockquote> <h2>4.5.0</h2> <ul> <li>Improved the performance of <code>anyio.Lock</code> and <code>anyio.Semaphore</code> on asyncio (even up to 50 %)</li> <li>Added the <code>fast_acquire</code> parameter to <code>anyio.Lock</code> and <code>anyio.Semaphore</code> to further boost performance at the expense of safety (<code>acquire()</code> will not yield control back if there is no contention)</li> <li>Added support for the <code>from_uri()</code>, <code>full_match()</code>, <code>parser</code> methods/properties in <code>anyio.Path</code>, newly added in Python 3.13 (<a href="https://redirect.github.com/agronholm/anyio/issues/737">#737</a>)</li> <li>Added support for more keyword arguments for <code>run_process()</code> and <code>open_process()</code>: <code>startupinfo</code>, <code>creationflags</code>, <code>pass_fds</code>, <code>user</code>, <code>group</code>, <code>extra_groups</code> and <code>umask</code> (<a href="https://redirect.github.com/agronholm/anyio/issues/742">#742</a>)</li> <li>Improved the type annotations and support for <code>PathLike</code> in <code>run_process()</code> and <code>open_process()</code> to allow for path-like arguments, just like <code>subprocess.Popen</code></li> <li>Changed the <code>ResourceWarning</code> from an unclosed memory object stream to include its address for easier identification</li> <li>Changed <code>start_blocking_portal()</code> to always use daemonic threads, to accommodate the "loitering event loop" use case</li> <li>Bumped the minimum version of Trio to v0.26.1</li> <li>Fixed <code>__repr__()</code> of <code>MemoryObjectItemReceiver</code>, when <code>item</code> is not defined (<a href="https://redirect.github.com/agronholm/anyio/pulls/767">#767</a>; PR by <a href="https://github.com/Danipulok"><code>@Danipulok</code></a>)</li> <li>Fixed <code>to_process.run_sync()</code> failing to initialize if <code>__main__.__file__</code> pointed to a file in a nonexistent directory (<a href="https://redirect.github.com/agronholm/anyio/issues/696">#696</a>)</li> <li>Fixed <code>AssertionError: feed_data after feed_eof</code> on asyncio when a subprocess is closed early, before its output has been read (<a href="https://redirect.github.com/agronholm/anyio/issues/490">#490</a>)</li> <li>Fixed <code>TaskInfo.has_pending_cancellation()</code> on asyncio not respecting shielded scopes (<a href="https://redirect.github.com/agronholm/anyio/issues/771">#771</a>; PR by <a href="https://github.com/gschaffner"><code>@gschaffner</code></a>)</li> <li>Fixed <code>SocketStream.receive()</code> returning <code>bytearray</code> instead of <code>bytes</code> when using asyncio with <code>ProactorEventLoop</code> (Windows) (<a href="https://redirect.github.com/agronholm/anyio/issues/776">#776</a>)</li> <li>Fixed quitting the debugger in a pytest test session while in an active task group failing the test instead of exiting the test session (because the exit exception arrives in an exception group)</li> <li>Fixed support for Linux abstract namespaces in UNIX sockets that was broken in v4.2 (<a href="https://redirect.github.com/agronholm/anyio/issues/781">#781</a> <<a href="https://redirect.github.com/agronholm/anyio/issues/781">agronholm/anyio#781</a>>_; PR by <a href="https://github.com/tapetersen"><code>@tapetersen</code></a>)</li> <li>Fixed <code>KeyboardInterrupt</code> (ctrl+c) hanging the asyncio pytest runner</li> </ul> </blockquote> </details> <details> <summary>Changelog</summary> <p><em>Sourced from <a href="https://github.com/agronholm/anyio/blob/master/docs/versionhistory.rst">anyio's changelog</a>.</em></p> <blockquote> <h1>Version history</h1> <p>This library adheres to <code>Semantic Versioning 2.0 <http://semver.org/></code>_.</p> <p><strong>4.5.0</strong></p> <ul> <li>Improved the performance of <code>anyio.Lock</code> and <code>anyio.Semaphore</code> on asyncio (even up to 50 %)</li> <li>Added the <code>fast_acquire</code> parameter to <code>anyio.Lock</code> and <code>anyio.Semaphore</code> to further boost performance at the expense of safety (<code>acquire()</code> will not yield control back if there is no contention)</li> <li>Added support for the <code>from_uri()</code>, <code>full_match()</code>, <code>parser</code> methods/properties in <code>anyio.Path</code>, newly added in Python 3.13 (<code>[#737](agronholm/anyio#737) <https://github.com/agronholm/anyio/issues/737></code>_)</li> <li>Added support for more keyword arguments for <code>run_process()</code> and <code>open_process()</code>: <code>startupinfo</code>, <code>creationflags</code>, <code>pass_fds</code>, <code>user</code>, <code>group</code>, <code>extra_groups</code> and <code>umask</code> (<code>[#742](agronholm/anyio#742) <https://github.com/agronholm/anyio/issues/742></code>_)</li> <li>Improved the type annotations and support for <code>PathLike</code> in <code>run_process()</code> and <code>open_process()</code> to allow for path-like arguments, just like <code>subprocess.Popen</code></li> <li>Changed the <code>ResourceWarning</code> from an unclosed memory object stream to include its address for easier identification</li> <li>Changed <code>start_blocking_portal()</code> to always use daemonic threads, to accommodate the "loitering event loop" use case</li> <li>Bumped the minimum version of Trio to v0.26.1</li> <li>Fixed <code>__repr__()</code> of <code>MemoryObjectItemReceiver</code>, when <code>item</code> is not defined (<code>[#767](agronholm/anyio#767) <https://github.com/agronholm/anyio/pulls/767></code>_; PR by <a href="https://github.com/Danipulok"><code>@Danipulok</code></a>)</li> <li>Fixed <code>to_process.run_sync()</code> failing to initialize if <code>__main__.__file__</code> pointed to a file in a nonexistent directory (<code>[#696](agronholm/anyio#696) <https://github.com/agronholm/anyio/issues/696></code>_)</li> <li>Fixed <code>AssertionError: feed_data after feed_eof</code> on asyncio when a subprocess is closed early, before its output has been read (<code>[#490](agronholm/anyio#490) <https://github.com/agronholm/anyio/issues/490></code>_)</li> <li>Fixed <code>TaskInfo.has_pending_cancellation()</code> on asyncio not respecting shielded scopes (<code>[#771](agronholm/anyio#771) <https://github.com/agronholm/anyio/issues/771></code>_; PR by <a href="https://github.com/gschaffner"><code>@gschaffner</code></a>)</li> <li>Fixed <code>SocketStream.receive()</code> returning <code>bytearray</code> instead of <code>bytes</code> when using asyncio with <code>ProactorEventLoop</code> (Windows) (<code>[#776](agronholm/anyio#776) <https://github.com/agronholm/anyio/issues/776></code>_)</li> <li>Fixed quitting the debugger in a pytest test session while in an active task group failing the test instead of exiting the test session (because the exit exception arrives in an exception group)</li> <li>Fixed support for Linux abstract namespaces in UNIX sockets that was broken in v4.2 (<a href="https://redirect.github.com/agronholm/anyio/issues/781">#781</a> <a href="https://redirect.github.com/agronholm/anyio/issues/781">agronholm/anyio#781</a>_; PR by <a href="https://github.com/tapetersen"><code>@tapetersen</code></a>)</li> <li>Fixed <code>KeyboardInterrupt</code> (ctrl+c) hanging the asyncio pytest runner</li> </ul> <p><strong>4.4.0</strong></p> <ul> <li>Added the <code>BlockingPortalProvider</code> class to aid with constructing synchronous counterparts to asynchronous interfaces that would otherwise require multiple blocking</li> </ul>  </blockquote> <p>... (truncated)</p> </details> <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/agronholm/anyio/commit/7f35ce79e3eb9db2a2731619b48fe289d8dd872f"><code>7f35ce7</code></a> Bumped up the version</li> <li><a href="https://github.com/agronholm/anyio/commit/108cc8300aa5a0d5be2834a8bbd3eb1938b8c104"><code>108cc83</code></a> [pre-commit.ci] pre-commit autoupdate (<a href="https://redirect.github.com/agronholm/anyio/issues/788">#788</a>)</li> <li><a href="https://github.com/agronholm/anyio/commit/d1aea98c4f552d04458e49f1484b9c018f2a3ca8"><code>d1aea98</code></a> Fixed KeyboardInterrupt hanging the asyncio test runner (<a href="https://redirect.github.com/agronholm/anyio/issues/779">#779</a>)</li> <li><a href="https://github.com/agronholm/anyio/commit/c1aff53d8ae5ddc2cf1b8558614a7a2d60c12518"><code>c1aff53</code></a> [pre-commit.ci] pre-commit autoupdate (<a href="https://redirect.github.com/agronholm/anyio/issues/785">#785</a>)</li> <li><a href="https://github.com/agronholm/anyio/commit/89d8b4c9609e22306c597cea98ecf3fba45fb663"><code>89d8b4c</code></a> Use sphinx_rtd_theme also as an extension</li> <li><a href="https://github.com/agronholm/anyio/commit/4e9f18dfaa6e7db55231a35fcd93e18c343519a4"><code>4e9f18d</code></a> Enabled uvloop to be used in the test suite on Python 3.13</li> <li><a href="https://github.com/agronholm/anyio/commit/7de644113250a817dd3224e6df9b3658cb09802d"><code>7de6441</code></a> Pin Sphinx to a compatible version with sphinx-rtd-theme</li> <li><a href="https://github.com/agronholm/anyio/commit/41647f4ba7389dc756b0401033af1e3f41ad8a60"><code>41647f4</code></a> Fixed feed_data after feed_eof assertion errors on asyncio (<a href="https://redirect.github.com/agronholm/anyio/issues/752">#752</a>)</li> <li><a href="https://github.com/agronholm/anyio/commit/38890e607c726be6ea29ea2af445e8df43df5725"><code>38890e6</code></a> Accept abstract namespace paths for unix domain sockets (<a href="https://redirect.github.com/agronholm/anyio/issues/782">#782</a>)</li> <li><a href="https://github.com/agronholm/anyio/commit/0c8ad519e136c4b136b51333863966a445080a97"><code>0c8ad51</code></a> Delegated the implementations of Lock and Semaphore to the async backend clas...</li> <li>Additional commits viewable in <a href="https://github.com/agronholm/anyio/compare/4.4.0...4.5.0">compare view</a></li> </ul> </details> <br /> [![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=anyio&package-manager=pip&previous-version=4.4.0&new-version=4.5.0)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) </details> Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Bumps [anyio](https://github.com/agronholm/anyio) from 4.4.0 to 4.6.0. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/agronholm/anyio/releases">anyio's releases</a>.</em></p> <blockquote> <h2>4.6.0</h2> <ul> <li>Dropped support for Python 3.8 (as <a href="https://redirect.github.com/agronholm/anyio/issues/698">#698</a> cannot be resolved without cancel message support)</li> <li>Fixed 100% CPU use on asyncio while waiting for an exiting task group to finish while said task group is within a cancelled cancel scope (<a href="https://redirect.github.com/agronholm/anyio/issues/695">#695</a>)</li> <li>Fixed cancel scopes on asyncio not propagating <code>CancelledError</code> on exit when the enclosing cancel scope has been effectively cancelled (<a href="https://redirect.github.com/agronholm/anyio/issues/698">#698</a>)</li> <li>Fixed asyncio task groups not yielding control to the event loop at exit if there were no child tasks to wait on</li> <li>Fixed inconsistent task uncancellation with asyncio cancel scopes belonging to a task group when said task group has child tasks running</li> </ul> <h2>4.5.0</h2> <ul> <li>Improved the performance of <code>anyio.Lock</code> and <code>anyio.Semaphore</code> on asyncio (even up to 50 %)</li> <li>Added the <code>fast_acquire</code> parameter to <code>anyio.Lock</code> and <code>anyio.Semaphore</code> to further boost performance at the expense of safety (<code>acquire()</code> will not yield control back if there is no contention)</li> <li>Added support for the <code>from_uri()</code>, <code>full_match()</code>, <code>parser</code> methods/properties in <code>anyio.Path</code>, newly added in Python 3.13 (<a href="https://redirect.github.com/agronholm/anyio/issues/737">#737</a>)</li> <li>Added support for more keyword arguments for <code>run_process()</code> and <code>open_process()</code>: <code>startupinfo</code>, <code>creationflags</code>, <code>pass_fds</code>, <code>user</code>, <code>group</code>, <code>extra_groups</code> and <code>umask</code> (<a href="https://redirect.github.com/agronholm/anyio/issues/742">#742</a>)</li> <li>Improved the type annotations and support for <code>PathLike</code> in <code>run_process()</code> and <code>open_process()</code> to allow for path-like arguments, just like <code>subprocess.Popen</code></li> <li>Changed the <code>ResourceWarning</code> from an unclosed memory object stream to include its address for easier identification</li> <li>Changed <code>start_blocking_portal()</code> to always use daemonic threads, to accommodate the "loitering event loop" use case</li> <li>Bumped the minimum version of Trio to v0.26.1</li> <li>Fixed <code>__repr__()</code> of <code>MemoryObjectItemReceiver</code>, when <code>item</code> is not defined (<a href="https://redirect.github.com/agronholm/anyio/pulls/767">#767</a>; PR by <a href="https://github.com/Danipulok"><code>@Danipulok</code></a>)</li> <li>Fixed <code>to_process.run_sync()</code> failing to initialize if <code>__main__.__file__</code> pointed to a file in a nonexistent directory (<a href="https://redirect.github.com/agronholm/anyio/issues/696">#696</a>)</li> <li>Fixed <code>AssertionError: feed_data after feed_eof</code> on asyncio when a subprocess is closed early, before its output has been read (<a href="https://redirect.github.com/agronholm/anyio/issues/490">#490</a>)</li> <li>Fixed <code>TaskInfo.has_pending_cancellation()</code> on asyncio not respecting shielded scopes (<a href="https://redirect.github.com/agronholm/anyio/issues/771">#771</a>; PR by <a href="https://github.com/gschaffner"><code>@gschaffner</code></a>)</li> <li>Fixed <code>SocketStream.receive()</code> returning <code>bytearray</code> instead of <code>bytes</code> when using asyncio with <code>ProactorEventLoop</code> (Windows) (<a href="https://redirect.github.com/agronholm/anyio/issues/776">#776</a>)</li> <li>Fixed quitting the debugger in a pytest test session while in an active task group failing the test instead of exiting the test session (because the exit exception arrives in an exception group)</li> <li>Fixed support for Linux abstract namespaces in UNIX sockets that was broken in v4.2 (<a href="https://redirect.github.com/agronholm/anyio/issues/781">#781</a> <<a href="https://redirect.github.com/agronholm/anyio/issues/781">agronholm/anyio#781</a>>_; PR by <a href="https://github.com/tapetersen"><code>@tapetersen</code></a>)</li> <li>Fixed <code>KeyboardInterrupt</code> (ctrl+c) hanging the asyncio pytest runner</li> </ul> </blockquote> </details> <details> <summary>Changelog</summary> <p><em>Sourced from <a href="https://github.com/agronholm/anyio/blob/master/docs/versionhistory.rst">anyio's changelog</a>.</em></p> <blockquote> <h1>Version history</h1> <p>This library adheres to <code>Semantic Versioning 2.0 <http://semver.org/></code>_.</p> <p><strong>4.6.0</strong></p> <ul> <li>Dropped support for Python 3.8 (as <code>[#698](agronholm/anyio#698) <https://github.com/agronholm/anyio/issues/698></code>_ cannot be resolved without cancel message support)</li> <li>Fixed 100% CPU use on asyncio while waiting for an exiting task group to finish while said task group is within a cancelled cancel scope (<code>[#695](agronholm/anyio#695) <https://github.com/agronholm/anyio/issues/695></code>_)</li> <li>Fixed cancel scopes on asyncio not propagating <code>CancelledError</code> on exit when the enclosing cancel scope has been effectively cancelled (<code>[#698](agronholm/anyio#698) <https://github.com/agronholm/anyio/issues/698></code>_)</li> <li>Fixed asyncio task groups not yielding control to the event loop at exit if there were no child tasks to wait on</li> <li>Fixed inconsistent task uncancellation with asyncio cancel scopes belonging to a task group when said task group has child tasks running</li> </ul> <p><strong>4.5.0</strong></p> <ul> <li>Improved the performance of <code>anyio.Lock</code> and <code>anyio.Semaphore</code> on asyncio (even up to 50 %)</li> <li>Added the <code>fast_acquire</code> parameter to <code>anyio.Lock</code> and <code>anyio.Semaphore</code> to further boost performance at the expense of safety (<code>acquire()</code> will not yield control back if there is no contention)</li> <li>Added support for the <code>from_uri()</code>, <code>full_match()</code>, <code>parser</code> methods/properties in <code>anyio.Path</code>, newly added in Python 3.13 (<code>[#737](agronholm/anyio#737) <https://github.com/agronholm/anyio/issues/737></code>_)</li> <li>Added support for more keyword arguments for <code>run_process()</code> and <code>open_process()</code>: <code>startupinfo</code>, <code>creationflags</code>, <code>pass_fds</code>, <code>user</code>, <code>group</code>, <code>extra_groups</code> and <code>umask</code> (<code>[#742](agronholm/anyio#742) <https://github.com/agronholm/anyio/issues/742></code>_)</li> <li>Improved the type annotations and support for <code>PathLike</code> in <code>run_process()</code> and <code>open_process()</code> to allow for path-like arguments, just like <code>subprocess.Popen</code></li> <li>Changed the <code>ResourceWarning</code> from an unclosed memory object stream to include its address for easier identification</li> <li>Changed <code>start_blocking_portal()</code> to always use daemonic threads, to accommodate the "loitering event loop" use case</li> <li>Bumped the minimum version of Trio to v0.26.1</li> <li>Fixed <code>__repr__()</code> of <code>MemoryObjectItemReceiver</code>, when <code>item</code> is not defined (<code>[#767](agronholm/anyio#767) <https://github.com/agronholm/anyio/pulls/767></code>_; PR by <a href="https://github.com/Danipulok"><code>@Danipulok</code></a>)</li> <li>Fixed <code>to_process.run_sync()</code> failing to initialize if <code>__main__.__file__</code> pointed to a file in a nonexistent directory (<code>[#696](agronholm/anyio#696) <https://github.com/agronholm/anyio/issues/696></code>_)</li> <li>Fixed <code>AssertionError: feed_data after feed_eof</code> on asyncio when a subprocess is closed early, before its output has been read (<code>[#490](agronholm/anyio#490) <https://github.com/agronholm/anyio/issues/490></code>_)</li> </ul>  </blockquote> <p>... (truncated)</p> </details> <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/agronholm/anyio/commit/8cce74917ffc7523203ab44862f20fd61f065cc5"><code>8cce749</code></a> Bumped up the version</li> <li><a href="https://github.com/agronholm/anyio/commit/01a37c603d55605e0d6f21b7d43828f4738c7a3d"><code>01a37c6</code></a> Fixed TaskGroup and CancelScope exit issues on asyncio (<a href="https://redirect.github.com/agronholm/anyio/issues/774">#774</a>)</li> <li><a href="https://github.com/agronholm/anyio/commit/7f35ce79e3eb9db2a2731619b48fe289d8dd872f"><code>7f35ce7</code></a> Bumped up the version</li> <li><a href="https://github.com/agronholm/anyio/commit/108cc8300aa5a0d5be2834a8bbd3eb1938b8c104"><code>108cc83</code></a> [pre-commit.ci] pre-commit autoupdate (<a href="https://redirect.github.com/agronholm/anyio/issues/788">#788</a>)</li> <li><a href="https://github.com/agronholm/anyio/commit/d1aea98c4f552d04458e49f1484b9c018f2a3ca8"><code>d1aea98</code></a> Fixed KeyboardInterrupt hanging the asyncio test runner (<a href="https://redirect.github.com/agronholm/anyio/issues/779">#779</a>)</li> <li><a href="https://github.com/agronholm/anyio/commit/c1aff53d8ae5ddc2cf1b8558614a7a2d60c12518"><code>c1aff53</code></a> [pre-commit.ci] pre-commit autoupdate (<a href="https://redirect.github.com/agronholm/anyio/issues/785">#785</a>)</li> <li><a href="https://github.com/agronholm/anyio/commit/89d8b4c9609e22306c597cea98ecf3fba45fb663"><code>89d8b4c</code></a> Use sphinx_rtd_theme also as an extension</li> <li><a href="https://github.com/agronholm/anyio/commit/4e9f18dfaa6e7db55231a35fcd93e18c343519a4"><code>4e9f18d</code></a> Enabled uvloop to be used in the test suite on Python 3.13</li> <li><a href="https://github.com/agronholm/anyio/commit/7de644113250a817dd3224e6df9b3658cb09802d"><code>7de6441</code></a> Pin Sphinx to a compatible version with sphinx-rtd-theme</li> <li><a href="https://github.com/agronholm/anyio/commit/41647f4ba7389dc756b0401033af1e3f41ad8a60"><code>41647f4</code></a> Fixed feed_data after feed_eof assertion errors on asyncio (<a href="https://redirect.github.com/agronholm/anyio/issues/752">#752</a>)</li> <li>Additional commits viewable in <a href="https://github.com/agronholm/anyio/compare/4.4.0...4.6.0">compare view</a></li> </ul> </details> <br /> [![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=anyio&package-manager=pip&previous-version=4.4.0&new-version=4.6.0)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) </details> Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Bumps [anyio](https://github.com/agronholm/anyio) from 4.5.0 to 4.6.0. <details> <summary>Release notes</summary> <p><em>Sourced from <a href="https://github.com/agronholm/anyio/releases">anyio's releases</a>.</em></p> <blockquote> <h2>4.6.0</h2> <ul> <li>Dropped support for Python 3.8 (as <a href="https://redirect.github.com/agronholm/anyio/issues/698">#698</a> cannot be resolved without cancel message support)</li> <li>Fixed 100% CPU use on asyncio while waiting for an exiting task group to finish while said task group is within a cancelled cancel scope (<a href="https://redirect.github.com/agronholm/anyio/issues/695">#695</a>)</li> <li>Fixed cancel scopes on asyncio not propagating <code>CancelledError</code> on exit when the enclosing cancel scope has been effectively cancelled (<a href="https://redirect.github.com/agronholm/anyio/issues/698">#698</a>)</li> <li>Fixed asyncio task groups not yielding control to the event loop at exit if there were no child tasks to wait on</li> <li>Fixed inconsistent task uncancellation with asyncio cancel scopes belonging to a task group when said task group has child tasks running</li> </ul> </blockquote> </details> <details> <summary>Changelog</summary> <p><em>Sourced from <a href="https://github.com/agronholm/anyio/blob/master/docs/versionhistory.rst">anyio's changelog</a>.</em></p> <blockquote> <h1>Version history</h1> <p>This library adheres to <code>Semantic Versioning 2.0 <http://semver.org/></code>_.</p> <p><strong>4.6.0</strong></p> <ul> <li>Dropped support for Python 3.8 (as <code>[#698](agronholm/anyio#698) <https://github.com/agronholm/anyio/issues/698></code>_ cannot be resolved without cancel message support)</li> <li>Fixed 100% CPU use on asyncio while waiting for an exiting task group to finish while said task group is within a cancelled cancel scope (<code>[#695](agronholm/anyio#695) <https://github.com/agronholm/anyio/issues/695></code>_)</li> <li>Fixed cancel scopes on asyncio not propagating <code>CancelledError</code> on exit when the enclosing cancel scope has been effectively cancelled (<code>[#698](agronholm/anyio#698) <https://github.com/agronholm/anyio/issues/698></code>_)</li> <li>Fixed asyncio task groups not yielding control to the event loop at exit if there were no child tasks to wait on</li> <li>Fixed inconsistent task uncancellation with asyncio cancel scopes belonging to a task group when said task group has child tasks running</li> </ul> <p><strong>4.5.0</strong></p> <ul> <li>Improved the performance of <code>anyio.Lock</code> and <code>anyio.Semaphore</code> on asyncio (even up to 50 %)</li> <li>Added the <code>fast_acquire</code> parameter to <code>anyio.Lock</code> and <code>anyio.Semaphore</code> to further boost performance at the expense of safety (<code>acquire()</code> will not yield control back if there is no contention)</li> <li>Added support for the <code>from_uri()</code>, <code>full_match()</code>, <code>parser</code> methods/properties in <code>anyio.Path</code>, newly added in Python 3.13 (<code>[#737](agronholm/anyio#737) <https://github.com/agronholm/anyio/issues/737></code>_)</li> <li>Added support for more keyword arguments for <code>run_process()</code> and <code>open_process()</code>: <code>startupinfo</code>, <code>creationflags</code>, <code>pass_fds</code>, <code>user</code>, <code>group</code>, <code>extra_groups</code> and <code>umask</code> (<code>[#742](agronholm/anyio#742) <https://github.com/agronholm/anyio/issues/742></code>_)</li> <li>Improved the type annotations and support for <code>PathLike</code> in <code>run_process()</code> and <code>open_process()</code> to allow for path-like arguments, just like <code>subprocess.Popen</code></li> <li>Changed the <code>ResourceWarning</code> from an unclosed memory object stream to include its address for easier identification</li> <li>Changed <code>start_blocking_portal()</code> to always use daemonic threads, to accommodate the "loitering event loop" use case</li> <li>Bumped the minimum version of Trio to v0.26.1</li> <li>Fixed <code>__repr__()</code> of <code>MemoryObjectItemReceiver</code>, when <code>item</code> is not defined (<code>[#767](agronholm/anyio#767) <https://github.com/agronholm/anyio/pulls/767></code>_; PR by <a href="https://github.com/Danipulok"><code>@Danipulok</code></a>)</li> <li>Fixed <code>to_process.run_sync()</code> failing to initialize if <code>__main__.__file__</code> pointed to a file in a nonexistent directory (<code>[#696](agronholm/anyio#696) <https://github.com/agronholm/anyio/issues/696></code>_)</li> <li>Fixed <code>AssertionError: feed_data after feed_eof</code> on asyncio when a subprocess is closed early, before its output has been read (<code>[#490](agronholm/anyio#490) <https://github.com/agronholm/anyio/issues/490></code>_)</li> </ul>  </blockquote> <p>... (truncated)</p> </details> <details> <summary>Commits</summary> <ul> <li><a href="https://github.com/agronholm/anyio/commit/8cce74917ffc7523203ab44862f20fd61f065cc5"><code>8cce749</code></a> Bumped up the version</li> <li><a href="https://github.com/agronholm/anyio/commit/01a37c603d55605e0d6f21b7d43828f4738c7a3d"><code>01a37c6</code></a> Fixed TaskGroup and CancelScope exit issues on asyncio (<a href="https://redirect.github.com/agronholm/anyio/issues/774">#774</a>)</li> <li>See full diff in <a href="https://github.com/agronholm/anyio/compare/4.5.0...4.6.0">compare view</a></li> </ul> </details> <br /> [![Dependabot compatibility score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=anyio&package-manager=pip&previous-version=4.5.0&new-version=4.6.0)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- <details> <summary>Dependabot commands and options</summary> <br /> You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show <dependency name> ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) </details> Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

jwodder mentioned this issue Nov 3, 2022

Add lower-level logging of unexpected exceptions dandi/dandisets#294

Merged

yarikoptic mentioned this issue Nov 4, 2022

AssertionError: feed_data after feed_eof dandi/dandisets#293

Closed

agronholm added a commit that referenced this issue Jun 29, 2024

Fixed feed_data after feed_eof assertion errors on asyncio

8d9a024

Fixes #490.

agronholm mentioned this issue Jun 29, 2024

Fixed feed_data after feed_eof assertion errors on asyncio #752

Merged

3 tasks

agronholm closed this as completed in #752 Sep 5, 2024

agronholm added a commit that referenced this issue Sep 5, 2024

Fixed feed_data after feed_eof assertion errors on asyncio (#752)

41647f4

Fixes #490.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Closing a process's stdout when there's more data to be read results in internal asyncio error #490

Closing a process's stdout when there's more data to be read results in internal asyncio error #490

jwodder commented Nov 3, 2022

dolamroth commented Feb 14, 2024 •

edited

Loading

agronholm commented Jun 29, 2024

Closing a process's stdout when there's more data to be read results in internal asyncio error #490

Closing a process's stdout when there's more data to be read results in internal asyncio error #490

Comments

jwodder commented Nov 3, 2022

dolamroth commented Feb 14, 2024 • edited Loading

agronholm commented Jun 29, 2024

dolamroth commented Feb 14, 2024 •

edited

Loading