Support stream cancellation #142
Closed
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
We now support stream cancellation via the `OutBodyIface` API's `outBodyCancel` function. Some care was taken to ensure that cancelling idle streams does not result in protocol errors. In particular, `outBodyCancel` will wait until either the headers have been sent successfully or an exception occurs. If we aren't totally sure that the headers are sent, we won't send `RST_STREAM`.
|
@kazu-yamamoto Could you please request a review from @edsko on this as well? Thank you! |
edsko
reviewed
Aug 28, 2024
|
This depends on kazu-yamamoto/http-semantics#11 . |
edsko
requested changes
Aug 28, 2024
The 'outputQ' invariant is what guarantees we won't send @RST_STREAM@ frames ahead of some still-enqueued data frames for a stream. Additionally, the previous commit was unnecessarily tracking whether headers had been sent on a stream to deal with a bug which we have now *actually* fixed, so we no longer track whether headers are sent per-stream as we were.
Track whether a stream is finished or cancelled in a `TVar` rather than an `IORef`, and update that `TVar` in a single transaction which also writes the appropriate http-semantics `StreamingChunk` to the queue.
edsko
requested changes
Aug 29, 2024
There was a problem hiding this comment.
This looks good to me now, and I think we could merge this now as-is, but I think we can make a two minor improvements (as well as remove that redundant constructor, mentioned above):
- I wonder what should happen with
outBodyPushetc once the stream is finished. This should be considered a user bug, I think, but it might be good to detect these cases and throw an exception. - Let's try and avoid the redundancy between the two
outBodyIfaceconstructions (all the more important after we also implement (1).
Network/HTTP2/H2/Types.hs
Outdated
| @@ -208,6 +214,7 @@ data HTTP2Error | |||
| | StreamErrorIsSent ErrorCode StreamId ReasonPhrase | |||
| | BadThingHappen E.SomeException | |||
| | GoAwayIsSent | |||
| | RSTStreamIsSent | |||
There was a problem hiding this comment.
Is this a leftover from a previous attempt? Doesn't seem to be used anywhere?
There was duplicated code in `Network.HTTP2.Client.Run` and `Network.HTTP2.Server.Worker` to construct a `OutBodyIface`. We have moved that to a dedicated module. We also now throw exceptions when a push or flush is attempted on a concluded stream.
edsko
reviewed
Aug 29, 2024
There was a problem hiding this comment.
LGTM! @kazu-yamamoto , this PR and kazu-yamamoto/http-semantics#11 and now ready for your review.
edsko
approved these changes
Aug 29, 2024
|
I have released |
kazu-yamamoto
approved these changes
Aug 29, 2024
|
A new version has been released. |
Merged
netbsd-srcmastr
pushed a commit
to NetBSD/pkgsrc
that referenced
this pull request
Jan 30, 2025
# ChangeLog for http2 ## 5.3.9 * Using `ThreadManager` of `time-manager`. ## 5.3.8 * `forkManagedTimeout` ensures that only one asynchronous exception is thrown. Fixing the thread leak via `Weak ThreadId` and `modifyTVar'`. [#156](kazu-yamamoto/http2#156) ## 5.3.7 * Using `withHandle` of time-manager. * Getting `Handle` for each thread. * Providing allocSimpleConfig' to enable customizing WAI tiemout manager. * Monitor option (-m) for h2c-client and h2c-server. ## 5.3.6 * Making `runIO` friendly with the new synchronism mechanism. [#152](kazu-yamamoto/http2#152) * Re-throwing asynchronous exceptions to prevent thread leak. * Simplifying the synchronism mechanism between workers and the sender. [#148](kazu-yamamoto/http2#148) ## 5.3.5 * Using `http-semantics` v0.3. * Deprecating `numberOfWorkers`. * Removing `unliftio`. * Avoid `undefined` in client. [#146](kazu-yamamoto/http2#146) ## 5.3.4 * Support stream cancellation [#142](kazu-yamamoto/http2#142) ## 5.3.3 * Enclosing IPv6 literal authority with square brackets. [#143](kazu-yamamoto/http2#143) ## 5.3.2 * Avoid unnecessary empty data frames at end of stream [#140](kazu-yamamoto/http2#140) * Removing unnecessary API from ServerIO ## 5.3.1 * Fix treatment of async exceptions [#138](kazu-yamamoto/http2#138) * Avoid race condition [#137](kazu-yamamoto/http2#137) ## 5.3.0 * New server architecture: spawning worker on demand instead of the worker pool. This reduce huge numbers of threads for streaming into only 2. No API changes but workers do not terminate quicly. Rather workers collaborate with the sender after queuing a response and finish after all response data are sent. * All threads are labeled with `labelThread`. You can see them by `listThreas` if necessary. ## 5.2.6 * Recover rxflow on closing. [#126](kazu-yamamoto/http2#126) * Fixing ClientSpec for stream errors. * Allowing negative window. (h2spec http2/6.9.2) * Update for latest http-semantics [#122](kazu-yamamoto/http2#124) ## 5.2.5 * Setting peer initial window size properly. [#123](kazu-yamamoto/http2#123) ## 5.2.4 * Update for latest http-semantics [#122](kazu-yamamoto/http2#122) * Measuring performance concurrently for h2c-client ## 5.2.3 * Update for latest http-semantics [#120](kazu-yamamoto/http2#120) * Enable containers 0.7 (ghc 9.10) [#117](kazu-yamamoto/http2#117) ## 5.2.2 * Mark final chunk as final [#116](kazu-yamamoto/http2#116)
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
We now support stream cancellation via the
OutBodyIfaceAPI'soutBodyCancelfunction. Some care was taken to ensure that cancelling idle streams does not result in protocol errors. In particular,outBodyCancelwill wait until either the headers have been sent successfully or an exception occurs. If we aren't totally sure that the headers are sent, we won't sendRST_STREAM.