-
Notifications
You must be signed in to change notification settings - Fork 600
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
refactor(stream): remove Executor::clear_cache #1820
Conversation
Signed-off-by: TennyZhuang <[email protected]>
Codecov Report
@@ Coverage Diff @@
## main #1820 +/- ##
==========================================
+ Coverage 70.75% 70.77% +0.02%
==========================================
Files 607 607
Lines 79461 79411 -50
==========================================
- Hits 56220 56203 -17
+ Misses 23241 23208 -33
Flags with carried forward coverage won't be shown. Click here to find out more.
📣 Codecov can now indicate which changes are the most critical in Pull Requests. Learn more |
self.managed_lowest_state.clear_cache(); | ||
self.managed_middle_state.clear_cache(); | ||
self.managed_highest_state.clear_cache(); | ||
self.first_execution = true; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This is quite suspicious. Why setting first_execution here before? Could that be related to @BugenZhao 's recently discovered bug?
By the way, we can remove no cache e2e test in CI.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The HashJoin has not been migrated to executor v2 and its clear_cache
still makes sense. Let's keep it for a while.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
IIRC, the first_execution
indicates whether we need to fetch the state from storage and was necessary when writing this. 🤣 I'll investigate into TopN in next days. cc @lmatz
Signed-off-by: TennyZhuang [email protected]
What's changed and what's your intention?
It's impossible to implement
clear_cache
inExecutorV2
, we may investigate another way.Checklist
Refer to a related PR or issue link (optional)