Skip to content

[594] Support continuous conversion with the RunSync tool #593

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged

Conversation

the-other-tim-brown
Copy link
Contributor

@the-other-tim-brown the-other-tim-brown commented Dec 8, 2024

What is the purpose of the pull request

Addresses #594, Adds a continuous mode for running RunSync at a scheduled interval

Brief change log

  • Add options to the cmd line args for RunSync to specify whether the tool should run in continuous mode
  • Add option for interval at which the tool runs if continuous mode is set

Verify this pull request

  • Added integration test validating that calling sync without any new data does not corrupt the target tables
  • Added test for RunSync in continuous mode that validates commits are updated by the tool in the background

@the-other-tim-brown the-other-tim-brown changed the title add a loop for continuous conversion with the RunSync tool [594] Add a loop for continuous conversion with the RunSync tool Dec 9, 2024
@the-other-tim-brown the-other-tim-brown changed the title [594] Add a loop for continuous conversion with the RunSync tool [594] Support continuous conversion with the RunSync tool Dec 9, 2024
@the-other-tim-brown the-other-tim-brown marked this pull request as ready for review March 9, 2025 16:27
0,
intervalInSeconds,
TimeUnit.SECONDS);
while (!Thread.interrupted()) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This method clears the interrupted status for the thread, do we need that here ?
Thread.currentThread().isInterrupted(false) doesn't clear the interrupted state after the check.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nice catch, I need to check the current thread which has an instance method which does not clear the state

@vinishjail97
Copy link
Contributor

Can you squash into one commit before merging ? Thanks !

@the-other-tim-brown the-other-tim-brown merged commit 546edaa into apache:main Mar 10, 2025
2 checks passed
@the-other-tim-brown the-other-tim-brown deleted the continuous-mode branch March 10, 2025 18:28
@vinishjail97 vinishjail97 mentioned this pull request Apr 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants