Migrate refactor of catalog to Rust #2681
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
faysou
force-pushed
the
catalog_rust
branch
22 times, most recently
from
c0e42d2 to
3cf252a
Compare
faysou
force-pushed
the
catalog_rust
branch
8 times, most recently
from
dd62c8b to
07613b5
Compare
faysou
force-pushed
the
catalog_rust
branch
3 times, most recently
from
14830e2 to
c9eace9
Compare
cjdsellers
changed the title
cjdsellers
approved these changes
Jun 13, 2025
stastnypremysl
pushed a commit
to stastnypremysl/nautilus_trader
that referenced
this pull request
Jun 16, 2025
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Pull Request
NautilusTrader prioritizes correctness and reliability, please follow existing patterns for validation and testing.
Summary
Migrate refactor of catalog to rust
Using object_store crate to connect to different object stores providing parquet files.
Centralised dependencies as workspace dependencies
Extensive research on avoiding a compile bug due to reqwest and tls when using object_store. Solution is to always use rustls that doesn't need openssl. Databento vendored required until they modify their reqwest config, else fork needed (issue raised Allow using reqwest and rustls without pulling in OpenSSL/native-tls databento/databento-rs#55)
Also incuded a Dockerfile to be able to experiment with CI conditions, and work on fixing the compile error.
Related Issues/PRs
#2652
Type of change
Breaking change details (if applicable)
Release notes
RELEASES.mdthat follows the existing conventions (when applicable)Testing
Ensure new or changed logic is covered by tests.