Skip to content

Attach runtime before calling scan for foreign table provider #1146

Open
@westonpace

Description

@westonpace

Is your feature request related to a problem or challenge? Please describe what you are trying to do.

In the table provider for lance in the scan method I sometimes have to do a small amount of I/O to load dataset metadata if the metadata is not already in the cache. The scan method is async so I assume this is ok. However, I use spawn_blocking to trigger this I/O and it fails because the runtime is not active.

Describe the solution you'd like

The runtime should be attached before calling scan.

Describe alternatives you've considered

Currently I work around this by forcing the metadata to be cached before creating the table provider but this is inconvenient.

Additional context

Can provide additional details (stack traces, lance reproducers, etc.) on request.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions