Open
Description
Feature Type
Adding new functionality to pandas
Changing existing functionality in pandas
Removing existing functionality in pandas
Problem Description
The default constructors pd.Timestamp.__new__
and pd.Timedelta.__new__
can return NaT
, which is a different type. This can lead to silent type errors, depending on the type-checker used. Consider the following example:
import numpy as np
from pandas import Timedelta, Timestamp
t: Timestamp = Timestamp("2024-04-29T18:00:00")
t2: Timestamp = Timestamp(np.datetime64("nat")) # actually NaTType!
dt: Timedelta = Timedelta(1, "h")
dt2: Timedelta = Timedelta(np.timedelta64("nat")) # actually NaTType!
Type-checking results:
mypy --strict
: No errors (w/ and w/opandas-stubs
)pyright
withuseLibraryCodeForTypes = true
: 4 errors (only formally correct result)pyright
withuseLibraryCodeForTypes = false
: no errors
Feature Description
Introduce new constructors timestamp
and timedelta
(in analogy to how pyarrow
does constructors), which are guaranteed to return pd.Timestamp
and pd.Timedelta
types, or raise an exception in the case when NaT
is encountered.
Alternative Solutions
Split pd.NaT
into two different types, Timestamp("NaT")
and Timedelta("NaT")
(as is the case in numpy
), which are instances of the respective types. (#24983)
Additional Context
Metadata
Metadata
Assignees
Type
Projects
Milestone
Relationships
Development
No branches or pull requests
Activity
randolf-scholz commentedon Apr 29, 2024
These constructors can be very simple wrappers, a rough sketch:
jbrockmendel commentedon Apr 29, 2024
There’s an issue about introducing a separate NaTD specific to Timedelta. If you did that ( and the same for Period), then NaT could become a Timestamp, and you would get type-safety in the constructors without new constructors