Skip to content

DEPR: ArrayManager #55043

@rhshadrach

Description

@rhshadrach
Member

Discussed in Basel, I believe there is a consensus to deprecate the ArrayManager.

cc @pandas-dev/pandas-core

Activity

self-assigned this
on Sep 7, 2023
added this to the 2.2 milestone on Sep 7, 2023
Dr-Irv

Dr-Irv commented on Sep 11, 2023

@Dr-Irv
Contributor

Discussed in Basel, I believe there is a consensus to deprecate the ArrayManager.

Can you summarize that discussion here for those of us who weren't in Basel?

rhshadrach

rhshadrach commented on Sep 12, 2023

@rhshadrach
MemberAuthor

I believe the main points are:

  • We do not see ArrayManager and BlockManager existing side-by-side in perpetuity. We need to choose one or the other.
  • Support for zero-copy to NumPy requires blocks, and is important to packages like scikit-learn
  • ArrayManager is not tested on the CI and is currently failing (I'm seeing 1038 failing)
  • We would like to instead pursue creating 2D EAs
topper-123

topper-123 commented on Sep 13, 2023

@topper-123
Contributor

I agree with the points you made, especially that we should pick one or the other and I'm fine with BlockManager being the one used going forward.

I'm +1 on this.

simonjayhawkins

simonjayhawkins commented on Feb 8, 2024

@simonjayhawkins
Member

in the roadmap we have a section on "Block manager rewrite".

Now the roadmap pre dates the PDEP process and in the section "Roadmap points pending a PDEP" we have

pandas is in the process of moving roadmap points to PDEPs (implemented in August 2022). During the transition, some roadmap points will exist as PDEPs, while others will exist as sections below.

Now that this issue is closed do we need to make any changes to the roadmap on the web page?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

DeprecateFunctionality to remove in pandas

Type

No type

Projects

No projects

Relationships

None yet

    Development

    Participants

    @simonjayhawkins@Dr-Irv@topper-123@rhshadrach

    Issue actions

      DEPR: ArrayManager · Issue #55043 · pandas-dev/pandas