Search results

PERF: dropna with SparseArray experiments a much worse time complexity

Groupby

PerformanceMemory or execution speed performanceMemory or execution speed performance

SparseSparse Data TypeSparse Data Type

Status: Open.

#60179 In pandas-dev/pandas;

· mflova opened on Nov 4, 2024

2 comments

DEPR: SparseDtype

DeprecateFunctionality to remove in pandasFunctionality to remove in pandas

Needs DiscussionRequires discussion from core team before further actionRequires discussion from core team before further action

SparseSparse Data TypeSparse Data Type

Status: Open.

#56518 In pandas-dev/pandas;

· jbrockmendel opened on Dec 15, 2023

1 comment

BUG: pd.DataFrame.sum() min_count parameter does not work with Sparse[float64, nan] dtype

Bug

Reduction Operationssum, mean, min, max, etc.sum, mean, min, max, etc.

SparseSparse Data TypeSparse Data Type

Status: Open.

#55123 In pandas-dev/pandas;

· Danferno opened on Sep 13, 2023

3 comments

BUG: Wrong result after comparison SparseArray with arrays

Bug

Numeric OperationsArithmetic, Comparison, and Logical operationsArithmetic, Comparison, and Logical operations

SparseSparse Data TypeSparse Data Type

Status: Open.

#45284 In pandas-dev/pandas;

· bdrum opened on Jan 9, 2022

1 comment



BUG: SparseArray is not implemented as index first

Bug

SparseSparse Data TypeSparse Data Type

Status: Open.

#45126 In pandas-dev/pandas;

· bdrum opened on Dec 30, 2021

5 comments

API/DEPR: SparseArray constructor usability

ConstructorsSeries/DataFrame/Index/pd.array ConstructorsSeries/DataFrame/Index/pd.array Constructors

DeprecateFunctionality to remove in pandasFunctionality to remove in pandas

Needs DiscussionRequires discussion from core team before further actionRequires discussion from core team before further action

SparseSparse Data TypeSparse Data Type

Status: Open.

#43628 In pandas-dev/pandas;

· mzeitlin11 opened on Sep 17, 2021

1 comment

BUG: COO matrices are copied and converted

Docs

SparseSparse Data TypeSparse Data Type

Status: Open.

#43419 In pandas-dev/pandas;

· memeplex opened on Sep 5, 2021

5 comments

BUG: error writing sparse DataFrame to HDF

Bug

IO HDF5read_hdf, HDFStoreread_hdf, HDFStore

SparseSparse Data TypeSparse Data Type

Status: Open.

#42070 In pandas-dev/pandas;

· raphaelquast opened on Jun 17, 2021

2 comments

BUG: Serializing sparse dataframe 15x slower than converting to dense version + serializing the dense version

IO CSVread_csv, to_csvread_csv, to_csv

PerformanceMemory or execution speed performanceMemory or execution speed performance

SparseSparse Data TypeSparse Data Type

Status: Open.

#41023 In pandas-dev/pandas;

· melkonyan opened on Apr 18, 2021

1

4 comments

BUG: pandas.SparseDtype from pandas.CategoricalDtype fails

Bug

CategoricalCategorical Data TypeCategorical Data Type

ExtensionArrayExtending pandas with custom dtypes or arrays.Extending pandas with custom dtypes or arrays.

SparseSparse Data TypeSparse Data Type

Status: Open.

#39874 In pandas-dev/pandas;

· PetarMPetrov opened on Feb 17, 2021

BUG: GroupBy.mean() is extremely slow with sparse arrays

Groupby

PerformanceMemory or execution speed performanceMemory or execution speed performance

SparseSparse Data TypeSparse Data Type

Status: Open.

#36123 In pandas-dev/pandas;

· gokceneraslan opened on Sep 4, 2020

9 comments

BUG: pd.DataFrame.astype for SparseDtype with different fill_value results in data loss

Astype

Bug

Needs DiscussionRequires discussion from core team before further actionRequires discussion from core team before further action

SparseSparse Data TypeSparse Data Type

Status: Open.

#35795 In pandas-dev/pandas;

· shengpu-tang opened on Aug 18, 2020

3 comments

API: expected result of concat of SparseArray with Categorical?

API - ConsistencyInternal Consistency of API/BehaviorInternal Consistency of API/Behavior

CategoricalCategorical Data TypeCategorical Data Type

Enhancement

ReshapingConcat, Merge/Join, Stack/Unstack, ExplodeConcat, Merge/Join, Stack/Unstack, Explode

SparseSparse Data TypeSparse Data Type

Status: Open.

#34459 In pandas-dev/pandas;

· jorisvandenbossche opened on May 29, 2020

Support pydata/sparse arrays in DataFrame

Closing CandidateMay be closeable, needs more eyeballsMay be closeable, needs more eyeballs

Enhancement

ExtensionArrayExtending pandas with custom dtypes or arrays.Extending pandas with custom dtypes or arrays.

InternalsRelated to non-user accessible pandas implementationRelated to non-user accessible pandas implementation

Needs DiscussionRequires discussion from core team before further actionRequires discussion from core team before further action

SparseSparse Data TypeSparse Data Type

Status: Open.

#33182 In pandas-dev/pandas;

· TomAugspurger opened on Mar 31, 2020

6 comments

Using python comparison operators when SparseArrays of uneven length raises uninformative error

Bug

Error ReportingIncorrect or improved errors from pandasIncorrect or improved errors from pandas

Numeric OperationsArithmetic, Comparison, and Logical operationsArithmetic, Comparison, and Logical operations

SparseSparse Data TypeSparse Data Type

Status: Open.

#32119 In pandas-dev/pandas;

· dburkhardt opened on Feb 19, 2020

1 comment

DataFrame[SparseArray] coerces to dense on sum(axis=1)

BenchmarkPerformance (ASV) benchmarksPerformance (ASV) benchmarks

PerformanceMemory or execution speed performanceMemory or execution speed performance

Reduction Operationssum, mean, min, max, etc.sum, mean, min, max, etc.

SparseSparse Data TypeSparse Data Type

Status: Open.

#28487 In pandas-dev/pandas;

· scottgigante opened on Sep 17, 2019

6 comments

Recommended way to check for sparse data (DataFrame or Series)

Enhancement

Needs DiscussionRequires discussion from core team before further actionRequires discussion from core team before further action

SparseSparse Data TypeSparse Data Type

Status: Open.

#26706 In pandas-dev/pandas;

· jorisvandenbossche opened on Jun 7, 2019

2

35 comments



SparseArrays backed by other Extension array/dtype ?

Enhancement

ExtensionArrayExtending pandas with custom dtypes or arrays.Extending pandas with custom dtypes or arrays.

SparseSparse Data TypeSparse Data Type

Status: Open.

#26407 In pandas-dev/pandas;

· jorisvandenbossche opened on May 15, 2019

3 comments

DataFrame with datetime column cannot concat with non-identical columns

Enhancement

ReshapingConcat, Merge/Join, Stack/Unstack, ExplodeConcat, Merge/Join, Stack/Unstack, Explode

SparseSparse Data TypeSparse Data Type

Status: Open.

#26288 In pandas-dev/pandas;

· ruiann opened on May 6, 2019

9 comments

Reindexing a sparse data structure with a different index results in losing the dtype

Bug

RegressionFunctionality that used to work in a prior pandas versionFunctionality that used to work in a prior pandas version

SparseSparse Data TypeSparse Data Type

Status: Open.

#26123 In pandas-dev/pandas;

· hdinh opened on Apr 17, 2019

1

2 comments

BUG: Sparse structures don't fully support value assignment

Bug

SparseSparse Data TypeSparse Data Type

Status: Open.

#21818 In pandas-dev/pandas;

· kernc opened on Jul 8, 2018

1 comment

Behaviour of Categorical inputs to sparse data structures

ConstructorsSeries/DataFrame/Index/pd.array ConstructorsSeries/DataFrame/Index/pd.array Constructors

Enhancement

SparseSparse Data TypeSparse Data Type

Status: Open.

#19278 In pandas-dev/pandas;

· jnothman opened on Jan 17, 2018

1

8 comments

ENH: Add sparse option in pivot_table / pivot / unstack

Enhancement

ReshapingConcat, Merge/Join, Stack/Unstack, ExplodeConcat, Merge/Join, Stack/Unstack, Explode

SparseSparse Data TypeSparse Data Type

Status: Open.

#14493 In pandas-dev/pandas;

· yupbank opened on Oct 25, 2016

10 comments