Skip to content

heap corruption in read_csv on 32-bit big-endian architectures #20785

Closed
@ginggs

Description

@ginggs
Contributor

While building pandas 0.22.0 for 32-bit big-endian architectures, the test suite crashes in TestMultiLevel::test_unstack_odd_failure with various errors:

realloc(): invalid next size
malloc(): smallbin double linked list corrupted
Segmentation fault
corrupted double-linked list

This happened to be the first test that calls read_csv, and I could reproduce this in the REPL by simply doing:

import pandas as pd
df = pd.read_csv('data.csv')

I narrowed it down to 8d7d3fb and found #17063 describing a similar problem introduced by the same commit affecting other 32-bit architectures.

Activity

jreback

jreback commented on Apr 22, 2018

@jreback
Contributor

you could submit a patch, but we have 0 support for big endian (no testing) and very little for 32-but arch (limited testing)

added
IO CSVread_csv, to_csv
Compatpandas objects compatability with Numpy or Python functions
32bit32-bit systems
on Apr 22, 2018
added this to the 0.23.0 milestone on Apr 22, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    32bit32-bit systemsCompatpandas objects compatability with Numpy or Python functionsIO CSVread_csv, to_csv

    Type

    No type

    Projects

    No projects

    Relationships

    None yet

      Development

      Participants

      @jreback@ginggs

      Issue actions

        heap corruption in read_csv on 32-bit big-endian architectures · Issue #20785 · pandas-dev/pandas