How to show blank values pandas

Question

I have dataframe df has column TX_order, when I tried to sum null values df.isnull().sum(axis=0) The output was TX_order has 0 null values, however it has blank values. How can I show it or calculate this blank values to can remove it.

As in example below the TX_order has blank values but doesn't appear in the output

df

A header	TX_order
First
Second	row
Second
Second	row
Second

Does this answer your question? [Find empty or NaN entry in Pandas Dataframe](https://stackoverflow.com/questions/27159189/find-empty-or-nan-entry-in-pandas-dataframe) — Lomtrur, May 11 '23 at 11:47
@Ynjxsjmh, I don't understand your edit in my question , you wrote the same code of mine. — asmaa mahmoud, May 11 '23 at 12:01
@asmaamahmoud, just to make sure, can you `print(df.sample(5).to_dict("list"))` ? — Timeless, May 11 '23 at 12:04
@Timeless, the output was 'Order_TX': ['', '', '', '', '']}, But when I tried df.replace("", None).isnull().sum(), the output still 0 — asmaa mahmoud, May 11 '23 at 12:09
`pd.DataFrame({'Order_TX': ['', '', '', '', '']}).replace('', None).isnull().sum()` gives `Order_TX 5`, you should give a reproducible example that lead to the behaviour described. — Timeless, May 11 '23 at 12:12
My df has 2131283 rows some of them are ' ' and the remain with values as the example I explained — asmaa mahmoud, May 11 '23 at 12:16
My edit is to improve the format of the column name and code, they should be enclosed by backtick to highlight. — Ynjxsjmh, May 11 '23 at 12:39

score 1 · Answer 1 · answered May 11 '23 at 12:00

Looks like you have empty strings, try to replace them before isnull/sum :

df.replace("", None).isnull().sum() # `axis=0` by default

Output :

A header    0
TX_order    3
dtype: int64

Input used :

df = pd.DataFrame(
    {"A header": ["First", "Second", "Second", "Second", "Second"],
     "TX_order": ["", "row", "", "row", ""]}
)

How to show blank values pandas

1 Answers1