Deleting rows of daylight saving time from a time indexed pandas dataframe

Question

I have written the following function to delete the rows for Daylight Saving Time in a pandas dataframe as not every column has data for the hour of switching:

def hrsDSTdelete (df):
    import pandas as pd    
    hrsDSTadjust = ['2000-03-26 02:00:00', ...  '2012-03-25 02:00:00', '2013-03-31 02:00:00']

    for DSTvalue in hrsDSTadjust:                          
        if DSTvalue in df.index :  
            df = df.drop(pd.Timestamp(DSTvalue)) 
            print 'DST hour: ', DSTvalue, " deleted!"         
    return df   
pass

As this seems to work when deleting single rows, the following error message occurs when trying to do it with this loop:

exceptions.TypeError: 'Timestamp' object is not iterable

I have tried also with

df =  df.ix[DSTvalue].drop

but this does not seem to delete the row in the dataframe. Has anyone got an idea what I am doing wrong?

Maybe this can help: http://stackoverflow.com/questions/14661701/how-to-drop-a-list-of-rows-from-pandas-dataframe — Paulo Almeida, Aug 06 '13 at 15:50

Paulo Almeida · Answer 1 · 2013-08-06T16:22:35.767

2

The problem is that drop takes an array-like argument labels, and you are only passing it a timestamp. You should be able to use a list comprehension instead of your loop too:

indices = [pd.Timestamp(DSTvalue) for DSTValue  in hrsDSTadjust if DSTvalue in df.index]
df = df.drop(indices)

edited Aug 06 '13 at 16:22

answered Aug 06 '13 at 16:03

Paulo Almeida

7,803
28
36

score 0 · Answer 2 · edited Jan 14 '19 at 22:51

0

you don't need a loop, try this one:

df.drop(df.index[hrsDSTadjust])

edited Jan 14 '19 at 22:51

nick

1,090
1
11
24

answered Aug 07 '13 at 08:01

erkinc

34
1

unfortunately this doesn't seem to work. Im getting this error message: exceptions.IndexError: unsupported iterator index – Markus W Aug 16 '13 at 12:21

Deleting rows of daylight saving time from a time indexed pandas dataframe

2 Answers2

Linked