Python3: writing csv files

Question

I'm trying to use Python 3.2 on a Windows computer to write a simple CSV file, however I'm having no luck. From the csv module documentation for Python 3.2:

>>> import csv
>>> spamWriter = csv.writer(open('eggs.csv', 'w'), delimiter=' ',
...                         quotechar='|', quoting=csv.QUOTE_MINIMAL)
>>> spamWriter.writerow(['Spam'] * 5 + ['Baked Beans'])
>>> spamWriter.writerow(['Spam', 'Lovely Spam', 'Wonderful Spam'])

produces a file with each line terminated by the byte sequence \r\r\n, so it looks like each line has an extra empty line when you open it with, e.g., MS Excel. This is not a "CSV file".

Note, if I try the same example for Python 2.7 in Python 3.2 (where the big difference is 'w' vs 'wb' for the file mode), I get an error when I try spamWriter.writerow:

Traceback (most recent call last): File "", line 1, in TypeError: 'str' does not support the buffer interface

How do I write a simple CSV file from Python 3.2 on a Windows computer?

The problem seems to be Windows-specific. Works fine on Linux. — phihag, Aug 26 '11 at 06:12

score 68 · Accepted Answer · answered Aug 26 '11 at 06:49

68

Documentation says that you should use open('eggs.csv', 'w', newline='')

http://docs.python.org/py3k/library/csv.html#id2

answered Aug 26 '11 at 06:49

alexanderlukanin13

4,577
26
29

2

Ah, it seems I picked up a slightly older version (-0.1) of the documentation (compare [3.2](http://docs.python.org/release/3.2/library/csv.html#csv.writer) vs [3.2.1](http://docs.python.org/release/3.2.1/library/csv.html#csv.writer)) – Mike T Aug 26 '11 at 07:11

score 20 · Answer 2 · answered Jun 27 '12 at 21:59

20

This will work on both Python 2 and Python 3:

if sys.version_info >= (3,0,0):
    f = open(filename, 'w', newline='')
else:
    f = open(filename, 'wb')

answered Jun 27 '12 at 21:59

Dave Burton

2,960
29
19

phihag · Answer 3 · 2011-08-26T07:17:38.867

As documented in a footnote:

csv.writer(csvfile, dialect='excel', **fmtparams)

If csvfile is a file object, it should be opened with newline=''.

If newline='' is not specified, newlines embedded inside quoted fields will not be interpreted correctly, and on platforms that use \r\n linendings on write an extra \r will be added. It should always be safe to specify newline='', since the csv module does its own (universal) newline handling.

The following variant works on Linux and Windows:

spamWriter = csv.writer(open('eggs.csv', 'wb'), delimiter=' ', quotechar='|',
                        quoting=csv.QUOTE_MINIMAL, newline='')
spamWriter.writerow(['Spam'] * 5 + ['Baked Beans'])
spamWriter.writerow(['Spam', 'Lovely Spam', 'Wonderful Spam'])

I get a `TypeError: 'newline' is an invalid keyword argument for this function` when trying to do this in py34. — Andy Hayden, Nov 06 '14 at 05:25

score 5 · Answer 4 · answered Aug 26 '11 at 06:18

5

To directly answer your question, you should be able to use the lineterminator formatting parameter:

...so modifying this line should work (untested):

>>> spamWriter = csv.writer(open('eggs.csv', 'w'), delimiter=' ',
...                         quotechar='|', quoting=csv.QUOTE_MINIMAL, lineterminator='\n')

As for why the example doesn't work out-of-the box, kind of looks like a bug to me.

answered Aug 26 '11 at 06:18

Gerrat

28,863
9
73
101

This is the only answer here that worked for me. And five years later the examples still don't work out-of-the-box :-( – Rup Sep 07 '16 at 10:55
This is the only answer works for me on Python 3.7, none of th above worked – Diego Andrés Díaz Espinoza Oct 19 '21 at 20:45
This works for me also, where `newline=''` did not. – Huw Walters Jul 20 '22 at 09:22

SashaZd · Answer 5 · 2017-02-28T21:26:09.993

1

[For Python 2.x] This implementation of spamWriter is working for me...

with open('assignmentresults.csv', 'wb') as csvfile:
  spamwriter = csv.writer(csvfile, delimiter=',', quotechar='|', quoting=csv.QUOTE_MINIMAL)
  spamwriter.writerow(["Hullo", "World"])

edited Feb 28 '17 at 21:26

answered Oct 03 '14 at 04:54

SashaZd

3,315
1
26
48

1

This is not an answer for Python 3, which raises "TypeError: 'str' does not support the buffer interface" – Mike T Oct 06 '14 at 22:10

score 1 · Answer 6 · edited Apr 21 '22 at 07:34

I resolved this error as I was moving one of my codes from Python2.6.6 to python3.4.3

Python2.6.6(I'm trying to do some obfuscation on my csvfile)

with open( os.path.join(path, name) , 'r') as mycsvfile:
    writer = csv.writer(open(newFilename, 'w'))

Above worked well with python2.6.6 but did not work on python3.4.3 as I was getting some utf-8 unicode errors when i tried to run the python3 file, so I made the below changes Python3.4.4

import codecs
with codecs.open(os.path.join(path, name) , 'r', encoding='ISO-8859-1') as mycsvfile:
    writer = csv.writer(open(newFilename, 'w'))

That's it, my code works fine now, basically python3 is not considering some of the unicode and we need to use the codecs import to make it working, hope it helps..

What is `mycsvfile` and what about indentation? – Roko C. Buljan Apr 13 '18 at 14:49 — Roko C. Buljan, Apr 13 '18 at 14:49

Python3: writing csv files

6 Answers6

Linked