Old read_csv() & EOF character issue back

[gaptekar]

I recently updated from pandas 0.19.2 to 0.2
I am experiencing the exact same issue as this person did back in 2013
#5500
"Error tokenizing data. C error: EOF inside string starting at line. 140"

Reverting back to 0.19.2 has fixed the issue. Can run the unit test that was created for this problem?
forking-repos@8c4cf85

[jreback]

can you show a reproducible example.

[gorkemozkaya]

I'm having the same problem. Python 3, pandas 0.20.2

reproducible example:

import pandas as pd

with open('test.csv', 'wb') as fout:
    fout.write(b'c1,c2\r\n"test \x1a    test", test\r\n')

pd.read_csv('test.csv')

#ParserError: Error tokenizing data. C error: EOF inside string starting at line 1

[jorisvandenbossche]

Is this a windows issue? (cannot reproduce your example above on linux)

[gorkemozkaya]

Yes, it happened on a 64 bit Windows.

[jreback]

@gfyoung can you verfiy / see if you can fix?

[gfyoung]

@jreback : Confirmed! git bisection reveals that #16039 is the culprit. PR coming soon.