Skip to content

Commit 6984821

Browse files
committed
Changed a condition in tokenize_delim_customterm to account for data chunks that start with terminator.
1 parent 8b314c5 commit 6984821

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

pandas/src/parser/tokenizer.c

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1172,7 +1172,7 @@ int tokenize_delim_customterm(parser_t *self, size_t line_limit)
11721172
--i;
11731173
} while (i + 1 > self->datapos && *buf != self->lineterminator);
11741174

1175-
if (i + 1 > self->datapos) // reached a newline rather than the beginning
1175+
if (*buf == self->lineterminator) // reached a newline rather than the beginning
11761176
{
11771177
++buf; // move pointer to first char after newline
11781178
++i;

0 commit comments

Comments
 (0)