Skip to content

bulk-update crashes at a certain percentage #90

Open
@nemote95

Description

@nemote95

I am trying to update nodes of a graph ( about 300 million nodes and 200 billion edges) using redisgraph-bulk-loader (latest version).

The csv file for this update is about 6Gb, containing two columns of integers, one representing the id of the node and the other represnting the date and time for that node. I ran the following command :

redisgraph-bulk-update $graph_name -h [host_IP_address] -p [host_redis_port] --csv csv _file_dir --query "MATCH (n:Article) WHERE n.id = row[0] SET n.date = row[1]".

This query used to work previously, but when I tried recently, it crashed at 7% of the progress. I tried changing the token size to half of the token, but it was not helpful. I also tried testing the command on 1% of the data. The progress bar showed 100% for the smaller update, but it stalled after that.

Any idea why this is crashing at a certain point?

Cheers.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions