cypher - Neo4j Load CSV Import Stalling -
after playing around toy datasets, first attempt use data relevant project @ work. in short, after limping of data neo4j, last query stalled. see screenshot.

note: prototyping queries pasting them browser tool, longer term plan keep of commands in .cql file script on workstation in order perform nightly analyses.
to add context problem, prototyping on macbook.
- 8gb ram
- 2.2 ghz intel core i7
- osx 10.9.5
- 2.2.0 community
the files processing (rows/columns). not importing every column, easier keep current datasets in check.
- ability.csv = 3/1
- brm.csv = 276992/34
- cont.sv = 80093/17
- email chain.csv = 199143/34 (this data can't in)
- email first last.csv = 77849/20
- recs.csv = 77962/20
- templates_topics.csv = 29/3
- templates.csv = 49/4
- topics.csv = 13/1
- vendors = 5/1
the config options set manually neo4j in neo4j-wrapper.conf set wrapper.java.initmemory , wrapper.java.maxmemory 4096. did after poking around find similar problems.
i made these changes out of gate because within browser, getting error messages database disconnected while processing queries.
lastly, because data work-related, can't provide test data. can, however, link cypher queries.
constraint , load csv .cql file
any , advice appreciated. pretty confident user error on end, have hit road respect next steps be.
avoid eager loading in load csv. doesn't respect periodic commit. see article mark needham thorough explanation.
Comments
Post a Comment