Skip to content

[BUG] Bulk loading SF300 takes >4h and causes OOM when open the graph #168

@liulx20

Description

@liulx20
  • Run Bulk Loader
./tools/utils/bulk_loader -g graph.yaml -l import.yaml -d db-sf300 -p 192
  • Log output:
W20260402 20:17:58.853390 2581016 types.h:559] var_char is deprecated, use long_text instead.
I20260402 21:40:30.373515 2581016 abstract_property_graph_loader.cc:182] Finished loading edges
I20260402 21:44:08.669917 2581016 property_graph.cc:973] Compaction completed.
I20260403 00:14:23.269536 2581016 property_graph.cc:1050] Dump graph to /data/0107/db-sf300-4/checkpoint/
I20260403 00:20:57.535560 2581016 bulk_loader.cc:191] Finished bulk loading in 14578.7 seconds.
  • Start the server
./bin/rt_server -d $DATA_DIR -m 3 -s 192 --host 0.0.0.0 
  • Log output:
W20260403 10:12:27.061918 2627327 anon_mmap_container.cc:134] Failed to allocate hugepages, falling back to regular mmap
E20260403 10:12:27.062142 2627327 neug_db.cc:222] Exception: Runtime exception: Failed to allocate memory at /data/0107/overflow/src/storages/container/anon_mmap_container.cc:139 func: try_allocate_hugepages, Error Code: 1012
terminate called after throwing an instance of 'neug::exception::InternalException'
  what():  Runtime exception: Failed to allocate memory at /data/0107/overflow/src/storages/container/anon_mmap_container.cc:139 func: try_allocate_hugepages, Error Code: 1012 at /data/0107/overflow/src/main/neug_db.cc:223 func: openGraphAndSchema, Error Code: 1012

Thread 1 "rt_server" received signal SIGABRT, Aborted.

Metadata

Metadata

Labels

No labels
No labels

Type

No type

Projects

Status

Done

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions