Skip to content

Runbook: Low-Memory Conversion

openalex-snapshot convert \
  --root-dir /data \
  --dataset works \
  --profile safe \
  --workers 1 \
  --max-memory-mb 4096

Notes: - safe profile allocates 15% of usable RAM (1–8 GiB global), caps workers at 2 - --workers 1 ensures the full budget goes to one file at a time - --max-memory-mb overrides the profile calculation if you need a precise cap - Use repeated --input-file to isolate and retry specific problematic files