Why mmap? about bigqueue HOT 2 CLOSED

I see. Some quick thoughts:

It avoids the copy of data from page cache (disk page cache that kernel maintains) to application memory. mmap directly maps the files into application virtual memory.

Looks like you can do that with a regular file, also: https://askubuntu.com/a/159012

We plan to build more data structures in future, such as BigArray, and plan to reuse some of the components that we have built for bigqueue. mmap will work better in that case.

👍

from bigqueue.

A couple of reasons -

• It avoids the copy of data from page cache (disk page cache that kernel maintains) to application memory. mmap directly maps the files into application virtual memory.
• We plan to build more data structures in future, such as BigArray, and plan to reuse some of the components that we have built for bigqueue. mmap will work better in that case.

from bigqueue.