Explanation about fcp HOT 8 CLOSED

Personally, I like to know the details on the reason it is faster other than the performance benchmarks on the README. Otherwise one can always study the code I guess. Also anyone knows what file-system is being used here for the benchmarks?

from fcp.

It's very shady that author did not mention copy-on-write anywhere in readme.

from fcp.

I'd like to know that too. Copy is a simple operation, just read and write, so what does fcp do to make it faster?

from fcp.

There is some discussion that took place on the hackernews regarding the same https://news.ycombinator.com/item?id=27523014

from fcp.

@AgainPsychoX The primary reason fcp is faster than cp is that it uses multiple threads to walk directories and issue IO requests in parallel, which is advantageous for performance on systems with SSDs. My guess as to why cp doesn't do this is that cp was written back when magnetic hard-drives were the norm, and issuing a large number of IO requests for disparate parts of a hard disk is quite bad for performance as it causes the drive head to seek large distances across the disk.

from fcp.

It's very shady that author did not mention copy-on-write anywhere in readme.

Hello @baverman,

Copy-on-write is mentioned implicitly in the footnote explaining the large performance difference on the "Large Files" benchmark run on macOS, which mentions the fclonefileat and fcopyfile syscalls. I can totally see how this is easy to miss though as it appears only in the footnote, and requires the reader to understand that those syscalls perform copy-on-write.

from fcp.

Personally, I like to know the details on the reason it is faster other than the performance benchmarks on the README. Otherwise one can always study the code I guess. Also anyone knows what file-system is being used here for the benchmarks?

See my response above and some of the discussion on hackernews than you linked for an explanation as to the performance. The filesystem used for the Linux benchmarks was xfs.

from fcp.

An explanation for fcp's high-performance has been added to the README under the "Methodology" section.

from fcp.