[perf] rg does not use globs to prune recursion when it can about ripgrep HOT 4 OPEN

I thought there was already an open issue for this, but I couldn't find it.

This is a rather difficult optimization to do and is blocked on a rewrite of globset and probably ignore. It's something I've been working on off-and-on for a while now, but it's unlikely to land any time soon. I'm not even 100% certain it's possible unless the --no-ignore flag is also passed. The interaction point between -g/--glob and ignore files will need to be carefully considered for something like this.

Your best bet is to use some other tool to filter out files first. Possibly even using your shell's glob support. Although those could in theory end up being slower than ripgrep even when ripgrep visits more than it needs to. It depends.

from ripgrep.

Alright, thanks for clarifying. Using fd to write all of the interesting filepaths to a file and then xargs-ing that into rg got me results way faster!

It would be neat if rg supported piping in filenames from stdin. So I wouldn't have to wait for fd to finish its scan. Should I post another enhancement issue for that?

from ripgrep.

That's #273. But you shouldn't need it. You should be able to pipe the output of fd straight into ripgrep with xargs without writing to an intermediate file.

from ripgrep.

I can use xargs yes but ripgrep won't start searching any of those paths until the fd scan completes.

EDIT: oh nvm i can make xargs chunk it up into multiple rg invocations

from ripgrep.