option to ignore whitespace stripping within quotes about parsers.jl HOT 3 CLOSED

Sorry for the slow response here. @nickrobinson251, as I consider this, it seems to me that it's actually incorrect in our original stripwhitespace implementation to strip whitespace within quoted strings. Like, the point of quoting a string is you want to preserve what's inside, including whitespace.

I think I perhaps just got too over-eager in that first implementation and didn't realize that we're over-stripping. Does that make sense? Do we think there would still be a use-case for stripping the whitespace inside quotes? I guess there are sometimes cases where a csv writer just quotes everything and you might want to also be able to strip inside quotes, but that feels like an additional option we'd want to be opt-in, since you're electing to ignore stuff inside your quotes.

from parsers.jl.

Alright, PR is up (#112) to fix stripwhitespace to preserve whitespace inside quoted string, but also adds stripquoted to allow stripping inside quotes.

from parsers.jl.

Do we think there would still be a use-case for stripping the whitespace inside quotes? I guess there are sometimes cases where a csv writer just quotes everything and you might want to also be able to strip inside quotes, but that feels like an additional option we'd want to be opt-in, since you're electing to ignore stuff inside your quotes.

Yeah, unfortunately i have this use-case, so it does exist 😞

I agree stripping whitespace within quotes should be opt-in and not the default for what stripwhitespace does (unlike currently)

from parsers.jl.