URL in AWS output is not interpolated about benthos HOT 5 OPEN

@rtkkroland: Not really. Just that the switch output requires that you to know the URLs when writing the config while interpolation allows you to extract the URL from each message at runtime. Benthos still has to extract some field from the message in each switch case to figure out which output to route the message to, so that will incur a similar performance penalty.

from benthos.

Looking to do something like this in the url field where route is added to metadata by a previous processor and can be one of up to 20 values.

    output:
      aws_sqs:
        url: 'https://sqs.us-west-2.amazonaws.com/AWS_ACCOUNT/${! meta("route") }'
        max_in_flight: 64

from benthos.

Hey, this is technically possible as we can specify the URL per batch send request. However, one minor annoyance is that when you batch messages up (which is recommended for performance reasons) each individual message could yield a different URL, and so the logic and predictability of batch dispatching becomes much more complicated.

from benthos.

Would having URL determined per message be worse/better performance than using the switch output?

from benthos.

Awesome, let's do URL interpolation then! :D

• Similar performance
• Run-time configurable

from benthos.