QUESTION: How to pas decoder: &'_ mut AvroDecoder <'_> from async move block about schema_registry_converter HOT 5 CLOSED

let sr_settings: SrSettings =
        SrSettings::new("http://avro-schemas.kafka.svc.cluster.local".to_string());
let decoder: Arc<Mutex<AvroDecoder>> = Arc::new(Mutex::new(AvroDecoder::new(sr_settings)));

    let stream_processor = consumer.start().try_for_each(|borrowed_message| {
        let decoder: Arc<Mutex<AvroDecoder>> = Arc::clone(&decoder);

        let owned_message = borrowed_message.detach();

        async move {
            let r: Option<Value> = get_value(owned_message, decoder.lock().unwrap()).await;
            });
            consumer.store_offset(&borrowed_message);
            Ok(())
        }
    });

This compiles but i'm not 100% sure that it works.

from schema_registry_converter.

It's correct you can't copy it, and you don't want to either, since it's containing the cache. I'm working towards a demo project using async and protobuf, but it could be several weeks or more till it's finished.

I know undeflive had it working, see #33, but having an async 'real' example would certainly be an improvement. I think using it would require wrapping the decoder in a mutex, but there might be better or other ways. The idea is whenever the decoder is used, the result is cashed, so no matter from which thread, only the first item handeled with the same id, does the http call to get the schema.

from schema_registry_converter.

Yeah. Okay i'll look into trying a mutex, and yeah I tried the blocking client but ran into the same issue as #33

I'll let you know what I come up with!

from schema_registry_converter.

I think ideally you might want a decoder for each 'real' thread. In that case you might fetch the same resource a couple of times, but you never need to wait. But I'm not sure something like that exists. I have little experience with async so far. Looking forward to what you come up with.

from schema_registry_converter.

Since you got an answer and got it to compile again I'm closing this. Would love to know if you got it working.

from schema_registry_converter.