Improved performance/memory usage for items with an expiry about go-generics-cache HOT 8 CLOSED

@hypirion Thanks for feedback!

I understand your opinion, but I have one concern. That is the data will remain on memory unless the next Get method is called.

I'm hoping this can be solved, so please, give me some ideas!

Oh, right. https://github.com/patrickmn/go-cache uses one janitor goroutine per cache, which at some user-specified interval removes all expired items from the cache:

https://github.com/patrickmn/go-cache/blob/46f407853014144407b6c2ec7ccc76bf67958d93/cache.go#L1071-L1126

There is a bit more overhead when getting values, as you have to check whether they have expired or not. Perhaps one of those things prevent this from being doable, as I haven't looked too closely at the performance implications of this.

And true, as outlined and tested in https://tpaschalis.github.io/goroutines-size/, the goroutine stack size is minimum 2kb, but could be more -- although I don't think the cleanup routines would go much beyond that.

I'd happy to take a look and make a PR if I find a workable solution that doesn't add too much complexity. If I were to do that I'd still fall back on the original implementation with goroutines though, for backwards compatibility/behaviour.

from go-generics-cache.

I find myself in the same situation. Thousands of ExpirationWatcher goroutines.
I think the idea mentioned above is the right direction: one routine taking care of collecting all expired items.

from go-generics-cache.

@hypirion Thanks for feedback!

I understand your opinion, but I have one concern. That is the data will remain on memory unless the next Get method is called.

I'm hoping this can be solved, so please, give me some ideas!

Thanks

from go-generics-cache.

And, I don't believe each goroutine size is 2kb. The size meaning for initial stack size.

See https://tpaschalis.github.io/goroutines-size/

from go-generics-cache.

@hypirion Thanks. I'm looking forward to the PR you create!

If you have no time, I can make PR for it. So please let me know.

from go-generics-cache.

improved, pls check the code

from go-generics-cache.

I've just published the latest version. Thank you for your contributions!

@mingcheng

https://github.com/Code-Hex/go-generics-cache/releases/tag/v1.1.0

from go-generics-cache.

Thanks for the contribution here! 😁

from go-generics-cache.