Develop caching mechanisms about pymediawiki HOT 11 OPEN

Just discovered this gem pun not intended https://pypi.python.org/pypi/cached-property and @ayuhsya has volunteered to integrate this over the weekend. 😄

from pymediawiki.

Hi all,
I think we can use either redis/mecahce to implement the same. I would like to discuss more about about this 😄

from pymediawiki.

I just had a look at redis python package. It requires a redis server to be running. If we look at the use case of the package, personally I feel the user isn't going to setup a redis server to use the feature. Correct me if I am wrong but isn't redis mostly used on the server side? The one we are looking at is a client side one.

We are looking at just saving a few repetitive requests. Is setting up redis worth it? IMO a naive one would work too. What do you think?

from pymediawiki.

Well, You are right when you say that. I think instead we can have inter-program communication modules set up so that there is some in-memory caching mechanism with fixed "memory-units" (so that it dosent end up eating a lot of system memory) where we can cache and query for the data.
What do you say to that?

from pymediawiki.

That sounds good! 👍

from pymediawiki.

I will start working on something then.. 👍 , so should i first fork the repo and make my commits over there?

from pymediawiki.

@sandeepkumarpani888 Yes. Go ahead.

from pymediawiki.

@sandeepkumarpani888 What are your thoughts on using a bloom filter for checking if something should be cached?
P.S. See the first example in the 'Examples' section https://en.wikipedia.org/wiki/Bloom_filter

from pymediawiki.

Yeah, I think we can work with this .. but there must be already be a library for the same. :)

from pymediawiki.

There is. pybloom.

from pymediawiki.

Nice !

from pymediawiki.