Duplicates the datasets about ckanext-dcat HOT 7 CLOSED

@montxo5 That was caused by the harvesters not being careful when checking if two requests had the same contents (to check if the remote server supported pagination).

In Madrid's case, there are some real time datasets that got the timestamp updated on each request:

<dct:modified rdf:datatype="http://www.w3.org/2001/XMLSchema#dateTime">2014-06-11T03:05:31</dct:modified>

Can you update your sources and check if you only get 101 records?

from ckanext-dcat.

Tanks for the reply. Sorry, but I didn't understand what do you mean when you say updating my resources.
You mean reharvesting?

from ckanext-dcat.

I meant doing git pull to update the ckanext-dcat source and reharvesting.
Let me know how it goes,

from ckanext-dcat.

I've updated the ckanext-dcat with git pull and it's still duplicating datasets.
I've also tried uninstalling and installing dcat, restarting, but also fails.

from ckanext-dcat.

Did you restart the two harvester consumers? ctrl+c if running them directly on the terminal or sudo supervisorctl restart all if using Supervisor on production.

from ckanext-dcat.

You were right, I forgot to restart the consumers... Thanks!! Now works perfectly!

from ckanext-dcat.

Glad you got it working! :)

from ckanext-dcat.