Query related to console_label and training_data_dedupe methods about dedupe HOT 3 CLOSED

Hi,
Still looking for an answer to my query. Please help anybody.

from dedupe.

Hi @Abhishek-thetechie,
from my experience you can train with Active Learning only once, save settings_file and training.json and re-use them for every subsequent run.
You can reuse only the data model by employing a StaticDedupe:
with open(sc_settings_file, 'rb') as f: deduper = dedupe.StaticDedupe(f)
Or re-train at every execution using labelled examples:

  fields = [{'field': 'name', 'type': 'String'},
              {'field': 'name', 'type': 'Exact'},
              {'field': 'address', 'type': 'String'}
              ]
   with open(settings_file) as sf:
        deduper = dedupe.Dedupe(fields, num_cores=5)
   with open(training_file) as tf:
        deduper.prepare_training(data_d, sample_size=10000)
   deduper.markPairs(training_pairs)
   deduper.train(index_predicates=False)

from dedupe.

you got it.

from dedupe.