rappdw / fs-crawler Goto Github PK

2022-02-01 16:08:00,235 712 invalid relationships remain after resolution: 
Iteration 1: 1
Iteration 2: 6
Iteration 3: 22
Iteration 4: 87
Iteration 5: 349
Iteration 6: 247
2022-02-01 16:08:00,236 Crawl complete.
root@rbg-collect:~# crawl-fs -b all -i ... -o /data/rbg/feb-01-2022/ -u rappdw -h 1 --save-living
2022-02-01 16:08:10,706 Login to FamilySearch...
2022-02-01 16:08:15,624 Loaded graph for restart: 91,341 vertices, 231,695 frontier, 137,909 edges, 229,493 spanning edges, 124396 frontier edges. Running iterations 7 through 8.
2022-02-01 16:08:15,696 Starting iteration: 7... (231,695 individuals to process)
2022-02-01 16:14:08,585         Finished iteration: 7. Duration: 351.79 s. Graph stats: 323,036 vertices, 735,050 frontier, 501,006 edges, 740,906 spanning edges, 387865 frontier edges
2022-02-01 16:14:21,389 Downloaded 323,036 vertices, 735,050 frontier, 501,006 edges, 740,906 spanning edges, 387865 frontier edges, duration: 371 seconds, HTTP Requests: 1,160.
2022-02-01 16:14:33,334 Resolving 73834 relationships.
2022-02-01 16:55:29,799 Moved 1269 relationships to 'auxiliary'.
2022-02-01 16:55:46,019 69397 invalid relationships remain after resolution: 
Iteration 0: 5
Iteration 1: 46
Iteration 2: 224
Iteration 3: 1183
Iteration 4: 4920
Iteration 5: 17483
Iteration 6: 44707
Iteration 7: 829