AttributeError when preprocessing data for DrQA about sru HOT 7 CLOSED

Hi,
The prepro.py code is taken from https://github.com/hitvoice/DrQA and the author is @hitvoice
The required spacy version is 1.x according to the README.

@hitvoice any ideas?

from sru.

prepro.py has been updated a month ago in https://github.com/hitvoice/DrQA. With spacy 2.0, the new script finishes without error, but it takes more than an hour to finish data processing (while with spacy 1.9 it takes only 70 seconds). I'm not able to find out what exactly is the problem and how to accelerate it even after following the "Migrating from spaCy 1.x" guide.
Related issues in spacy: #1371 #1572, which are still open.
I suggest sticking to spacy 1.9 until the spacy development team fixes related performance issues.

from sru.

Thanks @hitvoice . Do I need to update any other files to make it work with spaCy 2.x? I would like to use the same library version throughout my projects to avoid compatibility problems.

from sru.

No, only "prepro.py".

from sru.

@hitvoice when replacing the prepro.py with your new version, a new bug occurs.

Traceback (most recent call last):
File "lib/python3.5/site-packages/cupy/cuda/stream.py", line 113, in del
if self.ptr:
AttributeError: 'Stream' object has no attribute 'ptr'
if self.ptr:
AttributeError: 'Stream' object has no attribute 'ptr'

I'd like to know how to deal with it... Many thanks...

from sru.

I used @hitvoice 's repo for the DrQa and it worked well, so consider this option also.

from sru.

@aviczhl2 i think you should upgrade your NVIDIA driver, it worked for me.

from sru.