kaijuml / dtt-multi-branch Goto Github PK

Loading sentences...
[OK] (526575 sentences in 14.364 seconds)
Loading SpaCy parser...
[OK] (1.922 seconds)
Using 32 processes, starting now.
Parsing sentences:   0%|                                                                                                          | 0/526575 [00:00<?, ?it/s]
multiprocessing.pool.RemoteTraceback:
"""
Traceback (most recent call last):
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 121, in worker
    result = (True, func(*args, **kwds))
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 44, in mapstar
    return list(map(*args))
  File "dep_parsing_spacy.py", line 94, in _deal_with_one_instance
    ret = nlp.parser(Doc(nlp.vocab, sentence))
AttributeError: 'English' object has no attribute 'parser'
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "dep_parsing_spacy.py", line 111, in <module>
    total=len(sentences)
  File "dep_parsing_spacy.py", line 104, in <listcomp>
    processed_sentences = [item for item in tqdm.tqdm(
  File "/opt/conda/lib/python3.7/site-packages/tqdm/std.py", line 1178, in __iter__
    for obj in iterable:
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 325, in <genexpr>
    return (item for chunk in result for item in chunk)
  File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 748, in next
    raise value
AttributeError: 'English' object has no attribute 'parser'

Using the following devices: [1,2]
Using the following environment variables, please edit the script if needed
CUDA_VISIBLE_DEVICES=1,2
Using the following arguments, please edit the script if needed
--data_dir ./pos --model_type bert --labels ./pos/labels.txt --model_name_or_path bert-base-uncased --output_dir ./pos/trained --max_seq_length 256 --num_train_epochs 3 --per_gpu_train_batch_size 32 --save_steps 750
Traceback (most recent call last):
  File "run_ner.py", line 70, in <module>
    (),
  File "run_ner.py", line 68, in <genexpr>
    for conf in (BertConfig, RobertaConfig, DistilBertConfig, CamembertConfig, XLMRobertaConfig)
AttributeError: type object 'BertConfig' has no attribute 'pretrained_config_archive_map'
Loading examples from train
Traceback (most recent call last):
  File "run_ner.py", line 70, in <module>
    (),
  File "run_ner.py", line 68, in <genexpr>
    for conf in (BertConfig, RobertaConfig, DistilBertConfig, CamembertConfig, XLMRobertaConfig)
AttributeError: type object 'BertConfig' has no attribute 'pretrained_config_archive_map'
Traceback (most recent call last):
  File "pos_tagging.py", line 225, in <module>
    do_tagging(args.pos_folder, args.dataset_folder, args.do_tagging, gpus, args.max_seq_length, args.split_size)
  File "pos_tagging.py", line 163, in do_tagging
    run_script(examples, pos_folder, dest, gpus, max_seq_length)
  File "pos_tagging.py", line 139, in run_script
    open(orig, mode="r", encoding='utf8') as origfile:
FileNotFoundError: [Errno 2] No such file or directory: './pos/trained/test_predictions.txt'

Writting formatted wieghts to: /workspace/src/repos/dtt-multi-branch/train_weights.txt
Reading orig file. Can take up to a minute.
WARNING: path is data/wikibio but format is txt (by default).
Traceback (most recent call last):
  File "data/format_weights.py", line 240, in <module>
    args.orig, func=lambda x,y: (x, float(y)))
  File "data/format_weights.py", line 239, in <listcomp>
    sent for sent in TaggedFileIterable.from_filename(
  File "/workspace/src/repos/dtt-multi-branch/data/utils.py", line 124, in __getitem__
    return next(self)
  File "/workspace/src/repos/dtt-multi-branch/data/utils.py", line 134, in __next__
    return next(self._iterable)
  File "/opt/conda/lib/python3.7/site-packages/more_itertools/more.py", line 2670, in __next__
    item = next(self._source)
  File "/workspace/src/repos/dtt-multi-branch/data/utils.py", line 173, in read_file
    with open(path, mode='r', encoding='utf8') as f:
IsADirectoryError: [Errno 21] Is a directory: 'data/wikibio'