Using only encoder part for word accentation about torchnlp HOT 4 OPEN

So is the accent on particular characters? You could define tags at character levels and basically work with a character level Transformer Encoder.

from torchnlp.

Yes, the accent is on specific letter.
Does Transform need a dictionary for character level taggng?
What should my next steps be in order to train Transformer accentation on Lithuanina language. I have a dataset of ~13 K sentences with accentation. I'm suspicious it may not be enough to train Transformer though, but I'm very keen to try...

from torchnlp.

I think you can map the input directly to the unicode character values. The infrastructure around the Tagger classes currently works at a word (+char) level. We'll have to make it more generic to handle character only input (An incentive for me to work on this!).

But the Transformer module is independent of the input (check this file).

13K sentences should be more than enough if you're working at a character level. Do you have tags for each character (including none)?

from torchnlp.

I do have tags for each char.

from torchnlp.