jellyfin / jellyfin-plugin-anidb Goto Github PK

I somehow get this error with the plugin from your unstable repo.

Seems something is wrong.

[2021-01-28 22:08:31.052 +01:00] [ERR] Error in "AniDB"
System.Xml.XmlException: Root element is missing.
   at System.Xml.XmlTextReaderImpl.Throw(Exception e)
   at System.Xml.XmlTextReaderImpl.ParseDocumentContentAsync_ReadData(Boolean needMoreChars)
   at System.Xml.AsyncHelper.CallBoolTaskFuncWhenFinishCoreAsync[TArg](Task task, Func`2 func, TArg arg)
   at System.Xml.XmlReader.MoveToContentAsync()
   at Jellyfin.Plugin.AniDB.Providers.AniDB.Metadata.AniDbSeriesProvider.FetchSeriesInfo(MetadataResult`1 result, String seriesDataPath, String preferredMetadataLangauge)
   at Jellyfin.Plugin.AniDB.Providers.AniDB.Metadata.AniDbSeriesProvider.GetMetadata(SeriesInfo info, CancellationToken cancellationToken)
   at MediaBrowser.Providers.Manager.MetadataService`2.ExecuteRemoteProviders(MetadataResult`1 temp, String logName, TIdType id, IEnumerable`1 providers, CancellationToken cancellationToken)

Also, what is the best Anime scraper?

It seems that this plugin likes to match the longest title containing the search words.

Some examples:

• "Saki" is matched as "Saki: Achiga Hen - Episode of Side-A"
• "Sangatsu no Lion" is matched as "Sangatsu no Lion (2017)"
• "Seikai no Senki" is matched as "Seikai no Senki II"

and so on. I think the matching logic would get much better if it first attempted to find an exact match before attempting current logic.

I prefer going into things blind and view ratings as as something that spoil the initial impression. So, would it be possible to add a setting that disables fetching these?

Steps:

1. Install the AniDB plugin.
2. Create a library of type show with at least one show in it.

• Ensure the AniDB metadata downloader is enabled, easiest to see if it's the only downloader enabled for the library.

3. Open the library, select the show, and select "Identify"
4. Enter name "Lost", hit "Search"

Result: A single show (Lost Universe) shows up.
Expected result: Multiple shows are listed, goal is probably this list filtered to fit library type (show here, movie for movie type library, both for other type) so that the correctly identified show can be selected.

More details:
The series provider search function simply calls GetMetadata instead of hitting a search endpoint:

Some shows return only "undefined" when trying to identify them. The link to the entry from AniDB gets added but other information and images are missing.

please add the ability to login to anidb and track to mylist directly from the plugin. Its annoying to have to manually update mylist on anidb.
And provide options to do the following

features

• Scrobble newly added anime (anime imported into jf, is added into anidbs mylist. Ignore if already present on mylist)
• default import status (when added in above, set status to defaultm for example set to unwatched by default, then when the user watches 1 episode it can change to watched)
• track watched and completed episodes
• check status of already watched anime on jf (series says you completed it on jellyfin, but is set as not completed on anidb? have it mark it as complete)
• an option to don't unwatch stuff" on mylist if its marked as unwatched after previously being watched in jellyfin
• scan for subgroups on files and mark it in mylist
• see user ratings
• add start/end watching dates to mylist

failsafes

• ignore entires that dont have an anidb page number (if you have an anime in your library, and it couldnt find the anidb id for metadata, completely ignore it so it doesnt mess up mylist)

• a history feature with ability to revert recent changes (failsafe in case it adds an anime with wrong metadata, accidentally marks the wrong anime/bunch of episodes as watched, etc.)

https://wiki.anidb.net/API
https://anidb.net/software

Jellyfin version: 1.8.0
AniDB plugin version: 6.0.0.0

Steps to reproduce:

• Create a new Movie library, pointing it to a directory with anime movies (arranged according to jellyfin standard, one movie per subdirectory, named in romaji after anidb main title)
• Disable all other metadata providers, keeping only the anidb provider for this library
• Let jellyfin scan the library

Result: No metadata is found for the movies.

Other notes:

• If you manually try to identify the movies they will be found in anidb, so it's only the automatic scan that fails
• plugin works as expected for shows
• anilist plugin properly detects the movies if enabled
• rescanning the library (with "replace all metadata") does not help
• removing and re-adding the library does not help

Hi, I noticed that the plugin only retrieves the tags listed at the top of an AniDB page, but those are just a few ones (I assume this section is intended to be a summary?). I'd prefer it if it could also retrieve all of them lower on the page (these ones):

Could this be added, please?

It would be nice to have an option to limit the number of cast and crew names pulled from the provider.
Many entries on AniDB have an absurd number of "Staff" entries, when all I really want are the several lead character's VAs. Like the TMDB plugin, an option to limit cast to a certain number

Steps:

1. Install the AniDB plugin.
2. Create a library of type show with at least one show in it.

• Ensure the AniDB metadata downloader is enabled as the first metadata downloader in the library (for each category), and also enable TheMovieDb as a secondary downloader.

3. Open the library, select the show, and select "Identify"
4. Enter name "Lost", hit "Search"
5. Select the second entry ("Lost", from TheMovieDb) and hit "Ok"

Result: Metadata (title, images, description, etc) for "Lost Universe" are loaded, and the external links for the show are:

• AniDB: Lost Universe
• IMDb: Lost
• TheMovieDb: Lost

Expected result: Metadata for the selected show ("Lost") loaded, and AniDB does not have an ID linked because the show isn't listed there.

More details:
The equality check in the series provider passes the same value into both sides, so they can never not be equal. This results in whatever show first matches the search being selected and tagged with an AniDB id.

It would be nice to map the 18 restricted tag to the Parental Rating value of NC-17

Currently manually having to lock the field and set it myself, it would be nice if it was somehow automatically mapped.

My current folder structure looks like the following:

Series Name > Series Season Name [anidbid-12345] > Name - 01 - [some][info].ext

As AniDB does not support traditional seasons, a nice alternative would be to group series inside a folder and then have that folder be scanned in as a collection. This would greatly aid in adding new series to a library, and it would keep the main library directory more organized.

An example of this structure would look something this:

Anime Library >
        Initial D > Initial D First Stage [anidbid-135] > Initial D First Stage - 01.mkv
        Initial D > Initial D First Stage [anidbid-135] > Initial D First Stage - 02.mkv
        Initial D > Initial D Second Stage [anidbid-145] > Initial D Second Stage - 01.mkv
        Initial D > Initial D Second Stage [anidbid-145] > Initial D Second Stage - 02.mkv
        Initial D > Initial D Third Stage [anidbid-625] > Initial D Third Stage Full Movie (2001).mkv
        Initial D > ...

The base Initial D folder would be located in the root of the library. When scanned, Jellyfin should check within the folder and create a collection titled Initial D and then add the contained series to that collection.

Background

The AniDB API is heavily rate-limited and will ban any IP that requests more than maybe a few hundred series. Some of us data hoarders have far more series than that, meaning we can never do a full metadata refresh without getting banned.

Problems

I can think of three different scenarios when this causes problems:

• During initial creation of a large library (it was horrible)
• During full metadata refresh of a large library
• When adding a large amount of series or episodes in different series in a short time (a day?)

A bit of brainstorming follows 🙂

Possible solutions?

When I added my library I manually kept track in the xml cache directory for when I started getting banned messages. At that point I:

1. Stopped the library scanning
2. Noted ID:s for the bad xml files and removed them
3. Waited at least 24 hours
4. Manually refreshed the metadata for the previously noted ID:s
5. Restarted then library scan; rinse and repeat

Not the most smooth sailing possible. I guess PR #42 may have helped me to detect the bans which would be an improvement, but unless it also prevents the plugin from making more requests it might also have made the bans longer (I understand the AniDB API adds ban-time for each "unsolicited" request).

A possible high-level solution (which I don't know if it's possible) would be to limit the plugin to maybe 200 requests during a sliding window of 24 hours. When asked for more the plugin should just respond that it currently has no metadata and maybe schedule a new refresh for that series in 24/48/possible more hours. Same if a ban is detected: refuse to send any more requests for at least 24 hours. It will still take very long time for a large library to be refreshed; but it would be populated eventually and without any cumbersome user interaction.

As for library metadata refresh I think there can be some improvements to the xml-file caching. At the moment it looks like the xml files are cached for 7 days. One idea would be to make a daily scheduled task that updates the 50 (or 100 or something) oldest xml files for series that are present in the library and raise the cache time to 30, 60 or 90 days. This would keep the xml files fairly fresh even for larger collections and you wouldn't run in to trouble if you configure the libraries to refresh periodically.

I realize that this is a quite big change, and maybe the problem is rare enough that not many more than I find this troublesome. Unfortunately I cannot help with the code myself, but I'd like to put it up here as an idea, and maybe someone else finds it to be a fun challenge. Anyway; Thank you for an awesome plugin 😃

When using the plugin as well as the TVDB plugin if you manually specify an andb episode entry and refresh metadata on an entry the manually entered id will be reset and it will pull the wrong info again.

This is happening for a bunch of shows whether I use name matching or Anidb matching.

I already tried modified build.yml, then build the plugin.
But obviously it doesn't work.

Could you provide plugin build for Jellyfin 10.6.4 ?
Or how can I build it myself?

Hello

First off, thanks for the great work. It helps to have plugins dedicated for retrieving anime metadata.

One thing I've noticed is that the documentation does not mention how to add the AniDB ID to the name the folder in a way that the plugin can pick it up automatically.

This feature is already provided by Jellyfin for movies and TV shows

It would be great if you could add that as part of the documentation.

Thanks again

Also see: jellyfin-archive/jellyfin-plugin-anime#47

I am on Jellyfin 10.7 with the old anime plugin deactivated.

Hello,

Is it possible to choose the id only for the season ?
anidb don't provide a show id, only a season.

Thank you,
Best !

Some episodes are not properly added to a show or a season, even when placed in the correct folder with a similar filename to other episodes.

For instance, this episode of Goblin Slayer (S02E02):

Does not appear in the Season:

The filename is the same format as the S02E01 which was properly identified:

Contents of the .nfo generated:

<?xml version="1.0" encoding="utf-8" standalone="yes"?>
<episodedetails>
  <plot />
  <lockdata>false</lockdata>
  <dateadded>2023-10-07 01:42:47</dateadded>
  <title>An Ordinary Spring Day</title>
  <rating>0</rating>
  <year>2023</year>
  <imdbid>tt20896366</imdbid>
  <tvdbid>9040106</tvdbid>
  <runtime>24</runtime>
  <art>
    <poster>/home/multimedia/Downloads/Animes/Goblin Slayer/Season 2/metadata/[SubsPlease] Goblin Slayer S2 - 01 (1080p) [23637EF6].jpg</poster>
  </art>
  <actor>
    <name>Yuuichirou Umehara</name>
    <role>Goblin Slayer (voice)</role>
    <type>Actor</type>
    <sortorder>0</sortorder>
    <thumb>/var/lib/jellyfin/metadata/People/Y/Yuuichirou Umehara/folder.jpg</thumb>
  </actor>
  <actor>
    <name>Yui Ogura</name>
    <role>Priestess (voice)</role>
    <type>Actor</type>
    <sortorder>1</sortorder>
    <thumb>/var/lib/jellyfin/metadata/People/Y/Yui Ogura/folder.jpg</thumb>
  </actor>
  <actor>
    <name>Nao Toyama</name>
    <role>High Elf Archer (voice)</role>
    <type>Actor</type>
    <sortorder>2</sortorder>
    <thumb>/var/lib/jellyfin/metadata/People/N/Nao Toyama/folder.jpg</thumb>
  </actor>
  <actor>
    <name>Yuka Iguchi</name>
    <role>Cow Girl (voice)</role>
    <type>Actor</type>
    <sortorder>3</sortorder>
    <thumb>/var/lib/jellyfin/metadata/People/Y/Yuka Iguchi/folder.jpg</thumb>
  </actor>
  <actor>
    <name>Maaya Uchida</name>
    <role>Guild Girl (voice)</role>
    <type>Actor</type>
    <sortorder>4</sortorder>
    <thumb>/var/lib/jellyfin/metadata/People/M/Maaya Uchida/folder.jpg</thumb>
  </actor>
  <actor>
    <name>Yuichi Nakamura</name>
    <role>Dwarf Shaman (voice)</role>
    <type>Actor</type>
    <sortorder>5</sortorder>
    <thumb>/var/lib/jellyfin/metadata/People/Y/Yuichi Nakamura/folder.jpg</thumb>
  </actor>
  <actor>
    <name>Tomokazu Sugita</name>
    <role>Lizard Priest (voice)</role>
    <type>Actor</type>
    <sortorder>6</sortorder>
    <thumb>/var/lib/jellyfin/metadata/People/T/Tomokazu Sugita/folder.jpg</thumb>
  </actor>
  <actor>
    <name>Yoko Hikasa</name>
    <role>Witch (voice)</role>
    <type>Actor</type>
    <sortorder>7</sortorder>
    <thumb>/var/lib/jellyfin/metadata/People/Y/Yoko Hikasa/folder.jpg</thumb>
  </actor>
  <actor>
    <name>Yoshitsugu Matsuoka</name>
    <role>Spearman (voice)</role>
    <type>Actor</type>
    <sortorder>8</sortorder>
    <thumb>/var/lib/jellyfin/metadata/People/Y/Yoshitsugu Matsuoka/folder.jpg</thumb>
  </actor>
  <actor>
    <name>Aya Endo</name>
    <role>Sword Maiden (voice)</role>
    <type>Actor</type>
    <sortorder>9</sortorder>
    <thumb>/var/lib/jellyfin/metadata/People/A/Aya Endo/folder.jpg</thumb>
  </actor>
  <showtitle>Goblin Slayer</showtitle>
  <episode>1</episode>
  <season>2</season>
  <aired>2023-10-06</aired>
  <fileinfo>
    <streamdetails>
      <video>
        <codec>h264</codec>
        <micodec>h264</micodec>
        <bitrate>8153005</bitrate>
        <width>1920</width>
        <height>1080</height>
        <aspect>16:9</aspect>
        <aspectratio>16:9</aspectratio>
        <framerate>23.976025</framerate>
        <scantype>progressive</scantype>
        <default>True</default>
        <forced>False</forced>
        <duration>23</duration>
        <durationinseconds>1420</durationinseconds>
      </video>
      <audio>
        <codec>aac</codec>
        <micodec>aac</micodec>
        <bitrate>127999</bitrate>
        <language>jpn</language>
        <scantype>progressive</scantype>
        <channels>2</channels>
        <samplingrate>44100</samplingrate>
        <default>True</default>
        <forced>False</forced>
      </audio>
      <subtitle>
        <codec>ass</codec>
        <micodec>ass</micodec>
        <language>eng</language>
        <scantype>progressive</scantype>
        <default>True</default>
        <forced>False</forced>
      </subtitle>
    </streamdetails>
  </fileinfo>
</episodedetails>

<?xml version="1.0" encoding="utf-8" standalone="yes"?>
<episodedetails>
  <plot />
  <lockdata>false</lockdata>
  <dateadded>2023-10-13 19:06:16</dateadded>
  <title>Goblin Slayer S2</title>
  <language>en</language>
  <art />
  <showtitle />
  <fileinfo>
    <streamdetails>
      <video>
        <codec>h264</codec>
        <micodec>h264</micodec>
        <bitrate>8151020</bitrate>
        <width>1920</width>
        <height>1080</height>
        <aspect>16:9</aspect>
        <aspectratio>16:9</aspectratio>
        <framerate>23.976025</framerate>
        <scantype>progressive</scantype>
        <default>True</default>
        <forced>False</forced>
      </video>
      <audio>
        <codec>aac</codec>
        <micodec>aac</micodec>
        <bitrate>128000</bitrate>
        <language>jpn</language>
        <scantype>progressive</scantype>
        <channels>2</channels>
        <samplingrate>44100</samplingrate>
        <default>True</default>
        <forced>False</forced>
      </audio>
      <subtitle>
        <codec>ass</codec>
        <micodec>ass</micodec>
        <language>eng</language>
        <scantype>progressive</scantype>
        <default>True</default>
        <forced>False</forced>
      </subtitle>
    </streamdetails>
  </fileinfo>
</episodedetails>

I see to remember that identification and categorization in Shows/Seasons was based on the path and the filename, so why is Jellyfin properly identifying the first episode but not the second ?

I'd really love to have support for specials like openings and endings. @nalsai in #6 said

If you want any of these implemented or have another problem, make a new issue or message me, then we can work on it.
Originally posted by @nalsai in #6 (comment)

and so here's the issue.

It could also be good idea to support use of anidb episode prefixes:

• regular episode: none
• special episode: S
• openings: OP (sometimes it can be sth like OP1b)
• endings: ED (sometimes it can be sth like ED1b)
• trailer/promo/ads: T

Alternatively the prefixes could also be:

• E, EP or Episode - for regular episodes
• SP or Special - for specials
• PV, P, AD, PR (not necessarily) or Promo (not necessarily) - for trailer/promo/ads

There could be more types of episodes, but I haven't come across any.

And of course padded episode numbers (EP1, EP01 or EP0001) should also be supported, but I guess it's already implemented.

Background is this jellyfin issue. TL;DR: Combining the anidb plugin with TheTVDB can cause some watched-state woes between seasons.

The primary reason I want to enable the tvdb-plugin is so that I can get the pretty banners/backdrops/logos etc. that it can fetch for the series. If this plugin could be updated to fetch images from the same sources (thetvdb.com and fanart.tv) there would be no need to enable TheTVDB. I'm guessing it should be fairly easy to implement using the anime-lists as a mapping.

When following the common naming scheme (Series (year)) the titles aren't searched.

Example:
Canaan (2009) - returns empty result
Canaan - works

The last version that didn't have this issue was 5.0.0.0.

I have had a difficult time having Jellyfin detect episode information/names properly when there is information located near the end of filenames. This could potentially be related to #6 I am not sure.

Just for example:
In my folder: /Videos/Anime/Fate Stay Night/Fate Stay Night - S01E01 - The First Day - [76C77486] [Moby JJ].mkv
In Jellyfin it shows up as: Fate Stay/Night - 1. Fate Stay Night - S01E01 - The First Day - [76C77486] [Moby JJ]

I would expect it to ignore the ending [76C77486] [Moby JJ]. Often I also place codec and similar information in the filenames such as Fate Stay/Night - 1. Fate Stay Night - S01E01 - The First Day - [BluRay MKV FLAC 2.0] [76C77486] [Moby JJ]. I would expect it to match the former lines and ignore everything it doesn't recognize (So everything after S01E01 or the episode name).

Now I am not entirely sure if this is an issue with Jellyfin, or an issue with this plugin. I state this because I have also had issues with this with Music. While I understand this plugin doesn't handle music, just for clarity, an example with Music:
/Music/Artists/Zuill Bailey/Zuill Bailey - Bach Cello Suites Volume 2 - [192k 24bit] [WAV] (Octave Records)/01 - Zuill Bailey - BWV 1008 Suite No. 2 in D minor - Prelude.wav; /Music/Artists/Zuill Bailey/Zuill Bailey - Bach Cello Suites Volume 2 - [DSD] (Octave Records)/01 - Zuill Bailey - BWV 1008 Suite No. 2 in D minor - Prelude.dsf. While not exactly the same folder/file structure, these show up in Jellyfin without proper metadata, and show up as the folder names (Zuill Bailey - Bach Cello Suites Volume 2 - [DSD] (Octave Records)) instead of simply displaying Zuill Bailey - Bach Cello Suites Volume 2 as I would expect.

My Movies on the other hand, are labeled similarly and detect majority of the time properly, which is creating even more confusion for me. This makes me think this may be a plugin independent issue, and not Jellyfin? But I am not entirely sure anymore.
/Videos/Movies/Out of the Past (1947)/Out of the Past (1947) - BluRay Remux 1080p AVC FLAC 2.0 [HiFi].mkv is an example. Detects no problems.

TV Shows also seem to generally detect without issues, although I have run into one or two here or there.
/Videos/TV Shows/SpongeBob SquarePants/Season 01/SpongeBob SquarePants - S01E01-E03 - Help Wanted, Reef Blower, Tea at the Treedome - 1080p AMZN WEB-DL DDP2.0 x264 [TVSmash]

I only provide the latter for redundancy and clarity, to help further explain my issue with the anime detection. It seems to be a bit random, as I can have some things named exactly the same, yet one would have issues detecting whilist the other detects fine. My files are generally pretty consistent from one another as far as the local naming schemes go. It would also not be the easiest thing to go in and rename terabytes of data.
I have heard others complain about detection issues as well, whilist Plex detects no issues according to them. Again I am unsure if this is a Jellyfin issue, or a plugin independent issue. I can move this issue over to the Jellyfin repository if desired.