hklemp / dotnet-stop-words Goto Github PK

This issue lists Renovate updates and detected dependencies. Read the Dependency Dashboard docs to learn more.

Open

These updates have all been created already. Click a checkbox below to force a retry/rebase of any.

• Update actions/checkout action to v4
• Update actions/setup-dotnet action to v4

Detected dependencies

• Check this box to trigger a request for Renovate to run again on this repository

I have been using your library which seems to work fine locally, but when I push it to my microsoft azure app service and try to use it I'm getting a strange error that I've not been able to debug yet. I've found no google results related to the specific "iv" language and I'm not sure where to proceed from here.

I should clarify the first part of the error the serialization exception is from my code trying to decode what was supposed to be a json result but the api returned "there was an error processing your request" which is also part of my code and then the specific exception thrown which appears to be from the stopword package.

[07/13/2020 13:25:31 > d26972: INFO] Newtonsoft.Json.JsonSerializationException: Error converting value "There was an error processing your request: System.ArgumentException: The language iv is not supported
[07/13/2020 13:25:31 > d26972: INFO] at StopWord.StopWords.MapLanguage(String shortLanguageName)
[07/13/2020 13:25:31 > d26972: INFO] at StopWord.StopWordsExtension.Remove(String s, String shortLanguageName)

Our specific use case is this:

            string sPunctRemoved = Regex.Replace(sDefn, "[^a-zA-Z0-9]+", " ");

            sFilterDefn = StopWord.StopWordsExtension.RemoveStopWords(sPunctRemoved.ToLower());

In this code, the line with the linq => s = s.Split(..... If the entire input string of 's' is stop words (e.g. 'cannot find'), then the Aggregate call returns null, so it throws an exception on the .ToString().

private static string Remove(string s,string shortLanguageName)
		{
			var stopWordList = StopWords.GetStopWords(shortLanguageName);
			s = s.Split(' ').Where(x => !stopWordList.Contains(x)).DefaultIfEmpty().Aggregate((current, next) => current + " " + next).ToString();
			return s;
		}