Hi, thanks for this tool but i've a very strange bug, i use node.js webkit.

It don't work in my function :

But it work when i call the function in the console 😒 :

WTF ? Do you have any idea ? Thanks

Hello. I wrote this function on stackoverflow that removes the most common Arabic diacritics, as well as normalizing some characters that are commonly (although incorrectly) substituted in place of each other.

Please feel free to incorporate the code in your library as you wish.

This a cyrillic lowercase L (Л) which is not a diactric symbol

U+043B
U+041B

Do you have a list of diacritrics that get converted?

In Italy, the fiscal code ("codice fiscale") has recently changed in a way that all the diacritrics are converted to ASCII characters. This table has been provided for the conversion.

How can I know if those characters are actually supported by your module, given that there's just a list of Unicodes in the source code?

Thanks

It would be nice to have a version of the function that conserved case, as much as possible. (I.e., turn œ into oe and ș into s, but turn Æ into AE and Ș into S.)

This package is great, but it replaces the cyrillic letter "л" with the latin "n".

Unicode defines normalized forms for characters and character classes.

It might work to normalize strings to NFKD and remove any characters of class Mn (Nonspacing_Mark) (see table 12)

It might be necessary to specially handle conversions like ß to ss

See also python stack overflow answer

> console.log(removeDiacritics("más"));
mas
> console.log(removeDiacritics("más"));
más

The first has U+00E1 LATIN SMALL LETTER A WITH ACUTE and the second has U+0061 LATIN SMALL LETTER A + U+0301 COMBINING ACUTE ACCENT.

So we can follow what is being changed on the releases. Thanks :)

http://www.unicode.org/faq/normalization.html

Looks like there are some libraries available that would make this module more heavyweight but also more robust.

Hi @andrewrk,

What do you think about this? Right now i'm facing a case where i need to have a group of all possible diacritics from a specific char. I remembered about your great list of diacritics, and that your package is named as 'diacritics', and not something like 'remove-diacritics', so i thought that would be better to extend it with one more method instead of create another package.

I already created the new method:

function findDiacritics(chr) {

  var diacriticsFound = replacementList.find( o => o.base == chr || o.chars.indexOf(chr) >= 0 );
  return (diacriticsFound)? diacriticsFound.base + diacriticsFound.chars : null;

}

If you think it is ok, i can send you a pull request.

Did you get your map from here http://stackoverflow.com/a/16877175/151312?

I think that's where I got mine from:
https://github.com/coolaj86/mediabox/blob/master/example/browser/lib/remove-accents.js

I was just about to publish mine, but I think we have the exact same thing, no?

Looking through the code I didn't see any regex for it. Should be something like:

{
base: 'oe',
regex: /[œŒ]/g
}

Hi,

Coming from this post on SO http://stackoverflow.com/questions/990904/javascript-remove-accents-in-strings , the accepted answer links to a JSPerf with an interesting solution named "What ?" and which seems to be way faster than the one implemented here.
You should definitively have a look at it to maybe improve this package performance.

However, thanks for maintaining this package !

Need to make a test on string before calling replace

Looks like "C.....é..." always leads to having the 'C' turned in a lower-case 'c'.

See below:

> var removeDiacritics = require('diacritics').remove;
undefined
> removeDiacritics("Cassiopée")
'cassiopee'
> removeDiacritics("Cassiopee")
'Cassiopee'
> removeDiacritics("Bassiopée")
'Bassiopee'
> removeDiacritics("Clé")
'cle'
> removeDiacritics("Cé")
'ce'
> 

In German a ß should be replaced by ss. See http://www.duden.de/sprachwissen/rechtschreibregeln/doppel-s-und-scharfes-s

Regel 160:

1. Fehlt das ß auf der Tastatur eines Computers oder einer Schreibmaschine, schreibt man dafür ss. In der Schweiz kann das ß generell durch ss ersetzt werden <§ 25 E2>.

Rule 160:

1. In case the ß is missing on the keyboard, ss can be used instead. In Switzerland ß can be replaced by ss in general.

I'm a native German speaker and I can confirm that Fußball and Weißbier should become Fussball and Weissbier.

German umlaute are currently transformed by just removing diacritics. It would however make more sense to transform them the following way:

ä -> ae
ö -> oe
ü -> ue
ß -> ss
Ä -> Ae
Ö -> Oe
Ü -> Ue