Hi Salim, I was testing Rcrawler with '<a href="http://www.emiratesm

Thanks <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-u

Arabic characters are not rendered correctly about rcrawler HOT 6 CLOSED

salimk commented on May 21, 2024

Arabic characters are not rendered correctly

from rcrawler.

Comments (6)

Rifakh commented on May 21, 2024 1

Hi,

Sys.setlocale("LC_ALL","Arabic")

works for me.

from rcrawler.

salimk commented on May 21, 2024 1

We have fixed the issue now encoding will reflect on saved HTML files, but before start crawling you need to run :
Sys.setlocale("LC_CTYPE","Arabic_Saudi Arabia.1256")
Update will be released in the next few days you will be notified

from rcrawler.

salimk commented on May 21, 2024 1

update version 0.1.9 is released, enjoy!
subscribe to our mailing list to stay updated http://eepurl.com/dMv_7s

from rcrawler.

mzeidhassan commented on May 21, 2024

If I use this list(DATA, localeToCharset('UTF-8')), the Arabic text is rendered correctly in R Studio, but still the crawled HTML files are showing unicode characters. Any idea how to save the crawled HTML files in regular Arabic text?

from rcrawler.

mzeidhassan commented on May 21, 2024

Thanks @salimk and look forward to the update.

from rcrawler.