I am running rebrow in docker marian/rebrow:latest </p

Hi <a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="

Unicode about rebrow HOT 2 OPEN

marians commented on June 24, 2024

Unicode

from rebrow.

Comments (2)

earthgecko commented on June 24, 2024

Hi @konsumer

You probably want to use something like the emoji module and check if the key value has an emoji in it and if so then demojize the key value, something like https://stackoverflow.com/a/51007945 and https://gist.github.com/jezdez/0185e35704dbdf3c880f

# You will need to install emoji with pip and then import it in runserver.py
import emoji

# Then around line 219 https://github.com/marians/rebrow/blob/master/runserver.py#L219
    if t == "string":
        val = r.get(key).decode('utf-8', 'replace')
# Let us say the val was
# val = u'I \u2764 emoji'
   def char_is_emoji(character):
        return character in emoji.UNICODE_EMOJI
    if [c for c in val if char_is_emoji(c)]:
        val = emoji.demojize(val)
# Which will result in val
# u'I :red_heart: emoji'

This is just an example but may work for you, in the very least it is somewhere to start.

from rebrow.

konsumer commented on June 24, 2024

I could just strip any utf8 chars outside the ascii range, but It's in my data. I want to keep the emojis. I am just reporting that rebrow freaks on those records.

from rebrow.

Recommend Projects