Occasionally people will spam @sfmta_muni with more than 2 tweets in a short amount of

We'll need usernames for the tweeters, as in <a href="https://github.com/sfbrigade/nlt

<a class="user-mention notranslate" data-hovercard-type="user" data-hovercard-url="/us

<a class="issue-link js-issue-link" data-error-text="Failed to load title" data-id="40

Add twitter data cleaning step prior to labeling about nltweets HOT 7 CLOSED

frhino commented on July 18, 2024

Add twitter data cleaning step prior to labeling

from nltweets.

Comments (7)

frhino commented on July 18, 2024

We'll need usernames for the tweeters, as in issue 37.

from nltweets.

pahdo commented on July 18, 2024

@rileypredum Did your merged PR address this issue? If so, we can close this

from nltweets.

rileypredum commented on July 18, 2024

@pahdo No, it did basic spacy methods like removing stop words and punctuation and such.

from nltweets.

frhino commented on July 18, 2024

What I had in mind when I created this issue is to add whatever processing we needed to have a clean flat file prior to the nlp stuff, e.g the "b"s gone and the fields cleanly delimited.

…

On Wed, Feb 27, 2019, 9:39 PM Riley Predum ***@***.***> wrote: No, it did basic NLP library cleaning like removing stop words and punctuation and such. — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#50 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AHCiEeYxOPtA2pS43ulhXaADeMX2C_Tnks5vR0-CgaJpZM4amdhm> .

from nltweets.

rileypredum commented on July 18, 2024

#47 (comment) @frhino Does this work?

from nltweets.

rileypredum commented on July 18, 2024

I removed the NLP cleaning steps and am focusing on just the decoding. Anyone know how to clean emojis though?

from nltweets.

rileypredum commented on July 18, 2024

My PR is pending, once approved, this has been resolved

from nltweets.

Recommend Projects