Code Monkey home page Code Monkey logo

Comments (5)

0xEnders avatar 0xEnders commented on August 23, 2024 2

For 1, could it be auto translate? I am thinking of like the OCR function you implemented where you set a few languages you want and it translate from there.

  1. Yeah I can understand how big the files can end up especially if you are monitoring a lot of groups and OCR function needs to be able to download the files to analyze it. I am figuring out a way how to automatically push my logs to my SIEM to analyze but most of the time I just stop the scraper, cut out the data_local.db file, and start the scraper again

Having a Beta build would be great for us to test out your new features and give feedback.

On a side note, I would recommend implementing an image censor/filter in the distant future. I have come across multiple photos that people might consider gory or depressing. Having such a feature could really benefit the analysts in the future.

Looking forward to your official v3.0 release!

from tex.

guibacellar avatar guibacellar commented on August 23, 2024

Hi. I'm Happy to know that you are testing the 0.3.0 :D

About the features:

1-) You tell the translation, translation? Like, ENG to PT_BR or RU to ENG?

2 and 3-) I'm planning a auto export already, probably because the same problem that you are facing. Ref: #53
I'm really understand you, lol, currently my TEx setup uses about 300 GB (Yes, I download everything) and my data_local.db has 3,5 GB LOL-LOL-LOL. And i keep only the last 30 days on the DB. Also, I think on export specially to use ML and Gen IA to cluster and analyse all the messages.

I'm prioritizing the export feature to 0.3.0 official release. 😄

Also, two weeks ago, was impossible to add this features, but, to address one of your request (and again, lots of thanks for that) I fix the way how I work with the asyncio and the telegram client loop. 👍

For the end, I'm aware about the pain of keeping running the 'purge_old_data' command in order to keep the local database away from the meltdown. For that, on 0.3.0 I will introduce the Automatic Maintenance#43.

That 2 last features (DB Maintenance and now the Export to CSV/XML/JSON and other formats) are the last to release the 0.3.0.

Again, Thanks a lot for using TEx and making the world a better place

from tex.

guibacellar avatar guibacellar commented on August 23, 2024

And one thing that you say making me think about create a "Beta" build for the working versions. This way, anyone can download and try the On Development versions.

from tex.

guibacellar avatar guibacellar commented on August 23, 2024

image
It' taking a time, but I'm almost there ;)

Realtime, Rolling file exporting as csv, xml, json or pickle......

from tex.

guibacellar avatar guibacellar commented on August 23, 2024

Closing for Issues Cleanup. All requests features was addressed in other issues

from tex.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.