brunomateus / f-droid-crawler Goto Github PK

• Information about log in correct way
• Explain the difference between one_app crawler and apps crawler

To update easily our dataset, it would be interesting to have a possibility to specify a date and get the link only for applications added since that date.

We need a log file to make it easy to find out which app is not available anymore

In general F-droid shows three version of an app in the app page. However, it stores more versions. To find them, it is necessary to visit the tech info page for an application and then, get link from the oldest versions.

Using the GitHub API we can find out mow much of which language is used to write a software from a specific repository.

API endpoint:

• https://api.github.com/repos/REPO_OWNER/REPO/languages

Output:

{ "Kotlin": 195215, "Java": 25693 }

Currently, the crawler is able to get only the last version of one app.
Would be nice to get information about all version, so we can compare different version of the same app.