Most of the data in final.json currently comes from game files
- The app starts by querying a public api on wiki.warthunder.com for vehicles and downloads all vehicle pages
- Parses the internal vehicle name from wiki pages and combine them with internal gamedata
- Reads from game files data for all vehicles and parses it to out/final.json
- Downloads all garageimages from wiki.warthunder.com and saves them to garageimages directory
- Parses and creates shop.json from shop.blkx
Prerequisites:
- POSIX Shell
- bun
Clone the repo with submodules:
git clone --recursive https://github.com/natgo/wt-wiki-scraper.git
Install dependencies:
bun install
In order to run building in watch mode, run:
bun run build --watch
To prettify source code, run:
bun pretty
In order to do a build, run:
bun run build
Just run
bun start
the output will be in data/data/ directory
- Add lint-staged
- Create a pipeline to wt-app
- Improve the file structure
- Complete the scrape module