中文文档

A simple project about Web Spider made by python.

• Multi-thread Scheduling
• Persistent Storage
• Back-end Service
• Routing Registered Configuration
• Template Engine
• Performance Monitoring
• Description and Visualization
• Interactive Interface
• Command Line Tool
• Dependency Management Shell

$ ./env.bat

$ ./env.sh

$ python main.py -c

$ python main.py -r

$ python main.py -d

$ python main.py -d
[Task: (taskName)]
......
Spider Time :(timeOfTask)s
......
$ python main.py -r
Render /(routerName)
....
$ python main.py -d
INFO:     Started server process [9092]
INFO:     Waiting for application startup.
INFO:     Application startup complete.
INFO:     Uvicorn running on http://localhost:8080 (Press CTRL+C to quit)

If you visit the default site, you will noly get a null json because there are three different routes, which are the solutions of three different problems.

• http://localhost:8080/actress
• http://localhost:8080/television
• http://localhost:8080/epidemic