This is the website that runs on https://scrapy.org.
This website is made with Jekyll. The most universal way to install it is:
bundle installTo start the web server locally auto-reloading when files change use:
jekyll serve --watchThe website is updated via CI when merging to the main branch.
To generate CSS, you can use .. code:: bash
sass --watch ./css/main.scss:./css/main.css
Are you a company or individual using Scrapy for your product or project? Add yourself to the "Companies using Scrapy" list by sending a pull request:
- add a "company card" in
_data/companies/list/<companyslug>.ymlas a YAML file; you need to set a few fields: a name, a "logouser" for your logo filename, a homepage and a blurb in markdown syntax on how you're using Scrapy. Do add links to any article or tweet spreading your love of Scrapy - add your logo to
img/ - add the slug of your company card to the list in
_data/companies/users.yml.
If you are a company providing Scrapy consulting or spider development, you can submit a pull request to add your company to the "Scrapy Pros" list.
The companies are sorted by their overall contribution to the Scrapy project and ecosystem. There's a small process to manage that:
- In order to appear in the list, a company must score at least five points in the table below.
- The company must submit an issue to scrapy.org repo whenever they want to update their contributions and ranking.
- This issue must contain references to all the contributions that the company made since the last time their rank has been updated.
This is the criteria that will be used:
| Contribution | Points |
|---|---|
| Pull request accepted in scrapy repo |
|
| Creation or contribution to public Scrapy plugins |
|
| Instructional materials such as screencasts, tutorials or blog posts |
|
| Blog posts that spread the word about Scrapy |
|
| Landing page in the company website describing the Scrapy services |
|
| Scrapy listed in the company's technologies stack (if any) | 2 |
| Answer to StackOverflow question regarding Scrapy |
|
In practice, to be listed, you'll need to:
- add/update your "company card" in
_data/companies/list/<companyslug>.ymlas a YAML file; it needs aurlfield (e.g. the landing page of your consulting services offer), adescriptionfield describing your services (use markdown), and alogofilename - add your logo to
img/ - add/update your contributions in
_data/companies/pros/contributions.csv - re-run
update_ranking.pyinside_data/companies/pros/
and send a pull request with these changes.
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent
