Comments (5)
yes, there was an outage this weekend. We have suffered a lot of 429 from Cloudflare skipping a lot of packages.
I had to rollback to an older version of the index, and it's currently catching up with NPM update queue.
from npm-search.
yep indeed.
It seems NPM bumped their sequence again and we are 60K updates behind.
Not so much we can do since we need to process update sequentially.
The same issue all over again :'(
We had lost metrics monitoring since a few weeks (and had no time to look up), I have added a more annoying alerting so that I don't skip those.
For JsDelivr we should really sync and find not an alternative but a decent way to fallback. Could be with a secondary real time index that has no additional info combined with an internal API to refresh cache.
from npm-search.
Do you know what's slowing down the indexing most? I'm wondering how the fallback would work because if you visit a page like https://www.jsdelivr.com/package/npm/quantdom it's easy, but to get there, you'd usually search at https://www.jsdelivr.com/?query=quantdom and if that returns some results, there's no way for us to know we need to fallback.
At the same time, we use jsDelivrHits for sorting the search results and also plan to add an option for filtering based on moduleTypes/styleTypes fields, so using a lighter index always is not an option. Would it make sense to maybe insert packages to the main index immediately, with some kind of "in progress" flag, and update it later? That might work well also with your previous "on-demand" endpoint idea.
from npm-search.
I notice many versions being missing, some much older than 5 days - for example:
https://yarnpkg.com/package/svelte - last version shown is 3.44.0, October 17, 2021
https://www.npmjs.com/package/svelte - 3.45.0 was published January 6, 2022
from npm-search.
The index is back up to date now, thanks for standing by!
from npm-search.
Related Issues (20)
- `getObject()` for Yup reports types of DefinitelyTyped HOT 19
- Switch to new source of DefinitelyTyped data? HOT 5
- Fix deployment and deploy the latest version HOT 1
- Package missing from package index
- Published package not showing up in search
- 4+ days indexing delay HOT 25
- Fix FALSE advertising! Algolia npm-search has failed, it's not resilient. HOT 1
- Intermittent npm failing test because of jest timeout HOT 5
- Reconfigure/disable renovate HOT 8
- API Control failed
- [wip] API Control failed
- [wip] API Control failed
- API Control automated check have failed HOT 2
- Consider lowering the importance of "proximity" in ranking HOT 4
- Consider changing "exactOnSingleWordQuery" to "word" HOT 2
- Fix docker publishing HOT 3
- Improve ranking HOT 27
- Outdated package normalization HOT 4
- Gracefully handle 429 responses HOT 6
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from npm-search.