grikomsn / puppet-scraper Goto Github PK

Apparently publishing scrappeteer to npm does not work and there's no proof on whether it's already in use by a private package or something else:

https://www.npmjs.com/package/scrappeteer	npm publish

So the only options are either changing the project name or resolve the npm registry issue (which I have contacted npm).

Scrappeteer was made for its dead simple web scraper, and I haven't planned on adding other features. Do send your ideas here.

Getting the following errors in Jest when trying to use the module:

    Cannot find module 'puppeteer' from 'puppet-scraper.cjs.development.js'

    Require stack:
      node_modules/puppet-scraper/dist/puppet-scraper.cjs.development.js
      node_modules/puppet-scraper/dist/index.js
      src/puppeteer.ts
      src/puppeteer.test.ts

      at Resolver.resolveModule (node_modules/jest-resolve/build/index.js:299:11)
      at Object.<anonymous> (node_modules/puppet-scraper/dist/puppet-scraper.cjs.development.js:8:33)

I think it is probably this line:

It assumes one has puppeteer installed, but in reality it is also possible to use only puppeteer-core.

I think, in fact, it would be the preferred way for a library to use the -core version, as it wouldn't pull in Chromium by default.

The original plan was creating scrappeteer as an npm package, so helping me with this would be nice.

The initial plan was using chrome-aws-lambda instead of chunky boi Chromium, so helping me with this would be nice.