anthonylai / scrapedin Goto Github PK

Scraper for LinkedIn full profile data, working for 2019 new website layout.

Install via npm package manager: npm i scrapedin

const scrapedin = require('scrapedin')

const profileScraper = await scrapedin({ email: '[email protected]', password: 'pass' })
const profile = await profileScraper('https://www.linkedin.com/in/some-profile/')

• scrapedin(options)

  • options Object:
    • email: LinkedIn login e-mail (required)
    • password: LinkedIn login password (required)
  • returns: Promise of profileScraper function

• profileScraper(url, waitTimeMs = 500)

  • url string: A LinkedIn profile URL
  • waitTimeMs integer: milliseconds to wait page load before scraping
  • returns: Promise of profile Object

• profile Object:

  {
    profile: {
      name, headline, location, summary, connections
    },
    positions:[
      { title, company, description, date1, date2,
      roles: [
       { title, description, date1, date2 }
      ] }
    ],
    educations: [
      { title, degree, date1, date2 }
    ],
    skills: [
      { title, count }
    ],
    recommendations: [
      { user, text }
    ],
    recommendationsCount: {
      received, given
    },
    recommendationsReceived: [
      { user, text }
    ],
    recommendationsGiven: [
      { user, text }
    ],
    accomplishments: [
     { count, title, items }
    ],
    volunteerExperience: {
      title, experience, location, description, date1, date2
    },
    peopleAlsoViewed: [
      { user, text }
    ]
  }
  

Feel free to contribute. Just open an issue to discuss something before creating a PR.

Apache 2.0