softwareengineeringdaily / sedaily-miner Goto Github PK

Currently some episodes have transcripts, some don't. The transcripts are attached to the episode as PDF like here.

It would be nice to have a way to associate the transcript text with the text in a post. This would be great for SEO.

Related to Wordpress images are loaded over http instead of https.

We will often change a WordPress post within the 5 days following its release. The miner should check for these.

🚨 You need to enable Continuous Integration on all branches of this repository. 🚨

To enable Greenkeeper, you need to make sure that a commit status is reported on all branches. This is required by Greenkeeper because it uses your CI build statuses to figure out when to notify you about breaking changes.

Since we didn’t receive a CI status on the greenkeeper/initial branch, it’s possible that you don’t have CI set up yet. We recommend using Travis CI, but Greenkeeper will work with every other CI service as well.

If you have already set up a CI for this repository, you might need to check how it’s configured. Make sure it is set to run on all new branches. If you don’t want it to run on absolutely every branch, you can whitelist branches starting with greenkeeper/.

Once you have installed and configured CI on this repository correctly, you’ll need to re-trigger Greenkeeper’s initial pull request. To do this, please delete the greenkeeper/initial branch in this repository, and then remove and re-add this repository to the Greenkeeper integration’s white list on Github. You'll find this list on your repo or organization’s settings page, under Installed GitHub Apps.

SoftwareEngineeringDaily/software-engineering-daily-api#274

We want to put the WordPress posts in a schema that is easier for miner to scrape.

The minimum steps for this seem to be:

• Put the description in its own HTML tag that is consistent every time
• Put the ads in its own HTML tag that is consistent every time
• Put the transcript section in its own HTML tag that is consistent every time

Dwarf Fortress episode missing image.

This causes issues when trying to use this backend for dev work.

I can look into it this. In prod it is (several elements omitted):

"author": {
            "name": "Software Daily",
            "username": "SoftwareDaily"
}

For example, this page should automatically see this link: https://blog.acolyer.org/2016/04/21/the-amazing-power-of-word-vectors/

then grab the title of the post so that it appears like on https://www.softwaredaily.com/post/59b9d4b60b3fde560aa0fbe7/Word2Vec-with-Adrian-Colyer

addTags.js doesn't seem to finish.