xbc5 / sumo Goto Github PK
View Code? Open in Web Editor NEW[WIP] An RSS feed reader
License: MIT License
[WIP] An RSS feed reader
License: MIT License
Use selectors to parse a source into a generic interface (#5) -- e.g. like the one used for RSS.
Treat these as distinct, such that the user can tag and filter for shorts or live streams.
These should have their own type associated with it (#5), and conform to the generic interface (#5). This allows users to specify their on scraping rules (#6) for custom websites (e.g. Twitch).
Not all topics/people have a dedicated or official channel. Create a feature that subscribes to search results.
Some caveats:
For both caveats we should use a caching mechanism, whether it's the database, or the file system. Regardless, this will result in a two-stage process, which may contradict the generic feed interface (#5). The feed interface will expect a one-shot, fetch and format process; but the two-stage process will require 1) perform the search, 2) for each result, check the cache, if it misses, then fetch. Additionally, this will make another request to pull the item using the scraper approach (#6).
In conclusion, #5 will need to abstract the search, caching mechanism, and the scraping of each item. Only then that we can create/emit the finished feed type.
In short: scrape YouTube search for URLs; filter only new items, then scrape each one.
Use selectors to parse a source into a generic interface (#5) -- e.g. like the one used for RSS.
That can trigger on specific events:
Use a pipeline. Make fetching the feed somewhere near the start of it, and after it's fetched, apply custom user tags to both the feed and articles.
This application will depend on user set rule:
So that users can provide rules for parsing custom pages
One interface, for the above contexts + RSS.
Allow users to specify a predefined content type (#8) -- e.g. LiveStream
, ShortVOD
(aka short), Article
, LongVOD
. This is for filtering, and organisation -- for example, a YouTube channel has one URL, but possibly multiple feeds (uploads/live stream/shorts). This is hard and error prone to tag, and needs to be specified at rule creation time.
The client can apply ordinary tagging: by source, key words, and/or by type. This allows users to create complex rules to organise their feeds.
No description provided.
Use pubsub so that it will also relay errors to the client
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.