Comments (5)
So, after talking with @Ly0n about the scope of this specific part of the project, heres my 2 cents:
My main problem with this use case would be a whitelist search for topics/keywords. If you need to find keywords and topics and match them to existing ones in a database to find out what the project you are analysing is really about, you have failed.
0.) Provide a service that does the stuff below and analyses a git project
1.) Preprocess readme (not only abstract, but every relevant text)
2.) Use Bert (AI), to find metrics keywords/technologies used as well topic classifications
3.) Define heuristics for high correlation topics as well "side" topics
4.) Feed analysis (project Meta Info + ai content info) into a database for further tools, that can utilize this information (big graph with all projects and their best for topics/technologies used etc)
Sounds like a doable (first shot) use case (without magic bloat), while simultaneously allowing to further experiment with what we really want to do here :)
from open-sustainable-technology.
This would be fascinating to explore; I could see trying to either leverage the data from the landscape directly for this model or look at how to have this be a landscape feature.
from open-sustainable-technology.
Thanks @kikass13. In the first step, this would be exactly what you are describing. Theoretically, it should be possible to check every new open source project for sustainability issues. Ecosyste.ms records all open source projects anyway. If we filter them on certain basic criteria, it could be possible to capture a large part of the new open source projects in this area with little calculation effort. I am currently in contact with AI experts in this field who might be able to assist us here.
We should aim for a workshop in early September to clarify the main points.
from open-sustainable-technology.
If the analysis is easy/cheap to run I'd be up for attempting to run it on many projects and store the results against each one and then allow filtering by the results.
from open-sustainable-technology.
We have to learn, which kind of metric / information is needed for later analysis, therefore processing / databasing the info of every project separately is key (and should not take that long) ... The problem is, that we will probably need some (multiple) iterations per project, as we don't know what we need. Also projects change over time, so re iteration is necessary :)
So I guess my point is: we need a working mockup implementation and see how this would look / work (you already have a notebook as a starting point). I will look at that stuff starting September and fool around with Bert for a bit :)
from open-sustainable-technology.
Related Issues (20)
- Future of the Education Dataset HOT 3
- Automatically add contributors to CITATION.cff HOT 12
- Global weather forecasting - GraphCast HOT 4
- Create Open Sustainability Wikipedia Article
- Launch a new landing page and campaign for getting more contributors involved HOT 5
- TimeGPT HOT 1
- Improve Clustering of Projects HOT 7
- Publication of a new dataset based on manual investigation HOT 2
- Funding for OpenSustain.tech HOT 4
- Host a public community event to discuss further steps for OpenSustain.tech
- Weather forcasts: Graphcast, Metnet3 HOT 1
- Label projects based on the end user
- Remove Repos that are not Open Source HOT 1
- Find and implement new useful features provided by website framework
- Create a large hexagon with all the R hexagons by using the URL as filter HOT 3
- Blog articles for this year HOT 2
- Add a "Join the Community" area HOT 2
- Create an "Open Sustainable Technology" browser extension
- Add Scheffler Reflector (Parabolic Concentrated Solar Energy) HOT 8
- OpenClimate.fund HOT 5
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from open-sustainable-technology.