snek-at / intel Goto Github PK
View Code? Open in Web Editor NEWIntel serves as the ๐ of SNEK. Intel is the central data processing system for SNEK, providing interfaces to connect our other systems.
License: Other
Intel serves as the ๐ of SNEK. Intel is the central data processing system for SNEK, providing interfaces to connect our other systems.
License: Other
Describe the feature or change you'd like
There should be an option to check if the branch was used for updating the code documentation.
Describe the feature or change you'd like
Currently there is no way to get information about which platforms a user has connected.
It should be possible to get a statistic about the source types which should include the platform name and the total platforms.
E.g: name: "Github", total: 5 --> The user has five GitHub platforms connected.
Describe the feature or change you'd like
Currently when attaching a source list with mixed Github and Gitlab orders, the source objects are attached by order. Since the basic data of the profile should be taken from a github source object, these must also be appended first.
To achieve this following changes are required:
Describe the bug
Currently it is not possible to build a package because OAuth uses a JSON config file which leads to an error because resolving json modules is not activated.
To Reproduce
Steps to reproduce the behavior:
Expected behavior
It should build without errors.
Additional context
Describe the feature or change you'd like
The GitHub module should provide a converter which uses the models to fill the database with raw data.
Describe the feature or change you'd like
Currently there is only a number which represents the contribution types. There should be
a combination of number and percentage e.g size => Share
Describe the feature or change you'd like
There should be abstract statement objects which implement access to the SOAssabmler.
Describe the feature or change you'd like
Currently there is no way to fetch gitlab data from websites. This should be changed.
Describe the feature or change you'd like
Currently the GitHub organizations do not contain a description. This should be implemented.
Describe the feature or change you'd like
Currently the squeezer only supports key filtering. It does not support excluding keys. This functionallity should be added.
Describe the feature or change you'd like
Currently @types/lodash.clonedeep is not located in the development dependencies this should be changed.
Describe the feature or change you'd like
A repository is owned by the organization in which it is located. Therefore, the organization is rendered to the extent that it only contains the data that match a member. Then this rendered organization is saved as the owner.
It is important that the original data of the organization remain.
This does not happen. All data that do not match the member data are deleted during the rendering process. Therefore information like the members of an organisation is lost.
To solve this, a deep copy of a organisation must be made. This is then rendered and used as the owner.
Thus, the original data remain. ๐
Additional context
Ref: https://www.npmjs.com/package/lodash.clonedeep
Describe the feature or change you'd like
There should be a reconstructor which provides basic operations (GET,ALL,FILTER,CREATE).
To achieve general operations for each statement object a SOAssambler which provides these functions and access to the database is required.
Describe the bug
If a user changes his name on GitHub his profile can no longer be found by SNEK.
To Reproduce
Steps to reproduce the behavior:
Expected behavior
The username should be automatically updated using the GitHub access token.
Desktop (please complete the following information):
Smartphone (please complete the following information):
Additional context
Add any other context about the problem here.
Describe the feature or change you'd like
Currently there is an insufficient documentation of the existing code. This should be improved by adding JSdoc to the intel.
Describe the feature or change you'd like
All files should be updated with a new version tag due to the change of the licence agreement.
Additional context
New tag:
...
SPDX-License-Identifier: (EUPL-1.2)
Copyright ยฉ Simon Prast
...
Describe the feature or change you'd like
Currently the reduced object contains a profile, calendar, statistic and language object.
This should be reduced by moving the calendar and language object in the statistic object.
Describe the feature or change you'd like
Currently there are usually no anchors in Intel. Those who exist do not meet the requirements of snek-tonic. Therefore, the package imports should be revised throughout the code.
Additional context
Ref: https://github.com/snek-at/tonic
Describe the bug
OAuth util has implemented a switch which recognises whether you are on localhost or not.
The correct config detail is chosen accordingly. That doesn't work correctly.
To Reproduce
Steps to reproduce the behavior:
Expected behavior
The Github redirect should work on snek and localhost.
Desktop (please complete the following information):
Additional context
Describe the feature or change you'd like
Currently the uniqueness of a user is defined by the username and the platformId. This should be changed to the url to prevent duplicates.
Describe the feature or change you'd like
Due to snek-at/client/pull/21 the GitlabClient is not available anymore and must be changed to a WebClient.
Additional context
Ref: snek-at/client/pull/21
Describe the feature or change you'd like
Currently there is no file upload functionality provided by the intel. We should implement an upload functionality for talks to a specific file hosting service. Maybe anonfiles?
Additional context
Ref: https://github.com/snek-at/prototype-talks
Ref: https://anonfiles.com
Describe the feature or change you'd like
Currently the web scraped data is not processed. This should be changed. The data should be
filled using the OSM models.
Describe the feature or change you'd like
Currently the converters can crash if some specific data is not available. This breaks the whole intel.append() process.
Note to myself: Fix this.
Additional context
Ref: https://github.com/snek-at/intel/blob/implement-1/src/utils/github/converter.ts
Ref: https://github.com/snek-at/intel/blob/implement-1/src/utils/gitlab/converter.ts
Describe the feature or change you'd like
In order to prevent unwanted querying errors e.g due to rate limits a automatic retry functionality is required.
Describe the feature or change you'd like
Currently it is not possible to reset the reducer without resetting the whole intel. This should be changed. It should be possible to reinit the reducer separately.
Describe the feature or change you'd like
Due to the change in the coding guideline on Friday, 8. May 2020 the code should be adjusted over time.
Additional context
Ref: snek-at/tonic/pull/1
Describe the feature or change you'd like
Currently the Github util is fully implemented in javascript. This leads to incompatibility with seek-front which uses typescript. In order to fix that issue the reducer should be converted to typescript.
Describe the feature or change you'd like
There should be a AlaSQL database implemented in the reducer in order to handle the data. Due to that feature it should be easier to merge the data into the needed format.
Describe the feature or change you'd like
Currently there is no util to fetch talks. This should be implemented with the information provided by the prototype.
Additional context
Ref: https://github.com/snek-at/prototype-talks
Describe the feature or change you'd like
Currently there is no interface to the snek-client. In order to query data from GitHub's api, there should be predefined entry point.
Additional context
Describe the feature or change you'd like
Currently the gitlab util is not implemented in the intel. Therefore it cannot be used. It should be implemented in order to support source objects with gitlab as platform type.
Describe the feature or change you'd like
Currently the GitHub oauth request are not handled in intel. It should be changed so that it is handled using the intel.
Is your feature request related to a problem? Please describe.
Minor to major problems with spelling
Describe the solution you'd like
Better English skills
Additional context
I was asked by a colleague to fix this
Describe the bug
The endpoints defined in the paths file of the gitlab util seems to be invalid now. This could be because of Gitlab related updates.
Therefore it is not possible to query a gitlab user via web scraping anymore.
To Reproduce
Steps to reproduce the behavior:
Expected behavior
The requests to the selected gitlab servers should pass without errors.
Additional context
Ref: ๐
Describe the feature or change you'd like
Currently there is no start and end date in the calendar object. This should be implemented
in order to check where the year starts without selecting the first and last calendar entry.
Describe the feature or change you'd like
Currently there is no talk model implemented in the reducer. This should be implemented with the field specified in the talks prototype.
Additional context
Ref: https://github.com/snek-at/prototype-talks
Describe the feature or change you'd like
Currently there Is the default package-template repo url in the readme. This should be changed to the intel repo url.
Describe the bug
The OSM uses the constructor name of a statement object as a reference to the database table name. This variant works without JS JavaScript compression.
After react-script build compresses the code, the OSM can no longer resolve the table names with the help of the model constructor.
To Reproduce
Steps to reproduce the behavior:
Expected behavior
The page should load without errors. The caching must be carried out without falsifying data.
Desktop (please complete the following information):
Additional context
Describe the feature or change you'd like
Currently there is no reducer which can be used to transform raw snek-client data to the needed format. There should be a reducer which takes that data and allows it to get certain types of transformed data blocks.
Additional context
All reducers should contain:
Describe the feature or change you'd like
It should be possible to retrieve the profile query and the calendar query from the GitHub module.
Describe the feature or change you'd like
Currently the reducer is fully implemented in javascript. This leads to incompatibility with seek-front which uses typescript. In order to fix that issue the reducer should be converted to typescript.
Describe the feature or change you'd like
The structure of the intel reducer should be model based. To achieve this implementing a OSM (object statements mapping) is required.
Describe the feature or change you'd like
Currently there is only the owner id in the repository. This should be changed to a member
object.
Describe the feature or change you'd like
There should be a way to hand over a list of source objects and a single source object to intel.
Source object:
user: e.g. "schettn"
authorization: e.g. "xxx"
platform: e.g. "github"
Describe the feature or change you'd like
It is currently not possible to filter organization by platform name. Therefore, all organizations are selected for the process of generating talks, including those from Gitlab. This leads to an error because the talk util currently only works with GitHub organizations.
To achieve this following changes are required:
Describe the feature or change you'd like
The implementation of the GithubClient must be updated due to the changes of the snek-client.
Additional context
Ref: https://github.com/snek-at/client
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.