Code Monkey home page Code Monkey logo

kedata's Introduction

kedata's People

Contributors

beyondliu avatar

Watchers

Li, Xizhi avatar James Cloos avatar placeintime avatar  avatar zhangleio avatar  avatar

Forkers

beyondliu

kedata's Issues

Storage of web scrap content

Where should the content of web scrap be stored? In the previous version, it is stored in desc. If we keep doing so, we cannot simply tell the type of snippets based on its fields and an extra field such as snippet_type needs to be added.

One index per user in ElasticSearch?

Since in git storage, one user's data is stored independently, we might also store users' data on ES independently for each user. ES supports searching across different indices, so regarding searching and sorting it doesn't matter much. The only issue is that latest ES requires index and type to be the same. With ES version such as version 5.6.5 (deployed for testing platform), it still supports different index and type.

Mechanism to merge tags from different users

The current plan is to only keep tag name in es, discarding desc, private, init_time fields that are present for tags in the user space. This approach will lose the capability to do some stats on user data, such as new tags this year.

Implement basic restful api for Tag

Such as tag list, create a tag, get a tag, update a tag, delete a tag. Tag deletion and update will also update snippets that have this tag.

Implement restful api for Snippet and Tag

Build basic restful apis for Snippet and Tag with django-rest framework. The goal is to accomplish the full chain of restful api development with django-rest, yaml files, git and es. So probably only typical data api for Snippet and Tag will be implemented at this stage.

Change to use one yaml file per tag

Previously tags are all stored in one yaml file as multiple documents. However, this causes difficulty in telling change of tag from diff. Since one yaml file per tag is still quite human readable, a decision is made to switch the design to using one yaml file per tag.

Use "Snippet" instead "Significant Experiences" as the technical term

Thinking of using a set of new terms for Knowledge Engine: "Mind" is filled with "Snippets". Snippets are rich snippets, with urls and multimedia attachments. Snippets can be classified as various types depending on its fields, such as bookmarks, web scraps... The classification is not mandatory and is a bit arbitrary. It is up to the apps built on top of snippets to decide whether to use it or not. Some snippets are more experiences in nature, and significant experiences can be used to be built up knowledge that is core to one's understanding of a domain.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.