Code Monkey home page Code Monkey logo

eastwatch's Introduction

EastWatch - Video Search Microservice

Search microservice designed for low-latency full-text search across multiple fields. Backed by ElasticSearch. Updates and deletes handled via SQS Message Bus.

Boundaries

Microservice:

  • publishes client-facing search endpoint
  • writes search-relevant events to SQS for Events service
  • handles video updates, creates, deletes via SQS

Tech Stack

  • Koa-backed Node server, deployed to AWS EC2
  • ElasticSearch
  • Redis
  • Testing: Mocha/Chai with Instanbul for coverage
  • Monitoring: New Relic, StatsD

Table of Contents

  1. Usage
  2. Requirements
  3. Development
    1. Installing Dependencies
    2. Tasks

Usage

Some usage instructions

Testing

Loading queue node data_generation/loadQueue.js Check Queue node server/controllers/helpers/test.js Update & Delete node server/controllers/helpers/test.js

Setting up Elastic Search

In Kibana delete search: DELETE /bettersearch

Add new mappings () PUT /bettersearch ...followed by the schema.js JSON object

Can also curl:

 http://localhost:9200/bettersearch/ \
 -H 'content-type: application/json' \
 -d ``` 
...followed by mappings

Upload data

`curl -H 'Content-Type: application/x-ndjson' -XPOST 'localhost:9200/bettersearch/video/_bulk?pretty' --data-binary @v2.json`

Test
```GET /bettersearch/_search
 { 
    "query": {
      "match": {
       "title": "peace"
     }
   }
 }```

## Requirements

- Node 6.9.x
- Redis 3.2.x
- Postgresql 9.6.x
- etc

## Other Information

(TODO: fill this out with details about your project. Suggested ideas: architecture diagram, schema, and any other details from your app plan that sound interesting.)

eastwatch's People

Contributors

gingeranyhow avatar

Stargazers

 avatar  avatar

Watchers

 avatar  avatar

Forkers

ajunlonglive

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.