Code Monkey home page Code Monkey logo

milvus's Introduction

Milvuslogo

LICENSE Language codebeat badge

Welcome to Milvus

What is Milvus

Milvus is an open source similarity search engine for massive feature vectors. Designed with heterogeneous computing architecture for the best cost efficiency. Searches over billion-scale vectors take only milliseconds with minimum computing resources.

Milvus provides stable Python, Java and C++ APIs.

Keep up-to-date with newest releases and latest updates by reading Milvus release notes.

  • Heterogeneous computing

    Milvus is designed with heterogeneous computing architecture for the best performance and cost efficiency.

  • Multiple indexes

    Milvus supports a variety of indexing types that employs quantization, tree-based, and graph indexing techniques.

  • Intelligent resource management

    Milvus automatically adapts search computation and index building processes based on your datasets and available resources.

  • Horizontal scalability

    Milvus supports online / offline expansion to scale both storage and computation resources with simple commands.

  • High availability

    Milvus is integrated with Kubernetes framework so that all single point of failures could be avoided.

  • High compatibility

    Milvus is compatible with almost all deep learning models and major programming languages such as Python, Java and C++, etc.

  • Ease of use

    Milvus can be easily installed in a few steps and enables you to exclusively focus on feature vectors.

  • Visualized monitor

    You can track system performance on Prometheus-based GUI monitor dashboards.

Architecture

Milvus_arch

Get started

Hardware Requirements

Component Recommended configuration
CPU Intel CPU Haswell or higher
GPU NVIDIA Pascal series or higher
Memory 8 GB or more (depends on data size)
Storage SATA 3.0 SSD or higher

Install using docker

Use Docker to install Milvus is a breeze. See the Milvus install guide for details.

Build from source

Software requirements

  • Ubuntu 18.04 or higher
  • CMake 3.14 or higher
  • CUDA 10.0 or higher
  • NVIDIA driver 418 or higher

Compilation

Step 1 Install dependencies
$ cd [Milvus sourcecode path]/core
./ubuntu_build_deps.sh
Step 2 Build
$ cd [Milvus sourcecode path]/core
$ ./build.sh -t Debug
or 
$ ./build.sh -t Release

When the build is completed, all the stuff that you need in order to run Milvus will be installed under [Milvus root path]/core/milvus.

Launch Milvus server

$ cd [Milvus root path]/core/milvus

Add lib/ directory to LD_LIBRARY_PATH

$ export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/path/to/milvus/lib

Then start Milvus server:

$ cd scripts
$ ./start_server.sh

To stop Milvus server, run:

$ ./stop_server.sh

To edit Milvus settings in conf/server_config.yaml and conf/log_config.conf, please read Milvus Configuration.

Try your first Milvus program

Run Python example code

Make sure Python 3.5 or higher is already installed and in use.

Install Milvus Python SDK.

# Install Milvus Python SDK
$ pip install pymilvus==0.2.3

Create a new file example.py, and add Python example code to it.

Run the example code.

# Run Milvus Python example
$ python3 example.py

Run C++ example code

 # Run Milvus C++ example
 $ cd [Milvus root path]/core/milvus/bin
 $ ./sdk_simple

Run Java example code

Make sure Java 8 or higher is already installed.

Refer to this link for the example code.

Contribution guidelines

Contributions are welcomed and greatly appreciated. If you want to contribute to Milvus, please read our contribution guidelines. This project adheres to the code of conduct of Milvus. By participating, you are expected to uphold this code.

We use GitHub issues to track issues and bugs. For general questions and public discussions, please join our community.

Join the Milvus community

To connect with other users and contributors, welcome to join our slack channel.

Milvus Roadmap

Please read our roadmap to learn about upcoming features.

Resources

Milvus official website

Milvus docs

Milvus bootcamp

Milvus blog

Milvus CSDN

Milvus roadmap

License

Apache 2.0 license

milvus's People

Contributors

jinhai-cn avatar yhmo avatar xupeng-sh avatar youny626 avatar fishpenguin avatar jeffoverflow avatar tinkerlin avatar wxywb avatar cydrain avatar jielinxu avatar milvus-ci-robot avatar sre-ro avatar xuanyang-cn avatar del-zhenwu avatar dependabot[bot] avatar yukikaze-czr avatar

Watchers

James Cloos avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.