liyue201 / grpc-lb Goto Github PK

View Code? Open in Web Editor NEW

311.0 18.0 80.0 3.38 MB

gRPC service discovery and load balancing library for go

Go 100.00%

grpc-lb's Introduction

This repo is no longer maintained

grpc-lb

This is a gRPC load balancing library for go.

Feature

supports Random, RoundRobin, LeastConnection and ConsistentHash strategies.
supports etcd,consul and zookeeper as a registry.

Example

package main

import (
	etcd "github.com/coreos/etcd/client"
	"github.com/liyue201/grpc-lb/balancer"
	"github.com/liyue201/grpc-lb/examples/proto"
	registry "github.com/liyue201/grpc-lb/registry/etcd"
	"golang.org/x/net/context"
	"google.golang.org/grpc"
	"log"
	"time"
)

func main() {
	etcdConfg := etcd.Config{
		Endpoints: []string{"http://10.0.101.68:2379"},
	}
	registry.RegisterResolver("etcd", etcdConfg, "/backend/services", "test", "1.0")

	c, err := grpc.Dial("etcd:///", grpc.WithInsecure(), grpc.WithBalancerName(balancer.RoundRobin))
	if err != nil {
		log.Printf("grpc dial: %s", err)
		return
	}
	defer c.Close()

	client := proto.NewTestClient(c)
	for i := 0; i < 500; i++ {

		resp, err := client.Say(context.Background(), &proto.SayReq{Content: "round robin"})
		if err != nil {
			log.Println(err)
			time.Sleep(time.Second)
			continue
		}
		time.Sleep(time.Second)
		log.Printf(resp.Content)
	}
}

see more examples

Stargazers over time

grpc-lb's People

Contributors

Stargazers

Watchers

Forkers

webmi qizexi cluo hetian9288 vinsberg wwq2333 chinapcc edwardhey listr0ng lgweix lgwei trevor627 xlwh ymcvalu tony1991 s0x06 zwx-zsy rayzhoull 06wagon hotion suyanlong dubbo-x gorexlv flike qingcloudhx trendingtechnology lanrion xmge avolili huntsman-li dk-lockdown a617505352 ikaiguang wccms zhanglei iwangzz godeps lukashes linfangrong wqx0532 anjiawei1991 ygliu1847 yidwang fengberlin randydom quan-xie dcb-server basic-components ningeekw zhang1993 lingling1420q jimilong opvexe liusiming0001 lightpaw kalidorob leaf-rain iwanbk isgasho uuyunque tienthanh1993 gqcn wangzeping722 jofen-mn shangm2 lxkaka shapled shen-xianpeng undertreetech hzlpypy xinjiayu xulimeng3306 vamdt loric tomasmule2015 18318553760 bochuxt cctip gjmzj zhangxuanru

grpc-lb's Issues

错误的ticker时间

registry/etcd3/registrar.go第95行的ticker的时间，经过NewRegistrar赋值时的/ time.Second操作后，已经变成ms了，导致下面这个ticker的间隔时间成了2ms（我不确定你是不是想要2ms这个效果，应该不需要这么快吧）。

ticker := time.NewTicker(e.ttl / 5)

建议改成这样

ticker := time.NewTicker(e.ttl * time.Second / 5)

更换etcdv3 客户端实现

CoreOS上的etcd3客户端实现看项目描述已经过期....说让用官方库

无法编译

go.md

module example_go_grpc

go 1.14

require (
	github.com/Microsoft/go-winio v0.4.15 // indirect
	github.com/containerd/containerd v1.4.3 // indirect
	github.com/coreos/etcd v3.3.18+incompatible
	github.com/docker/distribution v2.7.1+incompatible // indirect
	github.com/docker/docker v20.10.0-rc1.0.20201130225557-ca520bd1b807+incompatible
	github.com/docker/go-connections v0.4.0 // indirect
	github.com/docker/go-units v0.4.0 // indirect
	github.com/golang/protobuf v1.4.2
	github.com/gorilla/mux v1.8.0 // indirect
	github.com/liyue201/grpc-lb v0.0.0-20201117062843-867c3e20933f
	github.com/moby/term v0.0.0-20201110203204-bea5bbe245bf // indirect
	github.com/morikuni/aec v1.0.0 // indirect
	github.com/opencontainers/go-digest v1.0.0 // indirect
	github.com/opencontainers/image-spec v1.0.1 // indirect
	github.com/sirupsen/logrus v1.4.2
	github.com/small-tk/pathlib v0.0.0-20190601032836-742166d9b695
	github.com/spf13/pflag v1.0.3
	github.com/spf13/viper v1.4.0
	github.com/xeipuuv/gojsonschema v1.2.0
	google.golang.org/grpc v1.31.1
	gotest.tools/v3 v3.0.3 // indirect
)

# github.com/coreos/etcd/clientv3/balancer/resolver/endpoint
..\..\..\go\pkg\mod\github.com\coreos\[email protected]+incompatible\clientv3\balancer\resolver\endpoint\endpoint.go:114:78: undefined: resolver.BuildOption
..\..\..\go\pkg\mod\github.com\coreos\[email protected]+incompatible\clientv3\balancer\resolver\endpoint\endpoint.go:182:31: undefined: resolver.ResolveNowOption
# github.com/coreos/etcd/clientv3/balancer/picker
..\..\..\go\pkg\mod\github.com\coreos\[email protected]+incompatible\clientv3\balancer\picker\err.go:37:44: undefined: balancer.PickOptions
..\..\..\go\pkg\mod\github.com\coreos\[email protected]+incompatible\clientv3\balancer\picker\roundrobin_balanced.go:55:54: undefined: balancer.PickOptions
PS C:\Users\hsz12\WORKSPACE\service\example-go-grpc>

cannot support etcd api v3

clentv3 use lease replace ttl, keepalive instead of refresh ttl,

where put a value to a exist key,will cause "read-only range request took too long (120.66575ms) to execute" error,

by solve this question, should modify etcd3/registry.go file, use KeepAlive method replace put when key exist

baseSelector Add方法

for _, v := range b.addrs {                                                                                                                                                                                    
     if addr.Addr == v {                                                                                                                                                                                        
         return AddrExistErr                                                                                                                                                                                    
     }                                                                                                                                                                                                          
 }                                                                                                                                                                                                              
      此处判断是否已存在的时候,使用 if _, ok := b.addrMap[addr.Addr]; ok {return AddrExistErr}

还有为什么不用加锁

close addrsChan?

should close addrsChan when watcher close?

how to use etcd client v3

how to use etcd client v3 ?
It only can use grpc under v1.26.0
Thanks

grpc-lb/registry/etcd3/watcher.go中发现两个bug

第46~48行在for range中对迭代变量取地址：

for _, v := range addrs {
    v := v    //添加一行fix问题
    updates = append(updates, &naming.Update{Op: naming.Add, Addr: v.Addr, Metadata: &v.Metadata}) //错误处：updates中的所有元素的Metadata都将指向最后的一个元素的Metadata
}

在69和77行之后，应该加上return语句，否则Next函数将卡在这里

官方版本好像没有BuildOption了，可以更改为BuildOptions吗？

grpc-lb/registry/zookeeper/resolver.go

Line 17 in fcece95

    
           func (r *zkResolver) Build(target resolver.Target, cc resolver.ClientConn, opts resolver.BuildOption) (resolver.Resolver, error) {

想加入这个项目

感觉项目挺好的，想加入项目，有没有什么可以做的呢

Support grpc newest balancer interface?

https://github.com/grpc/grpc-go/blob/master/balancer/balancer.go

least_connection_x

使用 least_connection_x 得时候链接一直堵塞是什么原因呢？

all goroutines are asleep

如果 zk 服务一直连不上的话，此函数永远不会退出

line: https://github.com/liyue201/grpc-lb/blob/master/registry/zookeeper/registrar.go#L41

etcd v3.3.18+ relay on grpc 1.26.0, how could install package using go mod tidy?

etcd: go.mod file

https://github.com/etcd-io/etcd/blob/master/go.mod

自定义负载均衡策略怎么实现

比如 proto 里有个account字段，我要根据服务个数取模调用对应的服务。
即：我需要解析请求后根据请求字段确定请求转发的服务
请问这个需求怎么实现，在哪实现
🙆🙆🙆🙆🙆

版本问题