beetlex-io / beetlex Goto Github PK

我使用hp-socket的client发送过来数据，但是解析的时候解析不出来，是什么问题呢？

class Program: ServerHandlerBase
    {
        private static IServer server;
        static void Main(string[] args)
        {
            
            server = SocketFactory.CreateTcpServer<Program>();
            server.Open();
            Console.Write(server);
            Console.Read();

            Console.WriteLine("Hello World!");
        }

        public override void SessionReceive(IServer server, SessionReceiveEventArgs e)
        {
            string name = e.Stream.ToPipeStream().ReadLine();
            Console.WriteLine("receive:");
            Console.WriteLine(name);
            e.Session.Stream.ToPipeStream().WriteLine("hello" + name);
            e.Session.Stream.Flush();
            base.SessionReceive(server, e);
        }
    }

add LineBase and EofBase packet

你的例子中,客户端和服务端都是用的beetleX自己的来做的解析和封装.
现在我想建立一个服务端,客户端可能是各种平台各种语言的,
该用什么方式来创建.?
我一直没找到协议解析相关的.
譬如我收到一个字节数组data,
第一个字节是header,第二个字节是功能,第三个字节表示数据长度,第4个字节到N个,表示数据等等
如是创建????

Create buffer error, maximum number of buffer pools!
at BeetleX.Buffers.BufferPool.CreateBuffer()
at BeetleX.Buffers.BufferPool.Pop()
at BeetleX.Buffers.SslStreamX.SyncData()
at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state)
--- End of stack trace from previous location where exception was thrown ---
at System.Threading.ThreadPoolWorkQueue.Dispatch()

感觉帮助文档不够全，请问以后会不会有像http://docs.supersocket.net/类似的详细使用文档？

First of all thank you for your contribution. I need a tcp server capable of tolerating 100,000 connected users concurrently. Could you give me an example based on your code? I also need to send a response to each of the connected users

您好，请问下BeetleX可以实现MQTT高并发的应用吗

请问有交流群吗？

如题，有没有UDP/MQTT协议的WebApi支持及其服务管理？
我看了文档，貌似只有TCP/HTTP/HTTPS/WebSocket。
老大，有没有这方面的计划呢？

在接口列表中显示的都是url地址，如果接口列表比较多的时候去查找某个接口比较不方便

你好，我准备使用你这个组件来重构一个基于Tcp协议的日志收集Server。服务端读取数据是如下写的：

public override void SessionReceive(IServer server, SessionReceiveEventArgs e)
        {
            var pipeStream = e.Stream.ToPipeStream();
            string name = pipeStream.ReadLine();
            Console.WriteLine(name);
            base.SessionReceive(server, e);
        }

就是你Readme中的写法。

服务端采用的是BeetleX，客户端采用的是C# TcpClient对象，我发现如果我在发送数据的时候如果使用“\n”来分隔每条数据，那么服务端的ReadLine就无法正确读取，如果改成 '\r\n'才行，我猜测ReadLine内部应该使用了服务端运行环境的换行符（没看源码只是猜测）。以上测试环境均为Windows 10。

但是我现在有个需求就是部署在Linux下的API Gateway发送过来的日志数据每条的分隔符为'\n'，我现在如何解决ReadLine这个问题呢。

泥水大哥好:
Stream.ToPipeStream().ReadString(4)、ReadInt()是否有实现类似netty的get read相关索引规则,比如每次readInt，索引增加是数组下标索引,下一次读取从最新位开始?

如何限制最大连接数？

我子啊用beetleX测试，AsyncTcpClient当server主动断开时(比如sessionTimeOut到期)，会接受到并关闭掉；tcpClient当server主动断开时(比如sessionTimeOut到期)，还是保持连接状态，下次发送命令才会发现与主机断开。请教下这块该怎么设计呢。当网络断开或者服务端掉线了，tcpClient获知断开。

如果出现这错误，可以尝试修改使用X509Certificate2

我前段时间关注作者的BeetleX组件很久了，因为使用了Bumblebee做netcore的网关转发，特别看重网关配置的管理插件Configuration；同时也发现作者相关的性能呢测试对比，加上开源就没有再自造轮子。昨天产品做集成测试发现压力还不到几百个网关转发请求，就连续出现“session send queue overflow!”的错误，然后中止了连接。

不知道如何调整，还是不敢轻易使用该组件啊

“.”会被解析成“\”；
例：文件“/static/css/main.b0e5dc35.css.map” 在加载时会被解析为“/static/css/main/b0e5dc35/css.map”

PipeStream添加Write(char[] data,int offset,int count)和Write(StringBuilder data)

接口返回能展示位格式化的json数据

现有的异步Client是通过事件来处理方法，添加AwaiterClient类用于支持异步client的

await receive()

来接收消息

First of all client.Read() doesn't exist, so I used client.Receive(), shown in the code below.

However, I keep getting the first thing read from the server every time, but the server is sending different data on each call.

Is there something I'm doing wrong? Do I need to clear out a buffer or something?

// send to server
client.Stream.ToPipeStream().WriteLine(Newtonsoft.Json.JsonConvert.SerializeObject(value));
client.Stream.Flush();

// Wait for a response
var reader = client.Receive();
var ret = reader.ToPipeStream().ReadLine();
return ret;

BTW, I use a static client, I don't get a new one each time, which worked fine in the Async version.

需要在SessionReceive中获取设备上传上来的以指定byte[]（如：new byte[]{0x0D,0x0A}）为分隔的字节数组数据。

public override void SessionReceive(IServer server, SessionReceiveEventArgs e)
{
        //类似于实现ReadBytes(byte[] eof)
        var data= e.Stream.ToPipeStream().ReadBytes(new byte[] { 0x0D, 0x0A });
         //.........
}

然后我在PipeStream.cs添加了如下方法：

  /// <summary>
        /// 读取字节数据
        /// </summary>
        /// <returns></returns>
        public byte[] ReadBytes(int length)
        {
            if (length == 0)
                return new byte[0];
            IBuffer rbuffer;
           //暂时不考虑跨平台的代码兼容
            ArraySegment<byte> data;
            byte[] byteSpan = mCacheBlock;

            //要获取的长度小于缓存固定长度时处理的逻辑
            if (length < mCacheBlockLen)
            {
                rbuffer = GetAndVerifyReadBuffer();
                int freelen = rbuffer.Length - rbuffer.Postion;
                if (freelen > length)
                {
                    data = rbuffer.Read(length);
                    ReadAdvance(length);
                    return data.Array;
                }
            }
            
            int rlen = 0;
            while (length > 0)
            {
                if (length > mCacheBlockLen)
                    rlen = mCacheBlockLen;
                else
                    rlen = length;
                rbuffer = GetAndVerifyReadBuffer();
                int freelen = rbuffer.Length - rbuffer.Postion;
                if (freelen > rlen)
                {
                    data = rbuffer.Read(rlen);
                }
                else
                {
                    data = rbuffer.Read(freelen);
                }

                ReadAdvance(data.Count);
                length -= data.Count;           

            }

            return data.Array;
        }

        /// <summary>
        /// 尝试读取数据
        /// </summary>
        /// <param name="eof">结束标识</param>
        /// <param name="value">读取到的byte[]数据</param>
        /// <param name="returnEof">返回时是否包含结束标识</param>
        /// <returns></returns>
        public bool TryReadWith(byte[] eof, out byte[] value, bool returnEof = false)
        {
            value = new byte[0];
            IndexOfResult result = IndexOf(eof);
            int length = result.Length;
            value = new byte[length];
            if (result.End != null)
            {
                if (result.Start.ID == result.End.ID)
                {
                    if (result.Length < mCacheBlockLen)
                    {
                        Array.Copy(result.Start.Bytes,0, value, 0, length);
                        ReadFree(length);
                    }
                    else
                    {
                        value = ReadBytes(length);
                    }
                }
                else
                {
                    if (returnEof)
                    {
                        value = ReadBytes(result.Length);
                    }
                    else
                    {
                        value = ReadBytes(result.Length - eof.Length);
                        Read(eof, 0, eof.Length);
                    }
                }

                return true;
            }
            return false;
        }

然后在SessionReceive中这样写：

        public override void SessionReceive(IServer server, SessionReceiveEventArgs e)
        {
            byte[] result;
            if (e.Stream.ToPipeStream().TryReadWith(new byte[] { 0x0D, 0x0A },out result,true))
            {
                if (result[0] == 0xFA && result.Length == 14 )
                {
                    Console.WriteLine("获取得到了设备代码数据！");
                }
            }
           
        }

.net core 可以运行在Linux。
针对IOCP, linux 也可以用？
谢谢

private Type GetType(string typeName)
{
Type result;
if (!mNameTypes.TryGetValue(typeName, out result))
{
if (typeName == null)
throw new BXException("{0} type not found!", typeName);
result = Type.GetType(typeName);
if (result == null)
throw new BXException("{0} type not found!", typeName);

            mNameTypes[typeName] = result;
        }
        return result;
    }

这一句 是不是有点多余

if (typeName == null)
throw new BXException("{0} type not found!", typeName);

ConcurrentDictionary<string, Type> 好像不能把null 当key

https://github.com/dotnet/corefx/issues/33794
请问，该问题在.net core 3.0中是否已修复？

new ServerOptions() { BufferSize = 1024000 }

这个参数BufferSize 设置完；
怎么判断 是否接收完毕?

BeetleX 版本1.3.2
BeetleX demo默认设置
[11:01:40] [Error] session [::ffff:127.0.0.1]:57980@38 error receive data completed SocketError Success!@create buffer error, maximum number of buffer pools!
at BeetleX.Buffers.BufferPool.CreateBuffer()
at BeetleX.Buffers.BufferPool.Pop()
at BeetleX.TcpServer.BeginReceive(ISession session)
at BeetleX.TcpServer.ProcessReceiveArgs(SocketAsyncEventArgs e)
at BeetleX.TcpServer.ReceiveCompleted(SocketAsyncEventArgs e)
使用TCP_UDP_PerformanceTest测试,只开一个连接的情况下持续发送数据,一段时间后BeetleX 也报错,debug下BufferPool里的mCount计数一直累加,直到超过mMaxCount

您好！我在使用你的工具对我的TCPServer进行测试过程中有个问题：创建1000 Client，每隔1s发送。我发送20s后，就关闭连接。针对有应答的测试模式，那么Server的消息还没来得急应答client就关闭了，这样是否也能表征出server的性能呢？谢谢

In the AsyncTcpClient, listening is via the client.DataReceive event.

I would prefer to use the async version, but I can't await for a result, if there's a way, I'd like to know.

If not, is there a way to listen for data coming from the server in the TcpClient?

由于部分Session是没有完成SSL验，这个时候如果向这些Session发消息会导致SSL验证失败会话关闭，解决这个问题要在Connected加上一个标记如session["SSLCompleted"]=true;在广播之前判断一下这个标签，如果这个标签为则未完成SSL验证，不能向session广播消息。

SpanJson.JsonSerializer.NonGeneric.Utf8.SerializeToArrayPool(data)
报错：
Operation is not valid due to the current state of the object
堆栈：
at lambda_method(Closure , JsonWriter1& , MsgType ) at SpanJson.Formatters.EnumStringFormatter3.Serialize(JsonWriter1& writer, T value) in C:\projects\spanjson\SpanJson\Formatters\EnumStringFormatter.cs:line 23 at lambda_method(Closure , JsonWriter1& , MessageContent )
at SpanJson.Formatters.ComplexClassFormatter3.Serialize(JsonWriter1& writer, T value) in C:\projects\spanjson\SpanJson\Formatters\ComplexClassFormatter.cs:line 32
at lambda_method(Closure , Object )
at SpanJson.JsonSerializer.NonGeneric.Inner`2.InnerSerializeToByteArrayPool(Object input) in C:\projects\spanjson\SpanJson\JsonSerializer.NonGeneric.cs:line 68
at SpanJson.JsonSerializer.NonGeneric.Utf8.SerializeToArrayPool(Object input) in C:\projects\spanjson\SpanJson\JsonSerializer.NonGeneric.cs:line 485
at BeetleXServer.Models.JsonPacket.OnWrite(ISession session, Object data, PipeStream stream) in L:\VSDemo\NetCoreBeetleXServer\BeetleXServer\BeetleXServer\Models\JsonPacket.cs:line 40
at BeetleX.Packets.FixedHeaderPacket.OnEncode(ISession session, Object data, Stream stream)
at BeetleX.Packets.FixedHeaderPacket.Encode(Object data, ISession session, Stream stream)
at BeetleX.TcpSession.WriterData(Object data, Stream stream)
at BeetleX.TcpSession.ProcessSendMessages()
at BeetleX.TcpSession.Send(Object data)
at BeetleX.TcpServer.Send(Object data, ISession session)

TcpClient client = SocketFactory.CreateClient("127.0.0.1", 9090);
client.Stream.ToPipeStream().WriteLine("aaaaaaaa");
client.Stream.Flush();
//System.Threading.Thread.Sleep(100);
client.Stream.ToPipeStream().WriteLine("bbbbbbb");
client.Stream.Flush();

在服务端第一次启动时，客户端连续发送两条数据必须sleep，否则服务端只能收到一条；奇怪的是在不关闭服务端的情况下，再次启动客户端即使没有sleep也能正常收到两条数据的。

在使用FasthttpAPI时候 都会报一个
[11:27:55] [Warring] no serverGC mode,please enable serverGC mode!
请问这个是服务器没有开启资源回收么？这种情况是否会有内存泄漏的问题。另外如果要开的话如何开启呢。

Release the buffer remain idle for a long time

在nuget安装的包 不存在NetConfig类，其他类还没有测试。

1、https 协议请求报 400 The plain HTTP request was sent to HTTPS port
2、可以在接口列表中显示描述或接口名称，因为现在显示的是url 如果接口比较多 查找某一个接口会不方便
3、接口返回的json数据可以显示为格式化后的json数据

AsyncTcpClient的IO_Completed存在不触发错误事件情况

If the session creation buffer exceeds the maximum value, it should be closed

客户端设置： ClientAsnyc.LocalEndPoint = new IPEndPoint(IPAddress.Any, 9110);

比较看重性能相比kestre优越。
但是又想用到netcore web middleware的生态。
所以请问下能否实现成一个Server来替换Kestre呢，如下：

Why did you break your own naming logic?

See line 23
in master/samples/TCP.SSL/Messages/JsonPacket.cs
you wrote
protected override object OnReader(ISession session, PipeStream stream)
but it should be
protected override object OnRead(ISession session, PipeStream stream)

TCP/IP协议，数据包(不包含协议头)，我记得和大端小端无关吧？
请教一下作者，设计这个大端小端的意义是什么呢？

给AsyncTcpClient的Connect方法添加一个输出参数，用于返回当前Connect是否有创建连接。
public bool Connect(out bool newConnection)

IBuffer添加发送完成事件，主要方便处理一些特别的需求场景。

Hello!

See line 26 in
master/samples/TCP.SSL/Client/Program.cs

it should be
register.Password = Console.ReadLine();
not register.City