didi / knowstreaming Goto Github PK

npm ERR! code ELIFECYCLE
npm ERR! errno 2
npm ERR! [email protected] pre-build: cross-env NODE_ENV=production webpack
npm ERR! Exit status 2
npm ERR!
npm ERR! Failed at the [email protected] pre-build script.
npm ERR! This is probably not a problem with npm. There is likely additional logging output above.

npm ERR! A complete log of this run can be found in:
npm ERR! C:\Users\me\AppData\Roaming\npm-cache_logs\2020-09-22T09_09_03_990Z-debug.log

debug.log:
0 info it worked if it ends with ok
1 verbose cli [ 'D:\ware\nodejs\node.exe',
1 verbose cli 'D:\ware\nodejs\node_modules\npm\bin\npm-cli.js',
1 verbose cli 'run',
1 verbose cli 'pre-build' ]
2 info using [email protected]
3 info using [email protected]
4 verbose run-script [ 'pre-build' ]
5 info lifecycle [email protected]pre-build: [email protected]
6 verbose lifecycle [email protected]pre-build: unsafe-perm in lifecycle true
7 verbose lifecycle [email protected]pre-build: PATH: D:\ware\nodejs\node_modules\npm\node_modules\npm-lifecycle\node-gyp-bin;E:\me\github\kafka-manager\console\node_modules.bin;C:\Program Files\WindowsApps\Microsoft.WindowsTerminal_1.2.2381.0_x64__8wekyb3d8bbwe;D:\ware\SecureCRT;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\WINDOWS\System32\WindowsPowerShell\v1.0;C:\Program Files (x86)\Intel\Intel(R) Management Engine Components\DAL;C:\Program Files\Intel\Intel(R) Management Engine Components\DAL;C:\WINDOWS\System32\OpenSSH;D:\ware\TortoiseSVN\bin;D:\ware\PuTTY;D:\ware\Git\cmd;D:\ware\Calibre;D:\ware\nodejs;C:\Program Files (x86)\ZeroTier\One;D:\ware\Go\bin;C:\Program Files\Docker\Docker\resources\bin;C:\ProgramData\DockerDesktop\version-bin;D:\ware\scala12\bin;D:\ware\UltraEdit;C:\Program Files\IDM Computer Solutions\UltraCompare;D:\ware\Python37\Scripts;D:\ware\Python37;D:\ware\Scoop\shims;C:\Users\me\AppData\Local\Microsoft\WindowsApps;D:\ware\Java\jdk1.8\bin;D:\ware\Java\jdk1.8\jre\bin;D:\ware\scala11\bin;D:\ware\scala11\jre\bin;D:\ware\apache-maven\bin;D:\ware\ffmpeg\bin;D:\ware\hadoop-2.6.4\bin;D:\ware\Microsoft VS Code\bin;C:\Users\me\AppData\Local\BypassRuntm;D:\ware\JetBrains\IntelliJ IDEA 2019.2.1\bin;C:\Users\me\AppData\Roaming\npm;D:\ware\cmder;D:\ware\mysql-8\bin;C:\Users\me\go\bin;C:\Users\me\AppData\Local\Microsoft\WindowsApps;D:\ware\gradle\bin
8 verbose lifecycle [email protected]pre-build: CWD: E:\me\github\kafka-manager\console
9 silly lifecycle [email protected]pre-build: Args: [ '/d /s /c', 'cross-env NODE_ENV=production webpack' ]
10 silly lifecycle [email protected]pre-build: Returned: code: 2 signal: null
11 info lifecycle [email protected]~pre-build: Failed to exec pre-build script
12 verbose stack Error: [email protected] pre-build: cross-env NODE_ENV=production webpack
12 verbose stack Exit status 2
12 verbose stack at EventEmitter. (D:\ware\nodejs\node_modules\npm\node_modules\npm-lifecycle\index.js:301:16)
12 verbose stack at EventEmitter.emit (events.js:198:13)
12 verbose stack at ChildProcess. (D:\ware\nodejs\node_modules\npm\node_modules\npm-lifecycle\lib\spawn.js:55:14)
12 verbose stack at ChildProcess.emit (events.js:198:13)
12 verbose stack at maybeClose (internal/child_process.js:982:16)
12 verbose stack at Process.ChildProcess._handle.onexit (internal/child_process.js:259:5)
13 verbose pkgid [email protected]
14 verbose cwd E:\me\github\kafka-manager\console
15 verbose Windows_NT 10.0.19041
16 verbose argv "D:\ware\nodejs\node.exe" "D:\ware\nodejs\node_modules\npm\bin\npm-cli.js" "run" "pre-build"
17 verbose node v10.16.3
18 verbose npm v6.9.0
19 error code ELIFECYCLE
20 error errno 2
21 error [email protected] pre-build: cross-env NODE_ENV=production webpack
21 error Exit status 2
22 error Failed at the [email protected] pre-build script.
22 error This is probably not a problem with npm. There is likely additional logging output above.
23 verbose exit [ 2, true ]

I want to contribute something, but the project doesn't have a dev branch.

CONTRIBUTING.md Branch: We only accept pull request on dev branch.

审核Topic扩容工单时，提示“create topic success, but update order status failed, err:without authority to cancel the order”，是什么原因？

topic采样功能，展现出来的消费目前看有截断操作。这个很不方便，希望能不截断或是限定一个比较大的数字。

修改密码没有权限
版本1.1.0

希望官方封装一个docker版本，方便客户使用

FYI

2020-06-08 17:24:18.774 ERROR 5059 --- [io-8080-exec-11] o.a.c.c.C.[.[.[/].[dispatcherServlet] : Servlet.service() for servlet [dispatcherServlet] in context with path [] threw exception [Request processing failed; nested exception is java.lang.NullPointerException] with root cause

java.lang.NullPointerException: null
at com.xiaojukeji.kafka.manager.web.converters.ClusterModelConverter.convert2ClusterBasicVO(ClusterModelConverter.java:40)
at com.xiaojukeji.kafka.manager.web.converters.ClusterModelConverter.convert2ClusterBasicVOList(ClusterModelConverter.java:29)
at com.xiaojukeji.kafka.manager.web.api.versionone.ClusterController.getBasicList(ClusterController.java:83)
at com.xiaojukeji.kafka.manager.web.api.versionone.ClusterController$$FastClassBySpringCGLIB$$b30e946b.invoke()
at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218)
at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:749)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)
at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:88)
at com.xiaojukeji.kafka.manager.web.inteceptor.WebMetricsInterceptor.doAround(WebMetricsInterceptor.java:38)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:644)
at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:633)
at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:70)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:93)
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:688)
at com.xiaojukeji.kafka.manager.web.api.versionone.ClusterController$$EnhancerBySpringCGLIB$$f6f3e537.getBasicList()
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.springframework.web.method.support.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:189)
at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:138)
at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:102)
at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandlerMethod(RequestMappingHandlerAdapter.java:895)
at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:800)
at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:87)
at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:1038)
at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:942)
at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:1005)
at org.springframework.web.servlet.FrameworkServlet.doGet(FrameworkServlet.java:897)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:645)
at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:882)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:750)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:53)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:200)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:199)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96)
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:490)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:139)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:92)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:74)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343)
at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:408)
at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66)
at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:791)
at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1417)
at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)

一般来说，这个功能用途不是很大，因为通常默认就是3，但是实际中发现也有同学没注意这些，填写了1或者其他不合理的值，如果管理员审核的时候没注意，topic上线后还需要手动到机器上重新修改副本个数。

为增加Kafka管理功能的完备性和方便上述情况的处理，希望可以支持topic副本数修改，感谢

FYI

由用户自行配置jmx exporter,然后再从prometheus里面获取监控数据.

接口使用文档是否可以提供?

CREATE TABLE topic_favorite
CREATE TABLE account
创建上面两张表报错
ERROR 1071 (42000): Specified key was too long; max key length is 767 bytes

这块sasl 怎么配置，还有集群怎么删除， 有方法没有

ConsumerGroup列表

后台有个warning
2020-09-15 10:00:30.667 WARN 1 --- [ask-ClusterId-1] c.x.k.m.s.service.impl.JmxServiceImpl : getSpecifiedBrokerMetricsFromJmx@JmxServiceImpl, get metrics fail, objectName:kafka.log:type=LogFlushStats,name=LogFlushRateAndTimeMs.

javax.management.InstanceNotFoundException: kafka.log:type=LogFlushStats,name=LogFlushRateAndTimeMs
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1095)
at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getAttributes(DefaultMBeanServerInterceptor.java:679)
at com.sun.jmx.mbeanserver.JmxMBeanServer.getAttributes(JmxMBeanServer.java:705)
at javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1449)
at javax.management.remote.rmi.RMIConnectionImpl.access$300(RMIConnectionImpl.java:76)
at javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1309)
at javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1401)
at javax.management.remote.rmi.RMIConnectionImpl.getAttributes(RMIConnectionImpl.java:675)
at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:357)
at sun.rmi.transport.Transport$1.run(Transport.java:200)
at sun.rmi.transport.Transport$1.run(Transport.java:197)
at java.security.AccessController.doPrivileged(Native Method)
at sun.rmi.transport.Transport.serviceCall(Transport.java:196)
at sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:573)
at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:834)
at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.lambda$run$0(TCPTransport.java:688)
at java.security.AccessController.doPrivileged(Native Method)
at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:687)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
at sun.rmi.transport.StreamRemoteCall.exceptionReceivedFromServer(StreamRemoteCall.java:303)
at sun.rmi.transport.StreamRemoteCall.executeCall(StreamRemoteCall.java:279)
at sun.rmi.server.UnicastRef.invoke(UnicastRef.java:164)
at com.sun.jmx.remote.internal.PRef.invoke(Unknown Source)
at javax.management.remote.rmi.RMIConnectionImpl_Stub.getAttributes(Unknown Source)
at javax.management.remote.rmi.RMIConnector$RemoteMBeanServerConnection.getAttributes(RMIConnector.java:928)
at com.xiaojukeji.kafka.manager.service.service.impl.JmxServiceImpl.getSpecifiedBrokerMetricsFromJmx(JmxServiceImpl.java:74)
at com.xiaojukeji.kafka.manager.service.collector.CollectBrokerMetricsTask.collect(CollectBrokerMetricsTask.java:41)
at com.xiaojukeji.kafka.manager.service.collector.BaseCollectTask.run(BaseCollectTask.java:23)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)

kafka-manager使用手册-待更新里的链接有许多报404.
如图：

希望官方能添加统计各个集群生产消息的总数和未消费消息的总数，自己根据已有的实现写了个统计各个集群生产消息和未消费消息的总数的功能。但是很遗憾的是，源码里面必须是有客户端进行消费的时候才能看到分区偏移量从而进行统计。如果没有消费者进行消费，也就没办法统计生产消息的总数了。

Kafka版本：2.1.0
Zookeeper版本：3.5.5
#JMX端口连接成功，项目会一直循环报错getSpecifiedBrokerMetricsFromJmx@JmxServiceImpl, get metrics fail, objectName:kafka.network:type=RequestMetrics,name=RequestsPerSec,request=FetchConsumer.

例如点击：Topic管理--全部Topic--具体某一topic，大概要一分多钟才会出来。请问是什么问题么

问题：应用下线后，下线调的应用依然存在与展示页面
操作：
1、运维管控-》平台管理-》应用管理-》申请下线默认存在的应用 km-admin-tmp（连接信息，无连接），提示下线成功
2、刷新应用管理展示页面，已经下线的应用 km-admin-tmp 依然存在
3、再次尝试申请下线 应用 km-admin-tmp，报错 app not exit

容器部署在https下，
重启pod
重新登录会跳http的login
跳转失败，需要退出重新登录

如图

集群已有的topic，应用的信息是不能编辑的，但确认的话又提示为空

重置密码失败复现，操作步骤：

1. 点击修改
2. 输入重置密码或随机生成
3. 点击提交
   报错：JSON解析失败。
   查看提交后的 request payload: {"username":"xxx","password":"xxxxxx","role":"普通用户"}

按照以下步骤，操作成功
完成上面步骤2后，需手动选择角色
查看提交后的 request payload: {"username":"xxx","password":"xxxxxx","role":0}

admin/broker_detail?clusterId=1&brokerId=11 该页面实时流量部分的刷新按钮不生效

[DataCollectorManager-ScheduleTask] ERROR c.x.k.manager.service.service.impl.JmxServiceImpl - getSpecifiedBrokerMetricsFromJmx@JmxServiceImpl, get metrics fail, objectName:kafka.network:type=RequestMetrics,name=RequestsPerSec,request=FetchConsumer.
javax.management.InstanceNotFoundException: kafka.network:type=RequestMetrics,name=RequestsPerSec,request=FetchConsumer
at java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1083)
at java.management/com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getAttributes(DefaultMBeanServerInterceptor.java:671)
at java.management/com.sun.jmx.mbeanserver.JmxMBeanServer.getAttributes(JmxMBeanServer.java:705)

ERROR 5628 --- [nio-8089-exec-8] c.x.k.m.service.service.TopicService : getTopicInfo@TopicServiceImpl, get topic simple info failed 报错这个是什么问题呢jmx也开了

URL中一定要有clusterName，如果clusterName没有时点击按钮就会一片空白。

正常的URL：
http://127.0.0.1:8080/admin/cluster_detail?clusterId=4&clusterName=TestClusterName#2

一片空白的URL：
http://127.0.0.1:8080/admin/cluster_detail?clusterId=4#2

正常来说有了集群ID就应该不需要集群名称的。

1、审批时需要选择分区：看看是否可以向kafka manage只需要写分区数量自动设置分区，或者有提供更加友好的选择分区数
2、topic列表展示流入qps和流量入流量，是否可以加上流出流量，导出数据，方便优化时是做消费和生产流量对比

如题。

主干的代码编译运行后报错，自动开启上报夜莺，但问题是还没用夜莺，能否改成可配置默认不开启

麻烦完善一下kafkamanager接入夜莺的用户操作文档，谢谢

期待新版本加上SSL监控，目前版本还不支持。

zookeeper配置了tlsSidecar通过TLS加密通信，怎么配置kafka-manager连接？

It make it easy to support standalone start up for beginners.

想问下，指标数据存在mysql里面，每天数据量是topic*1440，这个数据量有点大，如果myslq超过千万以后，就会很卡，请问后续再这方便有优化方案吗

Does it provide good compilation

逻辑集群的Bootstrap Severs 好像没有地方填，也没有用物理集群的Bootstrap Severs

Kafka-manager may have single node risk

我的kafka配置

::::::::::::::
kafka_server.properties:
::::::::::::::
listeners=SASL_PLAINTEXT://:19092
security.inter.broker.protocol=SASL_PLAINTEXT
sasl.mechanism.inter.broker.protocol=SCRAM-SHA-256
sasl.enabled.mechanisms=SCRAM-SHA-256
allow.everyone.if.no.acl.found=false
super.users=User:admin
authorizer.class.name=kafka.security.auth.SimpleAclAuthorizer

::::::::::::::
kafka_client_jaas.conf
::::::::::::::
KafkaClient {
org.apache.kafka.common.security.scram.ScramLoginModule required
username="admin"
password="12345678";
};

::::::::::::::
kafka_server_jaas.conf
::::::::::::::
KafkaServer {
org.apache.kafka.common.security.scram.ScramLoginModule required
username="admin"
password="12345678";
};

页面无法显示消费组信息。

数据不断写入且消费，分区有偏移量，但消费者组始终无数据，topic历史流量和实时流量始终无数据，broker所有图表无数据展示

如果连接ZK没有成功，或者中间出现了ZK连接的状态发生变化的情况，则会导致一些ZK的事件丢失，比如监听不到Topic的创建或者Broker的上线事件

can not mvn install under windows

项目运行一段时间报错，java.rmi.ConnectException: Connection refused to host: 127.0.0.1; nested exception is:
JMX端口开启成，jconsole可以获取正常指标。

每个用户都能看到所有的topic，然后操作，不安全，希望新增topic跟据用户进行隔离

配置JMX PORT后,报连接超时,日志中报错的IP不是我kafka集群对应的IP,而是127.0.0.1导致看不了Broker信息