Code Monkey home page Code Monkey logo

tophanttechnology / arl Goto Github PK

View Code? Open in Web Editor NEW
4.9K 4.9K 846.0 29.98 MB

ARL(Asset Reconnaissance Lighthouse)资产侦察灯塔系统旨在快速侦察与目标关联的互联网资产,构建基础资产信息库。 协助甲方安全团队或者渗透测试人员有效侦察和检索资产,发现存在的薄弱点和攻击面。

License: Other

Python 94.88% JavaScript 2.47% HTML 0.29% Dockerfile 0.58% Shell 1.78%
arl asset-reconnaissance-lighthouse bugbounty pentest-tool python recon security-tools

arl's People

Contributors

1c3z avatar chasenz avatar chushuai avatar naxg avatar ox01024 avatar tarihub avatar tophant-alex avatar xiutai avatar yangyang-zhang avatar yeahx avatar zyairelai avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

arl's Issues

是否可以添加模块独立运行功能

比如爆破域名时候我不希望文件泄露探测,但搜索完成后,我又想对部分域名进行文件泄露探测,这就需要一个模块对其独立运行

操作系统识别

应该最可信度最高的,第一个不定是可信度最高的
需要把所有已知的操作系统识别的结果缓存下为,进行可信度排序,然后取可信度最高的版本

一些建议

对于企业级信息收集目前的架构是不能保证信息收集全的
1.收域名枚举的关键字除了开源的关键字库外,需要用到的已经资产的关键字库
2,ICP备案查询也可以用上
3,整体用的信息技术比较单一,没有将这些工具搜集到的东西组合好
4,fofa没有用好,fofa的搜索语法较简单
5,可以看看fofa的api 其实可以获取更多的信息
6 ,指纹识别能力太弱了,用到的指纹库不行,除了库以前,方法也存在较大问题

nginx未安装认证模块,导致无法开启http基础认证

docker nginx未安装ngx_http_auth_basic_module模块,无法添加http基础认证

configure arguments: --prefix=/usr/share/nginx --sbin-path=/usr/sbin/nginx --modules-path=/usr/lib64/nginx/modules --conf-path=/etc/nginx/nginx.conf --error-log-path=/var/log/nginx/error.log --http-log-path=/var/log/nginx/access.log --http-client-body-temp-path=/var/lib/nginx/tmp/client_body --http-proxy-temp-path=/var/lib/nginx/tmp/proxy --http-fastcgi-temp-path=/var/lib/nginx/tmp/fastcgi --http-uwsgi-temp-path=/var/lib/nginx/tmp/uwsgi --http-scgi-temp-path=/var/lib/nginx/tmp/scgi --pid-path=/run/nginx.pid --lock-path=/run/lock/subsys/nginx --user=nginx --group=nginx --with-file-aio --with-ipv6 --with-http_ssl_module --with-http_v2_module --with-http_realip_module --with-stream_ssl_preread_module --with-http_addition_module --with-http_xslt_module=dynamic --with-http_image_filter_module=dynamic --with-http_sub_module --with-http_dav_module --with-http_flv_module --with-http_mp4_module --with-http_gunzip_module --with-http_gzip_static_module --with-http_random_index_module --with-http_secure_link_module --with-http_degradation_module --with-http_slice_module --with-http_stub_status_module --with-http_perl_module=dynamic --with-http_auth_request_module --with-mail=dynamic --with-mail_ssl_module --with-pcre --with-pcre-jit --with-stream=dynamic --with-stream_ssl_module --with-google_perftools_module --with-debug --with-cc-opt='-O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong --param=ssp-buffer-size=4 -grecord-gcc-switches -specs=/usr/lib/rpm/redhat/redhat-hardened-cc1 -m64 -mtune=generic' --with-ld-opt='-Wl,-z,relro -specs=/usr/lib/rpm/redhat/redhat-hardened-ld -Wl,-E'
[root@35ec9ed4b1b7 code]# 

工具很好用,在这里提一些建议,望采纳

1、希望可以开发一个实时监控子域名的功能,例如这个爆破子域任务刚完成后就立刻重新爆破或者可以设置过多久再爆破
2、希望可以对相同域名的新增域名有个明显标注,例如我今天对baidu.com扫完后,明天在扫,扫出新的子域名后,可以一眼看出来哪个是新发现的子域名。

希望后期可以通过多个代理的方式进行资产发现。

在使用此工具的过程中,我发现有的时候会被目标给办掉,无法访问目标,如果可以添加一个自动获取免费代理节点,通过这些节点去资产发现,会更全面。而且你们也可以再增加一个专属代理节点,付费内种,咳咳。

arl_worker还没有公开吗

ERROR: pull access denied for arl_worker, repository does not exist or may require 'docker login': denied: requested access to the resource is denied

docker 启动报错

docker-compose 启动后,arl_worker和arl_web无限重启,查看docker logs后,发现

PermissionError: [Errno 13] Permission denied: '/code/arl_worker.log'

修改docker-compose.yml进入docker后发现arl_web.log没权限

-rw-r--r--. 1 root root   0 Nov 19 08:33 arl_web.log

任务前端删除不了咋办?

答:
第一步:docker exec -ti arl_mongodb mongo -u admin -p admin
第二步:db.task.remove({"_id" : ObjectId("xxxxxxxxxxxxxxx")}) 前端:Task_Id

希望能帮到各位大哥

docker-compose up -d失败

/usr/local/lib/python3.5/dist-packages/paramiko/transport.py:33: CryptographyDeprecationWarning: Python 3.5 support will be dropped in the next release ofcryptography. Please upgrade your Python.
from cryptography.hazmat.backends import default_backend
Pulling worker (arl_worker:v2)...
ERROR: The image for the service you're trying to recreate has been removed. If you continue, volume data could be lost. Consider backing up your data before continuing.

Continue with the new image? [yN]

[无法访问]Docker 部署 arl_web和arl_worker 一直处于 Restarting 状态

  1. 采用docker部署方式,clone git仓库
  2. 按照 #3 提供的方法修改docker/docker-compose.yml 中services web image 和 services worker image 对应的镜像地址为 tophant/arl:latest
    Snipaste_2020-09-16_14-49-03
  3. docker-compose up -d 启动
docker-compose up -d 
Starting arl_mongodb  ... done
Starting arl_rabbitmq ... done
Starting arl_web      ... done
Starting arl_worker   ... done
  1. 查看容器状况,发现arl_web和arl_worker 一直处于 Restarting 状态
docker-compose ps

Snipaste_2020-09-16_14-51-19
5.宿主机无占用80端口的进程,selinux已关
Snipaste_2020-09-16_14-52-24
6. 系统版本

[root@localhost docker]# uname -a
Linux localhost.localdomain 3.10.0-1062.18.1.el7.x86_64 #1 SMP Tue Mar 17 23:49:17 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
  1. Docker版本
[root@localhost docker]# docker --version
Docker version 1.13.1, build cccb291/1.13.1

[root@localhost docker]# docker-compose --version
docker-compose version 1.25.0, build 0a186604

8.配置

  • 4C8G

镜像启动后报错

CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
4719eabe6ef4 tophant/arl:latest "sh -c 'celery -A ..." 2 minutes ago Restarting (255) 34 seconds ago arl_worker
ef9940cf55c4 tophant/arl:latest "sh -c 'nginx; gun..." 2 minutes ago Restarting (1) 37 seconds ago arl_web
5054aae5854e mongo:3.6-stretch "docker-entrypoint..." 2 minutes ago Up 2 minutes 27017/tcp arl_mongodb
245844a75da1 rabbitmq:3-management-alpine "docker-entrypoint..." 2 minutes ago Up 2 minutes 4369/tcp, 5671-5672/tcp, 15671-15672/tcp, 15691-15692/tcp, 25672/tcp arl_rabbitmq
[root@localhost docker]# ^C
[root@localhost docker]# docker logs 4719eabe6ef4
Parse config.yaml error [Errno 13] Permission denied: '/code/app/config.yaml'
Parse config.yaml error [Errno 13] Permission denied: '/code/app/config.yaml'
Parse config.yaml error [Errno 13] Permission denied: '/code/app/config.yaml'
Parse config.yaml error [Errno 13] Permission denied: '/code/app/config.yaml'
Parse config.yaml error [Errno 13] Permission denied: '/code/app/config.yaml'
Parse config.yaml error [Errno 13] Permission denied: '/code/app/config.yaml'
Parse config.yaml error [Errno 13] Permission denied: '/code/app/config.yaml'
Parse config.yaml error [Errno 13] Permission denied: '/code/app/config.yaml'
Parse config.yaml error [Errno 13] Permission denied: '/code/app/config.yaml'
Parse config.yaml error [Errno 13] Permission denied: '/code/app/config.yaml'
Parse config.yaml error [Errno 13] Permission denied: '/code/app/config.yaml'
[root@localhost docker]# docker logs ef9940cf55c4
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]

docker-compose up -d一直restart状态怎么解决?

下载的最新的docker-compose.yml还是启动不了

[root@webvul docker]# docker ps -a
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
00c4cf056e58 tophant/arl:latest "sh -c 'celery -A ..." 6 days ago Restarting (255) 36 hours ago arl_worker
949969d897ff tophant/arl:latest "sh -c 'nginx; gun..." 6 days ago Restarting (1) 36 hours ago arl_web
be9614e748fe rabbitmq:3-management-alpine "docker-entrypoint..." 6 days ago Up 6 days 4369/tcp, 5671-5672/tcp, 15671-15672/tcp, 15691-15692/tcp, 25672/tcp arl_rabbitmq
225260e65857 mongo:3.6-stretch "docker-entrypoint..." 6 days ago Up 6 days 27017/tcp

[root@webvul docker]# cat docker-compose.yml | more
version: '3'

services:
web:
image: tophant/arl:latest
container_name: arl_web
restart: unless-stopped
depends_on:
- mongodb
ports:
- "5003:80"
volumes:
- ./arl_web.log:/code/arl_web.log
- ./config-docker.yaml:/code/app/config.yaml
- ./image:/code/app/tmp_screenshot
entrypoint: ["sh", "-c", "nginx; gunicorn -b 0.0.0.0:5003 app.main:arl_app -w 3 --access-logfile arl_web.log"]
environment:
- LANG=en_US.UTF-8
- TZ=Asia/Shanghai

worker:
    image: tophant/arl:latest
    container_name: arl_worker
    restart: unless-stopped
    depends_on:
      - mongodb
      - rabbitmq
    volumes:
      - ./arl_worker.log:/code/arl_worker.log
      - ./config-docker.yaml:/code/app/config.yaml
      - ./image:/code/app/tmp_screenshot
    entrypoint: ["sh", "-c", "celery -A app.celerytask.celery worker -l info -Q arltask -n arltask -c 2 -O fair -f arl_worker.log"]
    environment:
      - LANG=en_US.UTF-8
      - TZ=Asia/Shanghai

mongodb:
    image: mongo:3.6-stretch
    container_name: arl_mongodb
    restart: always
    volumes:
        - ./mongo-init.js:/docker-entrypoint-initdb.d/mongo-init.js:ro
    environment:
      - MONGO_INITDB_DATABASE=arl
      - MONGO_INITDB_ROOT_USERNAME=admin
      - MONGO_INITDB_ROOT_PASSWORD=admin


rabbitmq:
  image: rabbitmq:3-management-alpine
  container_name: arl_rabbitmq
  restart: always
  environment:
    - RABBITMQ_DEFAULT_PASS=arlpassword
    - RABBITMQ_DEFAULT_USER=arl
    - RABBITMQ_DEFAULT_VHOST=arlv2host
  logging:
    driver: "json-file"
    options:
      max-size: "1M"
      max-file: "10"

目标设置成IP、IP段部分结果为空

(1)在将目标设置成IP段时,IP扫描结果结果只有IP、Geo和AS字段,其他开放端口、操作系统、关联域名为空,另外的SSL证书、子域名、站点、服务、文件泄露和URL信息也为空
(2)在将目标设置IP时,所有的结果均为空
对比masscan扫描结果确实存在IP和端口等

灯塔系统功能需求

1,系统能不能支持外部导入导出功能,外部收集的域名信息能和ARL域名做合并;
2,域名收集增加一些维度,API接口查询、搜索引擎...
3,开放API接口方便和其他工具对接;
Thx

[BUG] docker-compose up -d启动后无法登录

启动后访问5003端口,登录提示timeout of 12000ms exceeded或用户名密码错误,使用默认密码admin/arlpass,未更改过密码。

1. docker ps记录

CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
1c1d7ea947d1 tophant/arl:latest "sh -c 'nginx; gunic…" 8 minutes ago Up 8 minutes 0.0.0.0:5003->80/tcp arl_web
c80cac8c122e tophant/arl:latest "sh -c 'celery -A ap…" 8 minutes ago Up 8 minutes arl_worker
5506ae5edf90 rabbitmq:3-management-alpine "docker-entrypoint.s…" 8 minutes ago Up 8 minutes 4369/tcp, 5671-5672/tcp, 15671-15672/tcp, 15691-15692/tcp, 25672/tcp arl_rabbitmq
46844a8a77ca mongo:3.6-stretch "docker-entrypoint.s…" 8 minutes ago Up 8 minutes 27017/tcp arl_mongodb

2.docker logs 记录

1)arl_worker

2)arl_rabbitmq
Configuring logger redirection
2020-09-16 16:13:39.575 [debug] <0.284.0> Lager installed handler error_logger_lager_h into error_logger
2020-09-16 16:13:39.579 [debug] <0.287.0> Lager installed handler lager_forwarder_backend into error_logger_lager_event
2020-09-16 16:13:39.579 [debug] <0.290.0> Lager installed handler lager_forwarder_backend into rabbit_log_lager_event
2020-09-16 16:13:39.579 [debug] <0.293.0> Lager installed handler lager_forwarder_backend into
......
2020-09-16 16:13:43.264 [info] <0.689.0> Ready to start client connection listeners
2020-09-16 16:13:43.264 [info] <0.44.0> Application rabbitmq_prometheus started on node rabbit@5506ae5edf90
2020-09-16 16:13:43.266 [info] <0.993.0> started TCP listener on [::]:5672
completed with 4 plugins.
2020-09-16 16:13:43.451 [info] <0.689.0> Server startup complete; 4 plugins started.
rabbitmq_prometheus
rabbitmq_management
rabbitmq_web_dispatch
rabbitmq_management_agent
2020-09-16 16:13:43.451 [info] <0.689.0> Resetting node maintenance status

3)arl_web
[2020-09-17 00:13:37 +0800] [10] [INFO] Starting gunicorn 19.9.0
[2020-09-17 00:13:37 +0800] [10] [INFO] Listening at: http://0.0.0.0:5003 (10)
[2020-09-17 00:13:37 +0800] [10] [INFO] Using worker: sync
[2020-09-17 00:13:37 +0800] [19] [INFO] Booting worker with pid: 19
[2020-09-17 00:13:37 +0800] [20] [INFO] Booting worker with pid: 20
[2020-09-17 00:13:37 +0800] [21] [INFO] Booting worker with pid: 21
[2020-09-17 00:14:29 +0800] [10] [CRITICAL] WORKER TIMEOUT (pid:19)
[2020-09-17 00:14:29 +0800] [19] [INFO] Worker exiting (pid: 19)
[2020-09-17 00:14:30 +0800] [31] [INFO] Booting worker with pid: 31
[2020-09-17 00:14:30,834] ERROR in app: Exception on /api/user/login [POST]
Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1612, in full_dispatch_request
rv = self.dispatch_request()
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1598, in dispatch_request
return self.view_functionsrule.endpoint
File "/usr/local/lib/python3.6/site-packages/flask_restplus/api.py", line 325, in wrapper
resp = resource(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask/views.py", line 84, in view
return self.dispatch_request(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask_restplus/resource.py", line 44, in dispatch_request
resp = meth(*args, **kwargs)
File "/code/app/routes/user.py", line 31, in post
return build_data(utils.user_login(**args))
File "/code/app/utils/user.py", line 15, in user_login
if conn_db('user').find_one(query):
File "/usr/local/lib64/python3.6/site-packages/pymongo/collection.py", line 1262, in find_one
for result in cursor.limit(-1):
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1189, in next
if len(self.__data) or self._refresh():
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1087, in _refresh
self.__session = self.__collection.database.client._ensure_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1558, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1511, in __start_session
server_session = self._get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1544, in _get_server_session
return self._topology.get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 427, in get_server_session
None)
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 199, in _select_servers_loop
self._error_message(selector))
pymongo.errors.ServerSelectionTimeoutError: mongodb:27017: [Errno 113] No route to host
[2020-09-17 00:14:52,388] ERROR in app: Exception on /api/user/login [POST]
Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1612, in full_dispatch_request
rv = self.dispatch_request()
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1598, in dispatch_request
return self.view_functionsrule.endpoint
File "/usr/local/lib/python3.6/site-packages/flask_restplus/api.py", line 325, in wrapper
resp = resource(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask/views.py", line 84, in view
return self.dispatch_request(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask_restplus/resource.py", line 44, in dispatch_request
resp = meth(*args, **kwargs)
File "/code/app/routes/user.py", line 31, in post
return build_data(utils.user_login(**args))
File "/code/app/utils/user.py", line 15, in user_login
if conn_db('user').find_one(query):
File "/usr/local/lib64/python3.6/site-packages/pymongo/collection.py", line 1262, in find_one
for result in cursor.limit(-1):
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1189, in next
if len(self.__data) or self._refresh():
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1087, in _refresh
self.__session = self.__collection.database.client._ensure_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1558, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1511, in __start_session
server_session = self._get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1544, in _get_server_session
return self._topology.get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 427, in get_server_session
None)
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 199, in _select_servers_loop
self._error_message(selector))
pymongo.errors.ServerSelectionTimeoutError: mongodb:27017: [Errno 113] No route to host
[2020-09-17 00:14:52 +0800] [10] [CRITICAL] WORKER TIMEOUT (pid:20)
[2020-09-17 00:14:52 +0800] [20] [INFO] Worker exiting (pid: 20)
[2020-09-17 00:14:53 +0800] [37] [INFO] Booting worker with pid: 37
[2020-09-17 00:15:02,757] ERROR in app: Exception on /api/user/login [POST]
Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1612, in full_dispatch_request
rv = self.dispatch_request()
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1598, in dispatch_request
return self.view_functionsrule.endpoint
File "/usr/local/lib/python3.6/site-packages/flask_restplus/api.py", line 325, in wrapper
resp = resource(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask/views.py", line 84, in view
return self.dispatch_request(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask_restplus/resource.py", line 44, in dispatch_request
resp = meth(*args, **kwargs)
File "/code/app/routes/user.py", line 31, in post
return build_data(utils.user_login(**args))
File "/code/app/utils/user.py", line 15, in user_login
if conn_db('user').find_one(query):
File "/usr/local/lib64/python3.6/site-packages/pymongo/collection.py", line 1262, in find_one
for result in cursor.limit(-1):
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1189, in next
if len(self.__data) or self._refresh():
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1087, in _refresh
self.__session = self.__collection.database.client._ensure_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1558, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1511, in __start_session
server_session = self._get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1544, in _get_server_session
return self._topology.get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 427, in get_server_session
None)
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 199, in _select_servers_loop
self._error_message(selector))
pymongo.errors.ServerSelectionTimeoutError: mongodb:27017: [Errno 113] No route to host
[2020-09-17 00:15:04 +0800] [10] [CRITICAL] WORKER TIMEOUT (pid:31)
[2020-09-17 00:15:04 +0800] [31] [INFO] Worker exiting (pid: 31)
[2020-09-17 00:15:05 +0800] [39] [INFO] Booting worker with pid: 39
[2020-09-17 00:15:52,132] ERROR in app: Exception on /api/user/login [POST]
Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1612, in full_dispatch_request
rv = self.dispatch_request()
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1598, in dispatch_request
return self.view_functionsrule.endpoint
File "/usr/local/lib/python3.6/site-packages/flask_restplus/api.py", line 325, in wrapper
resp = resource(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask/views.py", line 84, in view
return self.dispatch_request(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask_restplus/resource.py", line 44, in dispatch_request
resp = meth(*args, **kwargs)
File "/code/app/routes/user.py", line 31, in post
return build_data(utils.user_login(**args))
File "/code/app/utils/user.py", line 15, in user_login
if conn_db('user').find_one(query):
File "/usr/local/lib64/python3.6/site-packages/pymongo/collection.py", line 1262, in find_one
for result in cursor.limit(-1):
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1189, in next
if len(self.__data) or self._refresh():
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1087, in _refresh
self.__session = self.__collection.database.client._ensure_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1558, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1511, in __start_session
server_session = self._get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1544, in _get_server_session
return self._topology.get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 427, in get_server_session
None)
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 199, in _select_servers_loop
self._error_message(selector))
pymongo.errors.ServerSelectionTimeoutError: mongodb:27017: [Errno 113] No route to host
[2020-09-17 00:15:53,358] ERROR in app: Exception on /api/user/login [POST]
Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1612, in full_dispatch_request
rv = self.dispatch_request()
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1598, in dispatch_request
return self.view_functionsrule.endpoint
File "/usr/local/lib/python3.6/site-packages/flask_restplus/api.py", line 325, in wrapper
resp = resource(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask/views.py", line 84, in view
return self.dispatch_request(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask_restplus/resource.py", line 44, in dispatch_request
resp = meth(*args, **kwargs)
File "/code/app/routes/user.py", line 31, in post
return build_data(utils.user_login(**args))
File "/code/app/utils/user.py", line 15, in user_login
if conn_db('user').find_one(query):
File "/usr/local/lib64/python3.6/site-packages/pymongo/collection.py", line 1262, in find_one
for result in cursor.limit(-1):
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1189, in next
if len(self.__data) or self._refresh():
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1087, in _refresh
self.__session = self.__collection.database.client._ensure_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1558, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1511, in __start_session
server_session = self._get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1544, in _get_server_session
return self._topology.get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 427, in get_server_session
None)
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 199, in _select_servers_loop
self._error_message(selector))
pymongo.errors.ServerSelectionTimeoutError: mongodb:27017: [Errno 113] No route to host
[2020-09-17 00:15:54 +0800] [10] [CRITICAL] WORKER TIMEOUT (pid:37)
[2020-09-17 00:15:54 +0800] [37] [INFO] Worker exiting (pid: 37)
[2020-09-17 00:15:55 +0800] [51] [INFO] Booting worker with pid: 51
[2020-09-17 00:16:22 +0800] [10] [CRITICAL] WORKER TIMEOUT (pid:39)
[2020-09-17 00:16:22 +0800] [39] [INFO] Worker exiting (pid: 39)
[2020-09-17 00:16:23 +0800] [10] [CRITICAL] WORKER TIMEOUT (pid:21)
[2020-09-17 00:16:23 +0800] [21] [INFO] Worker exiting (pid: 21)
[2020-09-17 00:16:23 +0800] [55] [INFO] Booting worker with pid: 55
[2020-09-17 00:16:24 +0800] [59] [INFO] Booting worker with pid: 59
[2020-09-17 00:16:26 +0800] [10] [CRITICAL] WORKER TIMEOUT (pid:51)
[2020-09-17 00:16:26 +0800] [51] [INFO] Worker exiting (pid: 51)
[2020-09-17 00:16:27 +0800] [63] [INFO] Booting worker with pid: 63
[2020-09-17 00:16:54,523] ERROR in app: Exception on /api/user/login [POST]
Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1612, in full_dispatch_request
rv = self.dispatch_request()
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1598, in dispatch_request
return self.view_functionsrule.endpoint
File "/usr/local/lib/python3.6/site-packages/flask_restplus/api.py", line 325, in wrapper
resp = resource(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask/views.py", line 84, in view
return self.dispatch_request(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask_restplus/resource.py", line 44, in dispatch_request
resp = meth(*args, **kwargs)
File "/code/app/routes/user.py", line 31, in post
return build_data(utils.user_login(**args))
File "/code/app/utils/user.py", line 15, in user_login
if conn_db('user').find_one(query):
File "/usr/local/lib64/python3.6/site-packages/pymongo/collection.py", line 1262, in find_one
for result in cursor.limit(-1):
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1189, in next
if len(self.__data) or self._refresh():
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1087, in _refresh
self.__session = self.__collection.database.client._ensure_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1558, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1511, in __start_session
server_session = self._get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1544, in _get_server_session
return self._topology.get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 427, in get_server_session
None)
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 199, in _select_servers_loop
self._error_message(selector))
pymongo.errors.ServerSelectionTimeoutError: mongodb:27017: [Errno 113] No route to host
[2020-09-17 00:16:55 +0800] [10] [CRITICAL] WORKER TIMEOUT (pid:59)
[2020-09-17 00:16:55 +0800] [59] [INFO] Worker exiting (pid: 59)
[2020-09-17 00:16:56 +0800] [69] [INFO] Booting worker with pid: 69
[2020-09-17 00:16:58,526] ERROR in app: Exception on /api/user/login [POST]
Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1612, in full_dispatch_request
rv = self.dispatch_request()
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1598, in dispatch_request
return self.view_functionsrule.endpoint
File "/usr/local/lib/python3.6/site-packages/flask_restplus/api.py", line 325, in wrapper
resp = resource(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask/views.py", line 84, in view
return self.dispatch_request(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask_restplus/resource.py", line 44, in dispatch_request
resp = meth(*args, **kwargs)
File "/code/app/routes/user.py", line 31, in post
return build_data(utils.user_login(**args))
File "/code/app/utils/user.py", line 15, in user_login
if conn_db('user').find_one(query):
File "/usr/local/lib64/python3.6/site-packages/pymongo/collection.py", line 1262, in find_one
for result in cursor.limit(-1):
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1189, in next
if len(self.__data) or self._refresh():
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1087, in _refresh
self.__session = self.__collection.database.client._ensure_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1558, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1511, in __start_session
server_session = self._get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1544, in _get_server_session
return self._topology.get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 427, in get_server_session
None)
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 199, in _select_servers_loop
self._error_message(selector))
pymongo.errors.ServerSelectionTimeoutError: mongodb:27017: [Errno 113] No route to host
[2020-09-17 00:17:24 +0800] [10] [CRITICAL] WORKER TIMEOUT (pid:55)
[2020-09-17 00:17:24 +0800] [55] [INFO] Worker exiting (pid: 55)
[2020-09-17 00:17:25 +0800] [75] [INFO] Booting worker with pid: 75
[2020-09-17 00:17:27,594] ERROR in app: Exception on /api/user/login [POST]
Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1612, in full_dispatch_request
rv = self.dispatch_request()
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1598, in dispatch_request
return self.view_functionsrule.endpoint
File "/usr/local/lib/python3.6/site-packages/flask_restplus/api.py", line 325, in wrapper
resp = resource(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask/views.py", line 84, in view
return self.dispatch_request(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask_restplus/resource.py", line 44, in dispatch_request
resp = meth(*args, **kwargs)
File "/code/app/routes/user.py", line 31, in post
return build_data(utils.user_login(**args))
File "/code/app/utils/user.py", line 15, in user_login
if conn_db('user').find_one(query):
File "/usr/local/lib64/python3.6/site-packages/pymongo/collection.py", line 1262, in find_one
for result in cursor.limit(-1):
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1189, in next
if len(self.__data) or self._refresh():
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1087, in _refresh
self.__session = self.__collection.database.client._ensure_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1558, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1511, in __start_session
server_session = self._get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1544, in _get_server_session
return self._topology.get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 427, in get_server_session
None)
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 199, in _select_servers_loop
self._error_message(selector))
pymongo.errors.ServerSelectionTimeoutError: mongodb:27017: [Errno 113] No route to host
[2020-09-17 00:17:28 +0800] [10] [CRITICAL] WORKER TIMEOUT (pid:63)
[2020-09-17 00:17:28 +0800] [63] [INFO] Worker exiting (pid: 63)
[2020-09-17 00:17:29 +0800] [79] [INFO] Booting worker with pid: 79
[2020-09-17 00:17:56 +0800] [10] [CRITICAL] WORKER TIMEOUT (pid:75)
[2020-09-17 00:17:56 +0800] [75] [INFO] Worker exiting (pid: 75)
[2020-09-17 00:17:57 +0800] [81] [INFO] Booting worker with pid: 81
[2020-09-17 00:18:57,987] ERROR in app: Exception on /api/user/login [POST]
Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1612, in full_dispatch_request
rv = self.dispatch_request()
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1598, in dispatch_request
return self.view_functionsrule.endpoint
File "/usr/local/lib/python3.6/site-packages/flask_restplus/api.py", line 325, in wrapper
resp = resource(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask/views.py", line 84, in view
return self.dispatch_request(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask_restplus/resource.py", line 44, in dispatch_request
resp = meth(*args, **kwargs)
File "/code/app/routes/user.py", line 31, in post
return build_data(utils.user_login(**args))
File "/code/app/utils/user.py", line 15, in user_login
if conn_db('user').find_one(query):
File "/usr/local/lib64/python3.6/site-packages/pymongo/collection.py", line 1262, in find_one
for result in cursor.limit(-1):
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1189, in next
if len(self.__data) or self._refresh():
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1087, in _refresh
self.__session = self.__collection.database.client._ensure_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1558, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1511, in __start_session
server_session = self._get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1544, in _get_server_session
return self._topology.get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 427, in get_server_session
None)
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 199, in _select_servers_loop
self._error_message(selector))
pymongo.errors.ServerSelectionTimeoutError: mongodb:27017: [Errno 113] No route to host
[2020-09-17 00:18:58,996] ERROR in app: Exception on /api/user/login [POST]
Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1612, in full_dispatch_request
rv = self.dispatch_request()
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1598, in dispatch_request
return self.view_functionsrule.endpoint
File "/usr/local/lib/python3.6/site-packages/flask_restplus/api.py", line 325, in wrapper
resp = resource(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask/views.py", line 84, in view
return self.dispatch_request(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask_restplus/resource.py", line 44, in dispatch_request
resp = meth(*args, **kwargs)
File "/code/app/routes/user.py", line 31, in post
return build_data(utils.user_login(**args))
File "/code/app/utils/user.py", line 15, in user_login
if conn_db('user').find_one(query):
File "/usr/local/lib64/python3.6/site-packages/pymongo/collection.py", line 1262, in find_one
for result in cursor.limit(-1):
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1189, in next
if len(self.__data) or self._refresh():
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1087, in _refresh
self.__session = self.__collection.database.client._ensure_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1558, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1511, in __start_session
server_session = self._get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1544, in _get_server_session
return self._topology.get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 427, in get_server_session
None)
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 199, in _select_servers_loop
self._error_message(selector))
pymongo.errors.ServerSelectionTimeoutError: mongodb:27017: [Errno 113] No route to host
[2020-09-17 00:19:00,533] ERROR in app: Exception on /api/user/login [POST]
Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1612, in full_dispatch_request
rv = self.dispatch_request()
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1598, in dispatch_request
return self.view_functionsrule.endpoint
File "/usr/local/lib/python3.6/site-packages/flask_restplus/api.py", line 325, in wrapper
resp = resource(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask/views.py", line 84, in view
return self.dispatch_request(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask_restplus/resource.py", line 44, in dispatch_request
resp = meth(*args, **kwargs)
File "/code/app/routes/user.py", line 31, in post
return build_data(utils.user_login(**args))
File "/code/app/utils/user.py", line 15, in user_login
if conn_db('user').find_one(query):
File "/usr/local/lib64/python3.6/site-packages/pymongo/collection.py", line 1262, in find_one
for result in cursor.limit(-1):
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1189, in next
if len(self.__data) or self._refresh():
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1087, in _refresh
self.__session = self.__collection.database.client._ensure_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1558, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1511, in __start_session
server_session = self._get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1544, in _get_server_session
return self._topology.get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 427, in get_server_session
None)
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 199, in _select_servers_loop
self._error_message(selector))
pymongo.errors.ServerSelectionTimeoutError: mongodb:27017: [Errno 113] No route to host
[2020-09-17 00:19:28,065] ERROR in app: Exception on /api/user/login [POST]
Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1612, in full_dispatch_request
rv = self.dispatch_request()
File "/usr/local/lib/python3.6/site-packages/flask/app.py", line 1598, in dispatch_request
return self.view_functionsrule.endpoint
File "/usr/local/lib/python3.6/site-packages/flask_restplus/api.py", line 325, in wrapper
resp = resource(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask/views.py", line 84, in view
return self.dispatch_request(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/flask_restplus/resource.py", line 44, in dispatch_request
resp = meth(*args, **kwargs)
File "/code/app/routes/user.py", line 31, in post
return build_data(utils.user_login(**args))
File "/code/app/utils/user.py", line 15, in user_login
if conn_db('user').find_one(query):
File "/usr/local/lib64/python3.6/site-packages/pymongo/collection.py", line 1262, in find_one
for result in cursor.limit(-1):
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1189, in next
if len(self.__data) or self._refresh():
File "/usr/local/lib64/python3.6/site-packages/pymongo/cursor.py", line 1087, in _refresh
self.__session = self.__collection.database.client._ensure_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1558, in _ensure_session
return self.__start_session(True, causal_consistency=False)
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1511, in __start_session
server_session = self._get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/mongo_client.py", line 1544, in _get_server_session
return self._topology.get_server_session()
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 427, in get_server_session
None)
File "/usr/local/lib64/python3.6/site-packages/pymongo/topology.py", line 199, in _select_servers_loop
self._error_message(selector))
pymongo.errors.ServerSelectionTimeoutError: mongodb:27017: [Errno 113] No route to host

4)arl_mongodb
about to fork child process, waiting until server is ready for connections.
forked process: 26
2020-09-16T16:13:34.110+0000 I CONTROL [main] ***** SERVER RESTARTED *****
2020-09-16T16:13:34.118+0000 I CONTROL [initandlisten] MongoDB starting : pid=26 port=27017 dbpath=/data/db 64-bit host=46844a8a77ca
2020-09-16T16:13:34.118+0000 I CONTROL [initandlisten] db version v3.6.11
2020-09-16T16:13:34.118+0000 I CONTROL [initandlisten] git version: b4339db12bf57ffee5b84a95c6919dbd35fe31c9
2020-09-16T16:13:34.118+0000 I CONTROL [initandlisten] OpenSSL version: OpenSSL 1.1.0j 20 Nov 2018
2020-09-16T16:13:34.118+0000 I CONTROL [initandlisten] allocator: tcmalloc
2020-09-16T16:13:34.118+0000 I CONTROL [initandlisten] modules: none
2020-09-16T16:13:34.118+0000 I CONTROL [initandlisten] build environment:
2020-09-16T16:13:34.118+0000 I CONTROL [initandlisten] distmod: debian92
2020-09-16T16:13:34.118+0000 I CONTROL [initandlisten] distarch: x86_64
2020-09-16T16:13:34.118+0000 I CONTROL [initandlisten] target_arch: x86_64
......
Successfully added user: {
"user" : "admin",
"roles" : [
{
"role" : "root",
"db" : "admin"
}
]
}
......
"PRETTY_NAME="Debian GNU/Linux 9 (stretch)"", architecture: "x86_64", version: "Kernel 5.8.6-1-MANJARO" } }
2020-09-16T16:17:56.347+0000 I ACCESS [conn1] Successfully authenticated as principal admin on admin
2020-09-16T16:17:56.350+0000 I ACCESS [conn1] Successfully authenticated as principal admin on admin
2020-09-16T16:18:19.463+0000 I NETWORK [conn1] end connection 127.0.0.1:37096 (0 connections now open)

一些建议,望采纳

1.建议增加任务的重复扫描 和 周期性的定时扫描计划
2.建议增加扫描结果较上次相比发现新域名时通过邮箱进行通知

操作系统识别代码有问题

def os_match_by_accuracy(self, os_match_list):
for os_match in os_match_list:
accuracy = os_match.get('accuracy', '0')
if int(accuracy) > 90:
return os_match

    return {}

1.应该对识别出来的可能的操作系统根据accuracy进行可信度排名
当nmap出来的结果 都不可信的时候直接去掉
2 对于操作系统识别可以通过nmap的扫出来的应用进行深层次的操作系统识别
3,可以将所有的回包 用pof进行获得操作系统。

docker-compose up -d失败

报这个错

ERROR: Version in "./docker-compose.yml" is unsupported. You might be seeing this error because you're using the wrong Compose file version. Either specify a version of "2" (or "2.0") and place your service definitions under the services key, or omit the version key and place your service definitions at the root of the file to use version 1.
For more on the Compose file format versions, see https://docs.docker.com/compose/compose-file/

平台方向建议

1,可以让用户自定义武器库,自定义的武器库扫出来结果单独用一个字段存放
2,可以仿照Zoomeye,将这个做成一个空间测绘,聚合用户的收集目标
3,建立企业-资产-漏洞关联
4,根据所有客户输入的信息,将所有客户的指纹进行排名
5,根据指纹,进行漏洞的挖掘

docker-compose up -d启动报错

`Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 597, in urlopen
httplib_response = self._make_request(conn, method, url,
File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 354, in _make_request
conn.request(method, url, **httplib_request_kw)
File "/usr/lib/python3.8/http/client.py", line 1255, in request
self._send_request(method, url, body, headers, encode_chunked)
File "/usr/lib/python3.8/http/client.py", line 1301, in _send_request
self.endheaders(body, encode_chunked=encode_chunked)
File "/usr/lib/python3.8/http/client.py", line 1250, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
File "/usr/lib/python3.8/http/client.py", line 1010, in _send_output
self.send(msg)
File "/usr/lib/python3.8/http/client.py", line 950, in send
self.connect()
File "/home/orochi/.local/lib/python3.8/site-packages/docker/transport/unixconn.py", line 43, in connect
sock.connect(self.unix_socket)
PermissionError: [Errno 13] Permission denied

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 439, in send
resp = conn.urlopen(
File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 637, in urlopen
retries = retries.increment(method, url, error=e, _pool=self,
File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 368, in increment
raise six.reraise(type(error), error, _stacktrace)
File "/usr/local/lib/python3.8/dist-packages/urllib3/packages/six.py", line 685, in reraise
raise value.with_traceback(tb)
File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 597, in urlopen
httplib_response = self._make_request(conn, method, url,
File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 354, in _make_request
conn.request(method, url, **httplib_request_kw)
File "/usr/lib/python3.8/http/client.py", line 1255, in request
self._send_request(method, url, body, headers, encode_chunked)
File "/usr/lib/python3.8/http/client.py", line 1301, in _send_request
self.endheaders(body, encode_chunked=encode_chunked)
File "/usr/lib/python3.8/http/client.py", line 1250, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
File "/usr/lib/python3.8/http/client.py", line 1010, in _send_output
self.send(msg)
File "/usr/lib/python3.8/http/client.py", line 950, in send
self.connect()
File "/home/orochi/.local/lib/python3.8/site-packages/docker/transport/unixconn.py", line 43, in connect
sock.connect(self.unix_socket)
urllib3.exceptions.ProtocolError: ('Connection aborted.', PermissionError(13, 'Permission denied'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/home/orochi/.local/lib/python3.8/site-packages/docker/api/client.py", line 205, in _retrieve_server_version
return self.version(api_version=False)["ApiVersion"]
File "/home/orochi/.local/lib/python3.8/site-packages/docker/api/daemon.py", line 181, in version
return self._result(self._get(url), json=True)
File "/home/orochi/.local/lib/python3.8/site-packages/docker/utils/decorators.py", line 46, in inner
return f(self, *args, **kwargs)
File "/home/orochi/.local/lib/python3.8/site-packages/docker/api/client.py", line 228, in _get
return self.get(url, **self._set_request_timeout(kwargs))
File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 537, in get
return self.request('GET', url, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 524, in request
resp = self.send(prep, **send_kwargs)
File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 637, in send
r = adapter.send(request, **kwargs)
File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 498, in send
raise ConnectionError(err, request=request)
requests.exceptions.ConnectionError: ('Connection aborted.', PermissionError(13, 'Permission denied'))

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/home/orochi/.local/bin/docker-compose", line 8, in
sys.exit(main())
File "/home/orochi/.local/lib/python3.8/site-packages/compose/cli/main.py", line 67, in main
command()
File "/home/orochi/.local/lib/python3.8/site-packages/compose/cli/main.py", line 123, in perform_command
project = project_from_options('.', options)
File "/home/orochi/.local/lib/python3.8/site-packages/compose/cli/command.py", line 60, in project_from_options
return get_project(
File "/home/orochi/.local/lib/python3.8/site-packages/compose/cli/command.py", line 131, in get_project
client = get_client(
File "/home/orochi/.local/lib/python3.8/site-packages/compose/cli/docker_client.py", line 41, in get_client
client = docker_client(
File "/home/orochi/.local/lib/python3.8/site-packages/compose/cli/docker_client.py", line 170, in docker_client
client = APIClient(**kwargs)
File "/home/orochi/.local/lib/python3.8/site-packages/docker/api/client.py", line 188, in init
self._version = self._retrieve_server_version()
File "/home/orochi/.local/lib/python3.8/site-packages/docker/api/client.py", line 212, in _retrieve_server_version
raise DockerException(
docker.errors.DockerException: Error while fetching server API version: ('Connection aborted.', PermissionError(13, 'Permission denied'))
`

镜像启动后报错

CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
4719eabe6ef4 tophant/arl:latest "sh -c 'celery -A ..." 2 minutes ago Restarting (255) 34 seconds ago arl_worker
ef9940cf55c4 tophant/arl:latest "sh -c 'nginx; gun..." 2 minutes ago Restarting (1) 37 seconds ago arl_web
5054aae5854e mongo:3.6-stretch "docker-entrypoint..." 2 minutes ago Up 2 minutes 27017/tcp arl_mongodb
245844a75da1 rabbitmq:3-management-alpine "docker-entrypoint..." 2 minutes ago Up 2 minutes 4369/tcp, 5671-5672/tcp, 15671-15672/tcp, 15691-15692/tcp, 25672/tcp arl_rabbitmq
[root@localhost docker]# ^C
[root@localhost docker]# docker logs 4719eabe6ef4
Parse config.yaml error [Errno 13] Permission denied: '/code/app/config.yaml'
Parse config.yaml error [Errno 13] Permission denied: '/code/app/config.yaml'
Parse config.yaml error [Errno 13] Permission denied: '/code/app/config.yaml'
Parse config.yaml error [Errno 13] Permission denied: '/code/app/config.yaml'
Parse config.yaml error [Errno 13] Permission denied: '/code/app/config.yaml'
Parse config.yaml error [Errno 13] Permission denied: '/code/app/config.yaml'
Parse config.yaml error [Errno 13] Permission denied: '/code/app/config.yaml'
Parse config.yaml error [Errno 13] Permission denied: '/code/app/config.yaml'
Parse config.yaml error [Errno 13] Permission denied: '/code/app/config.yaml'
Parse config.yaml error [Errno 13] Permission denied: '/code/app/config.yaml'
Parse config.yaml error [Errno 13] Permission denied: '/code/app/config.yaml'
[root@localhost docker]# docker logs ef9940cf55c4
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]
Error: Error: 'arl_web.log' isn't writable [PermissionError(13, 'Permission denied')]

扫描增加多网段格式

星光大佬,测试发现不支持 127.0.0.1-255 127.0.0.1-127.0.0.255这种格式的网段。
另外有限制qps嘛?

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.