kendryte / k510_buildroot Goto Github PK
View Code? Open in Web Editor NEWKendryte K510 SDK
License: BSD 2-Clause "Simplified" License
Kendryte K510 SDK
License: BSD 2-Clause "Simplified" License
Add coding parameters and advanced functions:roi, gdr, ltr
No response
No response
详见nncase网站 : https://github.com/kendryte/nncase/releases/tag/v1.7.0
Fix/fold matmul add (#584)
fix onnx prelu importer (#585)
remove quantization range limitation (#596)
修复demo1 landmark问题(demo1编译模型脚本有更新,量化时需要使用人脸真实图片,脚本和图片参考附件的demo1_data.tgz)
No response
Add AE control in encode app, to improve image quality of output stream.
No response
No response
Modify SEI user data implementation
No response
No response
Add coding functions: filtering, slice, entropy coding, SEI
No response
No response
kernel panic when encode_app input data is too big
cd /app/encode_app
./encode_app -split 1 -ch 0 -i /root/sd/p3/canaan_slice_NV12.yuv -o /root/sd/p3/my_out.264 -w 1920 -h 1080 -inframes 100 -outframes 100
k510 crb kit
v1.6-4d34292-20220523-102951CST-root-297352670b41
10/10
No response
1.AE闪烁问题
2.AWB不准确
3.色彩偏差
4.边角色偏
when share memory alloc failed , mediactl_init and drm_init use error address , kernel crash:
mediactl_init:total_size.width(0xd94),total_size.height(0x48e)
---------------------------start ----------------------------------------
[ 669.718949] [K510_RESET]:k510_reset id = 0x01404f80, offset = 0x00000140 type = 1 done = 31 reset =0
[ 670.108056] k510-share-memory: [ERROR] memPartAlignedAlloc mpid->numBytesFree less than nBytes!
ioctl(SHARE_MEMORY_ALIGN_ALLOC) failed: Bad address
[ 670.164849] k510-isp 92600000.isp1: swiotlb buffer is full (sz: 2351104 bytes)
[ 670.172254] k510-isp 92600000.isp1: swiotlb: coherent allocation failed, size=2351104
[ 670.180238] CPU: 0 PID: 920 Comm: object_detect_o Not tainted 4.17.0-gf8b1331c #1
[ 670.187744] Call Trace:
[ 670.190246] [] walk_stackframe+0x0/0xa4
[ 670.195689] [] show_stack+0x2c/0x38
[ 670.200788] [] dump_stack+0x64/0x80
[ 670.205874] [] swiotlb_alloc+0x10c/0x124
[ 670.211373] [] arch_dma_alloc+0x2c/0xd4
[ 670.216785] [] vb2_dc_alloc+0xc0/0x144
[ 670.222106] [] __vb2_queue_alloc+0x15a/0x3d0
[ 670.227946] [] vb2_core_reqbufs+0x1e8/0x334
[ 670.233700] [] vb2_reqbufs+0x24/0x30
[ 670.238855] [] k510isp_video_reqbufs+0x70/0x8c
[ 670.244872] [] v4l_reqbufs+0x50/0x60
[ 670.250018] [] __video_do_ioctl+0x15e/0x240
[ 670.255764] [] video_usercopy+0x1bc/0x34c
[ 670.261344] [] video_ioctl2+0x14/0x1c
[ 670.266576] [] v4l2_ioctl+0x9c/0xc8
[ 670.271640] [] do_vfs_ioctl+0x53a/0x568
[ 670.277048] [] ksys_ioctl+0x34/0x60
[ 670.282106] [] sys_ioctl+0x10/0x1c
[ 670.287081] [] ret_from_syscall+0x0/0xe
[ 670.292592] k510-isp 92600000.isp1: dma_alloc_coherent of size 2351104 failed
[ 672.695399] k510-isp 92600000.isp1: k510isp_video_streamoff:video(00000000c86e0514) video(00000000c86e0514) pipe( (null)) start
[ 672.707743] k510-isp 92600000.isp1: k510isp_video_streamoff:streaming0 err!
重复如下操作:
cd /app/ai/object_detect_opencv
./bf16.sh
等待几秒;ctrl +C
./uint8.sh
等待几秒;ctrl +C
k510 crb kit
No response
No response
No response
JPEG coding is abnormal, and the audio and picture of 264 coding are not synchronized
JPEG coding is abnormal, and the audio and picture of 264 coding are not synchronized
k510 crb kit
No response
No response
No response
1.增加外部分配stream buffer接口
2.roi 默认配置
No response
No response
There are too many configuration files in the v4l2 demo, which cannot be managed uniformly
no
k510 crb 1.2
v1.5
10/10
No response
Added function: ffmpeg push RTMP stream: ffmpeg add librtmp module to ffmpeg
Ffmpeg supports RTMP streaming
No response
[root@canaan /app/mediactl_lib ]$ ./isp-tuningd
page size: 4096
off_t size: 8
offset_in_page: 0
map_size: 1048576
FPGA board not detected
Segmentation fault (core dumped)
同时运行encode_app和isp-tuningd
k510 crb kit
No response
No response
No response
isp tuning tool保存硬件编码器的jpeg图片
No response
No response
Fix isp outputs old pitcure
Add debug method to check isp dma error and interrupt big duration
Want resolve what problem
Fix isp outputs old pitcure
Anything else
No response
dsi read hang when no lcd is connected at uboot startup
remove the lcd and start the board
k510 crb kit
v1.6
100%
No response
When ffmpeg encodes JEPG, press Q to exit core dump
When ffmpeg encodes JEPG, press Q to exit core dump
k510 crb kit
No response
No response
No response
Sensor支持多种帧率
Sensor支持多种帧率
No response
current result: github action can't get the latest tag for version str generate.
improvment: old command can't get the latest tags and casued version str is error in github checkout
[ 615.243772] __media_entity_enum_init:ent_enum->bmap1( (null)),idx_max(0x40)
[ 615.251536] Unable to handle kernel paging request at virtual address 0000000000600066
[ 615.259844] Oops [#1]
[ 615.262126] Modules linked in: brcmfmac cfg80211 brcmutil nfs_layout_flexfiles
[ 615.269380] CPU: 0 PID: 362 Comm: v4l2_drm.out Not tainted 4.17.0 #1
[ 615.275740] sepc: ffffffe0000f830e ra : ffffffe0000f8290 sp : ffffffe004b399a0
[ 615.282967] gp : ffffffe0008e9de8 tp : ffffffe0084c2e40 t0 : ffffffe000977f50
[ 615.290194] t1 : 000000000003b7f4 t2 : 0000003fff96c9c0 s0 : ffffffe004b399e0
[ 615.297421] s1 : ffffffe00099fe00 a0 : 0000000000000000 a1 : 00000000014080c0
[ 615.304648] a2 : 0000000000000001 a3 : ffffffe0008148e0 a4 : 0000000000600066
[ 615.311874] a5 : 0000000000600066 a6 : 00000000000014bb a7 : 000000000000000d
[ 615.319101] s2 : 00000000014080c0 s3 : ffffffe000409fdc s4 : ffffffe00097ca68
[ 615.326328] s5 : 000000000000803c s6 : ffffffe00a2b0208 s7 : ffffffe0096e5000
[ 615.333553] s8 : ffffffe00a2b7000 s9 : 0000000000000000 s10: 0000000000000000
[ 615.340779] s11: ffffffe00089efe8 t3 : 0000000000002770 t4 : 0000000000001968
[ 615.348004] t5 : 0000000000002770 t6 : ffffffe000973edf
[ 615.353321] sstatus: 0000000200000120 sbadaddr: 0000000000600066 scause: 000000000000000d
[ 615.361504] CPU: 0 PID: 362 Comm: v4l2_drm.out Not tainted 4.17.0 #1
[ 615.367860] Call Trace:
[ 615.370332] [] walk_stackframe+0x0/0xa4
[ 615.375740] [] show_stack+0x2c/0x38
[ 615.380804] [] dump_stack+0x64/0x80
[ 615.385863] [] die+0x70/0xf8
[ 615.390316] [] do_page_fault+0x24c/0x358
[ 615.395810] [] ret_from_exception+0x0/0xc
[ 615.403065] ---[ end trace 381220f0a5d8101c ]---
[ 615.407740] Kernel panic - not syncing: Fatal exception
cd /app/mediactl_lib/
./v4l2_drm.out -f video_drm_1920x1080.conf
k510 crb kit
v1.6-4d34292-20220523-102951CST-root-297352670b41
2/10
No response
ai ds2 add pitch,
ai full screen
No response
v4l2_drm 双摄水波纹
./v4l2_drm.out -f video_drm_1920x1080.conf
k510 crb kit
No response
No response
No response
在板子上执行如下命令
[root@canaan ~/sd/p2/app/ai/object_detect_v4l2 ]$ ./uint8.sh
报错:
`---------------------------start ----------------------------------------
case2 ./object_detect_v4l2 build May 11 2022 17:13:04
drm: Found plane_id: 50 connector_id: 49 crtc_id: 57
drm: 1080x720 (68mm X 121mm) pixel format NV12
found plane 50found plane 54dbuf_fd = 6
dbuf_fd = 7
dbuf_fd = 8
----------------drm_setup_buffers ---------------------------------
mediactl_init:video.conf
dofile_video_cfg:video.conf
doit_video_cfg:start
doit_video_cfg:sensor1 cJSON_GetArraySize: size=8
cJSON_GetArrayItem: type=4, string is sensor1_name, valuestring is m01_f_imx219_1 3-0010,m01_f_imx219_1 3-0010,8
cJSON_Ge[ 73.452889] k510-isp 92600000.isp1: __media_entity_setup_link:link->flags(0x1),MEDIA_LNK_FL_DYNAMIC(0x4),source->stream_count(1),sink->stream_count(1)
tArrayItem: type=4, string is se[ 73.470376] k510-isp 92600000.isp1: k510isp_video_streamon:start
nsor1_cfg_file, valuestring is i[ 73.477058] __media_entity_enum_init:idx_max(0x17)start
mx219_1.conf,imx219_1.conf,8
cJ[ 73.485862] _media_entity_enum_init:ent_enum->bmap1( (null)),idx_max(0x40)
SON_GetObjectItem(sensor1_total[ 73.495748] __media_entity_enum_init:ent_enum->bmap2(00000000313ff702)
width): type=3, string is sensor[ 73.504988] __media_entity_enum_init:end
[ 73.511778] __media_entity_enum_init:idx_max(0x17)start
`
ISP Tuning Tool 暂停时可能导致图片不完整/缺损
暂停 播放
k510 crb kit
v1.5
No response
isp-tuningd中stdin_read逻辑不正确,当一次收到的数据太多时会丢弃部分内容,导致数据大小不对齐和图片被截断,表现为图片乱码
ai demo 运行几次后 share_memory就会耗尽,随后打印类似下面错误:
memPartAlignedAlloc mpid->numBytesFree less than nBytes
isp_f2k_cfg:total_width =3476,total_height =1166
mediactl_init:total_size.width(0xd94),total_size.height(0x48e)
---------------------------start ----------------------------------------
[ 1008.590420] [K510_RESET]:k510_reset id = 0x01404f80, offset = 0x00000140 type = 1 done = 31 reset =0
[ 1008.837915] k510-share-memory: [ERROR] memPartAlignedAlloc mpid->numBytesFree less than nBytes!
[ 1008.891306] Unable to handle kernel paging request at virtual address 000000433cacbcbc
[ 1008.899276] Oops [#1]
[ 1008.901571] Modules linked in:
[ 1008.904676] CPU: 0 PID: 1166 Comm: object_detect_o Not tainted 4.17.0-g732c4420-dirty #14
[ 1008.908425] Unable to handle kernel paging request at virtual address 000000643c7fbcb0
[ 1008.912885] sepc: ffffffe0000eef3a ra : ffffffe0000f0514 sp : ffffffe009aff860
[ 1008.928021] gp : ffffffe0008ebde8 tp : ffffffe007956340 t0 : ffffffe00156f300
[ 1008.935248] t1 : 0000000000000000 t2 : 00000000014002c4 s0 : ffffffe009aff8f0
[ 1008.942476] s1 : ffffffe00156f298 a0 : ffffffe00156f298 a1 : 0000000000001000
[ 1008.949704] a2 : ffffffd018280000 a3 : ffffffd016f80000 a4 : ffffffe00a736bf8
[ 1008.956931] a5 : bd21bc433cacbccc a6 : 0000000000000008 a7 : ffffffff8012000d
[ 1008.964158] s2 : 000000000023f000 s3 : 0000000000080000 s4 : ffffffd000000000
[ 1008.971386] s5 : ffffffdfffffffff s6 : fffffffffff80000 s7 : 000000000007ffff
[ 1008.978613] s8 : ffffffd00023f000 s9 : 0000000000000000 s10: ffffffe00087c230
[ 1008.985840] s11: 00000000014000c0 t3 : ffffffffffffffff t4 : ffffffffffffff80
[ 1008.993066] t5 : 0000000000000038 t6 : 0000000000000400
[ 1008.998383] sstatus: 0000000200000120 sbadaddr: 000000433cacbcbc scause: 000000000000000d
重复如下步骤:
k510 crb kit
No response
1/30
No response
ai demo read 打印timeout ,随后异常,打印类似如下:
[ 379.622555] k510-isp 92600000.isp1: k510isp_pipeline_enable:i(0) f2k_used[0] (1)f2k multivideo!
[ 379.631270] k510-isp 92600000.isp1: k510isp_pipeline_enable:end
[ WARN:0] global /home/wangjianxin/w/k510_buildroot/k510_crb_lp3_v1_2_defconfig/build/opencv4-4.5.2/modules/videoio/src/cap_v4l.[ 389.651984] object_detect_o[692]: unhandled signal 11 code 0x1 at 0x0000000000000003 in object_detect_opencv[10000+c1000]
cpp (1001) tryIoctl VIDEOIO(V4L2:/dev/video5): select() timeout.
[ 389.674367] CPU: 0 PID: 692 Comm: object_detect_o Not tainted 4.17.0-gf8b1331c #2
[ 389.681920] sepc: 0000000000020f18 ra : 0000000000020ed8 sp : 00000020027cb470
[ 389.689149] gp : 00000000000d46b0 tp : 00000020027cc840 t0 : 000000200001ef10
[ 389.696415] t1 : 0000000000003200 t2 : 0000002000027ed8 s0 : 0000000000116040
[ 389.704004] s1 : 00000020027cb550 a0 : 0000000000000000 a1 : 0000000000000000
[ 389.711239] a2 : 0000000000035200 a3 : 0000000000000000 a4 : 0000000000000000
[ 389.718515] a5 : 0000000000000000 a6 : 00000000000000f0 a7 : 000000000001c200
[ 389.725902] s2 : 0000000000035200 s3 : 0000000000003200 s4 : 0000000000000140
[ 389.733162] s5 : 000000000001fca0 s6 : 000000000001c200 s7 : 00000020027cc840
[ 389.751944] s8 : 00000000000000f0 s9 : 00000020027cc130 s10: 0000000000001000
[ 389.759188] s11: 0000003ffffa8948 t3 : 0000000000000000 t4 : 0000000000000002
[ 389.773953] t5 : 0000000000000002 t6 : 0000000000000453
[ 389.779288] sstatus: 8000000200006020 sbadaddr: 0000000000000003 scause: 000000000000000d
重复如下命令:
cd /app/ai/object_detect_opencv
./bf16.sh
ctrl +C
./uint8.sh
ctrl +C
k510 crb kit
No response
1/50
No response
开始v4l2 双摄
k510 crb 1.2
1.5
10/10
No response
isp-tuning-gui 长时间暂停播放导致isp-tuningd oom
isp-tuning-gui 长时间暂停播放
k510 crb kit
v1.5-2b5b95d-20220518-114847CST-root-297352670b41
10/10
No response
README.md K510 开发板套装在线购买链接处有错误
开机自动启动单摄,屏幕很暗,比以前的版本暗多了
开机运行单摄或者双摄demo
k510 crb 1.2
v1.5
100%
No response
Encode_ App, set 7 or 8 ROIs, and start the core dump
Encode_ App, set 7 or 8 ROIs, and start the core dump
k510 crb kit
No response
No response
No response
nncase 需要提高性能
nncase提高性能
性能优化
支持int8输出类型/指定输入layout等
支持更多tflite/onnx算子
riscv64子目录重新组织了下,每个模块/第三方库一个子目录
支持9号客户模型(homemade_deeplabv3plus_mobilenet.onnx)
更新裸机刷cache接口和提前分配连续内存以提升yolov5s裸机性能
first camera picture sometimes splits to two parts in dual camera mode
encode_app add audio G.711 encoding and pushes RTSP stream
No response
No response
ISP Tuning Tool 增加3D降噪,LDC功能配置
No response
No response
encode demo,执行单摄像头双通道,报错( Failed to open subdev device node /dev/v4l-subdev2)
1.reboot
2.kill 开机自启的单摄
3.运行 cd /app/encode_app
4.执行
./encode_app -split 2 -ch 0 -i v4l2 -dev /dev/video3 -o rtsp -w 1920 -h 1080 -ch 1 -i v4l2 -dev /dev/video4 -o rtsp -w 1280
-h 720 -conf video_sample.conf -ae 1
k510 crb kit
No response
No response
No response
ffmpeg cannot parse video name.
cd /app/encode_app
ffmpeg -f v4l2 -s 1920x1080 -conf "video_sample.conf" -isp 1 -buf_type 2 -r 30 -i /dev/video4 -vcodec libk510_h264 -an -f rtp rtp://192.168.1.100:1234
k510 crb kit
v1.6-4d34292-20220523-102951CST-root-297352670b41
10/10
No response
After the network port is up, DHCP takes too long to obtain an IP address
等系统起来后,再插入网线,网口up 20秒后,dhcp才去获取ip
k510 crb kit
v1.6
1/2
No response
ai demo After the kernel panic, the reset self-starting single shot has a high probability of Huaping,
1.After starting the system, frePress reset to restartquently switch the demo program in /app/ai/shell until the kernel panic occurs
k510 crb 1.2
v1.6
8/10
No response
v4l2_drm 单摄切双摄后,上面屏幕右侧有一部分出现分屏现像
reboot
cd /app/mediactl_lib/
/v4l2_drm.out -f video_drm_1920x1080.conf 运行一会,ctrl + c结束
./v4l2_drm.out -f video_drm_1080x1920.conf 运行一会,ctrl + c结束
./v4l2_drm.out -f video_drm_1920x1080.conf
k510 crb kit
No response
9/10
No response
Cache inconsistency leads to network data error
TCP transmission data packet loss
k510 crb kit
No response
No response
No response
add gitee repository link
音画不同步,长时间播放rtsp音频延迟严重,5分钟左右alsa模块报错。
【复现步骤】:
k510 crb kit
No response
No response
No response
Change AI demo to full screen display
No response
No response
rtmp推流,无法正常推视频
1、reboot
2、kill开机自启的单摄
3、运行 cd /app/encode_app
ffmpeg -f v4l2 -s 1920x1080 -conf "video_sample.
conf" -isp 1 -buf_type 2 -r 30 -i /dev/video3 -vcodec libk510_h264 -f flv rtmp:/
/192.168.1.10/live/1
k510 crb kit
No response
No response
No response
Ffmpeg push RTP stream exception
Ffmpeg push RTP stream exception
k510 crb kit
No response
No response
No response
The resolution of the yuv file generated by v4l2-demo does not match the configuration
The resolution of the yuv file generated by v4l2-demo does not match the configuration
k510 crb 1.2
v1.7
10 / 10
No response
长时间运行ffmpeg推流video latency越来越大
任何v4l2的ffmpeg推流均能复现
k510 crb kit
No response
No response
No response
twod add osd drver
twod add osd drver
No response
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.