Volfied - Player's ship will travel down if key is released about ao486_mister HOT 1 OPEN

I'm using DOS 6.22
It seems my issue might be related to my Config.sys, specifically my EMM386.exe entry. If I remove my EMM386.exe line the issue is gone.
This is what I'm using for the EMM386 entry. Maybe someone can suggest a better entry.

DEVICE=C:\DOS\EMM386.EXE RAM 8192 FRAME=E000 D=256 X=CE00-CFFF I=D000-EFFF

==============================================================
My config.sys:

DEVICE=C:\DOS\HIMEM.SYS /TESTMEM:off /v
DOS=HIGH,UMB
DEVICE=C:\DOS\EMM386.EXE RAM 8192 FRAME=E000 D=256 X=CE00-CFFF I=D000-EFFF
DEVICEHigh=C:\DOS\oakcdrom.sys /D:mscd001
BUFFERS=15,0
FILES=30
LASTDRIVE=N
FCBS=4,0
SWITCHES=/F

Update: If the joystick is disabled in the OSD the issue is gone.

from ao486_mister.