nick-shmyrev / improved-osk-gnome-ext Goto Github PK

Describe the bug
Clicking on a website elements (buttons, places where text can be inserted) is disturbed.

To Reproduce
Steps to reproduce the behavior:

1. Go to whichever website with Brave Browser (downloaded from their official website).
2. Click on whichever button on whatever website.
3. See error

Expected behavior
The button or other clickable element should be selected and/or become available/focused. Instead, website reacts like I have clicked on something else, rather on the needed button. Seems like the on-screen keyboard moves the website up or down instead focusing a mouse click on a place what I have clicked.

Screenshots
If applicable, add screenshots to help explain your problem.

Environment (please complete the following information):

• Distro: Ubuntu 22.04.1 LTS
• Gnome version: 42.4

Additional context
System is a fresh installation.
No other extension is interfering with on-screen keyboard.
Does journalctl /usr/bin/gnome-shell -f -o cat show any errors?
(../clutter/clutter/clutter-actor.c:12430):clutter_actor_event: runtime check failed: (retval == CLUTTER_EVENT_PROPAGATE) (../clutter/clutter/clutter-actor.c:12430):clutter_actor_event: runtime check failed: (retval == CLUTTER_EVENT_PROPAGATE) (../clutter/clutter/clutter-actor.c:12430):clutter_actor_event: runtime check failed: (retval == CLUTTER_EVENT_PROPAGATE) meta_window_set_stack_position_no_sync: assertion 'window->stack_position >= 0' failed Could not load a pixbuf from icon theme. This may indicate that pixbuf loaders or the mime database could not be found. Ignored exception from dbus method: Gio.DBusError: GDBus.Error:org.freedesktop.DBus.Error.UnknownInterface: Object does not implement the interface Window manager warning: last_focus_time (337608) is greater than comparison timestamp (380). This most likely represents a buggy client sending inaccurate timestamps in messages such as _NET_ACTIVE_WINDOW. Trying to work around... Window manager warning: last_user_time (337608) is greater than comparison timestamp (380). This most likely represents a buggy client sending inaccurate timestamps in messages such as _NET_ACTIVE_WINDOW. Trying to work around... Window manager warning: W12 appears to be one of the offending windows with a timestamp of 337608. Working around... Window manager warning: W0 appears to be one of the offending windows with a timestamp of 310923. Working around...
Can you see any errors in looking glass? No

I installed and activated the extension. It does seem to work, although the layout of the OSK is not changed compared to when the extension is disabled. Especially, the additional control keys are missing.

Describe the bug
The extension doesn't work on GNOME 43.

To Reproduce
Steps to reproduce the behavior:

1. Update to GNOME 43.
2. The extension can't be enabled on GNOME 43.

Expected behavior
The extension works on GNOME 43.

Screenshots

Environment (please complete the following information):

• Distro: openSUSE Tumbleweed
• Gnome version: 43

Additional context

• Have you been running your system for a while, or is it a fresh installation?
  I have been running my system for a while.
• Are you running any other extensions that might interfere with on-screen keyboard?
  No.
• Does journalctl /usr/bin/gnome-shell -f -o cat show any errors?
  No.
• Can you see any errors in looking glass? (Press Alt + F2, enter lg, switch to "extensions" tab and click "show errors" for Improved OSK extension)
  No.

I've just been trying out improved OSK

I'd like to suggest that you change the name of this option to "show OSK with statusbar icon" from the current "show statusbar icon". Ideally it's be nice if it could be "toggle OSK with statusbar icon" (see issue #25).

It was a bit unclear what the icon actually does from the name. I thought it might be redundant with the option to enable/disable the OSK that is in the accessibility menu, rather than a 'manual' show OSK button.

Issue #23 may indicate that I'm not the only one who didn't quite understand this option as their issue could be partially be addressed by manually toggling the keyboard on.

I am using this extension with Dash to Panel. I would like to be able to have the OSK be shown above (on the Y axis, not Z axis) the panel, so that I can still access it while the keyboard is showing.

          > Great find! This is exactly what's needed to fix the issue with screensaver in #36 :+1: 

Also, I've found a way to get it working with GDM - the extension needs to be installed and enabled as a machine-wide extension in order for it to show up on login screen: https://help.gnome.org/admin/system-admin-guide/stable/extensions-enable.html.en. Once I'll have some time, I'll add another section to README with instructions and maybe a bash script to do all that the easy way.

Hmm, that doesn't work for me... The extension doesn't even show up in the Extensions app... Does it work for you?

Originally posted by @PhilDevProg in #39 (comment)

I daily drive Pop!_OS on my 2-in-1. Tablet mode works fairly well on it, with one exception...
The 16" screen size is really nice except for when you're trying to type on an absolutely massive keyboard, and your thumbs can only easily reach for ~20-30% of the area needed to type.
I have no idea how difficult this would be, but being able to maybe change the size of the keys and split the keyboard like so would make this way more usable:

The super text does not fit and it does not stand out as much as the Windows logo on a keyboard. Maybe giving it a generic logo or a penguin would improve it.

Describe the bug
The script, package-extension.sh does not run successfully because the file, src/stylesheet.css does not exist.
To Reproduce
Steps to reproduce the behavior:

1. Clone the repo.
2. Run the installation script as recommended, ./package-extension.sh
   The following error occurs during the running of the script:
   cp: cannot stat 'src/stylesheet.css': No such file or directory

Expected behavior
The script should run successfully.

Screenshots
N/A

Environment (please complete the following information):

• Distro: Debian 12
• Gnome version:43.9

Additional context
The src/stylesheet.css file is missing. It is still available in the original repo, which this repo was forked from.

Describe the bug
Systems with v9 still work great. Systems with v11 just pop up a black background where the keyboard should be. If I turn off your extension AND reboot the system the non-improved keyboard pops up fine. If I do not restart the system after turning off extension there is no effect. See attached picture.

I am running Ubuntu 22.04.1 LTS with Gnome version 42.5 and x11 instead of Wayland.

Output of journalctl:

Can't update stage views actor [:0x55558213b4e0] is on because it needs an allocation.
Can't update stage views actor [:0x555580194310] is on because it needs an allocation.
Can't update stage views actor [:0x555582137710] is on because it needs an allocation.
Can't update stage views actor [:0x55558213b4e0] is on because it needs an allocation.
Can't update stage views actor [:0x555580194310] is on because it needs an allocation.
Can't update stage views actor [:0x555582137710] is on because it needs an allocation.
Can't update stage views actor [:0x55558213b4e0] is on because it needs an allocation.
Can't update stage views actor [:0x555580194310] is on because it needs an allocation.
Can't update stage views actor [:0x555582137710] is on because it needs an allocation.
Can't update stage views actor [:0x55558213b4e0] is on because it needs an allocation.

Looking glass shows has not emitted any errors.

Hello I see all F-function keys, except F10.. Is this issue affecting only me?
I'm on arch linux with gnome 41 with wayland

Describe the bug
To install the extension successfully, the glib 2.0 development dependencies and the zip package are required. It is not explicit in your installation instructions that they should be installed as a pre-requisite.

To Reproduce
Steps to reproduce the behavior:

1. Ensure you do not have libglib2.0-dev-bin and zip installed.
2. Clone the repo. run the package-extension.sh script.
   The following errors are displayed:

./compile-gresource.sh: 3: glib-compile-resources: not found
cp: cannot stat 'src/data/gnome-shell-osk-layouts.gresource': No such file or directory
./package-extension.sh: 31: zip: not found
rm: cannot remove 'src/data/*.gresource': No such file or directory

Expected behavior
The script should run successfully without errors.

Screenshots
N/A

Environment (please complete the following information):

• Distro: Debian 12
• Gnome version: 43.9

Additional context
By default, Debian 12 does not come with these packages pre-installed. It would be wise to include in the readme and pre-requisite install step with these included, for example:
sudo apt install libglib2.0-dev-bin zip

Adding a number row similar to Android. Laptops should have enough space to accommodate a number row.

I'm on a fresh install of Fedora 38 an have today's Improved OSK update supporting gnome 44 installed and the extension refuses to work no matter what I try with any of the extension settings or system settings. Any ideas?

There's a lot of unused space above the keys with the default height 33 on portrait screen, while 16 looks fine for me. Should the default value be decreased?

Updated to Gnome 42, please add support on the extensions.gnome.org page

[Feature Request]
add special keys: Home, End, PageUp, PageDown

What is happening

Unable to install extension. Accessing the extension under Gnome 43 at https://extensions.gnome.org/extension/4413/improved-osk/ - extension is marked as "Incompatible".

Issue seems to be due to change to metadata.json file. Appears this file has been modified (and modified version uploaded to extensions.gnome.org) since the email notifying issue #30 was sent.

More information
I installed the extension via https://extensions.gnome.org/extension/4413/improved-osk/ earlier this morning. The extension installed, could be activated, and worked without issue. About half an hour ago, I attempted to reinstall the extension in the same way (I had to roll back my system to a snapshot from yesterday, due to an unrelated issue). When attempting to install Improved OSK via https://extensions.gnome.org/extension/4413/improved-osk/, the extension was marked as "INCOMPATIBLE" on the website.

I noted the only file that has been modified on Github between the two attempts at installing was metadata.json; I am assuming the issue has to do with the Gnome version in this file. Unfortunately, I don't have a copy of the installed version of the extension from earlier today to verify this.

Environment:

• Distro: Arch Linux (installed from official Arch ISO)
• Gnome version: 43 (Wayland)

Additional context
Have you been running your system for a while, or is it a fresh installation? System has been running for roughly a month.

Are you running any other extensions that might interfere with on-screen keyboard? None that I am aware of (see above re two installations of Improved OSK extension).

Does journalctl /usr/bin/gnome-shell -f -o cat show any errors?

Unhandled promise rejection. To suppress this warning, add an error handler to your promise chain with .catch() or a try-catch block around your await expression. Stack trace of the failed promise:
_onMountAdded@resource:///org/gnome/shell/ui/components/autorunManager.js:146:24

Unhandled promise rejection. To suppress this warning, add an error handler to your promise chain with .catch() or a try-catch block around your await expression. Stack trace of the failed promise:
_onMountAdded@resource:///org/gnome/shell/ui/components/autorunManager.js:146:24

GNOME Shell started at Sat Mar 11 2023 19:35:38 GMT+1000 (Australian Eastern Standard Time)
Registering session with GDM
Error connecting to the screencast service
activated: Extensions
Window manager warning: Buggy client sent a _NET_ACTIVE_WINDOW message with a timestamp of 0 for 0x2400004
Window manager warning: Buggy client sent a _NET_ACTIVE_WINDOW message with a timestamp of 0 for 0x2400004
clutter_actor_set_child_below_sibling: assertion 'sibling->priv->parent == self' failed
Starting ddterm app: ["/usr/share/gnome-shell/extensions/[email protected]/com.github.amezin.ddterm","--undecorated"]
(Note: I do not believe this output to be relevant, as at present Improved OSK extension is not installed on my system, and cannot be installed.)

Can you see any errors in looking glass? (Press Alt + F2, enter lg, switch to "extensions" tab and click "show errors" for Improved OSK extension): No, as extension not currently installed

Happy to continue testing, or assisting in any way I can.

The keyboard show up on all Gnome applications (Ubuntu 22.04 - Gnome 42) but it never show up with all other application, like Firefox. So I cannout use linux with my Surface with out phisical keyboard.

There is a way to show the keyboard up on this ohter app?

Like in Windows, is possible to add an keyboard button in the right top corner so there is always the possibilità to call the keyboard without a touch input?

Thanks

I have not delved into the source, but what is the likelihood of breaking this out of the dependencies of Gnome? I think this would be far better if it were independent of the DE entirely.

I played a bit with your extension and I basically managed to get what I needed.
There's just one thing I can't figure out how to do, change Space Bar width.

I tried changing in /src/data/osk-layouts/ this

"strings": [
              " "
            ],
            "width": 5
            ...

to

"strings": [
              " "
            ],
            "width": 7

and then run

glib-compile-resources gnome-shell-osk-layouts.gresource.xml --sourcedir=./osk-layouts --target=gnome-shell-osk-layouts.gresource

I also tried to hack it using some css workaround but no luck.

Is there a way to achieve this or is it some kind of bug?
Thanks

Hello, I use ubuntu 22.04 LTS and the last compatible version 9 of this incredibly MUST extension!!
I made some layout changes and I was wondering if you are interested and if you can update this version for us who still use gnome 42?

What happened

I downloaded the compatible version from the extension manager and start changing according to my likes and when I was happy with the result I came to this repository only to realize that the project went through a major rewrite for gnome 43!!
(I was happily surprised to see that for some things we took the same route :)

Preview

(Play with the height in the options for optimal result)

Install Improved OSK v9 and apply patches:

My changes are only in the layout, no functionality was altered.
For transparency I created two patches for extension.js and stylesheet.css

wget https://extensions.gnome.org/download-extension/improvedosk%40nick-shmyrev.dev.shell-extension.zip?version_tag=35584 \
    -O /tmp/improvedosknick-shmyrev.dev.v9.shell-extension.zip && \
gnome-extensions install /tmp/improvedosknick-shmyrev.dev.v9.shell-extension.zip && \
rm /tmp/improvedosknick-shmyrev.dev.v9.shell-extension.zip && \
wget -qO- https://github.com/nick-shmyrev/improved-osk-gnome-ext/files/11141363/extension.patch.txt | \
    patch ~/.local/share/gnome-shell/extensions/[email protected]/extension.js && \
wget -qO- https://github.com/nick-shmyrev/improved-osk-gnome-ext/files/11141950/stylesheet.patch.txt | \
    patch ~/.local/share/gnome-shell/extensions/[email protected]/stylesheet.css

--- extension.js	2022-10-18 17:37:58.000000000 +0200
+++ extension_updated.js	2023-04-03 20:07:23.217332802 +0200
@@ -207,110 +207,43 @@
 function override_getDefaultKeysForRow(row, numRows, level) {
   let defaultKeysPreMod = [
     [
-      [{ label: "Esc", width: 1, keyval: Clutter.KEY_Escape }],
-      [{ label: "↹", width: 1.5, keyval: Clutter.KEY_Tab }],
-      [
-        {
-          label: "⇑",
-          width: 1.5,
-          level: 1,
-          extraClassName: "shift-key-lowercase",
-        },
-      ],
-      [
-        {
-          label: "Ctrl",
-          width: 1,
-          keyval: Clutter.KEY_Control_L,
-          extraClassName: "control-key",
-        },
-        {
-          label: "◆",
-          width: 1,
-          keyval: Clutter.KEY_Super_L,
-          extraClassName: "super-key",
-        },
-        {
-          label: "Alt",
-          width: 1,
-          keyval: Clutter.KEY_Alt_L,
-          extraClassName: "alt-key",
-        },
+      [{ label: "Esc", width: 1, keyval: Clutter.KEY_Escape, extraClassName: "medium-text" }],
+      [{ label: "Tab ↹", width: 1.5, keyval: Clutter.KEY_Tab, extraClassName: "medium-text" }],
+      [{label: "⇧ Shift", width: 2, level: 1, extraClassName: "shift-key-lowercase medium-text" }],
+      [
+        { label: "Ctrl", width: 1, keyval: Clutter.KEY_Control_L, extraClassName: "control-key medium-text" },
+        { label: "?123", width: 1, level: 2, extraClassName: "rounded-key medium-text" },
+        { label: "Alt", width: 1, keyval: Clutter.KEY_Alt_L, extraClassName: "alt-key medium-text" },
       ],
     ],
     [
-      [{ label: "Esc", width: 1, keyval: Clutter.KEY_Escape }],
-      [{ label: "↹", width: 1.5, keyval: Clutter.KEY_Tab }],
-      [{ label: "⇑", width: 1.5, level: 0, extraClassName: "shift-key-uppercase" }],
-      [
-        {
-          label: "Ctrl",
-          width: 1,
-          keyval: Clutter.KEY_Control_L,
-          extraClassName: "control-key",
-        },
-        {
-          label: "◆",
-          width: 1,
-          keyval: Clutter.KEY_Super_L,
-          extraClassName: "super-key",
-        },
-        {
-          label: "Alt",
-          width: 1,
-          keyval: Clutter.KEY_Alt_L,
-          extraClassName: "alt-key",
-        },
+      [{ label: "Esc", width: 1, keyval: Clutter.KEY_Escape, extraClassName: "medium-text" }],
+      [{ label: "Tab ↹", width: 1.5, keyval: Clutter.KEY_Tab, extraClassName: "medium-text" }],
+      [{label: "⇧ Shift", width: 2, level: 0, extraClassName: "shift-key-uppercase medium-text" }],
+      [
+        { label: "Ctrl", width: 1, keyval: Clutter.KEY_Control_L, extraClassName: "control-key medium-text" },
+        { label: "❖", width: 1, keyval: Clutter.KEY_Super_L, extraClassName: "super-key" },
+        { label: "Alt", width: 1, keyval: Clutter.KEY_Alt_L, extraClassName: "alt-key medium-text" },
       ],
     ],
     [
-      [{ label: "Esc", width: 1, keyval: Clutter.KEY_Escape }],
-      [{ label: "↹", width: 1.5, keyval: Clutter.KEY_Tab }],
-      [{ label: "=/<F", width: 1.5, level: 3 }],
-      [
-        {
-          label: "Ctrl",
-          width: 1,
-          keyval: Clutter.KEY_Control_L,
-          extraClassName: "control-key",
-        },
-        {
-          label: "◆",
-          width: 1,
-          keyval: Clutter.KEY_Super_L,
-          extraClassName: "super-key",
-        },
-        {
-          label: "Alt",
-          width: 1,
-          keyval: Clutter.KEY_Alt_L,
-          extraClassName: "alt-key",
-        },
+      [{ label: "Esc", width: 1, keyval: Clutter.KEY_Escape, extraClassName: "medium-text" }],
+      [{ label: "Tab ↹", width: 1.5, keyval: Clutter.KEY_Tab, extraClassName: "medium-text" }],
+      [{ label: "=/<F", width: 2, level: 3, extraClassName: "medium-text" }],
+      [
+        { label: "Ctrl", width: 1, keyval: Clutter.KEY_Control_L, extraClassName: "control-key medium-text" },
+        { label: "ABC", width: 1, level: 0, extraClassName: "rounded-key highlighted medium-text" },
+        { label: "Alt", width: 1, keyval: Clutter.KEY_Alt_L, extraClassName: "alt-key medium-text" },
       ],
     ],
     [
-      [{ label: "Esc", width: 1, keyval: Clutter.KEY_Escape }],
-      [{ label: "↹", width: 1.5, keyval: Clutter.KEY_Tab }],
-      [{ label: "?123", width: 1.5, level: 2 }],
-      [
-        {
-          label: "Ctrl",
-          width: 1,
-          keyval: Clutter.KEY_Control_L,
-          extraClassName: "control-key",
-        },
-        {
-          label: "◆",
-          width: 1,
-          keyval: Clutter.KEY_Super_L,
-          extraClassName: "super-key",
-        },
-        {
-          label: "Alt",
-          width: 1,
-          keyval: Clutter.KEY_Alt_L,
-          extraClassName: "alt-key",
-        },
+      [{ label: "Esc", width: 1, keyval: Clutter.KEY_Escape, extraClassName: "medium-text" }],
+      [{ label: "Tab ↹", width: 1.5, keyval: Clutter.KEY_Tab, extraClassName: "medium-text" }],
+      [{ label: "=/<F", width: 2, level: 2, extraClassName: "highlighted medium-text" }],
+      [
+        { label: "Ctrl", width: 1, keyval: Clutter.KEY_Control_L, extraClassName: "control-key medium-text" },
+        { label: "ABC", width: 1, level: 0, extraClassName: "rounded-key highlighted medium-text" },
+        { label: "Alt", width: 1, keyval: Clutter.KEY_Alt_L, extraClassName: "alt-key medium-text" },
       ],
     ],
   ];
@@ -318,149 +251,101 @@
   let defaultKeysPostMod = [
     [
       [
-        { label: "⌫", width: 1.5, keyval: Clutter.KEY_BackSpace },
-        { label: "⌦", width: 1, keyval: Clutter.KEY_Delete },
-        { label: "⇊", width: 1, action: "hide", extraClassName: "hide-key" },
-      ],
-      [
-        {
-          label: "⏎",
-          width: 2,
-          keyval: Clutter.KEY_Return,
-          extraClassName: "enter-key",
-        },
-        {
-          label: "🗺",
-          width: 1.5,
-          action: "languageMenu",
-          extraClassName: "layout-key",
-        },
-      ],
-      [
-        {
-          label: "⇑",
-          width: 3,
-          level: 1,
-          right: true,
-          extraClassName: "shift-key-lowercase",
-        },
-        { label: "?123", width: 1.5, level: 2 },
-      ],
-      [
-        { label: "←", width: 1, keyval: Clutter.KEY_Left },
-        { label: "↑", width: 1, keyval: Clutter.KEY_Up },
-        { label: "↓", width: 1, keyval: Clutter.KEY_Down },
-        { label: "→", width: 1, keyval: Clutter.KEY_Right },
+        { label: "⌫", width: 1, keyval: Clutter.KEY_BackSpace, extraClassName: "medium-text" },
+        { label: "Delete", width: 1, keyval: Clutter.KEY_Delete, extraClassName: "small-text" },
+        { label: "🖮\n▿", width: 1, action: "hide", extraClassName: "hide-key" },
+      ],
+      [
+        { label: "⏎", width: 1.5, keyval: Clutter.KEY_Return, extraClassName: "enter-key big-text" },
+        { label: "Home", width: 1, keyval: Clutter.KEY_Home, extraClassName: "small-text" },
+        { label: "PgUp", width: 1, keyval: Clutter.KEY_Page_Up, extraClassName: "small-text" },
+      ],
+      [
+        { label: "⇧ Shift", width: 2, level: 1, right: true, extraClassName: "shift-key-lowercase medium-text" },
+        { label: "🠉", width: 1, keyval: Clutter.KEY_Up, extraClassName: "small-text" },
+        { label: "End", width: 1, keyval: Clutter.KEY_End, extraClassName: "small-text" },
+        { label: "PgDown", width: 1, keyval: Clutter.KEY_Page_Down, extraClassName: "small-text" },
+      ],
+      [
+        // { label: "❖", width: 1, keyval: Clutter.KEY_Super_L, extraClassName: "super-key" },
+        // { label: "🖮\n⌄", width: 0.5, action: "hide", extraClassName: "hide-key" },
+        { label: "🠈", width: 1, keyval: Clutter.KEY_Left, extraClassName: "small-text" },
+        { label: "🠋", width: 1, keyval: Clutter.KEY_Down, extraClassName: "small-text" },
+        { label: "🠊", width: 1, keyval: Clutter.KEY_Right, extraClassName: "small-text" },
+        { label: "🌐", width: 1, action: "languageMenu", extraClassName: "layout-key medium-text" },
       ],
     ],
     [
       [
-        { label: "⌫", width: 1.5, keyval: Clutter.KEY_BackSpace },
-        { label: "⌦", width: 1, keyval: Clutter.KEY_Delete },
-        { label: "⇊", width: 1, action: "hide", extraClassName: "hide-key" },
-      ],
-      [
-        {
-          label: "⏎",
-          width: 2,
-          keyval: Clutter.KEY_Return,
-          extraClassName: "enter-key",
-        },
-        {
-          label: "🗺",
-          width: 1.5,
-          action: "languageMenu",
-          extraClassName: "layout-key",
-        },
-      ],
-      [
-        {
-          label: "⇑",
-          width: 3,
-          level: 0,
-          right: true,
-          extraClassName: "shift-key-uppercase",
-        },
-        { label: "?123", width: 1.5, level: 2 },
-      ],
-      [
-        { label: "←", width: 1, keyval: Clutter.KEY_Left },
-        { label: "↑", width: 1, keyval: Clutter.KEY_Up },
-        { label: "↓", width: 1, keyval: Clutter.KEY_Down },
-        { label: "→", width: 1, keyval: Clutter.KEY_Right },
+        { label: "⌫", width: 1, keyval: Clutter.KEY_BackSpace, extraClassName: "medium-text" },
+        { label: "Insert", width: 1, keyval: Clutter.KEY_Insert, extraClassName: "small-text" },
+        { label: "🖮\n▿", width: 1, action: "hide", extraClassName: "hide-key" },
+      ],
+      [
+        { label: "⏎", width: 1.5, keyval: Clutter.KEY_Return, extraClassName: "enter-key big-text" },
+        { label: "Home", width: 1, keyval: Clutter.KEY_Home, extraClassName: "small-text" },
+        { label: "PgUp", width: 1, keyval: Clutter.KEY_Page_Up, extraClassName: "small-text" },
+      ],
+      [
+        { label: "⇧ Shift", width: 2, level: 0, right: true, extraClassName: "shift-key-uppercase medium-text" },
+        { label: "🠉", width: 1, keyval: Clutter.KEY_Up, extraClassName: "small-text" },
+        { label: "End", width: 1, keyval: Clutter.KEY_End, extraClassName: "small-text" },
+        { label: "PgDown", width: 1, keyval: Clutter.KEY_Page_Down, extraClassName: "small-text" },
+      ],
+      [
+        { label: "🠈", width: 1, keyval: Clutter.KEY_Left, extraClassName: "small-text" },
+        { label: "🠋", width: 1, keyval: Clutter.KEY_Down, extraClassName: "small-text" },
+        { label: "🠊", width: 1, keyval: Clutter.KEY_Right, extraClassName: "small-text" },
+        { label: "🌐", width: 1, action: "languageMenu", extraClassName: "layout-key medium-text" },
       ],
     ],
     [
       [
-        { label: "⌫", width: 1.5, keyval: Clutter.KEY_BackSpace },
-        { label: "⌦", width: 1, keyval: Clutter.KEY_Delete },
-        { label: "⇊", width: 1, action: "hide", extraClassName: "hide-key" },
-      ],
-      [
-        {
-          label: "⏎",
-          width: 2,
-          keyval: Clutter.KEY_Return,
-        },
-        {
-          label: "🗺",
-          width: 1.5,
-          action: "languageMenu",
-          extraClassName: "layout-key",
-        },
-      ],
-      [
-        { label: "=/<F", width: 3, level: 3, right: true },
-        { label: "ABC", width: 1.5, level: 0 },
-      ],
-      [
-        { label: "←", width: 1, keyval: Clutter.KEY_Left },
-        { label: "↑", width: 1, keyval: Clutter.KEY_Up },
-        { label: "↓", width: 1, keyval: Clutter.KEY_Down },
-        { label: "→", width: 1, keyval: Clutter.KEY_Right },
+        { label: "⌫", width: 1, keyval: Clutter.KEY_BackSpace, extraClassName: "medium-text" },
+        { label: "Delete", width: 1, keyval: Clutter.KEY_Delete, extraClassName: "small-text" },
+        { label: "🖮\n▿", width: 1, action: "hide", extraClassName: "hide-key" },
+      ],
+      [
+        { label: "⏎", width: 1.5, keyval: Clutter.KEY_Return, extraClassName: "enter-key big-text" },
+        { label: "Home", width: 1, keyval: Clutter.KEY_Home, extraClassName: "small-text" },
+        { label: "PgUp", width: 1, keyval: Clutter.KEY_Page_Up, extraClassName: "small-text" },
+      ],
+      [
+        { label: "=/<F", width: 2, level: 3, right: true, extraClassName: "medium-text" },
+        { label: "🠉", width: 1, keyval: Clutter.KEY_Up, extraClassName: "small-text" },
+        { label: "End", width: 1, keyval: Clutter.KEY_End, extraClassName: "small-text" },
+        { label: "PgDown", width: 1, keyval: Clutter.KEY_Page_Down, extraClassName: "small-text" },
+      ],
+      [
+        { label: "🠈", width: 1, keyval: Clutter.KEY_Left, extraClassName: "small-text" },
+        { label: "🠋", width: 1, keyval: Clutter.KEY_Down, extraClassName: "small-text" },
+        { label: "🠊", width: 1, keyval: Clutter.KEY_Right, extraClassName: "small-text" },
+        { label: "🌐", width: 1, action: "languageMenu", extraClassName: "layout-key medium-text" },
       ],
     ],
     [
       [
-        { label: "F1", width: 1, keyval: Clutter.KEY_F1 },
-        { label: "F2", width: 1, keyval: Clutter.KEY_F2 },
-        { label: "F3", width: 1, keyval: Clutter.KEY_F3 },
-        { label: "⌫", width: 1.5, keyval: Clutter.KEY_BackSpace },
-        { label: "⌦", width: 1, keyval: Clutter.KEY_Delete },
-        { label: "⇊", width: 1, action: "hide", extraClassName: "hide-key" },
-      ],
-      [
-        { label: "F4", width: 1, keyval: Clutter.KEY_F4 },
-        { label: "F5", width: 1, keyval: Clutter.KEY_F5 },
-        { label: "F6", width: 1, keyval: Clutter.KEY_F6 },
-        {
-          label: "⏎",
-          width: 2,
-          keyval: Clutter.KEY_Return,
-          extraClassName: "enter-key",
-        },
-        {
-          label: "🗺",
-          width: 1.5,
-          action: "languageMenu",
-          extraClassName: "layout-key",
-        },
-      ],
-      [
-        { label: "F7", width: 1, keyval: Clutter.KEY_F7 },
-        { label: "F8", width: 1, keyval: Clutter.KEY_F8 },
-        { label: "F9", width: 1, keyval: Clutter.KEY_F9 },
-        { label: "?123", width: 3, level: 2, right: true },
-        { label: "ABC", width: 1.5, level: 0 },
-      ],
-      [
-        { label: "F10", width: 1, keyval: Clutter.KEY_F10 },
-        { label: "F11", width: 1, keyval: Clutter.KEY_F11 },
-        { label: "F12", width: 1, keyval: Clutter.KEY_F12 },
-        { label: "←", width: 1, keyval: Clutter.KEY_Left },
-        { label: "↑", width: 1, keyval: Clutter.KEY_Up },
-        { label: "↓", width: 1, keyval: Clutter.KEY_Down },
-        { label: "→", width: 1, keyval: Clutter.KEY_Right },
+        { label: "F1", width: 1, keyval: Clutter.KEY_F1, extraClassName: "small-text" },
+        { label: "F2", width: 1, keyval: Clutter.KEY_F2, extraClassName: "small-text" },
+        { label: "F3", width: 1, keyval: Clutter.KEY_F3, extraClassName: "small-text" },
+      ],
+      [
+        { label: "", width: 0.5, extraClassName: "spacer" },
+        { label: "F4", width: 1, keyval: Clutter.KEY_F4, extraClassName: "small-text" },
+        { label: "F5", width: 1, keyval: Clutter.KEY_F5, extraClassName: "small-text" },
+        { label: "F6", width: 1, keyval: Clutter.KEY_F6, extraClassName: "small-text" },
+      ],
+      [
+        { label: "=/<F", width: 2, level: 2, right: true, extraClassName: "highlighted medium-text" },
+        { label: "F7", width: 1, keyval: Clutter.KEY_F7, extraClassName: "small-text" },
+        { label: "F8", width: 1, keyval: Clutter.KEY_F8, extraClassName: "small-text" },
+        { label: "F9", width: 1, keyval: Clutter.KEY_F9, extraClassName: "small-text" },
+      ],
+      [
+        { label: "🖮\n▿", width: 1, action: "hide", extraClassName: "hide-key" },
+        { label: "F10", width: 1, keyval: Clutter.KEY_F10, extraClassName: "small-text" },
+        { label: "F11", width: 1, keyval: Clutter.KEY_F11, extraClassName: "small-text" },
+        { label: "F12", width: 1, keyval: Clutter.KEY_F12, extraClassName: "small-text" },
       ],
     ],
   ];
@@ -620,8 +505,8 @@
       extraButton.setWidth(2);
     } else if (keyval == Clutter.KEY_Return && numKeys > 9) {
       extraButton.setWidth(1.5);
-    } else if (!this._emojiKeyVisible && (action == 'hide' || action == 'languageMenu')) {
-      extraButton.setWidth(1.5);
+    // } else if (!this._emojiKeyVisible && (action == 'hide' || action == 'languageMenu')) {
+    //   extraButton.setWidth(0.5);
     }
 
     layout.appendKey(extraButton, extraButton.keyButton.keyWidth);

--- stylesheet.css	2022-10-17 16:12:48.000000000 +0200
+++ stylesheet_updated.css	2023-04-03 21:50:39.605878736 +0200
@@ -9,11 +9,14 @@
 .alt-key-latched #keyboard .keyboard-key.default-key.alt-key,
 #keyboard .keyboard-key.default-key.shift-key-uppercase {
       background-color: #55a54c;
+      color: #fff;
 }
 
 #keyboard .keyboard-key.default-key.enter-key {
       border-color: #55a54c;
       background-color: #55a54c;
+      border-radius: 0;
+      color: #fff;
 }
 #keyboard .keyboard-key.default-key.enter-key:active {
       border-color: #43823c;
@@ -28,5 +31,44 @@
 }
 #keyboard .keyboard-key.default-key:active {
       border-color: #121212;
-      background-color: #121212;
+/*      background-color: #121212;*/
+}
+
+#keyboard .keyboard-key {
+      border-radius: 0;
+}
+
+#keyboard .keyboard-key.rounded-key {
+      border-radius: 20px;
+      color: #43823c;
+}
+
+#keyboard .keyboard-key.hide-key {
+      text-align: center;
+}
+
+#keyboard .keyboard-key.spacer {
+      background-color: transparent;
+      border: 0;
+}
+
+#keyboard .keyboard-key.highlighted {
+      background-color: #43823c;
+      color: #fff;
+}
+
+#keyboard .keyboard-key.margin-left {
+      margin-left: 5px;
+}
+
+#keyboard .keyboard-key.small-text {
+      font-size: 10pt;
+}
+
+#keyboard .keyboard-key.medium-text {
+      font-size: 14pt;
+}
+
+#keyboard .keyboard-key.big-text {
+      font-size: 18pt;
 }

Expected behavior:

1. Press Ctrl/Alt/Super to latch it.
2. Hide onscreen keyboard.
3. Ctrl/Alt/Super should be released.

Current behavior:

1. Press Ctrl/Alt/Super to latch it.
2. Hide onscreen keyboard.
3. Ctrl/Alt/Super remain latched and can trigger key combinations with other keys while onscreen keyboard is hidden.

Expected behavior:

1. Press Ctrl/Alt/Super key to latch it.
2. Press secondary key.
3. "Ctrl/Alt/Super + key" combination is triggered.
4. Secondary key released.
5. Ctrl/Alt/Super key released.

Current behavior:

1. Press Ctrl/Alt/Super key to latch it.
2. Press secondary key.
3. Only secondary keypress is triggered.
4. Secondary key released.
5. Ctrl/Alt/Super key remains latched.

Describe the bug
A. The pull up gesture doesnt work
B. Cannot enter password on polkit prompts

To Reproduce
Steps to reproduce the behavior:
A. Try pulling up from below, should open the osk
B. 1. Open apps that require root and use polkit to get it i.e gparted
2. Try typing on the osk

Environment (please complete the following information):

• Distro: Arch
• Gnome version: 42

Additional context
Have you been running your system for a while, or is it a fresh installation?
using for quite sometime but its rather minimal
Are you running any other extensions that might interfere with on-screen keyboard?
No
Does journalctl /usr/bin/gnome-shell -f -o cat show any errors?
Can you see any errors in looking glass? (Press Alt + F2, enter lg, switch to "extensions" tab and click "show errors" for Improved OSK extensionr
Nothing relevant

Describe the bug
Shift key modifier does not activate nor release while a character key is held continuously.

To Reproduce
Steps to reproduce the behavior:
open a terminal window, bring up the OSK and hold down the 'd' and see it repeating ddddddddd
Now try to press the Shift key while continueing to hold the 'd' key and it will not produce dddddddDDDDDDD

Expected behavior
The Shift key should implement modification of the key being pressed even during repeat mode when a key is held down.

Environment (please complete the following information):
PopOS 21.10 v3
Gnome version: 40.5

Additional context
I'm trying to use a feature of a laser cutter software which turns on the laser at low power during the framing operation. They have a Frame button which when pressed with the Shift key modifier pressed, it triggers the lower power laser firing operation.

All the modifier keys have their icons missing (Apart from return)
Tried installing 'ttf-ancient-fonts-symbola' but it didnt help :(
Stock Ubuntu 20.04 with gnome shell 3.36

Gnome 44 will come out on the 22.03 this year and is already available in gnome OS. It would be great if this extension is available when it releases on popular distros

Fedora plans to release version 38 on the 25.04, so it would be great, if this is done by that date and the release of Ubuntu 23.04 and other distros.

Related: #30

Like a couple of the other people that opened issues, I'm also using Pop!OS. It's OSK has a transparent background by default with opaque keys. It would be really neat to see that in this extension.

It's something I would consider working on but I'm not sure where to start as I know nothing about the process of building gnome extensions or how one might set or remove the opaque background. I wasn't able to figure out how to manually get this extension installed via cloning the git repo, so I installed it from the gnome extensions site.

This extension was a lifesaver for me. Thanks!

Using Ubuntu Impish Indri on a Lenovo Ideapad C314

Heya, I'm installing this extension as a better touch keyboard on my laptop.

It ran a few times the first time I installed it, when clicking text fields, but didn't work when selecting the dock icon.
It doesn't seem to run at all at the moment.

I've ran journalctl /usr/bin/gnome-shell -f -o cat as per your comments on other issues:

JS ERROR: TypeError: Main.keyboard._keyboard is null
toggleOSK@/home/pierre/.local/share/gnome-shell/extensions/[email protected]/extension.js:67:7
_init/<@/home/pierre/.local/share/gnome-shell/extensions/[email protected]/extension.js:60:9

JS ERROR: TypeError: Main.keyboard._keyboard is null
toggleOSK@/home/pierre/.local/share/gnome-shell/extensions/[email protected]/extension.js:67:7
_init/<@/home/pierre/.local/share/gnome-shell/extensions/[email protected]/extension.js:60:9

Are there further troubleshooting steps I can run to help diagnose the issue ?

1. In some programs, such as Sublime Text, the program crashes when you press the Backspace key.
2. In Firefox app, Gnome Web application, Gnome Text Editor: if the text is selected, the Backspace key does nothing (does not delete the selected text).

Fedora Linux 38
Gnome 44.1
Linux 6.2.13-300.fc38.x86_64

When the keyboard pop up on Gnome 40 (Wayland), windows can't resize correctly with the desktop, and some parts of the window can be left under the keyboard. Sometimes they don't resize at all, but when I push the Activity button with the keyboard popped up, the desktop and windows look resized for a second, and then return to the original size as the keyboard goes down.

The resizing option works as expected on Xorg, but my touchscreen is almost unusable on Xorg compared with Wayland. The original extension worked as expected on Gnome 3.38 on Wayland, but also have this issue on Gnome 40.

Describe the bug
Gnome 45 is using a different type of imports thus extensions don't work anymore without changes.
Context: Gnome blog post

To Reproduce
Steps to reproduce the behavior:

1. Upgrade to Gnome 45
2. Error SyntaxError: import declarations may only appear at top level of a module

Expected behavior
Working extension

Screenshots

Environment (please complete the following information):

• Distro: Arch Linux
• Gnome version: 45 RC

Additional context
Gnome 45 is fixing some nasty bug in mutter that makes touchscreen rather unusable on the long run. That's why I switched to version 45 earlier even if most of the extensions don't work yet. It would be nice to have working improved touch keyboard in new Gnome.

I currently use the extension on an HP Envy x360 with Pop!_OS 21.04, GNOME Shell 3.38.4 and Improved OSK 4.
When I switch to light mode however, some keys become almost invisible, as shown in the following picture:

Hi *,

First, thank you so much for creating and maintaining this Gnome extension. Great stuff!

Now, at my instance, I don't see a 'Super'-Key.

Is this intended? In case yes, are there reasons for this and can it be brought in?
Or do I do something wrong?

Thank you and best regards
Axel

First thing first, thanks for keeping this great extension alive and improving it.
In terms of user experience, it would be very nice to be able to open and close the keyboard by pressing the same statusbar icon button. Actually, it can only open the osk and I had to search a bit how to close it afterwards.
The closing button can still stay where it is on the osk.

Just a feature request to add option to enable a number row (0-9) on the top qwerty row kind of like Android does.

After installing and enabling the extension (and restarting the GNOME session), I still get the standard (and sadly, almost useless) stock GNOME OSK. If I toggle "Show statusbar icon" in the settings from the extension manager, it will indeed toggle the icon. However, touching the icon will just activate the same old basic OSK.

It is not clear from documentation, but I assume the newly installed extension should replace the default OSK without any further actions from the user?

The only relevant log entries I can find in the system journal:
JS ERROR: TypeError: Main.keyboard._keyboard is null toggleOSK@/home/pablo/.local/share/gnome-shell/extensions/[email protected]/extension.js:67:7 _init/<@/home/pablo/.local/share/gnome-shell/extensions/[email protected]/extension.js:60:9

The extension was installed from the command line with

gnome-extension install improvedosknick-shmyrev.dev.v18.shell-extension.zip
BTW, I originally installed the original implementation from Sebastian Luebke, but uninstalled it immediately after realizing my mistake, and I don't believe any files from that remains on my system.

Environment:

• Distro: Debian 12.1
• Gnome version: 43.6
• Windowing system: Wayland

Describe the bug
The Layout doesn't change when installing the extension and even remove some buttons for example ctrl.

To Reproduce
Steps to reproduce the behavior:
Just install the extension

Expected behavior
The extension shoud've changed layout to what is on the extension page.

Screenshots
This is how my layout looks like:

This is how it should look like:

And this is the troubleshooting steps written on your your github page (which didn't work for me because ibus is installed by default in Fedora 38 unless i'm misunderstanding something and sudo dnf install ttf-ancient-fonts-symbola didn't work either... because i'm on Fedora, but I had to try atleast XD):

Environment (please complete the following information):

Additional context
Have you been running your system for a while, or is it a fresh installation?
I'm originally a Windows 10 user and have done a dual boot config with Fedora 38 using this tutorial:
https://www.techhut.tv/how-to-dual-boot-fedora-and-windows-11/

Are you running any other extensions that might interfere with on-screen keyboard?
Application menu and User themes

Does journalctl /usr/bin/gnome-shell -f -o cat show any errors?

(../clutter/clutter/clutter-actor.c:11966):clutter_actor_event: runtime check failed: (retval == CLUTTER_EVENT_PROPAGATE)
(../clutter/clutter/clutter-actor.c:11966):clutter_actor_event: runtime check failed: (retval == CLUTTER_EVENT_PROPAGATE)
(../clutter/clutter/clutter-actor.c:11966):clutter_actor_event: runtime check failed: (retval == CLUTTER_EVENT_PROPAGATE)
(../clutter/clutter/clutter-actor.c:11966):clutter_actor_event: runtime check failed: (retval == CLUTTER_EVENT_PROPAGATE)
(../clutter/clutter/clutter-actor.c:11966):clutter_actor_event: runtime check failed: (retval == CLUTTER_EVENT_PROPAGATE)
(../clutter/clutter/clutter-actor.c:11966):clutter_actor_event: runtime check failed: (retval == CLUTTER_EVENT_PROPAGATE)
(../clutter/clutter/clutter-actor.c:11966):clutter_actor_event: runtime check failed: (retval == CLUTTER_EVENT_PROPAGATE)
(../clutter/clutter/clutter-actor.c:11966):clutter_actor_event: runtime check failed: (retval == CLUTTER_EVENT_PROPAGATE)
(../clutter/clutter/clutter-actor.c:11966):clutter_actor_event: runtime check failed: (retval == CLUTTER_EVENT_PROPAGATE)

meta_window_set_stack_position_no_sync: assertion 'window->stack_position >= 0' failed

Can you see any errors in looking glass? (Press Alt + F2, enter lg, switch to "extensions" tab and click "show errors" for Improved OSK extension)
Doesn't show any errors

Describe the bug
The built-in Gnome OSK comes up even if the built-in is turned off

To Reproduce
Steps to reproduce the behavior:
Install Debian Testing and the extension, turn it on :)

Expected behavior
I need to use the extension, with the improved keyboard.

Screenshots
https://ibb.co/F3WMCvt
https://ibb.co/4mHq46L

Environment (please complete the following information):

• Distro: Debian Bookworm
• Gnome version: 43.3

Additional context
Fresh install of extension, otherwise Gnome and Debian is not old and not much used. Builtin OSK works well, but it's difficult to use terminal with it :D

Hi, currently porting Fedora 37 to the Nintendo Switch. We added a key binding on the joycon "+" button that shows onboard osk in ubuntu bionic (which is currently our stable release / main product).

But in the case of Fedora I am using your extension, which is awesome btw, and would like to know if there is either an existing dbus binding for it or if it needs to be added (I'd like to PR that but I don't have a lot of time unfortunately, if I do find some time for that I will definitely make a PR)

Thanks for your work regardless !

Hey there. Sorry to be opening this issue here. It happens even with the native onscreen keyboard on Gnome. But I am opening to know if anyone has a workaround to this.

When you open a text editor like gedit or any other text field, when you press enter the line doesn't break. In other words, the enter/return key doesn't work the same as the physical keyboard key.

Does anyone have a workaround for this?

Describe the bug
While English(UK) keyboard works OK, Polish keyboard does not have additional buttons (Ctrl, Alt, Esc etc.).
This is the only way I could make them appear:
lukasaristide@681817e
though I suppose this is not the desired way - since this is not how it's done for other keyboard layouts.

Environment (those are the ones I verified):

• Distro: Fedora 38, Ubuntu 23.04, Ubuntu 22.10
• Gnome version: 43, 44

Hi, I don't know it this is technically possible, but I'd like to see copy/paste buttons like they appear on top row of a Android / iOS keyboard. Maybe virtual keys can be bound to ctrl+c / ctrl+v / ctrl+x ?
It's the one feature I miss most compared to true mobile os'es as Gnome also doesn't have a hold to copy/paste feature in general.

Hi. I am out of knowledge. I wanted to use your extension on a Arch-Gnome install on my SteamDeck but can"t make it to pop up.

• I installed the extension
• I can configure it and it is enabled
• I enabled ibus for my user (see below)
• The old OSK is shown when I open it or when it gets automatically opened

Where could I check what is going wrong?
Thanks a lot!

Here my running ibus:

systemctl status --user ibus@\:0.service 
● ibus@:0.service - Intelligent Input Bus
     Loaded: loaded (/usr/lib/systemd/user/[email protected]; enabled; preset: enabled)
     Active: active (running) since Tue 2023-04-18 07:38:02 CEST; 5h 7min ago
       Docs: man:ibus-daemon(1)
   Main PID: 1009 (ibus-daemon)
      Tasks: 9 (limit: 17750)
     Memory: 7.1M
        CPU: 170ms
     CGroup: /user.slice/user-1000.slice/[email protected]/app.slice/app-ibus.slice/ibus@:0.service
             ├─1009 /usr/bin/ibus-daemon --replace --xim
             └─1037 /usr/lib/ibus/ibus-dconf