a <- c(89, 75, 86, 23, 45)

The function of the below code block run by Visual basic( version 6.0) is get the mouse style value. Could you help to add such function get the mouse style value in the KeyboardSimulator?

Option Explicit

Private Declare Function GetCursorInfo Lib "user32 " (pci As CURSORINFO) As Long

Private Type POINTAPI
    X As Long
    Y As Long
End Type
 
 
Private Type CURSORINFO
  cbSize   As Long
  flags   As Long
  hCursor   As Long
  ptScreenPos   As POINTAPI
End Type
 
 
Private Sub Form_Load()
  Timer1.Enabled = True
  Timer1.Interval = 500
End Sub

Private Sub Timer1_Timer()
  Dim CursorPar     As CURSORINFO
  CursorPar.cbSize = Len(CursorPar)
  GetCursorInfo CursorPar
  Debug.Print CursorPar.hCursor
End Sub

HI, Could help to add Fn key function in next version? Thanks.

i means when mouse move on the button , it turn to hand style. how to judge the mouse is over the button ?

symbol includes _ " ; , .

I am using KeyboardSimulator to do a task but when I close the Laptopt screen It doesn't work. I have implemented a Loop and It run in R because I receiv the alarm when It finish but the mouse movement and the key press don't work. Is it possible to use if I close my laptop screen? I have proved with the screen saver and it work but not if I close the screen laptop.

Hi,
I run into the following issue on both machines I tried the package with:
While mouse works fine, the keyboard commands work as if "crtl+" were added. So if I say:

keybd.press("a", hold = FALSE)

it selects the whole script (as if "crtl+a" were executed). The same with other keys like "s" (tries to save script), "o", opens explorer to open a script, etc.
I made sure "crtl" is not held. I can

keybd.release('ctrl')

and nothing changes of the above behavior.
Both machines run Windows 10, one Enterprise, one Pro. One is a Dell, the other a Logitech Keyboard, both German-layout. Switching to US keyboard layout in Windows did not do the trick.
Any ideas would be welcome.

I want to add time to the mouse.move() function to make the pointer move slowly. Are there any such improvements planned?

Thank you for making the package.

I noticed that the package's function mouse.move() will not prevent the screensaver or the screen lock from becoming active. Is it a bug of feature? For monitoring reasons it would be great to have the option of prevention. Thanks!

Hi! This is exactly the package I was looking for but it's lacking an essential feature: scrolling.
Would it be viable to add a new mouse.scroll() function?
To give a little more context, the up and down keys don't work to scroll in my use-case.

Hello, when using the following command:

keybd.press('@')

I get the caracter "é" in the R console with the following warning:

Warning message: In keybd.press("@") : Button '@' will be treated as lowercase. Use 'keybd.type_string' for uppercase keyboard simulation.

Do you have any idea to solve this issue ?
Best regards

Hello,

I have a long running script that will perform some mouse/keyboard actions once every hour or so, basically clicking some buttons in a Windows application to upload some data. I noticed that it will work when I am at my computer observing, but it does not seem to work when the script is left running overnight and I am away. All other aspects of the R script work, but it is almost as if the mouse/keyboard section of the script was never executed because I will check after many hours have gone by and it seems fine, with the exception of the mouse/keyboard actions allegedly not executing.

I have put in a number of Sys.sleep() functions before/after mouse and keyboard actions to ensure the script is not executing moves too fast for the OS, but I continue to observe the same behaviour of working when I am there but seemingly skipped when I am away for long periods of time. I am wondering if there is a known affect on KeyboardSimulator if Windows goes into some kind of sleep/hibernate mode? Will the first action potentially be lost, and do I need to "wake up" the OS somehow first to reliably get mouse/keyboard actions to register with the OS?

Any other tips or thoughts about this issue would be greatly appreciated.

Thanks

how about use print screenshot key?

thank you

I am getting this error when trying to use mouse.click in R 4.3.0 and 4.3.1, but everything works fine in 4.2.3

KeyboardSimulator::mouse.click()
Error in .Call("_KeyboardSimulator_mouse_left_click", PACKAGE = "KeyboardSimulator") : "_KeyboardSimulator_mouse_left_click" not available for .Call() for package "KeyboardSimulator"

Could introduce the function support the key fn+prtsc for taking screenshots? Thanks.

In my case keybd.type_string() function types "/" as "ö" and "\" as "ç" where backslash is the main character I needed. Any solution or recommendation related to this issue?

When I try to install the package I get an error saying that it is not available for R version 3.3.3

See my code below:

install.packages("KeyboardSimulator")
Installing package into ‘C:/Users/SchubertK/Documents/R/win-library/3.3’
(as ‘lib’ is unspecified)
Warning in install.packages :
package ‘KeyboardSimulator’ is not available (for R version 3.3.3)

Could use mouse double click?

First, thank you for developing this package! It works beautifully when I am using my computer (even if R is not in the foreground). However, the problem I am trying to solve involves running the script every night on a server. I set up a scheduled task using Windows Task Scheduler, but the same script does not work on the server. Any suggestion?

Do have any plan add function to control the middle button on the mouse? now only have left and right. Thanks your attention.

I am having problems to get this address with

keybd.type_string(https://twitter.com/me_duele_mexico/status/1501776156504244226/photo/1)

I only get this result:

https¨}}https://twitter.com}me_duele_mexico}status}1501776156504244226}photo}1

I would like to know if it is possible to use keyboardSimulator to enter a command at the command line. From the description of the package, it sounds as it should be able to do it, but I'm stuck with a single command that doesn't want to budge, and stops the execution with an error ("attempt to apply non-function").

To provide some context, I need to do a screenshot of a Viewer pane, for a few files, one at a time, and cannot be hitting 'Enter' continuously. There is a nice procedure for a single screenshot, using websocket, at

   https://stackoverflow.com/questions/50946083/how-to-save-viewer-pane-as-image-through-command-line

(middle of the page in the url, "The Code", reproduced below). If I run those lines in one go, the process reports, "Error, attempt to apply non-function", at the line

   websocket$send("go") # send any message

However, the process works well if I execute in block from the start until the previous line, select the offending line [websocket$send("go")], and press either (a) 'Enter' or (b) "Run" at the top. In these cases it produces the png file perfectly.

I tried to replace 'websocket$send("go")' with

    keybd.type_string('websocket$send(\"go\")'); keybd.press("Enter")

or

    keybd.type_string('websocket$send(\"go\")'); mouse.click(); mouse.release()

but, in these cases, although I don't receive any error, the websocket is not called, pdf continues to be NULL, and no png file is produced (showing another error when it tries to download it).

I'm sure I'm writing something wrong to execute the command line. I'd also like to produce a shorter code but I'm afraid it may not reproduce the exact chain of events (Viewer -> websocket -> png -> download), although I think the issue is with formatting that single line of code correctly.

Can you provide some guidance?

Thank you so much ...

# From https://stackoverflow.com/questions/50946083/how-to-save-viewer-pane-as-image-through-command-line
# Updated two deprecated commands to start and stop the server

library(httpuv)

# Initialize variables
png <- NULL
websocket <- NULL

# Download Javascript libraries
polyfill_promise <- readLines('https://cdn.jsdelivr.net/npm/es6-promise/dist/es6-promise.auto.min.js')
html2canvas <- readLines('https://html2canvas.hertzen.com/dist/html2canvas.min.js')

# Configure the httpuv server
app <- list(
  call = function(req) {
    list(
      status  = 200L,
      headers = list( 'Content-Type' = 'text/html' ),
      body = paste0(collapse = "\r\n",
                    c("<!DOCTYPE html>",
                      "<html>", 
                      "<head>",
                      # polyfill the RStudio viewer to support JavaScript promises
                        '<script type="text/javascript">', polyfill_promise, "</script>",
                      # use html2canvas library
                        '<script type="text/javascript">', html2canvas, "</script>",
                      "</head>",

                      "<body>", html_body, "</body>",
                      '<script type="text/javascript">',
                      # Configure the client-side websocket connection:
                        'var ws = new WebSocket("ws://" + location.host);',
                      # When a websocket message is received:
                        "ws.onmessage = function(event) {",
                      # Take a screenshot of the HTML body element
                        "  html2canvas(document.body).then(function(canvas) {",
                      # Transform it to png
                        "    var dataURL = canvas.toDataURL();",
                      # Send it back to the server
                        "    ws.send(dataURL);",
                        "  });",
                        "};",
                      "</script>",
                      "</html>"
                    )
      )
    )
  },
  # Configure the server-side websocket connection
  onWSOpen = function(ws) {
    # because we need to send websocket message from the R command line:
      websocket <<- ws
    # when a websocket message is received from the client
      ws$onMessage(function(binary, message) {
        png <<- message
    })
  }
)

# From the original question:
html_body <- c(
  '<h1> Content</h1>', 
  '<h2> Content</h2>', 
  'lorem ipsum...'
)

# Start the server:
server <- startServer("0.0.0.0", 9454, app) # deprecated -> startDaemonizedServer("0.0.0.0", 9454, app)

# Open the RStudio viewer:
  rstudioapi::viewer("http://localhost:9454")
# Wait to see the result...

# Send a websocket message from the command line: 
  websocket$send("go") # send any message    # <=========== How to modify this line with keyboardSimulator?

# Write the png image to disk:
writeBin(
  RCurl::base64Decode( gsub("data:image/png;base64,", "", png), "raw" ), 
  "screenshot.png"
)

# Close the websocket connection
  websocket$close()

# Stop the server
  stopServer(server) # deprecated -> stopDaemonizedServer(server)

it's pity keybd.type_string not support Chinese.Could you help improve it ?

keybd.type_string("我爱你")
Error in keybd.type_string("我爱你") :
The 'button' value '我' is not supported. Available keys are : a b c d e f g h i j k l m n o p q r s t u v w x y z A B C D E F G H I J K L M N O P Q R S T U V W X Y Z 1 2 3 4 5 6 7 8 9 0 num0 num1 num2 num3 num4 num5 num6 num7 num8 num9 f1 f2 f3 f4 f5 f6 f7 f8 f9 f10 f11 f12 backspace tab enter shift ctrl alt capslock esc pageup pagedown end home left up right down insert del numlock win ` ~ ! @ # $ % ^ & * ( ) - _ + = [ { ] } \ | ; : ' " , < . > / ?