2

I am looking for a solution to control my computer mouse just with my hands and a webcam. The goal is to combine it with voice input to let me move more freely in front of my desk.

It should support the usual mouse actions:

  • position mouse pointer, left click, right click, middle click, scroll up, scroll down
  • optionally: scroll left, scroll right
Improve this question
1
  • If you have a disability and are looking for a mouse alternative, then please note that there are also foot controlled computer mouse solutions available.
    – mihca
    Oct 12, 2021 at 18:10

6 Answers 6

Reset to default
0
  • eViacam
    • Uses your head position to position the mouse pointer
    • Code is on Sourceforge and GitHub
    • Intended for people with disabilities
Improve this answer
0
  • cameramouse
    • Not open source, but free to use
    • Uses your head position to position the mouse pointer and to perform clicks
    • Intended for people with disabilities
Improve this answer
0
  • NPointer
    • Not open source and discontinued
Improve this answer
0
  • SmyleMouse
    • Professional and commercial solution to control the computer mouse with your head
    • Intended for people with disabilities

Controls

  1. Move your head to
    • Move the mouse pointer
  2. Smile to
    • Click a mouse, or
    • Make an adaptive switch selection
Improve this answer
0

Besides these, I found some prototypes/unfinished projects, some with academic background:

  • ofnote/gestop
    • idea: use machine learning to train model with custom gestures and bind them to any input.
    • Cool idea, but more of a prototype I would say.
  • bm371613/gest
    • Pinch gesture to scroll. Nice idea but more of a prototype.
    • The machine learning model seems to be trained manually to detect finger positions and from the description, it seems biased towards the developer.
  • Mouse_control
    • Academic prototype it seems.
    • Uses colors to detect the finger positions in the image, similar to "Mouse Control using a Web Camera based on Color Detection" by Abhik Banerjee, Abhirup Ghosh, Koustuvmoni Bharadwaj
  • whatifif/handgesture
    • Academic prototype with custom trained model. Pretty cool but not a finished product.
  • mouse-control-via-webcam on codeproject
    • I was not able to make this work
  • Ashvin-G/Virtual-Mouse
  • albpurpura/HandMouse
    • Again, similar approach to DedoMouse (uses Google MediaPipe) but less polished and not as much gestures as DedoMouse
Improve this answer
0
  • DedoMouse
    • Uses hand gestures to control the mouse pointer
    • Meets the requirements: position mouse pointer, left click, right click, middle click, scroll up, scroll down
    • Built using Google MediaPipe library
    • Modern UI that makes it pretty easy to use
    • Code is on GitHub
    • Requires full hand motion. Thus, not intended for people with disabilities.
      • However, might be useful if you have RSI because of more variety in hand positions.
Improve this answer
3
  • 2
    There are several answers here. Please post each as a separate answer, that way each can be voted upon by the community separately.
    – Chenmunka
    Oct 8, 2021 at 17:12
  • welcome mihca! awesome apps I never knew I wanted to know about. I second @Chenmunka, splitting the apps to separate answers would better suite the site's culture.
    – Lockszmith
    Oct 11, 2021 at 23:45
  • I split this answer to multiple anwsers
    – mihca
    Oct 12, 2021 at 18:08

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.