@mavica given I have no android knowledge my immediate idea was to rig one of those little robot arms to a raspi along with a webcam, give the arm a stylus, and control it that way

which is possibly the most ass-backward way of controlling it possible and not even slightly what you're looking for but I'm fond of the concept