Extend MousePadPlugin to see the screen under the mouse pointer

[Albert Vaca]

Hi Bernhard,

This is super cool! I totally agree it would be nice to reverse the
controls as well as to add a small cursor on screen, to polish it and make
it perfect. But as a proof of concept this works quite well already!

However, I would try to change the way yo send the images, because
base64-encode every image and send that as text doesn't seem very
efficient. A better way to do it would be to establish a connection using a
socket just for that, where you could keep "streaming" the image data in
binary format. It can be a bit challenging technologically, but do you
think you could implement something like that? If you want to use it, the
"setPayload" option of the NetworkPackage class automatically establishes
the socket connection for you and you only have to write through it.

Another good optimization would be to compress the image before sending it,
so we don't send a image unnecessarily big.

Do you think you can work on improving this points? This prototype is
already awesome, but polishing a bit the rough edges it can become a killer
feature for a lot of users :)

Albert

On Sat, Dec 13, 2014 at 8:14 AM, Bernhard Übelacker <bernhardu at vr-web.de>
wrote:
>
> Hello all,
> I tried to extend this plugin to show the remote region under the mouse
> pointer. So basically extend it to be used as remote control without
> having the screen in sight.
>
> Attached you find 2 prototype patches which enable this.
>
>
> Currently biggest problem is with the performance:
>
> Right now a QPixmap grabs the screen content, puts this as PNG to a
> buffer, encodes it as base64 and attaches it to a network packet.
>
> To make it even worse the space available on a network packet seems
> rather limited and so it is split into several network packets per picture.
>
> In small zoom areas it is bearable, but if you get a bigger part of the
> screen it does not work anymore.
>
>
> These minor points are also open:
> - Sometimes scroll events are sent when one tries to zoom (pinch).
>   Even after increasing MinDistanceToSendScroll.
> - When using it without looking at the screen probably an option is
>   needed to reverse directions. Also a mouse pointer on the android
>   device would be needed.
>
>
> What do you think about it?
>
> Kind regards,
> Bernhard
>
>
> _______________________________________________
> KDEConnect mailing list
> KDEConnect at kde.org
> https://mail.kde.org/mailman/listinfo/kdeconnect
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.kde.org/pipermail/kdeconnect/attachments/20141215/f3dce211/attachment-0001.html>