Extend MousePadPlugin to see the screen under the mouse pointer

[rahil momin]

Hey,

Great Idea, although do make it optional. WiFi bandwidth is limited and
especially I don't want to hog a big chunk of it streaming images every
millisecond or so.

VNC does this already, so we can look into how they handle streaming the
images/videos on the network, which is pretty efficient. I also agree on
opening a different socket for this.

On Tue, Dec 16, 2014 at 1:08 PM, Albert Vaca <albertvaka at gmail.com> wrote:
>
> Hi Bernhard,
>
> This is super cool! I totally agree it would be nice to reverse the
> controls as well as to add a small cursor on screen, to polish it and make
> it perfect. But as a proof of concept this works quite well already!
>
> However, I would try to change the way yo send the images, because
> base64-encode every image and send that as text doesn't seem very
> efficient. A better way to do it would be to establish a connection using a
> socket just for that, where you could keep "streaming" the image data in
> binary format. It can be a bit challenging technologically, but do you
> think you could implement something like that? If you want to use it, the
> "setPayload" option of the NetworkPackage class automatically establishes
> the socket connection for you and you only have to write through it.
>
> Another good optimization would be to compress the image before sending
> it, so we don't send a image unnecessarily big.
>
> Do you think you can work on improving this points? This prototype is
> already awesome, but polishing a bit the rough edges it can become a killer
> feature for a lot of users :)
>
> Albert
>
> On Sat, Dec 13, 2014 at 8:14 AM, Bernhard Übelacker <bernhardu at vr-web.de>
> wrote:
>
>> Hello all,
>> I tried to extend this plugin to show the remote region under the mouse
>> pointer. So basically extend it to be used as remote control without
>> having the screen in sight.
>>
>> Attached you find 2 prototype patches which enable this.
>>
>>
>> Currently biggest problem is with the performance:
>>
>> Right now a QPixmap grabs the screen content, puts this as PNG to a
>> buffer, encodes it as base64 and attaches it to a network packet.
>>
>> To make it even worse the space available on a network packet seems
>> rather limited and so it is split into several network packets per
>> picture.
>>
>> In small zoom areas it is bearable, but if you get a bigger part of the
>> screen it does not work anymore.
>>
>>
>> These minor points are also open:
>> - Sometimes scroll events are sent when one tries to zoom (pinch).
>>   Even after increasing MinDistanceToSendScroll.
>> - When using it without looking at the screen probably an option is
>>   needed to reverse directions. Also a mouse pointer on the android
>>   device would be needed.
>>
>>
>> What do you think about it?
>>
>> Kind regards,
>> Bernhard
>>
>>
>> _______________________________________________
>> KDEConnect mailing list
>> KDEConnect at kde.org
>> https://mail.kde.org/mailman/listinfo/kdeconnect
>>
>>
> _______________________________________________
> KDEConnect mailing list
> KDEConnect at kde.org
> https://mail.kde.org/mailman/listinfo/kdeconnect
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.kde.org/pipermail/kdeconnect/attachments/20141216/ebd9e3cc/attachment.html>