Border around cursor selects text when clicking

[MPvHarmelen]

When I move the cursor to a position too close to the edge of the viewport, the viewport is moved to maintain the border I specified. The cursor is placed at mouse button down, which means scrolling also starts at mouse button down. However, because I'm a human, I don't instantly release the mouse button after clicking, which results in a small amount of selected text.

Is there a way to postpone forcing the margin until mouse button up?

[Veedrac]

I suppose it shouldn't be too hard to "disable" the plugin on mouse down and recheck on mouse up. I'm not sure how reliable the mouse API is, but if it's good I don't see why not.