Just popping in to say your solution worked. You -can- grab the scroll view instance itself from $ionicScrollDelegate.$getByHandle('my-handle').getScrollView() and override the touchStart method. However, this does so within the scope of your controller, which ruins everything.
I am not happy about having to modify the source code instead of extending it, but my app is functional. Thank you!