It's a neat feature to be able to both change priority and column while drag & dropping tasks, but at our org with our early adopters, it seems to generate more harm than good. We had a number of tasks having the priority changed by mistake and even have notifying people of the behavior, it still happens.
This issue might fixable by de-coupling the behaviors:
- dragging tasks between column ONLY changes the column
- dragging tasks within a column and between other tasks ONLY changes the priority