Clean dataframe math (#6709)

* Clean switch by type in binary operations

* Simplify getting mutable buffers

* Don't convert buffer to mutable if it not required

Author: asmirnov82