Update base_imputer.py

[Astha0024]

removing infer because it changed manually converted object columns back to int or float

[solegalli]

Hi @Astha0024 thanks for the PR.

I remember vaguely adding the infer recently due to some pandas upgrade or something, By removing it, other tests fail.

What's the issue that you are having? could you add an example?

[Astha0024]

So sometimes a column that could be inferred at numerical needs to be cast to object type for example : number of bathrooms in a house. Then when we pass it through this transformation, the infer converts it back to int and then we can't run encoding on top of it.