It is necessary for there to be chesed in a house for it to be considered a house of G-d.

Where there is chesed people learn the ways of Hashem. 

Without chesed, even if other mitzvos are performed there, a house is lacking a basic ingredient. 

~ R’ Moshe Feinstein zt”l