Plans to turn a once-popular pub into a new restaurant could harm a Bradford Conservation Area, officers fear.