Multiple commentators clarify a key translation point. The verse doesn't mean the priests ate the offering with unleavened bread. Rather, the leftover portion of the grain offering was itself to be prepared and eaten unleavened. It was a sacred meal in its own right, not an accompaniment to another.