Albert Barnes Commentary Ezra 3:12

"But many of the priests and Levites and heads of fathers` [houses], the old men that had seen the first house, when the foundation of this house was laid before their eyes, wept with a loud voice; and many shouted aloud for joy:" — Ezra 3:12 (ASV)

Wept ... shouted ... for joy - Compare the marginal reference and (Zechariah 4:10). It is implied that the dimensions of the second temple were smaller than those of the first. Therefore, the feeling of sorrow came upon some. Those, however, who had not seen the former temple, and so could not contrast the two, naturally rejoiced to see the sanctuary of their religion begin to rise from its ruins.