The Tabernacle..[ Holy Tent ] was set up at Shiloh....and the Holy Place; the place where the Ark was, and the Shekinah Glory...was the Temple.
1 Samuel 3:21
The LORD continued to appear at Shiloh, and there he ...
... And the LORD appeared again at Shiloh, for the LORD revealed himself to Samuel at Shiloh by the word of the LORD. ...
and..Gill in his commentary says about "TEMPLE".
Where the ark of God was; that is, in the temple or tabernacle; though not in that part of it where the lamps were burning in the candlestick.
This was was in the holy place; but the ark was in the Holy of Holies, where the Lord dwelt, and was the symbol of His presence; and......
"which is observed to point out the place from whence the voice came."..Gill
"and a voice was heard out of the temple of the Lord, where the ark of the Lord was."
In essence, the temple word is clearly speaking about the Holy of Holies...the core of all worship.