OOC:
Sorry, I was waiting for more comments. Let's move it along a little more ...
You all stand at the archway, looking down on the orcs. You can see they have three wagons, and there are around two dozen orcs around the wagons. Presumably, there are a couple more per wagon, too. They don't seem to have much of their swagger as they head to the gate.
Assuming you just watch for a little longer, they simply exit from the southern gate, and start heading west from there. They are in no particular rush, but they do seem to have quite a bit of determination as they set out. Looking closer, you see that no one really stands out. Thinking about that, you realize that they don't have any chief or overt leader. They are just moving out as a group. Each performing their role, but no one dressed better than the others, and no one barking orders or giving demonstrative leadership. There is one who is leading, but they are not dressed differently, and they are not giving orders; just giving direction.
OOC:
At this point, you still have the same options as before, but you could try to interact with the orcs, or keep checking out the temple. Whatever you think is best.