When I first built my observatory it was a "wheat" colour. The inside would regularly be about 15 degrees hotter than the outside - meaning it often reached 50+ degrees.
I then painted the roof white and put white shadecloth double thickness on the north wall. Since then, the temperature gets up to about 5 degrees above outside.
I've also insulated it now so the "temperature curve" is slower - takes most of the day to get up to 5 degrees above outside.
I have an exhaust fan that I have used now and then, but to be honest it hasn't made a big difference. In fact, I've never found there has been a noticable difference of more than 1 degree with it on vs off. So I don't bother with it most of the time that I'm not in there.
So from my experience, fans don't do much, colour does.
I am about to put a portable aircon in there, but only for when I'm in there. I don't have any problem with it getting up to 40 or 45 when I'm not in there - sure it would be nice if it didn't, but I haven't found any problems with that.
Being tin mine cools down extremely quickly once the sun leaves it, which is about 2 hours before dark for me. A little less quick now that I have insulation, but still very quick.
I have sometimes thought that if I were worried, I'd put a shadecloth structure over it, which moved with the roof, and separated from the roof to allow an air gap. I think stopping the heat hitting it/being absorbed in the first place would be much more effective (not to mention cheaper and environmentally friendly) than trying to counter-act the heat with cooling.