Some great answers and experiences to draw on. Thanks a lot for that.
I'm still thinking and there are a lot of good points I didn't really factor in.
For starters the Jasmine and allergies. Now I remember the stuff used to grow a bit above the neighbourg fence 25 years ago and for a couple of weeks my head was like a pressure cooker.

So scrap that. But then again it's the most "wall friendly" kind... Ivy and creeping fig sound like an invasive species.
Then with all the fires we have up north and amber attacks I'm starting to ask myself is it really a good idea to cover the house with a layer of potential fuel.
Bummer!... I thought I had it all worked out for a sec there.
@Nick I had beautiful palm trees at the front. They became huge. The wind eventually got two and that scared the hell out of me. Also came to the point where nothing else would grow around, even the lawn. And the 2 to 3m long leaves were popping faster than I could trim them.