[There's a pause while he walks, before he sighs.]

How about this: when I leave for a mission or whatever, I'll take you with me and drop you off outside the area? The Hidden Elites wouldn't bother you if you're with me when we leave the house, and while I dunno how fun wandering around town is, it's probably better than being cooped up inside all day and you can at least talk with people.

Just don't accidentally trespass onto a noble's territory and watch out for carriages that look like they belong to someone important. The streets' atmospheres are pretty easy to read, though—if everyone suddenly becomes tense, that means you should be too.