@J as fediverse token christian: honestly go for it
if you really want to mind your ps and qs, most churches have an office or admin section that is open all the time - pop your head in, let them know what you're doing, or give them a call. if you're wanting to draw/paint inside this is a bit more of a required step, but outside is fair game.
expect some friendly and polite curiosity about what you're doing, and invites to come in for a cup of coffee/etc lol
@J do they have a phone # listed? maybe try giving that a call - it might go to voicemail but that's a good way to do the equivalent of knocking politely on the office door and go "hey just out to paint, don't mind me, things are chill!"
the only way honestly this might backfire is that you might get them very excited and asking if they can have a picture of the finished product LMAO but i feel like that might be fair dues - the church is emblematic of a community that would be v flattered.