unity – How big can/should wall colliders be?

Following my previous question, I now have my wall collider building tool and built many of them:

Bird-view, about 17 walls selected, on the right, one is selected:

enter image description here

Here, wall and barriers form a collider so the car will hit the barrier:

enter image description here

Here you can climb on that little slope:

enter image description here

Question:

Having either a single, large collider or tons of small ones doesn’t sound good to me.

What’s a good metric in deciding how many (and how big) colliders should there be?

Also, should they be as simple as possible, e.g. less points for straight lines?