I'm not Andar, but I'll try to answer your questions
RPG Maker MV uses three automatic layers for maps. Tiles from the A tab go on the lowest layer, tiles from the B-E tabs go on the two upper layers. The passability setting on the highest layer takes priority over the other layers. Pasability can be set to X (not passable), O (passable) and Star. Star passability is "special" in a sense; it means the tile has no inherent passability setting and basically tells the engine "no passability specified for this tile; look on the layer below for the passability".
That is why it's important that the empty tile in the top left corner of the B tab is always set to Star: All maps "without" upper layers actually have this tile on their upper layer. If its passability was set to, for example, O (passable), that setting would take priority because it's on the highest layer and therefore make large parts of your map passable.
I think, however, the problem with your map is what Andar mentioned about the A4 tiles. I agree that it's not well documented - I found out about this only recently myself, and a quick look though the Help file didn't bring anything up. The A4 tiles are made for 2-level-dungeons and always come in pairs - the tile on top (the ligher one) is the top of the dungeon "wall", the tile below that (the darker one) is the side of the wall. Although both are set to X passability in the tileset setting, only the lower one is actually impassable. The upper one can be entered from below. (I can show you an example map if you would like to see how that can be used in dungeon design; the main point is that the "light" A4 tiles, like the one you used for the house, are supposed to be passable under certain circumstances.)
So, to fix your mapping problem, there are at least two possibilities: Either you switch to a different tile for your brick wall (e.g. the darker bricks or one of the tiles below the roof tiles) or you edit your tileset graphic in such a way that the lighter brick graphic replaces an actual "wall" tile.
I hope that helps you unterstand a little bit better. If anything is still unclear to you, just ask
