After playing the map many times, I've noticed one issue repeating over and over.
When I capture the fortress (Which I always do
But when a player is kicked, not only do these four towers deactivate but also the units inside them are trapped for good. Can't make them move, shoot, or anything, except for Deleting them.
This also has happened that after these towers got deactivated and destroyed either by me or the enemies (there were 2 instances one or two of the towers got destroyed by an opponent) if I moved any unit in the place of the destroyed fortress tile, those units also would get frozen and I would lose them for good.
Another issue:
Sometimes after 4-5 turns, when I get my Bannerman to the gates, nothing is triggered! but when an opponent does the same they can capture the fortress.