Yes, you should definitely consider the overall plot on which you plan to construct the house.
You must keep enough space in all the side of your house for better light and air flow.
East and north side should have more open space compared to south and west.
Bigger trees in south, west and south west corner.
Smaller plants in east, north and north east side. You can have gardens in these areas.
Which direction, your land is facing? How big is the land?
How big house you wants to construct?