Handling Fragmented Object Instances in Instance Segmentation

I have images where a single object (such as a car) is partially covered by small trees, resulting in the object being divided into multiple visible fragments. So for that case i have one bbox that represents a car. After i use convert to Smart polygon i end up with 4 objects. How to handle it? Thanks