Abstract: Many traditional target extraction methods encountered a new challenge as the spatial resolution is increasing quickly. For the purpose of extracting buildings automatically in that circumstance, a new method combing both the object-based approach and boosting algorithm is proposed in this paper. The method associates segmentation with recognition by constructing a hierarchical object network, which improves effectively the problem of detecting targets with a modifiable sliding window existed in other methods. Then some useful features are selected automatically to train a validate classifier, and the confidence in each label incorporating kinds of information is computed to complete the extraction procedure. Competitive results both for multiform and complicated buildings demonstrate the precision, robustness and effectiveness of the proposed method.