During the rapid urbanization, surrounding built environment of the city have a significant effect on resident health. Many important cities in the world have begun to pay great attention to planning healthy cities. Beijing has also issued “healthy cities” Planning that is intended to explore the interaction mechanism between urban constructed environment and population health. Study mined residents ‘movement behavior characteristics with their sports APP using. Applying deep learning algorithms to semantically segment street built environment with data deriving of Internet map street view, such as storefront POI type, building age, greening rate, sky visibility rate, etc. Multiple linear regression and spatial autocorrelation are used for discovering factors of physical environment which affecting the behavior of residents. It is found that the jogging track intensively distributed on low-grade roads and green space in Beijing among which the Olympic Forest Park is the most popular site. Therefore, urban design of low-grade roads near residential areas should focus on the running spaces to better provide sports-friendly living environment of the residents. Encouraging residents to enhance outdoor sports and improve fitness, and create healthy urban space.