Video summarization is an effective way to quickly obtain the key information of video.Existing video summarization methods usually have high computational comp lexity and are difficult to be applied in the scene with limited computing resources.Therefore,a spatio temporal joint method for surveillance video summarization via the direction information is proposed. This method first uses the horizontal slice to obtain the object spatiotemporal motion trajectory.Secondly,t he spatiotemporal trajectory background is eliminated and the linear trajectory slope is calculate d,and the object motion direction is determined according to the object spatiotemporal trajectory slope. Thirdly,the motion segment in the sampling domain is detected to determine the timing position of t he object in the video. Finally,the video summarization is constructed adaptively according to the obje ct timing position and motion direction.Experimental results show that the average frame processing ti me (AFPT) of the proposed method reaches 0.374 s,which has obvious advantages over those of the comparison method s.In addition,the generated video summarization is concise and efficient,and the user experience is good.