Multi-object tracking technique is o ne of the challenging issues in computer vision.In this paper,we propose a multi-object tracking algorithm based on RJMCMC with RGB and depth informatio n fusion.Firstly,the moving objects are detected by fusing color information and depth information.Then,the observation likelihood model is established according to the result of object detection,and a reasonab le sta te transition model is also established. Finally,the multi-object tracking result is obtained using RJMCMC particle fil tering algorithm.Experimental results show that the proposed method has strong robustness.The algorithm can steadily track multiple targets and has higher accuracy.