The goal of multiple object tracking is to find the trajectory of the target objects through a number of frames from an image sequence. Generally, multi-object tracking is a challenging problem due to illumination variation, object occlusion, abrupt object motion and camera motion. In this paper, we propose a multi-object tracking scheme based on a new weighted Kanade-Lucas-Tomasi (KLT) tracker. The original KLT tracking algorithm tracks global feature points instead of a target object, and the features can hardly be tracked through a long sequence because some features may easily get lost after multiple frames. Our tracking method consists of three steps: the first step is to detect moving objects; the second step is to track the features within the moving object mask, where we use a consistency weighted function; and the last step is to identify the trajectory of the object. With an appropriately chosen weighting function, we are able to identify the trajectories of moving objects with high accuracy. In addition, our scheme is able to handle partial object occlusion.