Realistic part interaction is an important component of an effective virtual assembly application. Both collision detection and part interaction modeling are needed to simulate part-topart and hand-to-part interactions. This paper presents a comparison of several common collision detection algorithms and examines the VoxMap Pointshell (VPS) method as it is used in an application to evaluate proposed assembly methods. Results from several performance tests on VPS are presented. VPS was found to provide realistic collisions and physicallybased modeling interaction with excellent performance. This paper concludes by presenting how VPS has been implemented to handle multiple dynamic part collisions and two-handed assembly using the 5DT dataglove in a projection screen virtual environment.