This paper describes an AR system for remote collaboration using a captured 3D model of the local user’s scene. In the system a remote user can manipulate the scene independently of the view of the local user and add AR annotations that appear projected into the real world. Results from a pilot study and the design of a further full study are presented.