A system determines an otherwise unknown position and orientation of a camera in a working environment, relative to an associated coordinate system, based on visually identifiable unique objects in images taken by the camera. The system utilizes a database that includes or may be updated to include position coordinates for unique objects of interest. The system identifies a plurality of objects within images taken by the camera at a given location, and enters the database either to determine position coordinates for the respective identified objects or to add position coordinates to the database for the respective identified objects, or both. The system may also update the database to include newly identified unique objects and objects that are altered between images, to determine position and orientation of the camera in a changing environment. Sensors may be included to add additional information relative to the position and orientation of the camera.