Continuous research had been conducted on the operating systems that can manufacture, maintain, and repair marine structures. When Divers are put into exploration of offshore structures, there are limitations such as high water pressure, diver's desease, and activity, so unmanned underwater vehicles(UUV) are used the underwater environment. However, UUVs also have a problem of drifting by ocean currents, waves, and wind. and it is difficult to know its location because GPS can’t be used under the water. Therefore, in this paper, the camera is used to find the real-time location and to perform hovering control of the UUV. This paper presents an object detection algorithm using YOLOv2, which has high real-time performance among deep learning-based object detection algorithms, and used it to detect specific types of objects in camera images in real time and to obtain location information. In order to identify objects in various underwater environments, it was trained with variety of conditions such as the illumination, distance, and presence or absence of obstructions by taking these measures, detection stability was enhanced. The distance between the camera and the object was measured using the relationship between the focal length of the camera and the shape and size of the object. The hovering control between the UUV and the object was implemented using the proposed method. For hovering control, a six degrees-of-freedom UUV was designed and constructed. For robust system, redundant thrusters were deployed, and the thruster arrangement matrix was studied. The control system for the posture control using the attitude heading reference system sensor and the depth sensor was set up, and it was implemented using the camera information. Sensor reliability was verified through individual sensor performance tests, and posture control experiments and hovering control experiments were conducted in sea. The ultra short base line sensor was used to verify the relative position estimation performance of the proposed system. Through the sea experiment, the attitude control confirmed the RMS error of roll, pitch, and yaw within 1° and the RMS error of depth within 1 cm. For hovering control, it was confirmed that hovering control using a camera was successful through the experimental results: RMS error of roll, pitch, and yaw within 2°, and the RMS distance error within 4 cm.