In view of the problem of real-time assessment of structural safety caused by over-grade berthing at the wharf(the current static detection technology has problems such as response lag and insufficient displacement resolution),a real-time deformation measurement method of hydraulic structure during the ship berthing process on the basis of video-image is proposed,aiming to solve the problem of real-time matching between the dynamic characteristics of the ship and the dynamic response of the structure.The ship berthing speed is calculated by YOLOv5 object detection and DeepSORT object tracking.The berthing angle is calculated by combining the Canny edge detection and contour detection algorithm with the minimum circumscribed rectangle method.The deformation amount is obtained and the reaction force is calculated by the video image monitoring method.The results show that the average error of berthing speed calculated values is ±0.165 kn.The error of berthing angel calculated values is ±0.3°.The relative error between the counter-force calculated values and the counter-force measured values is 7.67%.All the calculated values meet the requirements of practical applications.The ship berthing safety assessment technology based on video image analysis proposed in this paper shows high efficiency and accuracy in both detection and assessment,and can provide comprehensive,real-time and accurate monitoring and assessment for wharf berthing safety.