Apple fruits on trees tend to swing because of wind or other natural causes,therefore reducing the accuracy of apple picking by robots.To increase the accuracy and to speed up the apple tracking and identifying proces...Apple fruits on trees tend to swing because of wind or other natural causes,therefore reducing the accuracy of apple picking by robots.To increase the accuracy and to speed up the apple tracking and identifying process,tracking and recognition method combined with an affine transformation was proposed.The method can be divided into three steps.First,the initial image was segmented by Otsu’s thresholding method based on the two times Red minus Green minus Blue(2R-G-B)color feature;after improving the binary image,the apples were recognized with a local parameter adaptive Hough circle transformation method,thus improving the accuracy of recognition and avoiding the long,time-consuming process and excessive fitted circles in traditional Hough circle transformation.The process and results were verified experimentally.Second,the Shi-Tomasi corners detected and extracted from the first frame image were tracked,and the corners with large positive and negative optical flow errors were removed.The affine transformation matrix between the two frames was calculated based on the Random Sampling Consistency algorithm(RANSAC)to correct the scale of the template image and predict the apple positions.Third,the best positions of the target apples within 1.2 times of the prediction area were searched with a de-mean normalized cross-correlation template matching algorithm.The test results showed that the running time of each frame was 25 ms and 130 ms and the tracking error was more than 8%and 20%in the absence of template correction and apple position prediction,respectively.In comparison,the running time of our algorithm was 25 ms,and the tracking error was less than 4%.Therefore,test results indicate that speed and efficiency can be greatly improved by using our method,and this strategy can also provide a reference for tracking and recognizing other oscillatory fruits.展开更多
Purpose-In response to these shortcomings,this paper proposes a dynamic obstacle detection and tracking method based on multi-feature fusion and a dynamic obstacle recognition method based on spatio-temporal feature v...Purpose-In response to these shortcomings,this paper proposes a dynamic obstacle detection and tracking method based on multi-feature fusion and a dynamic obstacle recognition method based on spatio-temporal feature vectors.Design/methodology/approach-The existing dynamic obstacle detection and tracking methods based on geometric features have a high false detection rate.The recognition methods based on the geometric features and motion status of dynamic obstacles are greatly affected by distance and scanning angle,and cannot meet the requirements of real traffic scene applications.Findings-First,based on the geometric features of dynamic obstacles,the obstacles are considered The echo pulse width feature is used to improve the accuracy of obstacle detection and tracking;second,the space-time feature vector is constructed based on the time dimension and space dimension information of the obstacle,and then the support vector machine method is used to realize the recognition of dynamic obstacles to improve the obstacle The accuracy of object recognition.Finally,the accuracy and effectiveness of the proposed method are verified by real vehicle tests.Originality/value-The paper proposes a dynamic obstacle detection and tracking method based on multi-feature fusion and a dynamic obstacle recognition method based on spatio-temporal feature vectors.The accuracy and effectiveness of the proposed method are verified by real vehicle tests.展开更多
基金This work was financially supported by Basic Public Welfare Research Project of Zhejiang Province(Grant No.LGN20E050007).
文摘Apple fruits on trees tend to swing because of wind or other natural causes,therefore reducing the accuracy of apple picking by robots.To increase the accuracy and to speed up the apple tracking and identifying process,tracking and recognition method combined with an affine transformation was proposed.The method can be divided into three steps.First,the initial image was segmented by Otsu’s thresholding method based on the two times Red minus Green minus Blue(2R-G-B)color feature;after improving the binary image,the apples were recognized with a local parameter adaptive Hough circle transformation method,thus improving the accuracy of recognition and avoiding the long,time-consuming process and excessive fitted circles in traditional Hough circle transformation.The process and results were verified experimentally.Second,the Shi-Tomasi corners detected and extracted from the first frame image were tracked,and the corners with large positive and negative optical flow errors were removed.The affine transformation matrix between the two frames was calculated based on the Random Sampling Consistency algorithm(RANSAC)to correct the scale of the template image and predict the apple positions.Third,the best positions of the target apples within 1.2 times of the prediction area were searched with a de-mean normalized cross-correlation template matching algorithm.The test results showed that the running time of each frame was 25 ms and 130 ms and the tracking error was more than 8%and 20%in the absence of template correction and apple position prediction,respectively.In comparison,the running time of our algorithm was 25 ms,and the tracking error was less than 4%.Therefore,test results indicate that speed and efficiency can be greatly improved by using our method,and this strategy can also provide a reference for tracking and recognizing other oscillatory fruits.
文摘Purpose-In response to these shortcomings,this paper proposes a dynamic obstacle detection and tracking method based on multi-feature fusion and a dynamic obstacle recognition method based on spatio-temporal feature vectors.Design/methodology/approach-The existing dynamic obstacle detection and tracking methods based on geometric features have a high false detection rate.The recognition methods based on the geometric features and motion status of dynamic obstacles are greatly affected by distance and scanning angle,and cannot meet the requirements of real traffic scene applications.Findings-First,based on the geometric features of dynamic obstacles,the obstacles are considered The echo pulse width feature is used to improve the accuracy of obstacle detection and tracking;second,the space-time feature vector is constructed based on the time dimension and space dimension information of the obstacle,and then the support vector machine method is used to realize the recognition of dynamic obstacles to improve the obstacle The accuracy of object recognition.Finally,the accuracy and effectiveness of the proposed method are verified by real vehicle tests.Originality/value-The paper proposes a dynamic obstacle detection and tracking method based on multi-feature fusion and a dynamic obstacle recognition method based on spatio-temporal feature vectors.The accuracy and effectiveness of the proposed method are verified by real vehicle tests.
