Regular fastener detection is necessary to ensure the safety of railways.However,the number of abnormal fasteners is significantly lower than the number of normal fasteners in real railways.Existing supervised inspect...Regular fastener detection is necessary to ensure the safety of railways.However,the number of abnormal fasteners is significantly lower than the number of normal fasteners in real railways.Existing supervised inspectionmethods have insufficient detection ability in cases of imbalanced samples.To solve this problem,we propose an approach based on deep convolutional neural networks(DCNNs),which consists of three stages:fastener localization,abnormal fastener sample generation based on saliency detection,and fastener state inspection.First,a lightweight YOLOv5s is designed to achieve fast and precise localization of fastener regions.Then,the foreground clip region of a fastener image is extracted by the designed fastener saliency detection network(F-SDNet),combined with data augmentation to generate a large number of abnormal fastener samples and balance the number of abnormal and normal samples.Finally,a fastener inspection model called Fastener ResNet-8 is constructed by being trained with the augmented fastener dataset.Results show the effectiveness of our proposed method in solving the problem of sample imbalance in fastener detection.Qualitative and quantitative comparisons show that the proposed F-SDNet outperforms other state-of-the-art methods in clip region extraction,reaching MAE and max F-measure of 0.0215 and 0.9635,respectively.In addition,the FPS of the fastener state inspection model reached 86.2,and the average accuracy reached 98.7%on 614 augmented fastener test sets and 99.9%on 7505 real fastener datasets.展开更多
Railway inspection poses significant challenges due to the extensive use of various components in vast railway networks,especially in the case of high-speed railways.These networks demand high maintenance but offer on...Railway inspection poses significant challenges due to the extensive use of various components in vast railway networks,especially in the case of high-speed railways.These networks demand high maintenance but offer only limited inspection windows.In response,this study focuses on developing a high-performance rail inspection system tailored for high-speed railways and railroads with constrained inspection timeframes.This system leverages the latest artificial intelligence advancements,incorporating YOLOv8 for detection.Our research introduces an efficient model inference pipeline based on a producer-consumer model,effectively utilizing parallel processing and concurrent computing to enhance performance.The deployment of this pipeline,implemented using C++,TensorRT,float16 quantization,and oneTBB,represents a significant departure from traditional sequential processing methods.The results are remarkable,showcasing a substantial increase in processing speed:from 38.93 Frames Per Second(FPS)to 281.06 FPS on a desktop system equipped with an Nvidia RTX A6000 GPU and from 19.50 FPS to 200.26 FPS on the Nvidia Jetson AGX Orin edge computing platform.This proposed framework has the potential to meet the real-time inspection requirements of high-speed railways.展开更多
Rapid bridge inspection and evaluation mainly uses information technology to test the quality of bridge infrastructure and structures,integrates the test results with the existing management system,completes the bridg...Rapid bridge inspection and evaluation mainly uses information technology to test the quality of bridge infrastructure and structures,integrates the test results with the existing management system,completes the bridge status assessment,establishes information management files to provide bridge disease problem inspection and analysis,and provides support for the application of disposal measures.This paper briefly discusses the necessity of applying rapid inspection and evaluation technology and analyzes the bridge’s rapid inspection and evaluation content,inspection system,and application process.We look forward to the future application prospects of this technology and supporting those in this field.展开更多
Parts with high-quality freeform surfaces have been widely used in industries,which require strict quality control during the manufacturing process.Among all the industrial inspection methods,contact measurement with ...Parts with high-quality freeform surfaces have been widely used in industries,which require strict quality control during the manufacturing process.Among all the industrial inspection methods,contact measurement with coordinate measuring machines or computer numerical control machine tool is a fundamental technique due to its high accuracy,robustness,and universality.In this paper,the existing research in the contact measurement field is systematically reviewed.First,different configurations of the measuring machines are introduced in detail,which may have influence on the corresponding sampling and inspection path generation criteria.Then,the entire inspection pipeline is divided into two stages,namely the pre-inspection and post-inspection stages.The typical methods of each sub-stage are systematically overviewed and classified,including sampling,accessibility analysis,inspection path generation,probe tip radius compensation,surface reconstruction,and uncertainty analysis.Apart from those classical research,the applications of the emerging deep learning technique in some specific tasks of measurement are introduced.Furthermore,some potential and promising trends are provided for future investigation.展开更多
The recent trends in Industry 4.0 and Internet of Things have encour-aged many factory managers to improve inspection processes to achieve automa-tion and high detection rates.However,the corresponding cost results of...The recent trends in Industry 4.0 and Internet of Things have encour-aged many factory managers to improve inspection processes to achieve automa-tion and high detection rates.However,the corresponding cost results of sample tests are still used for quality control.A low-cost automated optical inspection system that can be integrated with production lines to fully inspect products with-out adjustments is introduced herein.The corresponding mechanism design enables each product to maintain afixed position and orientation during inspec-tion to accelerate the inspection process.The proposed system combines image recognition and deep learning to measure the dimensions of the thread and iden-tify its defects within 20 s,which is lower than the production-line productivity per 30 s.In addition,the system is designed to be used for monitoring production lines and equipment status.The dimensional tolerance of the proposed system reaches 0.012 mm,and a 100%accuracy is achieved in terms of the defect reso-lution.In addition,an attention-based visualization approach is utilized to verify the rationale for the use of the convolutional neural network model and identify the location of thread defects.展开更多
Objective To identify and reduce the gap between China’s drug GMP inspection and pharmaceutical inspection co-operation scheme(PIC/S)audit checklist,find out the key improvement items,and revise them pertinently,whic...Objective To identify and reduce the gap between China’s drug GMP inspection and pharmaceutical inspection co-operation scheme(PIC/S)audit checklist,find out the key improvement items,and revise them pertinently,which will promote the process of China joining PIC/S.Methods The general situation of PIC/S organization and audit checklist were introduced first,and then the accession of several countries that joined the organization was analyzed.Meanwhile,the process of China’s participation in PIC/S was sorted out.After referring to the contents of PIC/S audit checklist,the problems of GMP inspection system in China were studied.Results and Conclusion There are still many problems in GMP inspection in China.Some suggestions are put forward for improvement and change,which can provide reference for the development of drug inspection agencies at all levels in China.展开更多
Workers who conduct regular facility inspections in radioactive environments will inevitably be affected by radiation.Therefore,it is important to optimize the inspection path to ensure that workers are exposed to the...Workers who conduct regular facility inspections in radioactive environments will inevitably be affected by radiation.Therefore,it is important to optimize the inspection path to ensure that workers are exposed to the least amount of radiation.This study proposes a discrete Rao-combined artificial bee colony(ABC)algorithm for planning inspection paths with minimum exposure doses in radioactive environments with obstacles.In this algorithm,retaining the framework of the traditional ABC algorithm,we applied the directional solution update rules of Rao algorithms at the employed bee stage and onlooker bee stage to increase the exploitation ability of the algorithm and implement discretion using the swap operator and swap sequence.To increase the randomness of solution generation,the chaos algorithm was used at the initialization stage.The K-opt operation technique was introduced at the scout bee stage to increase the exploration ability of the algorithm.For path planning in an environment with complex structural obstacles,an obstacle detour technique using a recursive algorithm was applied.To evaluate the performance of the proposed algorithm,we performed experimental simulations in three hypothetical environments and compared the results with those of improved particle swarm optimization,chaos particle swarm optimization,improved ant colony optimization,and discrete Rao’s algorithms.The experimental results show the high performance of the proposed discrete Rao-combined ABC algorithm and its obstacle detour capability.展开更多
Visual inspection is commonly adopted for building operation,maintenance,and safety.The durability and defects of components or materials in buildings can be quickly assessed through visual inspection.However,implemen...Visual inspection is commonly adopted for building operation,maintenance,and safety.The durability and defects of components or materials in buildings can be quickly assessed through visual inspection.However,implementations of visual inspection are substantially time-consuming,labor-intensive,and error-prone because useful auxiliary tools that can instantly highlight defects or damage locations from images are not available.Therefore,an advanced building inspection framework is developed and implemented with augmented reality(AR)and real-time damage detection in this study.In this framework,engineers should walk around and film every corner of the building interior to generate the three-dimensional(3D)environment through ARKit.Meanwhile,a trained YOLOv5 model real-time detects defects during this process,even in a large-scale field,and the defect locations indicating the detected defects are then marked in this 3D environment.The defects areas can be measured with centimeter-level accuracy with the light detection and ranging(LiDAR)on devices.All required damage information,including defect positions and sizes,is collected at a time and can be rendered in the 2D and 3D views.Finally,this visual inspection can be efficiently conducted,and the previously generated environment can also be loaded to re-localize existing defect marks for future maintenance and change observation.Moreover,the proposed framework is also implemented and verified by an underground parking lot in a building to detect and quantify surface defects on concrete components.As seen in the results,the conventional building inspection is significantly improved with the aid of the proposed framework in terms of damage localization,damage quantification,and inspection efficiency.展开更多
Pinhole corrosion is difficult to discover through conventional ultrasonic guided waves inspection,particularly for micro-sized pinholes less than 1 mm in diameter.This study proposes a new micro-sized pinhole inspect...Pinhole corrosion is difficult to discover through conventional ultrasonic guided waves inspection,particularly for micro-sized pinholes less than 1 mm in diameter.This study proposes a new micro-sized pinhole inspection method based on segmented time reversal(STR)and high-order modes cluster(HOMC)Lamb waves.First,the principle of defect echo enhancement using STR is introduced.Conventional and STR inspection experiments were conducted on aluminum plates with a thickness of 3 mm and defects with different diameters and depths.The parameters of the segment window are discussed in detail.The results indicate that the proposed method had an amplitude four times larger than of conventional ultrasonic guided waves inspection method for pinhole defect detection and could detect micro-sized pinhole defects as small as 0.5 mm in diameter and 0.5 mm in depth.Moreover,the segment window location and width(5-10 times width of the conventional excitation signal)did not affect the detection sensitivity.The combination of low-power and STR is more conducive to detection in different environments,indicating the robustness of the proposed method.Compared with conventional ultrasonic guided wave inspection methods,the proposed method can detect much smaller defect echoes usually obscured by noise that are difficult to detect with a lower excitation power and thus this study would be a good reference for pinhole defect detection.展开更多
Automated X-ray defect inspection of occluded objects has been an essential topic in semiconductors,autonomous vehicles,and artificial intelligence devices.However,there are few solutions to segment occluded objects i...Automated X-ray defect inspection of occluded objects has been an essential topic in semiconductors,autonomous vehicles,and artificial intelligence devices.However,there are few solutions to segment occluded objects in the X-ray inspection efficiently.In particular,in the Ball Grid Array inspection of X-ray images,it is difficult to accurately segment the regions of occluded solder balls and detect defects inside solder balls.In this paper,we present a novel automatic inspection algorithm that segments solder balls,and detects defects fast and efficiently when solder balls are occluded.The proposed algorithm consists of two stages.In the first stage,the defective candidates or defects are determined through the following four steps:(i)image preprocessing such as noise removal,contrast enhancement,binarization,connected component,and morphology,(ii)limiting the inspec-tion area to the ball regions and determining if the ball regions are occluded,(iii)segmenting each ball region into one or more regions with similar gray values,and(iv)determining whether there are defects or defective candidates in the regions using a weighted sum of local threshold on local variance.If there are defective candidates,the determination of defects is finally made in the following stage.In the second stage,defects are detected using the automated inspection technique based on oblique computed tomography.The 3D precision inspection process is divided into four steps:(i)obtaining 360 projection images(one image per degree)rotating the object from 0 to 360 degrees,(ii)reconstructing a 3D image from the 360 projected images,(iii)finding the center slice of gravity for solder balls from the axial slice images in the z-direction,and getting the inspection intervals between the upper bound and the lower bound from the center slice,and(iv)finally determining whether there are defects in the averaged image of solder balls.The proposed hybrid algorithm is robust for segmenting the defects inside occluded solder balls,and improves the performance of solder ball segmentation and defect detection algorithm.Experimental results show an accuracy of more than 97%.展开更多
As a distributed machine learning architecture,Federated Learning(FL)can train a global model by exchanging users’model parameters without their local data.However,with the evolution of eavesdropping techniques,attac...As a distributed machine learning architecture,Federated Learning(FL)can train a global model by exchanging users’model parameters without their local data.However,with the evolution of eavesdropping techniques,attackers can infer information related to users’local data with the intercepted model parameters,resulting in privacy leakage and hindering the application of FL in smart factories.To meet the privacy protection needs of the intelligent inspection task in pumped storage power stations,in this paper we propose a novel privacy-preserving FL algorithm based on multi-key Fully Homomorphic Encryption(FHE),called MFHE-PPFL.Specifically,to reduce communication costs caused by deploying the FHE algorithm,we propose a self-adaptive threshold-based model parameter compression(SATMPC)method.It can reduce the amount of encrypted data with an adaptive thresholds-enabled user selection mechanism that only enables eligible devices to communicate with the FL server.Moreover,to protect model parameter privacy during transmission,we develop a secret sharing-based multi-key RNS-CKKS(SSMR)method that encrypts the device’s uploaded parameter increments and supports decryption in device dropout scenarios.Security analyses and simulation results show that our algorithm can prevent four typical threat models and outperforms the state-of-the-art in communication costs with guaranteed accuracy.展开更多
The central environmental protection inspection (CEPI) system in China is a significant institutional innova‐tion in national environmental governance. The CEPI applies a joint supervision strategy to address salient...The central environmental protection inspection (CEPI) system in China is a significant institutional innova‐tion in national environmental governance. The CEPI applies a joint supervision strategy to address salient en‐vironmental issues and strictly enforce the environmental responsibilities of local governments. This study col‐lects and organizes CEPI inspection reports covering three stages that encompass the first round, the “look back”, and the second round, applying text analysis to obtain sample data and conduct statistical quantifica‐tion of word frequency in inspection reports and identify notable changes. The study explores the allocation of CEPI attention between policy objectives and the intensity of policy instruments. We determine that in con‐junction with public opinion feedback, the CEPI conducts targeted inspections and focuses more on pollutant governance, which has high severity and can be addressed quickly. The CEPI fills the gap of normalized gover‐nance with a campaign-style governance approach. Regarding the intensity of policy measures, the CEPI pri‐marily uses economic incentive policy instruments, supplemented by command-and-control and public guid‐ance approaches, advancing the sustainability of regulatory effectiveness through economic, social, and politi‐cal activities. This study extends knowledge in the field of CEPI policy priorities and implementation, expand‐ing the literature related to outcomes of environmental policy in developing countries.展开更多
AIM:To investigate whether Wild Field Imaging System(WFIS SW-8000),25G endoilluminator,and intraoperative optical coherence tomography(iOCT)can perform realtime screening and diagnosing in patients with suspicious dia...AIM:To investigate whether Wild Field Imaging System(WFIS SW-8000),25G endoilluminator,and intraoperative optical coherence tomography(iOCT)can perform realtime screening and diagnosing in patients with suspicious diabetic retinopathy(DR)during phacoemulsification,especially in cases of white cataract.METHODS:A cross-sectional study was carried out.A total of 204 dense diabetic cataractous eyes of 204 patients with suspected DR treated from April 2020 to March 2021 were included.Phacoemulsification combined with intraocular lens implantation was performed.Following the removal of the lens opacity,the 25G endoilluminator,fundus photography,and iOCT were performed successively.Optical coherence tomography(OCT)and/or fundus fluorescein angiography(FFA)were used to verify the fundus findings postoperatively.Intraoperative and postoperative results were compared to verify the accuracy of intraoperative diagnosis in each group.RESULTS:Intraoperative and postoperative examinations revealed 58 and 62 eyes with DR,respectively(positive rate,28.43%and 30.39%,respectively).During the phacoemulsification,WFIS SW-8000 detected 44 eyes with DR(the detection rate,70.97%);25G endo-illuminator found 56 eyes with DR(the detection rate,90.32%);iOCT found 46 eyes with DR(the detection rate,74.19%);and 58 eyes with DR were found by combining the three methods(the detection rate,93.55%).There were statistically significant differences in the diagnostic sensitivity for DR among the methods(χ^(2)=16.36,P=0.001).CONCLUSION:WFIS SW-8000,25G endo-illuminator,iOCT,and especially their combination can be used to inspect the fundus and detect DR intraoperatively;they are helpful for the timely diagnosis and treatment of DR in patients with dense cataract.展开更多
The continuous growth in the scale of unmanned aerial vehicle (UAV) applications in transmission line inspection has resulted in a corresponding increase in the demand for UAV inspection image processing. Owing to its...The continuous growth in the scale of unmanned aerial vehicle (UAV) applications in transmission line inspection has resulted in a corresponding increase in the demand for UAV inspection image processing. Owing to its excellent performance in computer vision, deep learning has been applied to UAV inspection image processing tasks such as power line identification and insulator defect detection. Despite their excellent performance, electric power UAV inspection image processing models based on deep learning face several problems such as a small application scope, the need for constant retraining and optimization, and high R&D monetary and time costs due to the black-box and scene data-driven characteristics of deep learning. In this study, an automated deep learning system for electric power UAV inspection image analysis and processing is proposed as a solution to the aforementioned problems. This system design is based on the three critical design principles of generalizability, extensibility, and automation. Pre-trained models, fine-tuning (downstream task adaptation), and automated machine learning, which are closely related to these design principles, are reviewed. In addition, an automated deep learning system architecture for electric power UAV inspection image analysis and processing is presented. A prototype system was constructed and experiments were conducted on the two electric power UAV inspection image analysis and processing tasks of insulator self-detonation and bird nest recognition. The models constructed using the prototype system achieved 91.36% and 86.13% mAP for insulator self-detonation and bird nest recognition, respectively. This demonstrates that the system design concept is reasonable and the system architecture feasible .展开更多
In renewal theory, the Inspection Paradox refers to the fact that an interarrival period in a renewal process which contains a fixed inspection time tends to be longer than one for the corresponding uninspected proces...In renewal theory, the Inspection Paradox refers to the fact that an interarrival period in a renewal process which contains a fixed inspection time tends to be longer than one for the corresponding uninspected process. We focus on the paradox for Bernoulli trials. Probability distributions and moments for the lengths of the interarrival periods are derived for the inspected process, and we compare them to those for the uninspected case.展开更多
The Inspection Paradox refers to the fact that in a Renewal Process, the length of the interarrival period which contains a fixed time is stochastically larger than the length of a typical interarrival period. To prov...The Inspection Paradox refers to the fact that in a Renewal Process, the length of the interarrival period which contains a fixed time is stochastically larger than the length of a typical interarrival period. To provide a more complete understanding of this phenomenon, conditioning arguments are used to obtain the distributions and moments of the lengths of the interarrival periods other than the one containing this fixed time for the case of the time-homogeneous Poisson Process. Distributions of the waiting times for events that occur both before and after this fixed time are derived. This provides a fairly complete probabilistic analysis of the Inspection Paradox.展开更多
To develop China’s human rights cause with a people-centered approach,we should pay close attention to the concrete experiences of the general public regarding the protection of human rights.Deepening the research on...To develop China’s human rights cause with a people-centered approach,we should pay close attention to the concrete experiences of the general public regarding the protection of human rights.Deepening the research on the perception of respect for human rights can contribute to a more comprehensive understanding of the practical achievements of the hu man rights cause.Public environmental rights,as a new type of human rights,have become an important aspect of the development of the human rights cause in the new era.The central envi ronmental inspection,as an authoritative and interventionist vertical governance mechanism,promotes the implementation of environmental policies by local Party committees and govern ments and strengthens environmental information disclosure and public participation in environ mental matters.As a result,it contributes to the realization of public environmental rights and stimulates public perception of respect for human rights.Among them,the“look-back inspec tion is an important component of the central environmental inspection,and its implemen tation consolidates and enhances the previous inspection work.An empirical analysis based on the World Values Survey’s data for China indicates that residents in the provinces that have underg one“look-back inspections are more inclined to believe that human rights are adequately re spected compared to residents in the provinces that have not underwent such inspections.It suggests that the advancement and improvement of the central environmental inspection system promote improvements in ecological environment quality and contribute to enhancing the public percep tion of respect for human rights.展开更多
Highway bridges are important transportation infrastructures in our country,and their quality is related to the people's lives.Highway bridge inspection,identification and test are measures to evaluate the quality...Highway bridges are important transportation infrastructures in our country,and their quality is related to the people's lives.Highway bridge inspection,identification and test are measures to evaluate the quality of highway bridges.Through the comprehensive application of various technologies,quality problems of highway bridges can be found early,thereby ensuring traffic safety.This paper first summarizes the role and the types of highway bridge inspection and test.Then the problems and solutions in highway bridge inspection and test are analyzed and studied,and some examples are given,in hopes of providing reference for future testing.展开更多
With the rapid development of information technologies such as digital twin, extended reality, and blockchain,the hype around "metaverse" is increasing at astronomical speed. However, much attention has been...With the rapid development of information technologies such as digital twin, extended reality, and blockchain,the hype around "metaverse" is increasing at astronomical speed. However, much attention has been paid to its entertainment and social functions. Considering the openness and interoperability of metaverses, the market of quality inspection promises explosive growth. In this paper, taking advantage of metaverses, we first propose the concept of Automated Quality Inspection(Auto QI), which performs integrated inspection covering the entire manufacturing process, including Quality of Materials, Quality of Manufacturing(Qo M), Quality of Products, Quality of Processes(Qo P), Quality of Systems, and Quality of Services(Qo S). Based on the scenarios engineering theory, we discuss how to perform interactions between metaverses and the physical world for virtual design instruction and physical validation feedback. Then we introduce a bottomup inspection device development workflow with productivity tools offered by metaverses, making development more effective and efficient than ever. As the core of quality inspection,we propose Quality Transformers to complete detection task,while federated learning is integrated to regulate data sharing.In summary, we point out the development directions of quality inspection under metaverse tide.展开更多
Periodical inspections and an age-based preventive replacement( APR) model were proposed based on a two-stage failure process for a single component system. Inspection activities were performed at regular intervals. O...Periodical inspections and an age-based preventive replacement( APR) model were proposed based on a two-stage failure process for a single component system. Inspection activities were performed at regular intervals. Once the system was identified to be at defective state by inspection,a maintenance decision needed to be made that whether to replace the defective system immediately or wait till the preset APR time. So a threshold was introduced into the model and called as inspection-based preventive replacement( IPR) threshold. If the distance from the defect identification point to the APR time was longer than the threshold, a preventive replacement( PR) action was made; otherwise PR action was to wait till the APR time. Two models were proposed and compared,and a numerical example was conducted to illustrate the applicability of the model.展开更多
基金supported in part by the National Natural Science Foundation of China (Grant Nos.51975347 and 51907117)in part by the Shanghai Science and Technology Program (Grant No.22010501600).
文摘Regular fastener detection is necessary to ensure the safety of railways.However,the number of abnormal fasteners is significantly lower than the number of normal fasteners in real railways.Existing supervised inspectionmethods have insufficient detection ability in cases of imbalanced samples.To solve this problem,we propose an approach based on deep convolutional neural networks(DCNNs),which consists of three stages:fastener localization,abnormal fastener sample generation based on saliency detection,and fastener state inspection.First,a lightweight YOLOv5s is designed to achieve fast and precise localization of fastener regions.Then,the foreground clip region of a fastener image is extracted by the designed fastener saliency detection network(F-SDNet),combined with data augmentation to generate a large number of abnormal fastener samples and balance the number of abnormal and normal samples.Finally,a fastener inspection model called Fastener ResNet-8 is constructed by being trained with the augmented fastener dataset.Results show the effectiveness of our proposed method in solving the problem of sample imbalance in fastener detection.Qualitative and quantitative comparisons show that the proposed F-SDNet outperforms other state-of-the-art methods in clip region extraction,reaching MAE and max F-measure of 0.0215 and 0.9635,respectively.In addition,the FPS of the fastener state inspection model reached 86.2,and the average accuracy reached 98.7%on 614 augmented fastener test sets and 99.9%on 7505 real fastener datasets.
基金supported by the Federal Railroad Administration (FRA)the National Academy of Science (NAS) IDEA program
文摘Railway inspection poses significant challenges due to the extensive use of various components in vast railway networks,especially in the case of high-speed railways.These networks demand high maintenance but offer only limited inspection windows.In response,this study focuses on developing a high-performance rail inspection system tailored for high-speed railways and railroads with constrained inspection timeframes.This system leverages the latest artificial intelligence advancements,incorporating YOLOv8 for detection.Our research introduces an efficient model inference pipeline based on a producer-consumer model,effectively utilizing parallel processing and concurrent computing to enhance performance.The deployment of this pipeline,implemented using C++,TensorRT,float16 quantization,and oneTBB,represents a significant departure from traditional sequential processing methods.The results are remarkable,showcasing a substantial increase in processing speed:from 38.93 Frames Per Second(FPS)to 281.06 FPS on a desktop system equipped with an Nvidia RTX A6000 GPU and from 19.50 FPS to 200.26 FPS on the Nvidia Jetson AGX Orin edge computing platform.This proposed framework has the potential to meet the real-time inspection requirements of high-speed railways.
文摘Rapid bridge inspection and evaluation mainly uses information technology to test the quality of bridge infrastructure and structures,integrates the test results with the existing management system,completes the bridge status assessment,establishes information management files to provide bridge disease problem inspection and analysis,and provides support for the application of disposal measures.This paper briefly discusses the necessity of applying rapid inspection and evaluation technology and analyzes the bridge’s rapid inspection and evaluation content,inspection system,and application process.We look forward to the future application prospects of this technology and supporting those in this field.
基金partially supported by the Natural Science Foundation of Shanghai(Grant No.22ZR1435200)the National Natural Science Foundation of China(Grant No.52075337)the Open Research Fund of State Key Laboratory of Digital Manufacturing and Equipment Technology,HUST(Grant No.DMETKF2022010)。
文摘Parts with high-quality freeform surfaces have been widely used in industries,which require strict quality control during the manufacturing process.Among all the industrial inspection methods,contact measurement with coordinate measuring machines or computer numerical control machine tool is a fundamental technique due to its high accuracy,robustness,and universality.In this paper,the existing research in the contact measurement field is systematically reviewed.First,different configurations of the measuring machines are introduced in detail,which may have influence on the corresponding sampling and inspection path generation criteria.Then,the entire inspection pipeline is divided into two stages,namely the pre-inspection and post-inspection stages.The typical methods of each sub-stage are systematically overviewed and classified,including sampling,accessibility analysis,inspection path generation,probe tip radius compensation,surface reconstruction,and uncertainty analysis.Apart from those classical research,the applications of the emerging deep learning technique in some specific tasks of measurement are introduced.Furthermore,some potential and promising trends are provided for future investigation.
基金supported partially by the Ministry of Science and Technology,Taiwan,under contracts MOST-110-2634-F-009-024,109-2218-E-150-002,and 109-2218-E-005-015.
文摘The recent trends in Industry 4.0 and Internet of Things have encour-aged many factory managers to improve inspection processes to achieve automa-tion and high detection rates.However,the corresponding cost results of sample tests are still used for quality control.A low-cost automated optical inspection system that can be integrated with production lines to fully inspect products with-out adjustments is introduced herein.The corresponding mechanism design enables each product to maintain afixed position and orientation during inspec-tion to accelerate the inspection process.The proposed system combines image recognition and deep learning to measure the dimensions of the thread and iden-tify its defects within 20 s,which is lower than the production-line productivity per 30 s.In addition,the system is designed to be used for monitoring production lines and equipment status.The dimensional tolerance of the proposed system reaches 0.012 mm,and a 100%accuracy is achieved in terms of the defect reso-lution.In addition,an attention-based visualization approach is utilized to verify the rationale for the use of the convolutional neural network model and identify the location of thread defects.
文摘Objective To identify and reduce the gap between China’s drug GMP inspection and pharmaceutical inspection co-operation scheme(PIC/S)audit checklist,find out the key improvement items,and revise them pertinently,which will promote the process of China joining PIC/S.Methods The general situation of PIC/S organization and audit checklist were introduced first,and then the accession of several countries that joined the organization was analyzed.Meanwhile,the process of China’s participation in PIC/S was sorted out.After referring to the contents of PIC/S audit checklist,the problems of GMP inspection system in China were studied.Results and Conclusion There are still many problems in GMP inspection in China.Some suggestions are put forward for improvement and change,which can provide reference for the development of drug inspection agencies at all levels in China.
文摘Workers who conduct regular facility inspections in radioactive environments will inevitably be affected by radiation.Therefore,it is important to optimize the inspection path to ensure that workers are exposed to the least amount of radiation.This study proposes a discrete Rao-combined artificial bee colony(ABC)algorithm for planning inspection paths with minimum exposure doses in radioactive environments with obstacles.In this algorithm,retaining the framework of the traditional ABC algorithm,we applied the directional solution update rules of Rao algorithms at the employed bee stage and onlooker bee stage to increase the exploitation ability of the algorithm and implement discretion using the swap operator and swap sequence.To increase the randomness of solution generation,the chaos algorithm was used at the initialization stage.The K-opt operation technique was introduced at the scout bee stage to increase the exploration ability of the algorithm.For path planning in an environment with complex structural obstacles,an obstacle detour technique using a recursive algorithm was applied.To evaluate the performance of the proposed algorithm,we performed experimental simulations in three hypothetical environments and compared the results with those of improved particle swarm optimization,chaos particle swarm optimization,improved ant colony optimization,and discrete Rao’s algorithms.The experimental results show the high performance of the proposed discrete Rao-combined ABC algorithm and its obstacle detour capability.
文摘Visual inspection is commonly adopted for building operation,maintenance,and safety.The durability and defects of components or materials in buildings can be quickly assessed through visual inspection.However,implementations of visual inspection are substantially time-consuming,labor-intensive,and error-prone because useful auxiliary tools that can instantly highlight defects or damage locations from images are not available.Therefore,an advanced building inspection framework is developed and implemented with augmented reality(AR)and real-time damage detection in this study.In this framework,engineers should walk around and film every corner of the building interior to generate the three-dimensional(3D)environment through ARKit.Meanwhile,a trained YOLOv5 model real-time detects defects during this process,even in a large-scale field,and the defect locations indicating the detected defects are then marked in this 3D environment.The defects areas can be measured with centimeter-level accuracy with the light detection and ranging(LiDAR)on devices.All required damage information,including defect positions and sizes,is collected at a time and can be rendered in the 2D and 3D views.Finally,this visual inspection can be efficiently conducted,and the previously generated environment can also be loaded to re-localize existing defect marks for future maintenance and change observation.Moreover,the proposed framework is also implemented and verified by an underground parking lot in a building to detect and quantify surface defects on concrete components.As seen in the results,the conventional building inspection is significantly improved with the aid of the proposed framework in terms of damage localization,damage quantification,and inspection efficiency.
基金National Natural Science Foundation of China(Grant No.62071433)National Key R&D Program of China(Grant No.2022YFC3005002)。
文摘Pinhole corrosion is difficult to discover through conventional ultrasonic guided waves inspection,particularly for micro-sized pinholes less than 1 mm in diameter.This study proposes a new micro-sized pinhole inspection method based on segmented time reversal(STR)and high-order modes cluster(HOMC)Lamb waves.First,the principle of defect echo enhancement using STR is introduced.Conventional and STR inspection experiments were conducted on aluminum plates with a thickness of 3 mm and defects with different diameters and depths.The parameters of the segment window are discussed in detail.The results indicate that the proposed method had an amplitude four times larger than of conventional ultrasonic guided waves inspection method for pinhole defect detection and could detect micro-sized pinhole defects as small as 0.5 mm in diameter and 0.5 mm in depth.Moreover,the segment window location and width(5-10 times width of the conventional excitation signal)did not affect the detection sensitivity.The combination of low-power and STR is more conducive to detection in different environments,indicating the robustness of the proposed method.Compared with conventional ultrasonic guided wave inspection methods,the proposed method can detect much smaller defect echoes usually obscured by noise that are difficult to detect with a lower excitation power and thus this study would be a good reference for pinhole defect detection.
文摘Automated X-ray defect inspection of occluded objects has been an essential topic in semiconductors,autonomous vehicles,and artificial intelligence devices.However,there are few solutions to segment occluded objects in the X-ray inspection efficiently.In particular,in the Ball Grid Array inspection of X-ray images,it is difficult to accurately segment the regions of occluded solder balls and detect defects inside solder balls.In this paper,we present a novel automatic inspection algorithm that segments solder balls,and detects defects fast and efficiently when solder balls are occluded.The proposed algorithm consists of two stages.In the first stage,the defective candidates or defects are determined through the following four steps:(i)image preprocessing such as noise removal,contrast enhancement,binarization,connected component,and morphology,(ii)limiting the inspec-tion area to the ball regions and determining if the ball regions are occluded,(iii)segmenting each ball region into one or more regions with similar gray values,and(iv)determining whether there are defects or defective candidates in the regions using a weighted sum of local threshold on local variance.If there are defective candidates,the determination of defects is finally made in the following stage.In the second stage,defects are detected using the automated inspection technique based on oblique computed tomography.The 3D precision inspection process is divided into four steps:(i)obtaining 360 projection images(one image per degree)rotating the object from 0 to 360 degrees,(ii)reconstructing a 3D image from the 360 projected images,(iii)finding the center slice of gravity for solder balls from the axial slice images in the z-direction,and getting the inspection intervals between the upper bound and the lower bound from the center slice,and(iv)finally determining whether there are defects in the averaged image of solder balls.The proposed hybrid algorithm is robust for segmenting the defects inside occluded solder balls,and improves the performance of solder ball segmentation and defect detection algorithm.Experimental results show an accuracy of more than 97%.
基金supported by the National Natural Science Foundation of China under Grant 62171113。
文摘As a distributed machine learning architecture,Federated Learning(FL)can train a global model by exchanging users’model parameters without their local data.However,with the evolution of eavesdropping techniques,attackers can infer information related to users’local data with the intercepted model parameters,resulting in privacy leakage and hindering the application of FL in smart factories.To meet the privacy protection needs of the intelligent inspection task in pumped storage power stations,in this paper we propose a novel privacy-preserving FL algorithm based on multi-key Fully Homomorphic Encryption(FHE),called MFHE-PPFL.Specifically,to reduce communication costs caused by deploying the FHE algorithm,we propose a self-adaptive threshold-based model parameter compression(SATMPC)method.It can reduce the amount of encrypted data with an adaptive thresholds-enabled user selection mechanism that only enables eligible devices to communicate with the FL server.Moreover,to protect model parameter privacy during transmission,we develop a secret sharing-based multi-key RNS-CKKS(SSMR)method that encrypts the device’s uploaded parameter increments and supports decryption in device dropout scenarios.Security analyses and simulation results show that our algorithm can prevent four typical threat models and outperforms the state-of-the-art in communication costs with guaranteed accuracy.
基金supported by National Natural Science Foundation of China[Grant No.72304124]Spring Sunshine Collaborative Re‐search Project of the Ministry of Education in China[Grant No.202201660]+2 种基金Youth Project of Gansu Natural Science Foundation[Grant No.22JR5RA542]General Project of Gansu Philosophy and Social Science Foundation[Grant No.2022YB014]Fundamental Re‐search Funds for the Central Universities[Grant No.2023lzdxjb‐kyzx008].
文摘The central environmental protection inspection (CEPI) system in China is a significant institutional innova‐tion in national environmental governance. The CEPI applies a joint supervision strategy to address salient en‐vironmental issues and strictly enforce the environmental responsibilities of local governments. This study col‐lects and organizes CEPI inspection reports covering three stages that encompass the first round, the “look back”, and the second round, applying text analysis to obtain sample data and conduct statistical quantifica‐tion of word frequency in inspection reports and identify notable changes. The study explores the allocation of CEPI attention between policy objectives and the intensity of policy instruments. We determine that in con‐junction with public opinion feedback, the CEPI conducts targeted inspections and focuses more on pollutant governance, which has high severity and can be addressed quickly. The CEPI fills the gap of normalized gover‐nance with a campaign-style governance approach. Regarding the intensity of policy measures, the CEPI pri‐marily uses economic incentive policy instruments, supplemented by command-and-control and public guid‐ance approaches, advancing the sustainability of regulatory effectiveness through economic, social, and politi‐cal activities. This study extends knowledge in the field of CEPI policy priorities and implementation, expand‐ing the literature related to outcomes of environmental policy in developing countries.
基金Supported by National Natural Science Foundation of China(No.81974129)the Technology and Science Foundation of Jiangsu Province(No.2016699)+1 种基金the Technology and Science Foundation of Nantong(No.22019012No.2019078).
文摘AIM:To investigate whether Wild Field Imaging System(WFIS SW-8000),25G endoilluminator,and intraoperative optical coherence tomography(iOCT)can perform realtime screening and diagnosing in patients with suspicious diabetic retinopathy(DR)during phacoemulsification,especially in cases of white cataract.METHODS:A cross-sectional study was carried out.A total of 204 dense diabetic cataractous eyes of 204 patients with suspected DR treated from April 2020 to March 2021 were included.Phacoemulsification combined with intraocular lens implantation was performed.Following the removal of the lens opacity,the 25G endoilluminator,fundus photography,and iOCT were performed successively.Optical coherence tomography(OCT)and/or fundus fluorescein angiography(FFA)were used to verify the fundus findings postoperatively.Intraoperative and postoperative results were compared to verify the accuracy of intraoperative diagnosis in each group.RESULTS:Intraoperative and postoperative examinations revealed 58 and 62 eyes with DR,respectively(positive rate,28.43%and 30.39%,respectively).During the phacoemulsification,WFIS SW-8000 detected 44 eyes with DR(the detection rate,70.97%);25G endo-illuminator found 56 eyes with DR(the detection rate,90.32%);iOCT found 46 eyes with DR(the detection rate,74.19%);and 58 eyes with DR were found by combining the three methods(the detection rate,93.55%).There were statistically significant differences in the diagnostic sensitivity for DR among the methods(χ^(2)=16.36,P=0.001).CONCLUSION:WFIS SW-8000,25G endo-illuminator,iOCT,and especially their combination can be used to inspect the fundus and detect DR intraoperatively;they are helpful for the timely diagnosis and treatment of DR in patients with dense cataract.
基金This work was supported by Science and Technology Project of State Grid Corporation“Research on Key Technologies of Power Artificial Intelligence Open Platform”(5700-202155260A-0-0-00).
文摘The continuous growth in the scale of unmanned aerial vehicle (UAV) applications in transmission line inspection has resulted in a corresponding increase in the demand for UAV inspection image processing. Owing to its excellent performance in computer vision, deep learning has been applied to UAV inspection image processing tasks such as power line identification and insulator defect detection. Despite their excellent performance, electric power UAV inspection image processing models based on deep learning face several problems such as a small application scope, the need for constant retraining and optimization, and high R&D monetary and time costs due to the black-box and scene data-driven characteristics of deep learning. In this study, an automated deep learning system for electric power UAV inspection image analysis and processing is proposed as a solution to the aforementioned problems. This system design is based on the three critical design principles of generalizability, extensibility, and automation. Pre-trained models, fine-tuning (downstream task adaptation), and automated machine learning, which are closely related to these design principles, are reviewed. In addition, an automated deep learning system architecture for electric power UAV inspection image analysis and processing is presented. A prototype system was constructed and experiments were conducted on the two electric power UAV inspection image analysis and processing tasks of insulator self-detonation and bird nest recognition. The models constructed using the prototype system achieved 91.36% and 86.13% mAP for insulator self-detonation and bird nest recognition, respectively. This demonstrates that the system design concept is reasonable and the system architecture feasible .
文摘In renewal theory, the Inspection Paradox refers to the fact that an interarrival period in a renewal process which contains a fixed inspection time tends to be longer than one for the corresponding uninspected process. We focus on the paradox for Bernoulli trials. Probability distributions and moments for the lengths of the interarrival periods are derived for the inspected process, and we compare them to those for the uninspected case.
文摘The Inspection Paradox refers to the fact that in a Renewal Process, the length of the interarrival period which contains a fixed time is stochastically larger than the length of a typical interarrival period. To provide a more complete understanding of this phenomenon, conditioning arguments are used to obtain the distributions and moments of the lengths of the interarrival periods other than the one containing this fixed time for the case of the time-homogeneous Poisson Process. Distributions of the waiting times for events that occur both before and after this fixed time are derived. This provides a fairly complete probabilistic analysis of the Inspection Paradox.
基金a phased achievement of“Research on the Improvement of the Central Environmental Inspection System”(project No.21ZDA088)a key project on studying and interpreting the guiding principles of the Fifth Plenary Session of the 19th CPC Central Committeeunder the support of the National Social Science Fund of China。
文摘To develop China’s human rights cause with a people-centered approach,we should pay close attention to the concrete experiences of the general public regarding the protection of human rights.Deepening the research on the perception of respect for human rights can contribute to a more comprehensive understanding of the practical achievements of the hu man rights cause.Public environmental rights,as a new type of human rights,have become an important aspect of the development of the human rights cause in the new era.The central envi ronmental inspection,as an authoritative and interventionist vertical governance mechanism,promotes the implementation of environmental policies by local Party committees and govern ments and strengthens environmental information disclosure and public participation in environ mental matters.As a result,it contributes to the realization of public environmental rights and stimulates public perception of respect for human rights.Among them,the“look-back inspec tion is an important component of the central environmental inspection,and its implemen tation consolidates and enhances the previous inspection work.An empirical analysis based on the World Values Survey’s data for China indicates that residents in the provinces that have underg one“look-back inspections are more inclined to believe that human rights are adequately re spected compared to residents in the provinces that have not underwent such inspections.It suggests that the advancement and improvement of the central environmental inspection system promote improvements in ecological environment quality and contribute to enhancing the public percep tion of respect for human rights.
文摘Highway bridges are important transportation infrastructures in our country,and their quality is related to the people's lives.Highway bridge inspection,identification and test are measures to evaluate the quality of highway bridges.Through the comprehensive application of various technologies,quality problems of highway bridges can be found early,thereby ensuring traffic safety.This paper first summarizes the role and the types of highway bridge inspection and test.Then the problems and solutions in highway bridge inspection and test are analyzed and studied,and some examples are given,in hopes of providing reference for future testing.
基金supported by Optima Collaborative Research Project of Defect Detection Algorithm for Automated Optical Inspection±Phase IIthe Key-Area Research and Development Program of Guangdong Province(2020B0909050001,2020B090921003)the Natural Science Foundation of Hebei Province(2021402011)。
文摘With the rapid development of information technologies such as digital twin, extended reality, and blockchain,the hype around "metaverse" is increasing at astronomical speed. However, much attention has been paid to its entertainment and social functions. Considering the openness and interoperability of metaverses, the market of quality inspection promises explosive growth. In this paper, taking advantage of metaverses, we first propose the concept of Automated Quality Inspection(Auto QI), which performs integrated inspection covering the entire manufacturing process, including Quality of Materials, Quality of Manufacturing(Qo M), Quality of Products, Quality of Processes(Qo P), Quality of Systems, and Quality of Services(Qo S). Based on the scenarios engineering theory, we discuss how to perform interactions between metaverses and the physical world for virtual design instruction and physical validation feedback. Then we introduce a bottomup inspection device development workflow with productivity tools offered by metaverses, making development more effective and efficient than ever. As the core of quality inspection,we propose Quality Transformers to complete detection task,while federated learning is integrated to regulate data sharing.In summary, we point out the development directions of quality inspection under metaverse tide.
基金National Natural Science Foundation of China(NSFC)(No.71231001)China Postdoctoral Science Foundation Funded Project(No.2013M530531)+1 种基金the Fundamental Research Funds for the Central Universities of China(Nos.FRF-M P-13-009A,FRF-TP-13-026A)the MOE PhD Supervisor Fund,China(No.20120006110025)
文摘Periodical inspections and an age-based preventive replacement( APR) model were proposed based on a two-stage failure process for a single component system. Inspection activities were performed at regular intervals. Once the system was identified to be at defective state by inspection,a maintenance decision needed to be made that whether to replace the defective system immediately or wait till the preset APR time. So a threshold was introduced into the model and called as inspection-based preventive replacement( IPR) threshold. If the distance from the defect identification point to the APR time was longer than the threshold, a preventive replacement( PR) action was made; otherwise PR action was to wait till the APR time. Two models were proposed and compared,and a numerical example was conducted to illustrate the applicability of the model.
