With the maturation of autonomous driving technology, the use of autonomous vehicles in a socially acceptable manner has become a growing demand of the public. Human-like autonomous driving is expected due to the impa...With the maturation of autonomous driving technology, the use of autonomous vehicles in a socially acceptable manner has become a growing demand of the public. Human-like autonomous driving is expected due to the impact of the differences between autonomous vehicles and human drivers on safety.Although human-like decision-making has become a research hotspot, a unified theory has not yet been formed, and there are significant differences in the implementation and performance of existing methods. This paper provides a comprehensive overview of human-like decision-making for autonomous vehicles. The following issues are discussed: 1) The intelligence level of most autonomous driving decision-making algorithms;2) The driving datasets and simulation platforms for testing and verifying human-like decision-making;3) The evaluation metrics of human-likeness;personalized driving;the application of decisionmaking in real traffic scenarios;and 4) The potential research direction of human-like driving. These research results are significant for creating interpretable human-like driving models and applying them in dynamic traffic scenarios. In the future, the combination of intuitive logical reasoning and hierarchical structure will be an important topic for further research. It is expected to meet the needs of human-like driving.展开更多
Model predictive control is widely used in the design of autonomous driving algorithms.However,its parameters are sensitive to dynamically varying driving conditions,making it difficult to be implemented into practice...Model predictive control is widely used in the design of autonomous driving algorithms.However,its parameters are sensitive to dynamically varying driving conditions,making it difficult to be implemented into practice.As a result,this study presents a self-learning algorithm based on reinforcement learning to tune a model predictive controller.Specifically,the proposed algorithm is used to extract features of dynamic traffic scenes and adjust the weight coefficients of the model predictive controller.In this method,a risk threshold model is proposed to classify the risk level of the scenes based on the scene features,and aid in the design of the reinforcement learning reward function and ultimately improve the adaptability of the model predictive controller to real-world scenarios.The proposed algorithm is compared to a pure model predictive controller in car-following case.According to the results,the proposed method enables autonomous vehicles to adjust the priority of performance indices reasonably in different scenarios according to risk variations,showing a good scenario adaptability with safety guaranteed.展开更多
Autonomous vehicles are currently regarded as an interesting topic in the AI field.For such vehicles,the lane where they are traveling should be detected.Most lane detection methods identify the whole road area with a...Autonomous vehicles are currently regarded as an interesting topic in the AI field.For such vehicles,the lane where they are traveling should be detected.Most lane detection methods identify the whole road area with all the lanes built on it.In addition to having a low accuracy rate and slow processing time,these methods require costly hardware and training datasets,and they fail under critical conditions.In this study,a novel detection algo-rithm for a lane where a car is currently traveling is proposed by combining simple traditional image processing with lightweight machine learning(ML)methods.First,a preparation phase removes all unwanted information to preserve the topographical representations of virtual edges within a one-pixel width around expected lanes.Then,a simple feature extraction phase obtains only the intersection point position and angle degree of each candidate edge.Subsequently,a proposed scheme that comprises consecutive lightweight ML models is applied to detect the correct lane by using the extracted features.This scheme is based on the density-based spatial clustering of applications with noise,random forest trees,a neural network,and rule-based methods.To increase accuracy and reduce processing time,each model supports the next one during detection.When a model detects a lane,the subsequent models are skipped.The models are trained on the Karlsruhe Institute of Technology and Toyota Technological Institute datasets.Results show that the proposed method is faster and achieves higher accuracy than state-of-the-art methods.This method is simple,can handle degradation conditions,and requires low-cost hardware and training datasets.展开更多
The advancement of artificial intelligence(AI)has truly stimulated the development and deployment of autonomous vehicles(AVs)in the transportation industry.Fueled by big data from various sensing devices and advanced ...The advancement of artificial intelligence(AI)has truly stimulated the development and deployment of autonomous vehicles(AVs)in the transportation industry.Fueled by big data from various sensing devices and advanced computing resources,AI has become an essential component of AVs for perceiving the surrounding environment and making appropriate decision in motion.To achieve goal of full automation(i.e.,self-driving),it is important to know how AI works in AV systems.Existing research have made great efforts in investigating different aspects of applying AI in AV development.However,few studies have offered the research community a thorough examination of current practices in implementing AI in AVs.Thus,this paper aims to shorten the gap by providing a comprehensive survey of key studies in this research avenue.Specifically,it intends to analyze their use of AIs in supporting the primary applications in AVs:1)perception;2)localization and mapping;and 3)decision making.It investigates the current practices to understand how AI can be used and what are the challenges and issues associated with their implementation.Based on the exploration of current practices and technology advances,this paper further provides insights into potential opportunities regarding the use of AI in conjunction with other emerging technologies:1)high definition maps,big data,and high performance computing;2)augmented reality(AR)/virtual reality(VR)enhanced simulation platform;and 3)5G communication for connected AVs.This paper is expected to offer a quick reference for researchers interested in understanding the use of AI in AV research.展开更多
Planning and decision-making technology at intersections is a comprehensive research problem in intelligent transportation systems due to the uncertainties caused by a variety of traffic participants.As wireless commu...Planning and decision-making technology at intersections is a comprehensive research problem in intelligent transportation systems due to the uncertainties caused by a variety of traffic participants.As wireless communication advances,vehicle infrastructure integrated algorithms designed for intersection planning and decision-making have received increasing attention.In this paper,the recent studies on the planning and decision-making technologies at intersections are primarily overviewed.The general planning and decision-making approaches are presented,which include graph-based approach,prediction base approach,optimization-based approach and machine learning based approach.Since connected autonomous vehicles(CAVs)is the future direction for the automated driving area,we summarized the evolving planning and decision-making methods based on vehicle infrastructure cooperative technologies.Both four-way signalized and unsignalized intersection(s)are investigated under purely automated driving traffic and mixed traffic.The study benefit from current strategies,protocols,and simulation tools to help researchers identify the presented approaches’challenges and determine the research gaps,and several remaining possible research problems that need to be solved in the future.展开更多
Environmental perception is one of the key technologies to realize autonomous vehicles.Autonomous vehicles are often equipped with multiple sensors to form a multi-source environmental perception system.Those sensors ...Environmental perception is one of the key technologies to realize autonomous vehicles.Autonomous vehicles are often equipped with multiple sensors to form a multi-source environmental perception system.Those sensors are very sensitive to light or background conditions,which will introduce a variety of global and local fault signals that bring great safety risks to autonomous driving system during long-term running.In this paper,a real-time data fusion network with fault diagnosis and fault tolerance mechanism is designed.By introducing prior features to realize the lightweight network,the features of the input data can be extracted in real time.A new sensor reliability evaluation method is proposed by calculating the global and local confidence of sensors.Through the temporal and spatial correlation between sensor data,the sensor redundancy is utilized to diagnose the local and global confidence level of sensor data in real time,eliminate the fault data,and ensure the accuracy and reliability of data fusion.Experiments show that the network achieves state-of-the-art results in speed and accuracy,and can accurately detect the location of the target when some sensors are out of focus or out of order.The fusion framework proposed in this paper is proved to be effective for intelligent vehicles in terms of real-time performance and reliability.展开更多
Autonomous vehicles require safe motion planning in uncertain environments,which are largely caused by surrounding vehicles.In this paper,a driving environment uncertainty-aware motion planning framework is proposed t...Autonomous vehicles require safe motion planning in uncertain environments,which are largely caused by surrounding vehicles.In this paper,a driving environment uncertainty-aware motion planning framework is proposed to lower the risk of position uncertainty of surrounding vehicles with considering the risk of rollover.First,a 4-degree of freedom vehicle dynamics model,and a rollover risk index are introduced.Besides,the uncertainty of surrounding vehicles’position is processed and propagated based on the Extended Kalman Filter method.Then,the uncertainty potential field is established to handle the position uncertainty of autonomous vehicles.In addition,the model predictive controller is designed as the motion planning framework which accounts for the rollover risk,the position uncertainty of the surrounding vehicles,and vehicle dynamic constraints of autonomous vehicles.Furthermore,two edge cases,the cut-in scenario,and merging scenario are designed.Finally,the safety,effectiveness,and real-time performance of the proposed motion planning framework are demonstrated by employing a hardware-in-the-loop experiment bench.展开更多
Providing autonomous systems with an effective quantity and quality of information from a desired task is challenging. In particular, autonomous vehicles, must have a reliable vision of their workspace to robustly acc...Providing autonomous systems with an effective quantity and quality of information from a desired task is challenging. In particular, autonomous vehicles, must have a reliable vision of their workspace to robustly accomplish driving functions. Speaking of machine vision, deep learning techniques, and specifically convolutional neural networks, have been proven to be the state of the art technology in the field. As these networks typically involve millions of parameters and elements, designing an optimal architecture for deep learning structures is a difficult task which is globally under investigation by researchers. This study experimentally evaluates the impact of three major architectural properties of convolutional networks, including the number of layers, filters, and filter size on their performance. In this study, several models with different properties are developed,equally trained, and then applied to an autonomous car in a realistic simulation environment. A new ensemble approach is also proposed to calculate and update weights for the models regarding their mean squared error values. Based on design properties,performance results are reported and compared for further investigations. Surprisingly, the number of filters itself does not largely affect the performance efficiency. As a result, proper allocation of filters with different kernel sizes through the layers introduces a considerable improvement in the performance.Achievements of this study will provide the researchers with a clear clue and direction in designing optimal network architectures for deep learning purposes.展开更多
In recent years,autonomous driving technology has made good progress,but the noncooperative intelligence of vehicle for autonomous driving still has many technical bottlenecks when facing urban road autonomous driving...In recent years,autonomous driving technology has made good progress,but the noncooperative intelligence of vehicle for autonomous driving still has many technical bottlenecks when facing urban road autonomous driving challenges.V2I(Vehicle-to-Infrastructure)communication is a potential solution to enable cooperative intelligence of vehicles and roads.In this paper,the RGB-PVRCNN,an environment perception framework,is proposed to improve the environmental awareness of autonomous vehicles at intersections by leveraging V2I communication technology.This framework integrates vision feature based on PVRCNN.The normal distributions transform(NDT)point cloud registration algorithm is deployed both on onboard and roadside to obtain the position of the autonomous vehicles and to build the local map objects detected by roadside multi-sensor system are sent back to autonomous vehicles to enhance the perception ability of autonomous vehicles for benefiting path planning and traffic efficiency at the intersection.The field-testing results show that our method can effectively extend the environmental perception ability and range of autonomous vehicles at the intersection and outperform the PointPillar algorithm and the VoxelRCNN algorithm in detection accuracy.展开更多
Autonomous vehicles are essential for mobility in big cities,just like how elevators make high-rise buildings livable.While significant progress has been achieved over the last 15 years,there are still several remaini...Autonomous vehicles are essential for mobility in big cities,just like how elevators make high-rise buildings livable.While significant progress has been achieved over the last 15 years,there are still several remaining challenges,namely:cost,robust performance,and trust.To address these challenges,this paper discusses research at Mcity.展开更多
It is a striking fact that the path tracking accuracy of autonomous vehicles based on active front wheel steering is poor under high-speed and large-curvature conditions.In this study,an adaptive path tracking control...It is a striking fact that the path tracking accuracy of autonomous vehicles based on active front wheel steering is poor under high-speed and large-curvature conditions.In this study,an adaptive path tracking control strategy that coordinates active front wheel steering and direct yaw moment is proposed based on model predictive control algorithm.The recursive least square method with a forgetting factor is used to identify the rear tire cornering stiffness and update the path tracking system prediction model.To adaptively adjust the priorities of path tracking accuracy and vehicle stability,an adaptive strategy based on fuzzy rules is applied to change the weight coefficients in the cost function.An adaptive control strategy for coordinating active front steering and direct yaw moment is proposed to improve the path tracking accuracy under high-speed and large-curvature conditions.To ensure vehicle stability,the sideslip angle,yaw rate and zero moment methods are used to construct optimization constraints based on the model predictive control frame.It is verified through simulation experiments that the proposed adaptive coordinated control strategy can improve the path tracking accuracy and ensure vehicle stability under high-speed and largecurvature conditions.展开更多
The driver-automation shared driving is a transition to fully-autonomous driving,in which human driver and vehicular controller cooperatively share the control authority.This paper investigates the shared steering con...The driver-automation shared driving is a transition to fully-autonomous driving,in which human driver and vehicular controller cooperatively share the control authority.This paper investigates the shared steering control of semi-autonomous vehicles with uncertainty from imprecise parameter.By considering driver’s lane-keeping behavior on the vehicle system,a driver-automation shared driving model is introduced for control purpose.Based on the interval type-2(IT2)fuzzy theory,moreover,the driver-automation shared driving model with uncertainty from imprecise parameter is described using an IT2 fuzzy model.After that,the corresponding IT2 fuzzy controller is designed and a direct Lyapunov method is applied to analyze the system stability.In this work,sufficient design conditions in terms of linear matrix inequalities are derived,to guarantee the closed-loop stability of the driver-automation shared control system.In addition,an H∞performance is studied to ensure the robustness of control system.Finally,simulation-based results are provided to demonstrate the performance of proposed control method.Furthermore,an existing type-1 fuzzy controller is introduced as comparison to verify the superiority of the proposed IT2 fuzzy controller.展开更多
For autonomous vehicles (AVs) to receive general acceptance, society must have a positive perception about their safety impact on vulnerable road users. Using data from a statewide random-digit-dialing telephone surve...For autonomous vehicles (AVs) to receive general acceptance, society must have a positive perception about their safety impact on vulnerable road users. Using data from a statewide random-digit-dialing telephone survey of 1001 adults, this paper examines how New Jersey residents perceive the safety impact of AVs on pedestrians, bicyclists, and people with ambulatory disability. </span><span style="font-family:Verdana;">It uses a combination of confirmatory factor analysis and ordered probit</span><span style="font-family:Verdana;"> models. Confirmatory factor analysis is used to create latent variables on socioeconomic status and built environment. Three ordered probit models are used to examine people’s perception of AV safety impact on each of the three pop</span><span style="font-family:Verdana;">ulation groups. The models also examine how frequent walkers, bicyclists, </span><span style="font-family:Verdana;">and people with ambulatory disability perceive their own safety as well as the safety of the other two groups. All three models examine the effect of familiarity with AV, gender, age, income, education, race, ethnicity, number of vehicles in household, political party affiliation, as well as built environment and socioeconomic status of the municipalities where the survey respondents live. The analysis showed that men, people with familiarity with the AV concept, Democrats, bicyclists, and people with high household income generally have a positive perception about the safety impact of AVs. While frequent walkers are ambivalent about their own safety as pedestrians, bicyclists have a positive perception about their own safety and the safety of pedestrians, whereas people with ambulatory disability have a strong negative perception about their own safety. The models did not show statistically significant effects of socioeconomic status or built environment of municipalities on AV safety perception.展开更多
With the deployment of Connected and Automated Vehicles in the coming decades,road transportation will experience a significant upheaval.CAVs(Connected and Autonomous Vehicles)have been a main emphasis of Transportati...With the deployment of Connected and Automated Vehicles in the coming decades,road transportation will experience a significant upheaval.CAVs(Connected and Autonomous Vehicles)have been a main emphasis of Transportation and the automotive sector,and the future of transportation system analysis is widely anticipated.The examination and future development of CAVs technology has been the subject of numerous researches.However,as three essential kinds of road users,pedestrians,bicyclists,and motorcyclists have experienced little to no handling.We explored the influence of CAVs on non-motorized mobility in this article and seven various issues that CAVs face in the environment.展开更多
The rapid advance of autonomous vehicles(AVs)has motivated new perspectives and potential challenges for existing modes of transportation.Currently,driving assistance systems of Level 3 and below have been widely prod...The rapid advance of autonomous vehicles(AVs)has motivated new perspectives and potential challenges for existing modes of transportation.Currently,driving assistance systems of Level 3 and below have been widely produced,and several applications of Level 4 systems to specific situations have also been gradually developed.By improving the automation level and vehicle intelligence,these systems can be further advanced towards fully autonomous driving.However,general development concepts for Level 5 AVs remain unclear,and the existing methods employed in the development processes of Levels 0-4 have been mainly based on task-driven function development related to specific scenarios.Therefore,it is difficult to identify the problems encountered by high-level AVs.The essential logical and physical mechanisms of vehicles have hindered further progression towards Level 5 systems.By exploring the physical mechanisms behind high-level autonomous driving systems and analyzing the essence of driving,we put forward a coordinated and balanced framework based on the brain-cerebellum-organ concept through reasoning and deduction.Based on a mixed mode relying on the crow inference and parrot imitation approach,we explore the research paradigm of autonomous learning and prior knowledge to realize the characteristics of self-learning,self-adaptation,and self-transcendence for AVs.From a systematic,unified,and balanced point of view and based on least action principles and unified safety field concepts,we aim to provide a novel research concept and develop an effective approach for the research and development of high-level AVs,specifically at Level 5.展开更多
This study investigates the challenges and opportunities pertaining to transportation policies that may arise as a result of emerging autonomous vehicle(AV)technologies. AV technologies can decrease the transportation...This study investigates the challenges and opportunities pertaining to transportation policies that may arise as a result of emerging autonomous vehicle(AV)technologies. AV technologies can decrease the transportation cost and increase accessibility to low-income households and persons with mobility issues. This emerging technology also has far-reaching applications and implications beyond all current expectations. This paper provides a comprehensive review of the relevant literature and explores a broad spectrum of issues from safety to machine ethics. An indispensable part of a prospective AV development is communication over cars and infrastructure(connected vehicles). A major knowledge gap exists in AVtechnology with respect to routing behaviors. Connectedvehicle technology provides a great opportunity to implement an efficient and intelligent routing system. To this end, we propose a conceptual navigation model based on a fleet of AVs that are centrally dispatched over a network seeking system optimization. This study contributes to the literature on two fronts:(i) it attempts to shed light on future opportunities as well as possible hurdles associated with AV technology; and(ii) it conceptualizes a navigation model for the AV which leads to highly efficient traffic circulations.展开更多
A new vision-based long-distance lane perception and front vehicle location method was developed for decision making of full autonomous vehicles on highway roads,Firstly,a real-time long-distance lane detection approa...A new vision-based long-distance lane perception and front vehicle location method was developed for decision making of full autonomous vehicles on highway roads,Firstly,a real-time long-distance lane detection approach was presented based on a linear-cubic road model for two-lane highways.By using a novel robust lane marking feature which combines the constraints of intensity,edge and width,the lane markings in far regions were extracted accurately and efficiently.Next,the detected lane lines were selected and tracked by estimating the lateral offset and heading angle of ego vehicle with a Kalman filter,Finally,front vehicles were located on correct lanes using the tracked lane lines,Experiment results show that the proposed lane perception approach can achieve an average correct detection rate of 94.37% with an average false positive detection rate of 0.35%,The proposed approaches for long-distance lane perception and front vehicle location were validated in a 286 km full autonomous drive experiment under real traffic conditions.This successful experiment shows that the approaches are effective and robust enough for full autonomous vehicles on highway roads.展开更多
All automobile manufacturing companies, Google and Microsoft have announced recently their production of the Fully Automated Autonomous Vehicles (FAAVs), otherwise known as driverless cars. A few FAAVs would be availa...All automobile manufacturing companies, Google and Microsoft have announced recently their production of the Fully Automated Autonomous Vehicles (FAAVs), otherwise known as driverless cars. A few FAAVs would be available in the market as early as in 2018, but mostly in 2020’s. When FAAVs will be available to and become affordable by the average consumers, the implications to the society would be far reaching. The purpose of the paper is to examine the prospect of the popularity of FAAVs and their socio-economic implications to the future society of the World. The paper examines potential impacts on selected sectors of the society including changes in demand for automobiles, its impact on the use of oil, on the environment, and on urban land uses, to list a few.展开更多
There is an increasing awareness of the need to reduce traffic accidents and fatality due to vehicle collision.Post-impact hazards can be more serious as the driver may fail to maintain effective control after collisi...There is an increasing awareness of the need to reduce traffic accidents and fatality due to vehicle collision.Post-impact hazards can be more serious as the driver may fail to maintain effective control after collisions.To avoid subsequent crash events and to stabilize the vehicle,this paper proposes a post-impact motion planning and stability control method for autonomous vehicles.An enabling motion planning method is proposed for post-impact situations by combining the polynomial curve and artificial potential field while considering obstacle avoidance.A hierarchical controller that consists of an upper and a lower controller is then developed to track the planned motion.In the upper controller,a time-varying linear quadratic regulator is presented to calculate the desired generalized forces.In the lower controller,a nonlinear-optimization-based torque allocation algorithm is proposed to optimally coordinate the actuators to realize the desired generalized forces.The proposed scheme is verified under comprehensive driving scenarios through hardware-in-loop tests.展开更多
With the increasing maturity of automatic driving technology,the homogeneous traffic flow will gradually evolve into the heterogeneous traffic flow,which consists of human-driving and autonomous vehicles.To better stu...With the increasing maturity of automatic driving technology,the homogeneous traffic flow will gradually evolve into the heterogeneous traffic flow,which consists of human-driving and autonomous vehicles.To better study the characteristics of the heterogeneous traffic system,this paper proposes a new car-following model for autonomous vehicles and heterogeneous traffic flow,which considers the self-stabilizing effect of vehicles.Through linear and nonlinear methods,this paper deduces and analyzes the stability of such a car-following model with the self-stabilizing effect.Finally,the model is verified by numerical simulation.Numerical results show that the self-stabilizing effect can make the heterogeneous traffic flow more stable,and that increasing the self-stabilizing coefficient or historical time length can strengthen the stability of heterogeneous traffic flow and alleviate traffic congestion effectively.In addition,the heterogeneous traffic flow can also be stabilized with a higher proportion of autonomous vehicles.展开更多
基金supported by the National Key R&D Program of China (2022YFB2502900)the National Natural Science Foundation of China (62088102, 61790563)。
文摘With the maturation of autonomous driving technology, the use of autonomous vehicles in a socially acceptable manner has become a growing demand of the public. Human-like autonomous driving is expected due to the impact of the differences between autonomous vehicles and human drivers on safety.Although human-like decision-making has become a research hotspot, a unified theory has not yet been formed, and there are significant differences in the implementation and performance of existing methods. This paper provides a comprehensive overview of human-like decision-making for autonomous vehicles. The following issues are discussed: 1) The intelligence level of most autonomous driving decision-making algorithms;2) The driving datasets and simulation platforms for testing and verifying human-like decision-making;3) The evaluation metrics of human-likeness;personalized driving;the application of decisionmaking in real traffic scenarios;and 4) The potential research direction of human-like driving. These research results are significant for creating interpretable human-like driving models and applying them in dynamic traffic scenarios. In the future, the combination of intuitive logical reasoning and hierarchical structure will be an important topic for further research. It is expected to meet the needs of human-like driving.
基金Supported by National Key R&D Program of China(Grant No.2022YFB2502900)Fundamental Research Funds for the Central Universities of China,Science and Technology Commission of Shanghai Municipality of China(Grant No.21ZR1465900)Shanghai Gaofeng&Gaoyuan Project for University Academic Program Development of China.
文摘Model predictive control is widely used in the design of autonomous driving algorithms.However,its parameters are sensitive to dynamically varying driving conditions,making it difficult to be implemented into practice.As a result,this study presents a self-learning algorithm based on reinforcement learning to tune a model predictive controller.Specifically,the proposed algorithm is used to extract features of dynamic traffic scenes and adjust the weight coefficients of the model predictive controller.In this method,a risk threshold model is proposed to classify the risk level of the scenes based on the scene features,and aid in the design of the reinforcement learning reward function and ultimately improve the adaptability of the model predictive controller to real-world scenarios.The proposed algorithm is compared to a pure model predictive controller in car-following case.According to the results,the proposed method enables autonomous vehicles to adjust the priority of performance indices reasonably in different scenarios according to risk variations,showing a good scenario adaptability with safety guaranteed.
基金funded by DEANSHIP OF SCIENTIFIC RESEARCH AT UMM AL-QURA UNIVERSITY,Grant Number 22UQU4361009DSR04.
文摘Autonomous vehicles are currently regarded as an interesting topic in the AI field.For such vehicles,the lane where they are traveling should be detected.Most lane detection methods identify the whole road area with all the lanes built on it.In addition to having a low accuracy rate and slow processing time,these methods require costly hardware and training datasets,and they fail under critical conditions.In this study,a novel detection algo-rithm for a lane where a car is currently traveling is proposed by combining simple traditional image processing with lightweight machine learning(ML)methods.First,a preparation phase removes all unwanted information to preserve the topographical representations of virtual edges within a one-pixel width around expected lanes.Then,a simple feature extraction phase obtains only the intersection point position and angle degree of each candidate edge.Subsequently,a proposed scheme that comprises consecutive lightweight ML models is applied to detect the correct lane by using the extracted features.This scheme is based on the density-based spatial clustering of applications with noise,random forest trees,a neural network,and rule-based methods.To increase accuracy and reduce processing time,each model supports the next one during detection.When a model detects a lane,the subsequent models are skipped.The models are trained on the Karlsruhe Institute of Technology and Toyota Technological Institute datasets.Results show that the proposed method is faster and achieves higher accuracy than state-of-the-art methods.This method is simple,can handle degradation conditions,and requires low-cost hardware and training datasets.
基金supported by the FundamentalResearch Funds for the Central Universities(2662019QD002)
文摘The advancement of artificial intelligence(AI)has truly stimulated the development and deployment of autonomous vehicles(AVs)in the transportation industry.Fueled by big data from various sensing devices and advanced computing resources,AI has become an essential component of AVs for perceiving the surrounding environment and making appropriate decision in motion.To achieve goal of full automation(i.e.,self-driving),it is important to know how AI works in AV systems.Existing research have made great efforts in investigating different aspects of applying AI in AV development.However,few studies have offered the research community a thorough examination of current practices in implementing AI in AVs.Thus,this paper aims to shorten the gap by providing a comprehensive survey of key studies in this research avenue.Specifically,it intends to analyze their use of AIs in supporting the primary applications in AVs:1)perception;2)localization and mapping;and 3)decision making.It investigates the current practices to understand how AI can be used and what are the challenges and issues associated with their implementation.Based on the exploration of current practices and technology advances,this paper further provides insights into potential opportunities regarding the use of AI in conjunction with other emerging technologies:1)high definition maps,big data,and high performance computing;2)augmented reality(AR)/virtual reality(VR)enhanced simulation platform;and 3)5G communication for connected AVs.This paper is expected to offer a quick reference for researchers interested in understanding the use of AI in AV research.
文摘Planning and decision-making technology at intersections is a comprehensive research problem in intelligent transportation systems due to the uncertainties caused by a variety of traffic participants.As wireless communication advances,vehicle infrastructure integrated algorithms designed for intersection planning and decision-making have received increasing attention.In this paper,the recent studies on the planning and decision-making technologies at intersections are primarily overviewed.The general planning and decision-making approaches are presented,which include graph-based approach,prediction base approach,optimization-based approach and machine learning based approach.Since connected autonomous vehicles(CAVs)is the future direction for the automated driving area,we summarized the evolving planning and decision-making methods based on vehicle infrastructure cooperative technologies.Both four-way signalized and unsignalized intersection(s)are investigated under purely automated driving traffic and mixed traffic.The study benefit from current strategies,protocols,and simulation tools to help researchers identify the presented approaches’challenges and determine the research gaps,and several remaining possible research problems that need to be solved in the future.
基金Supported by the National Natural Science Foundation of China(Grant U1964201,Grant 61790562 and Grant 61803120)by the Fundamental Research Fundsfor the Central Universities.
文摘Environmental perception is one of the key technologies to realize autonomous vehicles.Autonomous vehicles are often equipped with multiple sensors to form a multi-source environmental perception system.Those sensors are very sensitive to light or background conditions,which will introduce a variety of global and local fault signals that bring great safety risks to autonomous driving system during long-term running.In this paper,a real-time data fusion network with fault diagnosis and fault tolerance mechanism is designed.By introducing prior features to realize the lightweight network,the features of the input data can be extracted in real time.A new sensor reliability evaluation method is proposed by calculating the global and local confidence of sensors.Through the temporal and spatial correlation between sensor data,the sensor redundancy is utilized to diagnose the local and global confidence level of sensor data in real time,eliminate the fault data,and ensure the accuracy and reliability of data fusion.Experiments show that the network achieves state-of-the-art results in speed and accuracy,and can accurately detect the location of the target when some sensors are out of focus or out of order.The fusion framework proposed in this paper is proved to be effective for intelligent vehicles in terms of real-time performance and reliability.
基金National Key R&D Program of China(Grant No.2020YFB1600303)National Natural Science Foundation of China(Grant Nos.U1964203,52072215)Chongqing Municipal Natural Science Foundation of China(Grant No.cstc2020jcyj-msxmX0956).
文摘Autonomous vehicles require safe motion planning in uncertain environments,which are largely caused by surrounding vehicles.In this paper,a driving environment uncertainty-aware motion planning framework is proposed to lower the risk of position uncertainty of surrounding vehicles with considering the risk of rollover.First,a 4-degree of freedom vehicle dynamics model,and a rollover risk index are introduced.Besides,the uncertainty of surrounding vehicles’position is processed and propagated based on the Extended Kalman Filter method.Then,the uncertainty potential field is established to handle the position uncertainty of autonomous vehicles.In addition,the model predictive controller is designed as the motion planning framework which accounts for the rollover risk,the position uncertainty of the surrounding vehicles,and vehicle dynamic constraints of autonomous vehicles.Furthermore,two edge cases,the cut-in scenario,and merging scenario are designed.Finally,the safety,effectiveness,and real-time performance of the proposed motion planning framework are demonstrated by employing a hardware-in-the-loop experiment bench.
文摘Providing autonomous systems with an effective quantity and quality of information from a desired task is challenging. In particular, autonomous vehicles, must have a reliable vision of their workspace to robustly accomplish driving functions. Speaking of machine vision, deep learning techniques, and specifically convolutional neural networks, have been proven to be the state of the art technology in the field. As these networks typically involve millions of parameters and elements, designing an optimal architecture for deep learning structures is a difficult task which is globally under investigation by researchers. This study experimentally evaluates the impact of three major architectural properties of convolutional networks, including the number of layers, filters, and filter size on their performance. In this study, several models with different properties are developed,equally trained, and then applied to an autonomous car in a realistic simulation environment. A new ensemble approach is also proposed to calculate and update weights for the models regarding their mean squared error values. Based on design properties,performance results are reported and compared for further investigations. Surprisingly, the number of filters itself does not largely affect the performance efficiency. As a result, proper allocation of filters with different kernel sizes through the layers introduces a considerable improvement in the performance.Achievements of this study will provide the researchers with a clear clue and direction in designing optimal network architectures for deep learning purposes.
基金This research was supported by the National Key Research and Development Program of China under Grant No.2017YFB0102502the Beijing Municipal Natural Science Foundation No.L191001+2 种基金the National Natural Science Foundation of China under Grant No.61672082 and 61822101the Newton Advanced Fellowship under Grant No.62061130221the Young Elite Scientists Sponsorship Program by Hunan Provincial Department of Education under Grant No.18B142.
文摘In recent years,autonomous driving technology has made good progress,but the noncooperative intelligence of vehicle for autonomous driving still has many technical bottlenecks when facing urban road autonomous driving challenges.V2I(Vehicle-to-Infrastructure)communication is a potential solution to enable cooperative intelligence of vehicles and roads.In this paper,the RGB-PVRCNN,an environment perception framework,is proposed to improve the environmental awareness of autonomous vehicles at intersections by leveraging V2I communication technology.This framework integrates vision feature based on PVRCNN.The normal distributions transform(NDT)point cloud registration algorithm is deployed both on onboard and roadside to obtain the position of the autonomous vehicles and to build the local map objects detected by roadside multi-sensor system are sent back to autonomous vehicles to enhance the perception ability of autonomous vehicles for benefiting path planning and traffic efficiency at the intersection.The field-testing results show that our method can effectively extend the environmental perception ability and range of autonomous vehicles at the intersection and outperform the PointPillar algorithm and the VoxelRCNN algorithm in detection accuracy.
文摘Autonomous vehicles are essential for mobility in big cities,just like how elevators make high-rise buildings livable.While significant progress has been achieved over the last 15 years,there are still several remaining challenges,namely:cost,robust performance,and trust.To address these challenges,this paper discusses research at Mcity.
基金Supported by the Foundation of Key Laboratory of Vehicle Advanced ManufacturingMeasuring and Control Technology(Beijing Jiaotong University)+1 种基金Ministry of Education,China(Grant No.014062522006)National Key Research Development Program of China(Grant No.2017YFB0103701)。
文摘It is a striking fact that the path tracking accuracy of autonomous vehicles based on active front wheel steering is poor under high-speed and large-curvature conditions.In this study,an adaptive path tracking control strategy that coordinates active front wheel steering and direct yaw moment is proposed based on model predictive control algorithm.The recursive least square method with a forgetting factor is used to identify the rear tire cornering stiffness and update the path tracking system prediction model.To adaptively adjust the priorities of path tracking accuracy and vehicle stability,an adaptive strategy based on fuzzy rules is applied to change the weight coefficients in the cost function.An adaptive control strategy for coordinating active front steering and direct yaw moment is proposed to improve the path tracking accuracy under high-speed and large-curvature conditions.To ensure vehicle stability,the sideslip angle,yaw rate and zero moment methods are used to construct optimization constraints based on the model predictive control frame.It is verified through simulation experiments that the proposed adaptive coordinated control strategy can improve the path tracking accuracy and ensure vehicle stability under high-speed and largecurvature conditions.
基金Supported by Defense Industrial Technology Development Program.
文摘The driver-automation shared driving is a transition to fully-autonomous driving,in which human driver and vehicular controller cooperatively share the control authority.This paper investigates the shared steering control of semi-autonomous vehicles with uncertainty from imprecise parameter.By considering driver’s lane-keeping behavior on the vehicle system,a driver-automation shared driving model is introduced for control purpose.Based on the interval type-2(IT2)fuzzy theory,moreover,the driver-automation shared driving model with uncertainty from imprecise parameter is described using an IT2 fuzzy model.After that,the corresponding IT2 fuzzy controller is designed and a direct Lyapunov method is applied to analyze the system stability.In this work,sufficient design conditions in terms of linear matrix inequalities are derived,to guarantee the closed-loop stability of the driver-automation shared control system.In addition,an H∞performance is studied to ensure the robustness of control system.Finally,simulation-based results are provided to demonstrate the performance of proposed control method.Furthermore,an existing type-1 fuzzy controller is introduced as comparison to verify the superiority of the proposed IT2 fuzzy controller.
文摘For autonomous vehicles (AVs) to receive general acceptance, society must have a positive perception about their safety impact on vulnerable road users. Using data from a statewide random-digit-dialing telephone survey of 1001 adults, this paper examines how New Jersey residents perceive the safety impact of AVs on pedestrians, bicyclists, and people with ambulatory disability. </span><span style="font-family:Verdana;">It uses a combination of confirmatory factor analysis and ordered probit</span><span style="font-family:Verdana;"> models. Confirmatory factor analysis is used to create latent variables on socioeconomic status and built environment. Three ordered probit models are used to examine people’s perception of AV safety impact on each of the three pop</span><span style="font-family:Verdana;">ulation groups. The models also examine how frequent walkers, bicyclists, </span><span style="font-family:Verdana;">and people with ambulatory disability perceive their own safety as well as the safety of the other two groups. All three models examine the effect of familiarity with AV, gender, age, income, education, race, ethnicity, number of vehicles in household, political party affiliation, as well as built environment and socioeconomic status of the municipalities where the survey respondents live. The analysis showed that men, people with familiarity with the AV concept, Democrats, bicyclists, and people with high household income generally have a positive perception about the safety impact of AVs. While frequent walkers are ambivalent about their own safety as pedestrians, bicyclists have a positive perception about their own safety and the safety of pedestrians, whereas people with ambulatory disability have a strong negative perception about their own safety. The models did not show statistically significant effects of socioeconomic status or built environment of municipalities on AV safety perception.
文摘With the deployment of Connected and Automated Vehicles in the coming decades,road transportation will experience a significant upheaval.CAVs(Connected and Autonomous Vehicles)have been a main emphasis of Transportation and the automotive sector,and the future of transportation system analysis is widely anticipated.The examination and future development of CAVs technology has been the subject of numerous researches.However,as three essential kinds of road users,pedestrians,bicyclists,and motorcyclists have experienced little to no handling.We explored the influence of CAVs on non-motorized mobility in this article and seven various issues that CAVs face in the environment.
基金This work was jointly supported by the National Science Fund for Distinguished Young Scholars(51625503)the National Natural Science Foundation of China,the Major Project(61790561)the Joint Laboratory for Internet of Vehicle,Ministry of Education,China Mobile Communications Corporation.
文摘The rapid advance of autonomous vehicles(AVs)has motivated new perspectives and potential challenges for existing modes of transportation.Currently,driving assistance systems of Level 3 and below have been widely produced,and several applications of Level 4 systems to specific situations have also been gradually developed.By improving the automation level and vehicle intelligence,these systems can be further advanced towards fully autonomous driving.However,general development concepts for Level 5 AVs remain unclear,and the existing methods employed in the development processes of Levels 0-4 have been mainly based on task-driven function development related to specific scenarios.Therefore,it is difficult to identify the problems encountered by high-level AVs.The essential logical and physical mechanisms of vehicles have hindered further progression towards Level 5 systems.By exploring the physical mechanisms behind high-level autonomous driving systems and analyzing the essence of driving,we put forward a coordinated and balanced framework based on the brain-cerebellum-organ concept through reasoning and deduction.Based on a mixed mode relying on the crow inference and parrot imitation approach,we explore the research paradigm of autonomous learning and prior knowledge to realize the characteristics of self-learning,self-adaptation,and self-transcendence for AVs.From a systematic,unified,and balanced point of view and based on least action principles and unified safety field concepts,we aim to provide a novel research concept and develop an effective approach for the research and development of high-level AVs,specifically at Level 5.
文摘This study investigates the challenges and opportunities pertaining to transportation policies that may arise as a result of emerging autonomous vehicle(AV)technologies. AV technologies can decrease the transportation cost and increase accessibility to low-income households and persons with mobility issues. This emerging technology also has far-reaching applications and implications beyond all current expectations. This paper provides a comprehensive review of the relevant literature and explores a broad spectrum of issues from safety to machine ethics. An indispensable part of a prospective AV development is communication over cars and infrastructure(connected vehicles). A major knowledge gap exists in AVtechnology with respect to routing behaviors. Connectedvehicle technology provides a great opportunity to implement an efficient and intelligent routing system. To this end, we propose a conceptual navigation model based on a fleet of AVs that are centrally dispatched over a network seeking system optimization. This study contributes to the literature on two fronts:(i) it attempts to shed light on future opportunities as well as possible hurdles associated with AV technology; and(ii) it conceptualizes a navigation model for the AV which leads to highly efficient traffic circulations.
基金Project(90820302) supported by the National Natural Science Foundation of China
文摘A new vision-based long-distance lane perception and front vehicle location method was developed for decision making of full autonomous vehicles on highway roads,Firstly,a real-time long-distance lane detection approach was presented based on a linear-cubic road model for two-lane highways.By using a novel robust lane marking feature which combines the constraints of intensity,edge and width,the lane markings in far regions were extracted accurately and efficiently.Next,the detected lane lines were selected and tracked by estimating the lateral offset and heading angle of ego vehicle with a Kalman filter,Finally,front vehicles were located on correct lanes using the tracked lane lines,Experiment results show that the proposed lane perception approach can achieve an average correct detection rate of 94.37% with an average false positive detection rate of 0.35%,The proposed approaches for long-distance lane perception and front vehicle location were validated in a 286 km full autonomous drive experiment under real traffic conditions.This successful experiment shows that the approaches are effective and robust enough for full autonomous vehicles on highway roads.
文摘All automobile manufacturing companies, Google and Microsoft have announced recently their production of the Fully Automated Autonomous Vehicles (FAAVs), otherwise known as driverless cars. A few FAAVs would be available in the market as early as in 2018, but mostly in 2020’s. When FAAVs will be available to and become affordable by the average consumers, the implications to the society would be far reaching. The purpose of the paper is to examine the prospect of the popularity of FAAVs and their socio-economic implications to the future society of the World. The paper examines potential impacts on selected sectors of the society including changes in demand for automobiles, its impact on the use of oil, on the environment, and on urban land uses, to list a few.
基金Beijing Municipal Science and Technology Commission via the Beijing Nova Program(Grant No.Z201100006820007).
文摘There is an increasing awareness of the need to reduce traffic accidents and fatality due to vehicle collision.Post-impact hazards can be more serious as the driver may fail to maintain effective control after collisions.To avoid subsequent crash events and to stabilize the vehicle,this paper proposes a post-impact motion planning and stability control method for autonomous vehicles.An enabling motion planning method is proposed for post-impact situations by combining the polynomial curve and artificial potential field while considering obstacle avoidance.A hierarchical controller that consists of an upper and a lower controller is then developed to track the planned motion.In the upper controller,a time-varying linear quadratic regulator is presented to calculate the desired generalized forces.In the lower controller,a nonlinear-optimization-based torque allocation algorithm is proposed to optimally coordinate the actuators to realize the desired generalized forces.The proposed scheme is verified under comprehensive driving scenarios through hardware-in-loop tests.
基金supported by the National Natural Science Foundation of China(Grant No.61773243)the Major Technology Innovation Project of Shandong Province,China(Grant No.2019TSLH0203)the National Key Research and Development Program of China(Grant No.2020YFB1600501)。
文摘With the increasing maturity of automatic driving technology,the homogeneous traffic flow will gradually evolve into the heterogeneous traffic flow,which consists of human-driving and autonomous vehicles.To better study the characteristics of the heterogeneous traffic system,this paper proposes a new car-following model for autonomous vehicles and heterogeneous traffic flow,which considers the self-stabilizing effect of vehicles.Through linear and nonlinear methods,this paper deduces and analyzes the stability of such a car-following model with the self-stabilizing effect.Finally,the model is verified by numerical simulation.Numerical results show that the self-stabilizing effect can make the heterogeneous traffic flow more stable,and that increasing the self-stabilizing coefficient or historical time length can strengthen the stability of heterogeneous traffic flow and alleviate traffic congestion effectively.In addition,the heterogeneous traffic flow can also be stabilized with a higher proportion of autonomous vehicles.
