In the digital age,non-touch communication technologies are reshaping human-device interactions and raising security concerns.A major challenge in current technology is the misinterpretation of gestures by sensors and...In the digital age,non-touch communication technologies are reshaping human-device interactions and raising security concerns.A major challenge in current technology is the misinterpretation of gestures by sensors and cameras,often caused by environmental factors.This issue has spurred the need for advanced data processing methods to achieve more accurate gesture recognition and predictions.Our study presents a novel virtual keyboard allowing character input via distinct hand gestures,focusing on two key aspects:hand gesture recognition and character input mechanisms.We developed a novel model with LSTM and fully connected layers for enhanced sequential data processing and hand gesture recognition.We also integrated CNN,max-pooling,and dropout layers for improved spatial feature extraction.This model architecture processes both temporal and spatial aspects of hand gestures,using LSTM to extract complex patterns from frame sequences for a comprehensive understanding of input data.Our unique dataset,essential for training the model,includes 1,662 landmarks from dynamic hand gestures,33 postures,and 468 face landmarks,all captured in real-time using advanced pose estimation.The model demonstrated high accuracy,achieving 98.52%in hand gesture recognition and over 97%in character input across different scenarios.Its excellent performance in real-time testing underlines its practicality and effectiveness,marking a significant advancement in enhancing human-device interactions in the digital age.展开更多
BACKGROUND Ileal atresia is a congenital abnormality where there is significant stenosis or complete absence of a portion of the ileum.The overall diagnostic accuracy of prenatal ultrasound in detecting jejunal and il...BACKGROUND Ileal atresia is a congenital abnormality where there is significant stenosis or complete absence of a portion of the ileum.The overall diagnostic accuracy of prenatal ultrasound in detecting jejunal and ileal atresia is low.We report a case of ileal atresia diagnosed prenatally by ultrasound examination with the“keyboard sign”and“coffee bean sign”.CASE SUMMARY We report a case of ileal atresia diagnosed in utero at 31 weeks'of gestation.Prenatal ultrasound examination revealed two rows of intestines arranged in an‘S’shape in the middle abdomen.The inner diameters were 1.7 cm and 1.6 cm,respectively.A typical“keyboard sign”was observed.The intestine canal behind the“keyboard sign”showed an irregular strong echo.There was no normal intestinal wall structure,showing a typical“coffee bean sign”.Termination of the pregnancy and autopsy findings confirmed the diagnosis.CONCLUSION The prenatal diagnosis of ileal atresia is difficult.The sonographic features of the“keyboard sign”and“coffee bean sign”are helpful in diagnosing the location of congenital jejunal and ileal atresia.展开更多
We propose an eye-shaped keyboard for high-speed text entry in virtual reality (VR), having the shape of dual eyes with characters arranged along the curved eyelids, which ensures low density and short spacing of the ...We propose an eye-shaped keyboard for high-speed text entry in virtual reality (VR), having the shape of dual eyes with characters arranged along the curved eyelids, which ensures low density and short spacing of the keys. The eye-shaped keyboard references the QWERTY key sequence, allowing the users to benefit from their experience using the QWERTY keyboard. The user interacts with an eye-shaped keyboard using rays controlled with both the hands. A character can be entered in one step by moving the rays from the inner eye regions to regions of the characters. A high-speed auto-complete system was designed for the eye-shaped keyboard. We conducted a pilot study to determine the optimal parameters, and a user study to compare our eye-shaped keyboard with the QWERTY and circular keyboards. For beginners, the eye-shaped keyboard performed significantly more efficiently and accurately with less task load and hand movement than the circular keyboard. Compared with the QWERTY keyboard, the eye-shaped keyboard is more accurate and significantly reduces hand translation while maintaining similar efficiency. Finally, to evaluate the potential of eye-shaped keyboards, we conducted another user study. In this study, the participants were asked to type continuously for three days using the proposed eye-shaped keyboard, with two sessions per day. In each session, participants were asked to type for 20min, and then their typing performance was tested. The eye-shaped keyboard was proven to be efficient and promising, with an average speed of 19.89 words per minute (WPM) and mean uncorrected error rate of 1.939%. The maximum speed reached 24.97 WPM after six sessions and continued to increase.展开更多
Combination flexible and stretchable textiles with self-powered sensors bring a novel insight into wearable functional electronics and cyber security in the era of Internet of Things.This work presents a highly flexib...Combination flexible and stretchable textiles with self-powered sensors bring a novel insight into wearable functional electronics and cyber security in the era of Internet of Things.This work presents a highly flexible and self-powered fully fabric-based triboelectric nanogenerator(F-TENG)with sandwiched structure for biomechanical energy harvesting and real-time biometric authentication.The prepared F-TENG can power a digital watch by low-frequency motion and respond to the pressure change by the fall of leaves.A self-powered wearable keyboard(SPWK)is also fabricated by integrating large-area F-TENG sensor arrays,which not only can trace and record electrophysiological signals,but also can identify individuals’typing characteristics by means of the Haar wavelet.Based on these merits,the SPWK has promising applications in the realm of wearable electronics,self-powered sensors,cyber security,and artificial intelligences.展开更多
The paper puts forward a method of virtual keyboard key positioning based on infrared laser reflection and image processing technology. In this paper, the positioning principle is introduced first. And the experimenta...The paper puts forward a method of virtual keyboard key positioning based on infrared laser reflection and image processing technology. In this paper, the positioning principle is introduced first. And the experimental system is established based on image acquisition, image transformation, threshold selection and binarization processing and identification of key placement. Tested in the indoor environment, the method can achieve characters input efficiently and accurately. And the key positioning has high accuracy, validity and reliability. So the method which has a high practical value provides a good theoretical basis for design of virtual keyboard application.展开更多
A robust system for backlit keyboard inspection is revealed. The backlit keyboard not only has changeable diverse colors but also has the laser marking keys. The keys on the keyboard can be divided into regions of fun...A robust system for backlit keyboard inspection is revealed. The backlit keyboard not only has changeable diverse colors but also has the laser marking keys. The keys on the keyboard can be divided into regions of function keys, normal keys, and number keys. However, there might have some types of defects： incorrect illuminating area, non-uniform illumination of specified inspection region（IR）, and incorrect luminance and intensity of individual key. Since the illumination features of backlit keyboard are too complex to inspect for human inspector in the production line, an auto-mated inspection system for the backlit keyboard is proposed in this paper. The system was designed into the operation module and inspection module. A set of image processing methods were developed for these defects inspection. Some experimental results demonstrate the robustness and effectiveness of the proposed system.展开更多
We have proposed some methods for feature extraction and identification that enable identification of individuals through long-text input as an important topic in keystroke dynamics research. As to the robustness in p...We have proposed some methods for feature extraction and identification that enable identification of individuals through long-text input as an important topic in keystroke dynamics research. As to the robustness in practical circumstances, there exists a question on the keystroke dynamics how much the recognition accuracy is influenced by the change of keyboard. By comparing the performance in the cases of using the same keyboard and different keyboards, the dependencies on keyboards are evaluated through three implemented experiments for subjects. As a result, it is found that we do not need to worry about the keyboard difference for users whose typing skills reach high level with about 900 or more letters in 5 minutes, and only for the remaining users it would be necessary to register their profile data with respect to each keyboard they use in order to avoid recognition accuracy degradation.展开更多
There are more and more complex tools and machinery that need be operated by human fingers in our modem industrial environment. Such as computer keyboards, screwdriver, handle wrench, button and switch. All of those s...There are more and more complex tools and machinery that need be operated by human fingers in our modem industrial environment. Such as computer keyboards, screwdriver, handle wrench, button and switch. All of those should be designed to work effectively and safely with the operators for whom they were designed. At first, ergonomic consideration in design is reachable; this means the operator＇ s fingertip must be able to reach the operating component. This is generally no question because human ann has much more degrees of freedom required to position his arms, hands and fingers in the three-dimension space. However, some times we need the finger operate with a fixed wrist. For exm＇nple in the case in the typing, the reachable workspace of the finger must take into account in such situation. Finger contacting is the most familiar operation mode of the man-machine system, and the index fmger takes on the primary operation tasks. From viewpoint of ergonomic engineering, the operation component should be placed within the workspace of the fingertip to reduced or eliminate the movement of palm and ann should to the greatest extent during finger manipulation. Therefore the research of the workspace of ginger is significant to the ergonomic design of the operation device. In this paper, the reachable workspace and workspace under direction restrain of contacting for the index finger are determined using serial mechanism model and the Penalty Function Method based on geometric measurement of human body. The optimal operating position and orientation of human finger is analyzed.展开更多
The password keyboard as a kind of input device that is essential to bank and other financial departments,it must have high credibility,safety,and the function of keeping secret.Disorder keyboard is a developed kind o...The password keyboard as a kind of input device that is essential to bank and other financial departments,it must have high credibility,safety,and the function of keeping secret.Disorder keyboard is a developed kind on the basis of the traditional password keyboard,which increased some new functions and characteristics,for example,there is LED on the surface of the keys,and the numbers displayed on the keys are random,also a certain angle of view is restricted.Outside of a certain angle,the number LED displayed on the keyboard is impossible to be seen.Even other people can see the keys that the customer pressed,but because when the customer finished inputting the password,the key numbers will be re-arranged again,so,the customer unnecessarily worried about that other people would take his password.展开更多
文摘In the digital age,non-touch communication technologies are reshaping human-device interactions and raising security concerns.A major challenge in current technology is the misinterpretation of gestures by sensors and cameras,often caused by environmental factors.This issue has spurred the need for advanced data processing methods to achieve more accurate gesture recognition and predictions.Our study presents a novel virtual keyboard allowing character input via distinct hand gestures,focusing on two key aspects:hand gesture recognition and character input mechanisms.We developed a novel model with LSTM and fully connected layers for enhanced sequential data processing and hand gesture recognition.We also integrated CNN,max-pooling,and dropout layers for improved spatial feature extraction.This model architecture processes both temporal and spatial aspects of hand gestures,using LSTM to extract complex patterns from frame sequences for a comprehensive understanding of input data.Our unique dataset,essential for training the model,includes 1,662 landmarks from dynamic hand gestures,33 postures,and 468 face landmarks,all captured in real-time using advanced pose estimation.The model demonstrated high accuracy,achieving 98.52%in hand gesture recognition and over 97%in character input across different scenarios.Its excellent performance in real-time testing underlines its practicality and effectiveness,marking a significant advancement in enhancing human-device interactions in the digital age.
文摘BACKGROUND Ileal atresia is a congenital abnormality where there is significant stenosis or complete absence of a portion of the ileum.The overall diagnostic accuracy of prenatal ultrasound in detecting jejunal and ileal atresia is low.We report a case of ileal atresia diagnosed prenatally by ultrasound examination with the“keyboard sign”and“coffee bean sign”.CASE SUMMARY We report a case of ileal atresia diagnosed in utero at 31 weeks'of gestation.Prenatal ultrasound examination revealed two rows of intestines arranged in an‘S’shape in the middle abdomen.The inner diameters were 1.7 cm and 1.6 cm,respectively.A typical“keyboard sign”was observed.The intestine canal behind the“keyboard sign”showed an irregular strong echo.There was no normal intestinal wall structure,showing a typical“coffee bean sign”.Termination of the pregnancy and autopsy findings confirmed the diagnosis.CONCLUSION The prenatal diagnosis of ileal atresia is difficult.The sonographic features of the“keyboard sign”and“coffee bean sign”are helpful in diagnosing the location of congenital jejunal and ileal atresia.
文摘We propose an eye-shaped keyboard for high-speed text entry in virtual reality (VR), having the shape of dual eyes with characters arranged along the curved eyelids, which ensures low density and short spacing of the keys. The eye-shaped keyboard references the QWERTY key sequence, allowing the users to benefit from their experience using the QWERTY keyboard. The user interacts with an eye-shaped keyboard using rays controlled with both the hands. A character can be entered in one step by moving the rays from the inner eye regions to regions of the characters. A high-speed auto-complete system was designed for the eye-shaped keyboard. We conducted a pilot study to determine the optimal parameters, and a user study to compare our eye-shaped keyboard with the QWERTY and circular keyboards. For beginners, the eye-shaped keyboard performed significantly more efficiently and accurately with less task load and hand movement than the circular keyboard. Compared with the QWERTY keyboard, the eye-shaped keyboard is more accurate and significantly reduces hand translation while maintaining similar efficiency. Finally, to evaluate the potential of eye-shaped keyboards, we conducted another user study. In this study, the participants were asked to type continuously for three days using the proposed eye-shaped keyboard, with two sessions per day. In each session, participants were asked to type for 20min, and then their typing performance was tested. The eye-shaped keyboard was proven to be efficient and promising, with an average speed of 19.89 words per minute (WPM) and mean uncorrected error rate of 1.939%. The maximum speed reached 24.97 WPM after six sessions and continued to increase.
基金the National Key R&D Project from Minister of Science and Technology(Grant No.2016YFA0202704)the Beijing Municipal Natural Science Foundation(Grant No.2212052)+1 种基金the Shanghai Sailing Program(Grant No.19S28101)the Fundamental Research Funds for the Central Universities(Grant No.19D128102).
文摘Combination flexible and stretchable textiles with self-powered sensors bring a novel insight into wearable functional electronics and cyber security in the era of Internet of Things.This work presents a highly flexible and self-powered fully fabric-based triboelectric nanogenerator(F-TENG)with sandwiched structure for biomechanical energy harvesting and real-time biometric authentication.The prepared F-TENG can power a digital watch by low-frequency motion and respond to the pressure change by the fall of leaves.A self-powered wearable keyboard(SPWK)is also fabricated by integrating large-area F-TENG sensor arrays,which not only can trace and record electrophysiological signals,but also can identify individuals’typing characteristics by means of the Haar wavelet.Based on these merits,the SPWK has promising applications in the realm of wearable electronics,self-powered sensors,cyber security,and artificial intelligences.
文摘The paper puts forward a method of virtual keyboard key positioning based on infrared laser reflection and image processing technology. In this paper, the positioning principle is introduced first. And the experimental system is established based on image acquisition, image transformation, threshold selection and binarization processing and identification of key placement. Tested in the indoor environment, the method can achieve characters input efficiently and accurately. And the key positioning has high accuracy, validity and reliability. So the method which has a high practical value provides a good theoretical basis for design of virtual keyboard application.
文摘A robust system for backlit keyboard inspection is revealed. The backlit keyboard not only has changeable diverse colors but also has the laser marking keys. The keys on the keyboard can be divided into regions of function keys, normal keys, and number keys. However, there might have some types of defects： incorrect illuminating area, non-uniform illumination of specified inspection region（IR）, and incorrect luminance and intensity of individual key. Since the illumination features of backlit keyboard are too complex to inspect for human inspector in the production line, an auto-mated inspection system for the backlit keyboard is proposed in this paper. The system was designed into the operation module and inspection module. A set of image processing methods were developed for these defects inspection. Some experimental results demonstrate the robustness and effectiveness of the proposed system.
文摘We have proposed some methods for feature extraction and identification that enable identification of individuals through long-text input as an important topic in keystroke dynamics research. As to the robustness in practical circumstances, there exists a question on the keystroke dynamics how much the recognition accuracy is influenced by the change of keyboard. By comparing the performance in the cases of using the same keyboard and different keyboards, the dependencies on keyboards are evaluated through three implemented experiments for subjects. As a result, it is found that we do not need to worry about the keyboard difference for users whose typing skills reach high level with about 900 or more letters in 5 minutes, and only for the remaining users it would be necessary to register their profile data with respect to each keyboard they use in order to avoid recognition accuracy degradation.
文摘There are more and more complex tools and machinery that need be operated by human fingers in our modem industrial environment. Such as computer keyboards, screwdriver, handle wrench, button and switch. All of those should be designed to work effectively and safely with the operators for whom they were designed. At first, ergonomic consideration in design is reachable; this means the operator＇ s fingertip must be able to reach the operating component. This is generally no question because human ann has much more degrees of freedom required to position his arms, hands and fingers in the three-dimension space. However, some times we need the finger operate with a fixed wrist. For exm＇nple in the case in the typing, the reachable workspace of the finger must take into account in such situation. Finger contacting is the most familiar operation mode of the man-machine system, and the index fmger takes on the primary operation tasks. From viewpoint of ergonomic engineering, the operation component should be placed within the workspace of the fingertip to reduced or eliminate the movement of palm and ann should to the greatest extent during finger manipulation. Therefore the research of the workspace of ginger is significant to the ergonomic design of the operation device. In this paper, the reachable workspace and workspace under direction restrain of contacting for the index finger are determined using serial mechanism model and the Penalty Function Method based on geometric measurement of human body. The optimal operating position and orientation of human finger is analyzed.
文摘The password keyboard as a kind of input device that is essential to bank and other financial departments,it must have high credibility,safety,and the function of keeping secret.Disorder keyboard is a developed kind on the basis of the traditional password keyboard,which increased some new functions and characteristics,for example,there is LED on the surface of the keys,and the numbers displayed on the keys are random,also a certain angle of view is restricted.Outside of a certain angle,the number LED displayed on the keyboard is impossible to be seen.Even other people can see the keys that the customer pressed,but because when the customer finished inputting the password,the key numbers will be re-arranged again,so,the customer unnecessarily worried about that other people would take his password.
