Visual Feedback Effects and Movement Time Prediction for Mouse Control

Seung-Kweon Hong,Seon-Soo Kim 대한인간공학회 2011 대한인간공학회 학술대회논문집 Vol.2011 No.10

The aim of this study is to investigate visual feedback effects for predicting mouse control times. Background: Computer mouse tasks are controlled by visual feedback. The visual feedback also gives impact on the mouse control time. In order to predict mouse control time for mouse tasks, it is important to investigate the patterns of visual feedback involved in mouse control task. Method: Three types of mouse control (Fitts' movement, steering movement, Fitts + steering movement) were determined to investigate visual feedback effects on the mouse control time. Visual feedback is required in the step of homing to the target and in the process of cursor passage of constrained path. As the visual feedback is required, the cursor movement speed is decreased. The cursor movement speed was measured in the various experimental conditions of three types of tasks. Results: The target width in the Fitts' movement and the path width of the steering movement gave rise to visual feedback and increased the mouse control time. The mouse control time was in inverse proportion to both target width and path width. As the widths were wide enough, the visual feedback was not required. Conclusion The relationship between target width or path width and visual feedback should be considered to develop a mouse control time prediction model. Application: The results of cursor speed analysis might help to determine the mouse control time prediction models.

Visual Feedback and Human Performance in the Foot Mouse Control

Seung-Kweon Hong,Seon-Soo Kim 대한인간공학회 2012 대한인간공학회지 Vol.31 No.6

Objective: The aim of this study is to investigate visual feedback effects and human performance in the foot mouse control. Background: Generally, computer mouse tasks are controlled by visual feedback. In order to understand the characteristics of a foot mouse control, it is important to investigate the patterns of visual feedback involved in foot-mouse control tasks. Human performance of foot mouse control is also an important factor to understand the foot mouse control. Method: Three types of mouse control were determined to investigate visual feedback effects and human performance in the foot mouse control. Visual feedback effects in the foot mouse control were compared with those of a typical hand mouse. The cursor movement speed and mental workload were measured in the three types of tasks and two types of mouses. Results: Mouse control tasks with an element of homing-in to the target were more quickly performed by the hand mouse than the foot mouse. Mental workload was also higher in the foot mouse than the hand mouse. However, in the steering movement, human performance of the foot mouse control was not lower than that of the hand mouse control. Visual feedback in the foot mouse control was less required than in the hand mouse control. Conclusion: The foot mouse was not efficient in the most mouse control tasks, compared to the hand mouse. However, the foot mouse was efficient in the steering movement, moving a cursor within a path with lateral constraints. Application: The results of this study might help to develop the foot mouse.

Visual Feedback and Trial-to-Trial Force Variability in Chronic Stroke

( Nyeonju Kang ) 인천대학교 스포츠과학연구소 2018 스포츠科學硏究誌 Vol.31 No.0

Unilateral stroke typically causes deficits in bimanual movements. Although visual information is important for successful force control, stroke survivors may have an impaired capability to process visual information and correct their motor actions across multiple force control trials. This study investigated trial-to-trial variability on bimanual force production patterns in chronic stroke patients while manipulating visual information (i.e., vision versus no vision). Nine chronic stroke patients and nine age-matched healthy controls performed isometric bimanual force control at 25% of maximal voluntary contraction with and without visual information. Across 12 trials, we calculated trial-to-trial variability (coefficient of variation; CV) and variability components (good and bad variability) on mean force, CV on force variability (standard deviation; SD), and CV on force frequency power below 16 Hz. Individuals with a stroke revealed three significant force control deficits across trials: (a) increased trial-to-trial variability on mean force and bad variability in the no vision condition, (b) greater trial-to-trial variability on SD in both vision and no vision conditions, and (c) higher trial-to-trial variability on power below 4 Hz across vision conditions. Our novel findings indicate that constantly producing bimanual force across trials are relatively challenging for chronic stroke patients and these impairments may be associated with impaired visuomotor processing and feedback control.

시각적 피드백 유무에 따른 인공와우이식 청년의 음성조절능력

강지은(Ji Eun Kang),이영미(Youngmee Lee),심현섭(Hyun Sub Sim) 한국언어청각임상학회 2021 Communication Sciences and Disorders Vol.26 No.2

배경 및 목적: 본 연구는 인공와우이식 청년과 정상 청력 청년 간 음성조절능력에 차이가 있는지 알아보고자 하였다. 또한 인공와우이식 청년의 인공와우 관련정보, 수행력과 음성조절능력 변수(음성역동면적, VRP 기울기) 간 상관관계를 알아보고자 하였다. 방법: 본 연구에서는 만 7세 이전에 인공와우를 이식한 청년 12명(여성 8명, 남성 4명)과 성별 및 연령을 일치시킨 정상 청력 청년 12명이 참여하였다. 시각적 피드백 유무에 따른 음성조절능력을 평가하기 위해 음성범위프로파일(VRP)이 사용되었다. 결과: 정상 청력 청년의 음성역동면적은 인공와우이식 청년보다 유의하게 컸으며, 청각에만 의존하는 것보다 시-청각적 피드백이 제공되었을 때 음성역동면적이 유의하게 컸다. VRP 기울기는 두 집단 간 차이가 통계적으로 유의하지 않았지만, 청각적 피드백만 제시되었을 때보다 시-청각적 피드백 제공시의 기울기가 유의하게 작았다. 인공와우이식 청년 집단의 자음정확도와 VRP 기울기 간에는 강한 부적상관관계가 나타났다. 논의 및 결론: 만 7세 이전에 인공와우를 이식한 선천성 농인은 생활연령이 일치하는 정상 청력 청년과 같이 정상적인 음성조절능력을 보이지 않았다. 그러나 인공와우이식 청년은 음성조절을 위해 시각적 정보를 활용할 수 있었다. 음성역동면적은 음성조절능력을 측정하는 변수로서 적절하나, 음성역동면적과 VRP 기울기는 상호보완적인 관계로 결과를 분석할 때 함께 고려하여야 한다. Objectives: The purpose of this study is to investigate whether there is a difference in the voice control ability between young adults with cochlear implants (CIs) and a normal hearing (NH) group. This study examined the correlation between CI-related characteristics, performance, and acoustic measurements (i.e., voice dynamic area, voice range profile slope). Methods: Participants were 12 young adults (8 females and 4 males) who had CIs before 7 years of age, and 12 NH young adults who matched their sex and age. A voice range profile (VRP) program was used to evaluate voice control ability according to the presence or absence of visual feedback. Results: The voice dynamic area (VDA) of the NH group was significantly larger than that of the CI group, and the VDA was significantly greater when the visual-auditory feedback was presented rather than relying solely on hearing. There was no significant difference between the groups in the VRP slope, but the slope was significantly smaller when the visual-auditory feedback was provided than when only the auditory feedback was provided. There was a negative correlation between the consonant accuracy and the VRP slope in the CI group. Conclusion: Congenitally deafened young adults didn’t achieve normal voice control abilities in comparison with NH. However, CIs were able to use the visual information in order to better control their voice. Additionally, the VDA is appropriate as a variable to measure the voice control ability of CIs, but the VDA and the VRP slope are complementary and need to be considered together when analyzing the results.

산업용 로봇 아암의 비쥬얼 피드백 제어 알고리즘 개발

한성현,Le Xuan Thu,김홍래,안종국 한국공작기계학회 2006 한국공작기계학회 추계학술대회논문집 Vol.2006 No.-

The equipment of industrial robot in manufacturing and assembly lines has rapidly increased. In order to achieve high productivity and flexibility, it becomes very important to develop the visual feedback control system with Off-Line Programming System(OLPS). We can save much efforts and time in adjusting robots to newly defined workcells by using OLPS. A proposed visual calibration scheme is based on position-based visual feedback. The calibration program firstly generates predicted images of objects in an assumed end-effector position. The process to generate predicted images consists of projection to screen-coordinates, visible range test, and construction of simple silhouette figures. Then, camera images acquired are compared with predicted ones for updating position and orientation data. Computation of error is very simple because the scheme is based on perspective projection, which can be also expanded to experimental results. Computation time can be extremely reduced because the proposed method does not require the precise calculation of tree-dimensional object data and image Jacobian.

영상피드백에 의한 로봇 지능제어

김준홍,Nguyen Huu Cong,이우송,한성현 한국공작기계학회 2008 한국공작기계학회 추계학술대회논문집 Vol.2008 No.-

The equipment of industrial robot in manufacturing and assembly lines has rapidly increased. In order to achieve high productivity and flexibility, it becomes very important to develop the visual feedback control system with Off-Line Programming System(OLPS). We can save much efforts and time in adjusting robots to newly defined workcells by using OLPS. A proposed visual calibration scheme is based on position-based visual feedback. The calibration program firstly generates predicted images of objects in an assumed end-effector position. The process to generate predicted images consists of projection to screen-coordinates, visible range test, and construction of simple silhouette figures. Then, camera images acquired are compared with predicted ones for updating position and orientation data. Computation of error is very simple because the scheme is based on perspective projection, which can be also expanded to experimental results. Computation time can be extremely reduced because the proposed method does not require the precise calculation of tree-dimensional object data and image Jacobian.

영상피드백에 의한 로봇의 자세제어

김준홍,Nguyen Huu Cong,이우송,한성현 한국공작기계학회 2009 한국공작기계학회 춘계학술대회논문집 Vol.2009 No.-

The equipment of industrial robot in manufacturing and assembly lines has rapidly increased. In order to achieve high productivity and flexibility, it becomes very important to develop the visual feedback control system with Off-line Programming System(OLPS). We can save much efforts and time in adjusting robots to newly defined workcells by using OLPS. A proposed visual calibration scheme is based on position-based visual feedback. The calibration program firstly generates predicted images of objects in an assumed end-effector position. The process to generate predicted images consists of projection to screen-coordinates, visible range test, and construction of simple silhouette figures. Then, camera images acquired are compared with predicted ones for updating position and orientation data. Computation of error is very simple because the scheme is based on perspective projection, which can be also expanded to experimental results. Computation time can be extremely reduced because the proposed method does not require the precise calculation of tree-dimensional object data and image Jacobian.

영상피드백에 의한 로봇 지능제어

김준홍(Jun-Hong Kim),이우송(Woo-Song Lee),Nguyen Van Quyet,한성현(Sung-Hyun Han) 한국기계가공학회 2008 한국기계가공학회 춘추계학술대회 논문집 Vol.2008 No.-

The equipment of industrial robot in manufacturing and assembly lines has rapidly increased. In order to achieve high productivity and flexibility, it becomes very important to develop the visual feedback control system with Off-Line Programming System(OLPS). We can save much efforts and time in adjusting robots to newly defined workcells by using OLPS. A proposed visual calibration scheme is based on position-based visual feedback. The calibration program firstly generates predicted images of objects in an assumed end-effector position. The process to generate predicted images consists of projection to screen-coordinates, visible range test, and construction of simple silhouette figures. Then, camera images acquired are compared with predicted ones for updating position and orientation data. Computation of error is very simple because the scheme is based on perspective projection, which can be also expanded to experimental results. Computation time can be extremely reduced because the proposed method does not require the precise calculation of tree-dimensional object data and image Jacobian.

Robust Control of Robot Manipulators using Vision Systems

이영찬 ( Lee Yeong Chan ),지민석 ( Ji Min Seog ),이강웅 ( Lee Gang Ung ) 한국항행학회 2003 한국항행학회논문지 Vol.7 No.2

In this paper, we propose a robust controller for trajectory control of n-link robot manipulators using feature based on visual feedback. In order to reduce tracking error of the robot manipulator due to parametric uncertainties, integral action is included in the dynamic control part of the inner control loop. The desired trajectory for tracking is generated from feature extraction by the camera mounted on the end effector. The stability of the robust state feedback control system is shown by the Lyapunov method. Simulation and experimental results on a 5-line robot manipulator with two degree of freedom show that the proposed method has good tracking performance.

오프라인 프로그래밍을 이용한 스카라 로봇의 비쥬얼 피드백 제어

신행봉,이우송,이현철,한성현 한국공작기계학회 2004 한국공작기계학회 춘계학술대회논문집 Vol.2004 No.-

The equipment of industrial robot in manufacturing and assembly lines has rapidly increased. In order to achieve high productivity and flexibility, it becomes very important to develop the visual feedback control system with Off-Line Programming System(OLPS). We can save much efforts and time in adjusting robots to newly defined workcells by using OLPS. A proposed visual calibration scheme is based on position-based visual feedback. The calibration program firstly generates predicted images of objects in an assumed end-effector position. The process to generate predicted images consists of projection to screen-coordinates, visible range test, and construction of simple silhouette figures. Then, camera images acquired are compared with predicted ones for updating position and orientation data. Computation of error is very simple because the scheme is based on perspective projection, which can be also expanded to experimental results. Computation time can be extremely reduced because the proposed method does not require the precise calculation of tree-dimensional object data and image Jacobian.