The principal purpose of this study is to identify and analyze the factors responsible for poor listening skill of Bangladeshi EFL learners.The study was conducted from 01 March 2015 to 25 May 2017. Thirty-two variables which are mostlyresponsible for poor listening skill are selected from related literature and the researcher’s own experience in teaching EFL learners. Factor analysis has been conducted to reduce the amount of the total variables, to identify the important variables and to arrange them into useful categories. SPSS 16 has been used to analyze the data collected from the primary sources through a complete set of Likert scaled questionnaire. Data for this research have been collected from 142 EFL teachers and 171 MA students studying English Language at 29 public and private universities located in different parts of Bangladesh.