By Author
  By Title
  By Keywords

March 2019, Volume 69, Issue 3

Research Article

Questionnaire on conceptions about teaching: Factorial structure and reliability in academics of health careers in Chile. Questionnaire on conceptions about teaching

Cristhian Exequel Perez-Villalobos  ( Universidad de Concepcion, Departamento de Educacion Medica )
Nancy Bastias-Vega  ( Universidad de Concepcion, Departamento de Educacion Medica )
Giulietta Karina Vaccarezza-Garrido  ( Universidad San Sebastian, Facultad de Psicologia )
Rocio Glaria-Lopez  ( Universidad de Concepcion, Departamento de Fonoaudiologia )
Cesar Aguilar-Aguilar  ( EnfoqueEmico, Concepcion, Chile )
Patricio Lagos-Rebolledo  ( Universidad Catolica de Temuco, Facultad de Educacion, Temuco, Chile )

Abstract

Objective: To evaluate the factorial structure of the questionnaire on conceptions about teaching in the domain of health careers in Chile.
Method:The cross-sectional analytical study was conducted from July 2016 to  December 2016 at different cities in Chile, and comprised healthcare academics in Chile. The questionnaire on conceptions about teaching was used for data collection in addition to a socio-demographic proforma. Exploratory factorial analysis of the questionnaire was performed, and the reliability of the factors located was evaluated through Cronbach's alpha. Descriptive analysis of the data was subsequently performed.
Results:Of the 312 subjects, 196(63%) were women and 116(37%) were men. The overall mean age was 45.70}12.04 years (range: 24-73 years). A total of three factors were identified: student as an autonomous learner, professor as a content transmitter, and professor as a trained mediator. These presented reliabilities with Cronbach's alpha between 0.74 and 0.84 and had direct and statistically significant  correlations among them (p<0.05).
Conclusions:There was psychometric evidence supporting both validity and reliability of the questionnaire on conceptions about teaching.
Keywords: Education, Medical, Educational measurement, Faculty. (JPMA 69: 355; 2019)

Introduction

There is an increasing concern in the universities about how to improve their training processes, making university teaching a priority of the system and the professor figure at the centre of the analysis.1 Today, teaching management is one of the quality criteria of higher education institutions and the updating of the university teacher is a central strategy for improvement,2 becoming one of the main priorities of the teams that lead universities.3 This implies a break with the traditional image of the professor, who usually had freedom of teaching and research and was free from evaluations and social penalties.4 On the other hand, the traditional idea that having good specialists and researchers ensured a good university teaching has already changed.3 The pedagogical skills of the academic and his/her teaching capacities prove to be the main concern of the institutions seeking to ensure educational excellence. 2,3,5 Attention in the pedagogical component would be the necessary reaction to problems evidenced by traditional university training in order to face the cultural, political, social and economic changes. .6  The accrediting, regulatory and de-autonomisingtendencies, .7  as well as the pressures to reconceptualise education as a private good instead of public,4,8 the increase in the diversity of students and the impact of the technological advances9 have also contributed. Specifically in the health area, this has been accompanied by variations in epidemiological patterns9 and by changes in education and health, placing the university teacher in a scenario of decreasing resources, greater public scrutiny and greater expectations.10 The problems of the traditional model led to a direct criticism of the theoretical-conceptual foundations of the same9, which was labelled as positivists, behavioural, traditional or transmission-centric conceptions that seek to develop learning sequences where students-neophytes are exposed to knowledge provided by a teacher-expert.11 For this reason it is considered a teacher-centred education11 and it would be associated more to a technical rationality where the teacher must control the correct appropriation of contents by the students, applying pertinent techniques. 12  Contrary to the above, the academic world has been inclined to incorporate a conceptualisation of teaching, which some call constructivist, 12  student-centred11  orandragogic. 13 These conceptualisations have in common the factor that they conceive learning as a textually depending process, where students must buildknowledge from their experiences and beliefs, and where the teacher must facilitate the process by generating activities of authentic and meaningful exploration, and empowering them in the process. 13  The greater appreciation of this second approach has caused changes in the way in which all university disciplines are taught. In this context, the effort that the medical education has promoted since the 1980s in terms of important reforms in the way of teaching should be highlighted. 11   However, the pedagogical practice is not only referred to what teachers do, but also to the reflexive processes performed around the learning context that lead them to choose a course of action. 1   For this reason, it is important to understand how teachers think about training their students and from what conceptions this process is observed. Assuming that educational conceptions imply conviction, appreciation and predisposition to act on the educational context, 14   these would be referred to the unobservable dimension of teaching. What the teacher knows, believes and thinks is what is called teacher cognition. 15   Conceptions associated with teaching of academics would be a product, a personal construction based on their daily experience and their interactions with the cultural and social context. 16  As such, they would affect the way in which teachers perform their practices and even affect the conceptions that students have on their training. 14   Some studies have tried to approach the way in which health academics conceptualise their teaching, from what they think of the overall formative process, 17   their pedagogical practice, 18  the academic environment, 19   teacher improvement, 20   and from their implicit theories about teaching. 21   Given the origin of this phenomenon, many of these studies are qualitative. However, there are also quantitative studies that have used measuring  instruments to approximate teaching conceptions suchas the questionnaire of implicit theories on teaching, which is validated in Chile. 21   Thus, this questionnaire is focussed on the way in which the teacher conceptualizes his/her action22    and not in the formative process in general. For this reason, the Questionnaire of Conceptions about teaching (QCAT or in Spanish, 'Cuestionario de Concepcionessobre la Docencia' or CDD), developed by the authors of the current study, form the qualitative phase of a national study on university teaching. 1,20   This instrument is aimed at evaluating the way in which university academics think about the educational process in general, seeking to differentiate those who conceptualise it from a more traditional approach and centred on the teacher, and those who visualise it from a more constructivist approach and student-centred logic. From the categories identified in this phase, an outline of the QCAT was prepared whose validity of content was evaluated by a judgment of 15 experts in higher education level as medical education scientific research methods. Then it was submitted to a pilot application where the definitive version of the questionnaire was elaborated upon. The current study planned to evaluate the psychometric properties of QCAT and to provide evidence about the validity and reliability of the instrument in healthcare academics in Chile.

Subjects and Methods

The cross-sectional analytical study was conducted from July 2016 to December 2016 at different cities in Chile, and comprised healthcare academics who taught in medical undergraduate programmes in universities across Chile, including from those universities attached to the Council of Rectors of Chilean Universities (CRUCH). Teachers were selected through a non-probability sampling by volunteers. The study was approved by the National Commission of Scientific and Technological Research of Chile (CONICYT). Each participant answered a socio-demographic questionnaire. The main data-collection tool was QCAT in which the respondents had to answer 36 statements about the formative process, indicating their degree of agreement with what they declared when choosing one of five choices in a Likert scale format (1 = strongly disagree; 2 = disagree; 3 = neither agree nor disagree; 4 = agree; and 5 = strongly agree). Teachers shortlisted were sent an email inviting them to participate. The email stated the purpose of the study and the type of participation being sought. Those willing to explore further used a hyperlink within the email that took them to the questionnaire on an online platform. As the first step in the survey, the subjects had to read a page of informed consent. Those who clicked their acceptance could continue with the questionnaire, while those who declined received a 'Thank You; note which completed the process. In addition, participants could require more background of the study via telephone or email. In order to provide evidence of the QCAT's validity of construct, the factorial structure was evaluated by performing exploratory factorial analysis (EFA), applying Principal Axis Analysis (PAA) as the extraction method.23 Kaiser- Guttman and Catell criteria23as well as Horn Parallel Analysis were used to pick the more prominent factors. 23 Within PAA, the Oblimin direct rotation method presented factor loadings, and those higher than 0.30 were considered significant. 23 Subsequently, the reliability of each factor was calculated by using Cronbach's alpha coefficient, which is the most used tool for such purposes in psychometry. 23 Finally, a descriptive analysis of factor scores was  performed and the correlation between them was evaluated with the Spearman's correlation coefficient. Factor scores were calculated through a simple summation of the items of each one. 24 P<0.05 was considered statistically significant. All analyses were performed in STATA SE 11.0 software.

Results

Of the 312 subjects, 196(63%) were women and 116(37%) were men. The overall mean age was 45.70}12.04 years (range: 24-73 years), and the sample included teachers from across Chile (Table-1).



Kaiser-Meyer-Olkin (KMO) statistics produced a value of 0.86, and the Bartlett's test for sphericity results were statistically significant (p<0.001), indicating that data was good enough for EFA.The number of factors in which the 36 items were  organised was identified. Three factors were identified as 'student as an autonomous learner', 'professor as a content transmitter', and 'professor as a trained mediator'. All the three items presented factor loadings higher than 0.30 (p<0.05). However, one item presented higher loadings in two factors. In this case, its conceptual content was evaluated and it was defined that presented greater affinity with the second factor, where it also presented a greater loading (Table-2).



The three factors presented reliabilities with Cronbach's alpha between 0.74 and 0.84 and had direct and statistically significant correlations among them (p<0.05). Also, the first and third factors significantly differed from normal distribution (p<0.001) (Table-3).



Discussion

Results obtained showed a three-factor structure. Two of them included the conceptions that academics have their own role, whereas the third factor alluded to the role of the student. Factors associated with the role of academics were, 'Teacher as a content transmitter' and 'Teacher as a trained mediator'. The association of the first role with the traditional teaching model is clear since it includes the idea of a specialised teacher and the responsibility of transmitting that knowledge to students.11,12 Likewise, the second factor clearly represents a logic mode centredon the student where the integral formation is conceived as a goal of the educational process, 10  the need to generate a teaching that facilitates the learning of students in many ways, 11 and the requirement of having a trained teacher to lead it. 20 Thus, instead of being opposed to the same dimension, the student-centred logic and teacher-centred are represented in different factors as differentiated constructs. The above is consistent with what was found in Chilean health academics with the Questionnaire of Pedagogic Practices (QPP). 1 Although the QPP is focussed on the frequency with which teachers perform activities of their role, it also identifies that the student-centred teaching was a factor different from that centred on teachers. However, in that study both factors presented no statistically significant relation. 1 In the present study, conceptions associated with both forms of teaching were positively correlated, indicating that they coexist in the perspectives of the academics. On the other hand, the factor 'Student as autonomous learner' clearly shows a conception of learner that belongs to andragogy13 and is consistent with the constructivist perspectives of education.11,12 Nevertheless, the fact that it was isolated from the other two factors indicates that the conceptions that academics have on their activity and the role the student should have are not conceived as part of the same idea. In fact, it shows that a more traditional and conductive conception of teaching can be directly associated with a view of the student as an autonomous agent, although both are theoretically opposed. In spite of this, it was the weakest of the correlations found. In contrast, the conception of the 'teacher as trained mediator' showed the highest correlation with the conception of an independent student, indicating that both present a greater theoretical agreement and eventually they could create a virtuous circle in the practice. Finally, the three factors obtained adequate reliabilities, showing an acceptable precision in the measurements they offer.23 In terms of limitations, it should be noted that although the study had a national scope, the representation of each geographic region is not comparable. On the other hand, the present study focused on the properties of the instrument, so its use to describe and explain the reality of local academics remains pending.

Conclusion

Understanding that a complex and polyhedral construct such as the one of conception could have a deeper and detailed approximation from the qualitative approaches as having the QPP allows performing screenings, diagnoses and massive studies that lead to characterizing the broad population of academics. Both approaches should be complementary and not mutually exclusive.

Disclaimer: None.
Conflict of Interest: None.
Source of Funding: The CONICYT FONDECYT Project "1161541" 
References

1. Perez C, Vaccarezza G, Aguilar C, Coloma K, Salgado H, Baquedano M, et al. Factor analysis and internal consistency of
pedagogical practices questionnaire among health care teachers. Rev Med Chile. 2016; 144:795-805.
2. Fook CY. Best practices of teaching in higher education in United States: a case study. Procedia. 2012; 40:4817-21.
3. Zabalza MA. The convergence process as an opportunity to improve university teaching. Revistauniversitaria de formacion del profesorado. 2006; 20:37-69.
4. Altbach P. Higher education and the WTO: Globalization run amok. Inter Higher Educ. 2016; 23:2-4.
5. Lowry S. Teaching the teachers. BMJ.1993; 306:127-30.
6. Barron MA. Teaching at the University and educational competences. Perfileseducativos. 2009; 31:76-87.
7. Rama C. Trends and tensions: The crossroads of higher education in Latin America. Policy futures Educ. 2010; 7:463-72.
8. Araneda Guirriman C, Rodriguez Ponce E, PedrajaRejas L. Relationship between fiscal funding, quality of faculty and university students retention in Chile. Form univ. 2013; 6: 55-64.
9. StenforsHayes T, Hult H, Dahlgren LO. Three ways of understanding development as a teacher. Eur J Dent Educ. 2012; 16: e151-7.
10. Billings D, Halstead J. Teaching in nursing a guide for faculty. In: Billings D, Halstead J, Eds. Teaching in Nursing: A Guide . Saint Louis, USA: Elsevier; 2016.
11. Harden R, Crosby R. The good teacher is more than a lecturer-the twelve roles of the teacher. AMEE Guide No 20. Med Teach. 2000; 22: 334-47.
12. Prieto M, Contreras G. Teachers' conceptions that inform their assessment practices: a problem to be disclose.EstudoPedagogia. 2008; 34: 245-62.
13. Roebuck H, Moran K, MacDonald D, Shumer S, McCune R. Assessing Skin Cancer Prevention and Detection Educational Needs: An Andragogical Approach. J Nur Practitioners. 2015; 11:409-16.
14. Mellado V. Concepciones y prácticas de aula de profesores de ciencias, enformacioninicial de primaria y secundaria [Classroom beliefs and practices in science teachers in initial primary and secondary education]. Ensenanza de las ciencias. 1996; 14:289-302.
15. Borg S. Teacher cognition in language teaching: A review of research on what language teachers think, believe and do. Lang Teach. 2003; 36: 81-109.
16. Hamel F. Teacher understanding of student understanding: Revising the gap between teachers' conceptions and students' ways with literature. Res Teach English. 2003; 38: 49-84.
17. Williams R, Klamen D. See one, do one, teach one-exploring the core teaching beliefs of medical school faculty. Med Teach. 2006; 28: 418-24.
18. Ortega J, Nocetti A, Ortiz L. Reflective practices of the teaching process in university health science professors. Educ Med Super.2015; 29: 22-34.
19. Seabrook M. Medical teachers' concerns about the clinical teaching context. Med Educ. 2003; 37: 213-22.
20. Pérez C, Fasce E, Coloma K, Vaccarezza G, Ortega J. Perceptions about continuous training of Chilean health care teachers. Rev Med Chile. 2013; 141: 787-92.
21. Lazcano X, Santa Cruz V, Conget P. Implicit theories about teaching and its association with pedagogical practices of teachers in the Medical school. Rev EducCiencSalud 2013; 10(1): 47-52.
22. Jimenez A, Correa A. Concepciones del profesorado de educacioninfantil y primaria, secundaria y superior sobre la disciplina y gestion del aula [Beliefs of teachers of childhood, primary, secondary and higher education about classroom discipline and management]. Qurriculum 2003; 16: 87-104.
23. Martínez R, Hernández MJ, Hernández MV. Psicometrics. Madrid: Alianza; 2006.
24. George D, Mallery P. SPSS for Windows step by step: A simple guide and reference. 11.0 update, 4th ed. Boston: Allyn& Bacon; 2003

Journal of the Pakistan Medical Association has agreed to receive and publish manuscripts in accordance with the principles of the following committees: