AS the term is about to end, I am archiving all my answers to faculty-initiated discussions. I am doing it for the purpose of assessing how much I have learned throughout the term and if there are certain concepts that seem vague to me before that have been clarified and now I understand better. Also, I want to reflect on how much I have grown as a distance learner in terms of my habits, thinking, interaction, and the like.
(NOTE: I removed the links to my references since they are on subscript mode. Anything I quoted I give full credit to the authors of the journals and articles. Also, I have pending answers to modules 3 and 9.)
Module 1
Part 1
“Taking credit for anyone else’s work is stealing, and it is unacceptable in all academic situations, whether you do it intentionally or not.”1
Stealing comes in many forms, and plagiarism is one of them.
When we were still younger (and studying), we might have used information from several sources without properly citing or crediting them. We might not feel guilty becuase th concept of plagiarism has not been fully instilled in us, however, these should change. As students taking post graduate studies, it is important to give credit to references or sources especially that courses like PTC entails a lot of research and supplementary reading.
Like what I mentioned in my commitment, regardless of who one is, whether he or shye is a famous author or just an ordinary person, proper acknowledgement and credit should be given to him or her because of the creativity and hard work he or she put into those thoughts and ideas. For sure, most of us, if not all, wouldn’t like to be disregarded for our hard work.
Part 2
Good day! The following are the definitions/descriptions I found in relation to the set of words given. I hope these would enrich our knowledge as we get to know and learn EDS 113.
Set A
- Evaluation – a term frequently confused with measurement and testing; it is the ongoing process of gathering information, making judgment about the information and then arriving at decisions.1
- Measurement – process of developing or obtaining and then using some testing device or rating scale to call it information. 1
- Testing – defines the conditions and steps involved in administering and scoring tests of various kinds for different purposes. 1
- Assessment – involves the use of empirical data on student learning to refine programs and improve learning2; it is also the systematic collection, review and use of information about educational programs undertaken for the purpose of improving student learning and development3
- Grading – The process of applying standardized measurements of varying levels of achievement in a course; can be assigned in letters, as a range, as a percentage of a total number correct, as a number out of a possible total or as descriptors. 4
Set B
- Summative assessment – determines degree of mastery or learning of a course and therefore it is given at the end of the course. The result is the final grade; grades in most cases reflect a student’s standing relative to other students in the class. 1
- typically used to evaluate effectiveness of instructional programs and services at the end of an academic year or at a predetermined time; the goal of this is to make a judgment of student competency after an instructional phase is complete wherein it is used to determine if students have mastered specific competencies and to identify instructional areas that need additional information.5
- Formative assessment– done during instruction when the primary aim is to improve learning, which may come in the form of pretests used to determine what students already know about the subject matter thus repetition can be avoided and new material can be linked with prior learning. 1
- Ongoing assessment, reviews and observations in a classroom; teachers use this to improve instructional methods and student feedback throughout the teaching and learning process.5
- Diagnostic assessment – given at the beginning of the course for ability grouping or identifying learning difficulties. 1
- Validity – evaluative information, to be useful in forming judgments, must be valid meaning, it must be appropriate1; refers to the extent to which assessment are consistent.6
- Reliability – concerns the consistency of test results or relatively free from errors1; accuracy of an assessment whether or not it measures what is supposed to be measured.6
Module 2
Cite actual examples of assessments (specific test items or tasks) that are (a) well-aligned and (b)poorly aligned with learning goals/ objectives.
Like in education/teaching, assessment is very important to us nurses. When I was still a student, we have this activity called a “pre-visit” wherein before we have our duty, we visit our prospect patients the day before so that we could assess and interview them. Information obtained from te pre-visit will be used for our nursing care plan, which we will implement during our duty days. This plan will be assessed and evaluated by our clinical instructor. I can say that this activity is well aligned with the learning goals and objectives of nursing because it does not only involve making a plan that must include theoretical basis as rationale but also, it instilled in us that we should always be prepared in taking care of our patients, aiming for the quality care they deserve.
Using your personal experience/s or observation/s, what is the effect of poor alignment on how students learn? Would poorly aligned assessment also affect the way teachers design or decide about the ways they teach?
Poor alignment may come in two forms: asking less or asking more. Either way, if this happens, it defeats one of the purposes on why assessment is being done, which is to measure how much a student has learned. Asking less will promote superficial learning; asking more would exhaust students. Poor alignment does not only affect students but teachers as well. If methods used by techers are poorly aligned, they might get the wrong message on what topics or lessons students are having difficulty with. They might focus on it since that’s what the results of the assessment methods reflect, however, this may not be always the case.
Module 4
AS I read the material given for this module (“The Student Assessment Handbook: New Directions in Traditional and Online Assessment”) I had my “ahh!” and “onga!” moments… Making me able to look back and relate my experiences to what is being asked (see above).
We all had our shares of these kinds of moments, and for every situation is a comment or two. Let me share mine.
The handbook mentioned that one of the side effects of assessment is creating stereotypes. I have experienced this in high school as most of the top students (usually the top 10) would be joining inter-school competitions on poster making, journalism, quiz bees and the like. Since they are the TOP students… however, I know some of my classmates/batchmates are capable of joining them too, but since their abilities are overshadowed by the “ranking” and exam results and all, they are ignored.
Another side effect very common to universities and colleges is keeping up with the standards and reputation, which also leads to high stakes competition. I graduated from a university that boasts high passing rates of different courses, particularly of the health related courses. A way for the school/department (from which I came from) “keep” the best students by having a QUOTA. Luckily, I did meet the necessary criteria and was retained. Did the quota helped the school maintain the good reputation it has? Yes, because the students that were retained “delivered” very well, especially during the board exams, and receive good feedback from the institutions they have worked in or currently working for. However, what happens to those who were not retained? It creates an negative impact on them and they may feel inferior, which is not really the case.
The side effects of assessment have its positive and negative impact in each of us. Regardless, it is up to us, future teachers, to use our awareness in improving our methods thus creating a better learning environment for our students.
Module 5
What “new assumptions” about the nature of the learner, the nature of learning and the types of meaningful learning have emerged in education literature?
From what I understand from the ideas presented in “Why Talk About Different Ways to Grade? The Shift from Traditional Assessment to Alternative Assessment,” these new assumptions are “reconceptualized” ideas, based from the results of different studies done that dealt wth traditional assessment methods, which include the following: 1) redundant utilization of lectures and objective tests as the main means of teaching; 2) proliferation of different kinds (or races) of students, particularly of the minority; and 3) the utilization of the constructivist learning theory.
How do these new assumptions influence the way/s we should assess?
These new assumptions influence ways we should assess in such a way that traditional methods in the modern world (we live in now) MAY be bent to give way to alternative types of assessment that are considered more modern, collaborative and interactive in approach, which may facilitate a more conducive and secured learning environment.
How do the roles of teachers and students’ under a constructivist assessment paradigm differ from those under traditional assessment practices?
In the traditional view, teachers are seen as the main source of knowledge and information (the “experts”), and students are considered to mere recepients of information (the “novices”). On the other hand, teachers utilizing alternative assessment (particularly the constructivist theory/approach) serves as facilitators or guides to students, who are the main ‘builders’ responsible for their learning.
What challenges/ obstacles face the introduction of new assessment methods into the educational system?
Challenges that might affect the implementation of alternative assessment methods, according to the article, may include “issues on instuctional strategies, formative and summative evaluation, rubrics, and instructor, peer and self-evaluation.”
However, based from my understanding and relating it to the Philippine setting, the obstacles alternative assessment MAY be facing are the following:
- “Old habits die hard”
- Constraints – time, finances, etc
- Lack of training or skills for teachers OR lack of awareness for teachers and students
- Situation of the community
I say that these are problems because currently, our education system has recently shifted to a K-12 curriculum (from the traditional reformed basic education curriculum), which garnered some negative views. If people always have something to say negatively against change, it would be difficult to introduce these despite the good intentions that come with it.
Another reason is, we assume that teachers know how to teach different skills and knowledge including complex skills, however, this is not always the case because they are restricted and used to the traditional ways. When the time comes that students NEED to use complex skills for their learning, they cannot ‘deliver’ because they were not taught to do so. This problem can also be attributed to teachers’ lack of awareness of the impact of just teaching and assessing using traditonal methods that only encourage lower levels of learning.
Also, utilizing alternative assessments may be time-consuming and resource-depleting, especially in areas that lack funding.
Module 6
Describe how alternative assessments align with the broader vision towards more meaningful, relevant, and globally competitive education.
- Alternative assessment align with today’s broader vision for education by and through its nature. Reforms in education are geared towards a more sophisticated and well-rounded approaches in teaching and assessing. Alternative assessment is more holistic, collaborative and engaging in nature.
What challenges/ obstacles face the introduction of new assessment methods into the educational system? How do you propose to hurdle these challenges?
- Even with good intentions, Alternative assessment will be faced with challenges as it is to be implemented.
- Different opinions of the members of the academe, which may pose problems of acceptance and implementation. “While some believe traditional assessment methods are more effective, others think that alternative assessment tools are superior.” (Dikli, 2003)
- Alternative assessment is not as convenient and practical as traditional ax.
- Alternative assessment requires more from both the student and teacher. These include: time, effort, resources and responsibility.
- Alternative assessment is relatively new for most teachers. And these would require them to update themselves with the new trends in teaching or to undergo additional/further studies. These would or might be costly for teachers.
- This is also new for students which would require their time and effort to get used to. AA “require a lot of input and responsibility from the student. Moreover, they demand a great deal of time commitment from the teachers…” (Bailey [1998] in Dikli [2003]).
4. Fear of Change – most common hurdle or challenge of new ideas is the change it can bring, which may “disturbance” in the “status quo.”
Module 7
- In which type of assessment will you associate rubrics with—criterion- or norm-referenced assessments? Elaborate.
Rubrics can be associated with criterion-referenced assessment. We define criterion-referenced assessment as “a test or other type of assessment designed to provide a measure of performance that is interpretable in terms of a clearly defined and delimited domain of learning tasks.1” When rubrics are utilized, the product or process is being compared to a set of criteria.
- How do rating scales, checklists, and rubrics compare with respect to the type of information they provide?
Checklists are used if teachers want to know if a student has done a specific task or not, or whether a student has included a certain element in an end product. Thi is considered the least complex among the three because all items are of the same weight, does not include variations and only looks for the presence or absence of a certain element (in a product) or step (in a process or performance).
A rating scale is used to assess the quality of a product or performance, wherein degrees of accomplishment are indicated. It is more specific than a checklist but less detailed than a rubric.
Rubrics are the most complex and detailed of all performance assessment tools. Each step or aspect of a product or performance is assessed independently, therefore multiply criteria and levels of accomplishment are present.
Checklist and rating scales are more convenient because they are shorter and relatively easier to construct than rubrics. Rating scales and rubrics have subjectivity tendencies than checklists due to differences in perspective or perception of the assessor or instructor who will be using them, therefore requiring clearly defined parameters to avoid bias.
Checklists, rating scales and rubrics provide information that can be used by teachers in imporiving instruction, clarifying misconceptions and for statistical purposes. These tools may show patterns or trends that show certain strengths and weaknesses of the students in class. From there, the teacher can determine what to do in order to adapt or adjust to the learning needs of the students, as revealed by the results of these tools.
- Cite ways how you can use rubrics to promote thinking and learning in your own class settings. In what ways can rubrics be used to intentionally promote learning?
I can promote student learning and thinking through rubrics by utilizing and/or maximizing the benefits it brings in the classroom. Several benefits or advantages of using rubrics include:
- Clarifies learning goals and objectives.
- Guides students in making their requirements.
- Students are able to make informed decisions in relation to their work.
- Provides students with an opportunity to assess themselves and others as they are aware of the criteria.
- Assessment is more objective and consistent.
Having metnioned these, when I am already part of the teaching force or academe, I will (and hope to) make sure communicate the rubrics I have made to my students so as to be their guide in making complex requirements. Also, if I am not able to create one yet, I would involve them in making the rubric so that they will be more engaged in the discussion thus producing a collaborative vibe. AS I communicate the rubric and expectations to the class, I have to make sure that the elements or content are well defined and explained, and clarify any misconceptions that they have. This would help them make more informed or better decisions in learning. Being aware of the rubric/s would aid students in assessing their own work, as well as the work of others, enabling them to learn as they go along.
Module 8
1. Which type/s of traditional assessment/ testing are you inclined to choose? Why?
I do not have any formal teaching experience but as much as possible, I would like to be inclined to all types of traditional assessment. But if I have to choose at the moment (because of course, my preferences may change over time depending on the need), I would have to choose to use multiple choice, essay and true or false. I would be inclined to use the multiple choice format because I am accustomed to answering it. Most of my tests in college and the format of the NLE is in multiple choice. Also, it is not only used in recalling concepts, but it can also be used to check students’ application and analysis skills (higher order skills), as long as well-crafted. Second is the essay, because it enables students to express their thoughts and understanding of a lesson or topic. Lastly, the true or false type, which can also be in modified form wherein the students need to decipher whether there is an incorrect term or phrase in the statement and if there is, replace it with the correct one. This type can assess how students discriminate what is true or false depending on how they were able to comprehend the lessons.
2. Is it possible to ensure that the traditional assessment you craft will be good assessment, no less effective than an alternative assessment?
Yes, it is possible. Assessment that is well-crafted, regardless of whether it is traditional or alternative, will turn out to be good assessment hence an effective one.
3. Not all traditional tests are “standard”; hence, how can they be useful?
Yes, not all traditional assessment are considered standard, depending on how they were used, but it does not mean they are not useful. Non-standard traditional assessment can be used to evaluate extent of student knowledge which may be helpful in developing how teachers would approach the class.
4. What are some issues with norm-referenced tests? Are there issues with criterion-referenced tests?
The usual or common issue being dealt with norm-referenced testing/tests is that they are not designed to measure individual knowledge acquisition, standards mastery, content comprehension, academic achievement or intelligence.1
On the other hand, some concerns with criterion-based tests are:
- They do not tell us all we need to know about achievement, for example, excellence and deficiency in learning which can only be measured normatively.2
- They are difficult to obtain as they require detailed specification of objectives or out comes in behavioural terms.2
- They are necessary for only a small fraction of important educational achievements as they are inappropriate for measuring diverse talents, interests, abilities, understandings and appreciations that keep a Society functioning and are possessed in varying degree by all.2
Module 9
1. Here are examples of poorly-crafted test items and how they can be written better.
Essay
Poor: Describe the action of diuretics in the kidneys.
-This item is ambiguous because it may be interpreted by the student in two ways: describing the action of diuretics in general OR describing the action of ALL the types of diuretics
Better: What are the 5 types of diuretics? Differentiate one from the other according to their action in the kidneys. OR Differentiate the 5 types of diuretics according to their action in the kidneys.
-The suggested version asks the students to apply and elaborate what s/he had learned, and not just simple recall of the action of diuretics.
Multiple choice
Poor: All but one are the basic principles of bioethics?
A.Justice
B.Beneficence
C.Non-maleficence
D.Autonomy
E.Confidentiality
F.Integrity
G.All of the above
H.None of the above
-There are too many choices, which may cause confusion to the student. Also, there are “all of the above” and “none of the above” options, which should be rarely used.
Better: The following are the basic principles of bioethics EXCEPT?
A.Justice
B.Beneficence
C.Autonomy
D .Integrity
-The alternatives were reduced to only four, and “all of the above” and “none of the above” options were removed.
2. The following are outlined steps of creating different test items, as adapted from the reference “Is This A Trick Question?”
Multiple Choice Items
-State the stem as a single direct question (rather than an incomplete stem).
-Remove extraneous or irrelevant details from the stem; include in the stem words that might be repeated in the alternatives.
-Use negatively stated items sparingly, as well as for the alternatives “all of the above” and “none of the above.” If used, emphasize the term.
-Make all alternatives mutually exclusive, of equal length and attractive to both less and more knowledgeable students.
-Use at least four alternatives, listed with capital letters and randomly distributed.
My own examples:
- What should a nurse do before administering medications via nasogastric tube (NGT)?
- Crush the enteric-coated pill before mixing with water.
- Flush the NGT with 100 ml of water.
- Check for the proper placement of the NGT (to decrease risk for aspiration)
- Take the patient’s vital signs.
- What is the rationale for encouraging leg exercises to a post – op patient?
- Promote respiratory function
- Maintain functional abilities
- Provide diversional activities
- Increase venous return (decreases thrombus formation)
- What nursing action would promote relief of gas pains postoperatively?
- Cough and deep – breathe every two hours
- Maintain NPO status for 48 hours
- Encourage frequent ambulation (increases peristalsis)
- Take vital signs every four hours
- What post – operative complication may occur in an obese patient?
- Thrombophlebitis
- Impaired wound healing (fatty tissues are less vascular, therefore decreased blood flow to wound)
- Hemorrhage
- Gas pains
- Which of the following types of medications, if taken by a patient preoperatively, would increase his/her risk for complications?
- Anticoagulants (increased risk for bleeding)
- Antacids
- Laxatives
- Sedatives
Completion or Fill-in-the-blanks
-Omit only significant terms
-Do not omit too much words, so as the meaning of the statement is not lost
-Avoid obvious clues (like grammatical clues) to the correct answer
-Make sure there is only one response
If possible, put the blank at the end of the statement and not at the beginning.
My own examples:
- Hand washing is the single most effective way and least expensive method to prevent (nosocomial infections).
- Coughing exercises is an effective measure to facilitate (expectoration of secretions).
- Deep breathing exercises is an effective means of (expanding the alveoli) and (mobilizing secretions).
- A rule of thumb in nasogastric (NGT) feeding is (checking for NGT placement).
- Before suctioning a client, (preoxygenate/hyperoxygenate) by using a manual resuscitation bag or asking the client to take several deep breaths.
Essay
-Formulate a question that clearly defines what you want the student to do; and that require short answers so more content is covered
-Do not use optional questions
-Write essay items at different learning levels
-Develop a scoring model or guide
-Prepare students for essay exams by showing them examples of answers from previous tests
My own examples:
- Identify the different stages of Sigmund Freud’s Psychoanalytical Development Theory (5pts)
- Differentiate repression from suppression (5pts)
- Summarize the physiologic changes a woman undergoes after giving birth. (10pts)
- Give examples of common complications that occur during pregnancy.(5pts)
- Justify that mental retardation does not only occur in children or people with Trisomy 21. (5pts)
- Compare and contrast angina pectoris and myocardial infarction.
Reflection:
I found the material “Is This A Trick Question” very informative and helpful for me in making my own examples of traditional assessment. That is why most, if not all, of my outline’s content were taken from the material. With the steps in mind, I tried my luck in creating essay, multiple choice and completion questions.
While doing so, I kept in mind what I want (my) prospect students to do or achieve, as well as what I want from them. My goal or objective is to construct test questions or items at different levels of learning. This would prompt my students to study the lessons more in depth and not rely on memorization of basic concepts.