Course description: Systematic design of instruction including task analysis, learner analysis, needs assessment, content analysis, specification of objectives, media selection, evaluation and revision. Analysis of instructional design models.
The learning in the course is split into nine instruction areas: goal analysis, subordinate skills analysis, learner and context analysis, performance objectives, learner assessment, instructional strategy, instructional development, formative evaluation, and summative evaluation. I was assigned to work with a local non-profit organization to improve the human resources segment of their new employee orientation.
|
Method |
Type
of Test Item |
Sample
Behaviors |
|
Conventional |
True/False |
identify, recognize, select, choose |
|
Matching |
identify, recognize, select, discriminate, locate | |
|
Fill-in-the-Blank |
construct, develop, discuss, define, generate, identify, solve, locate, state | |
|
Multiple
Choice |
choose, discriminate, identify, recognize, select, solve, locate | |
|
Short
Answer |
define, discriminate, evaluate, identify, locate, state, name, select, judge, solve | |
|
Essay |
construct, discuss, develop, evaluate, generate, judge, solve | |
|
Performance |
Performance/Product
Checklists |
construct, solve, develop, generate, locate, perform, operate |
|
Assessment
Rubric |
choose, construct, generate, operate, perform |
|
Method |
Type of Test Item |
Learning Domain |
|
Conventional |
True/False
|
Verbal Information Concepts |
|
Matching |
||
|
Fill-in-the-Blank |
||
|
Multiple Choice |
||
|
Performance |
Performance/Product
Checklists |
Procedures/Rules |
|
Assessment
Rubric |
Problem Solving/Cognitive Strategies |
The difficult part of this project has not been meeting with the service learning partner or getting the information we need, it has been the deciding on what content is good or bad, correct or incorrect for charting in the goal analysis. At the start, everyone except James wanted to jump into reorganizing the Hospice orientation as we thought it should be, however the assignment called for drawing how the system is currently implemented.
As I sketched out the process of HR orientation with Michelle, we created skill boxes and verbs for what the client wanted to accomplish. Note, what the client wants to accomplish is different from what they are currently presenting, so the charting came to a halt as our group members debated four different interpretations of the assignment. Michelle interpreted the assignment to mean it was possible we were supposed to be sketching how Hospice actually does orientation, now. Since my verbs matched more of an ideal implementation of Hospice, it would have involved a total re-think of the goal analysis. Three of us turned out to be correct anyway, but only in parts. In retrospect, it might have been helpful to have just asked our questions earlier instead of debating our interpretations of the assignment requirements.
One of the most useful things I used during the assignments was the Gagne's list of verbs. I had trouble with adding verbs to the goal analysis because I imagined the verbs had to be some physical action I could observe. I hadn't considered the verb could just as easily been someone speaking a one-word answer to a question. As I started connecting verbal arrows to other boxes in the Visio file I created, I realized I have only a vague understanding of how to create the flow of connections for verbal information. I will need to re-read that section of Dick, Carey, and Carey to properly contribute my input to the team version of the analysis.
In a few partial group discussions, we played with alternative ideas methods for presenting the orientation content in the current program. For example, I think all of my group members believe most, if not all of the paperwork signed during orientation can be done individually, without consuming HR's staff time. By downloading the forms online, receiving them by mail, or coming in to review the current packet on their own shouldn't require as significant amount of time as HR is putting in now. If HR allowed employees alternative methods or opportunities to file personnel paperwork, they could use more orientation time to orient the new employees to the culture of the client's organization.
After reading draft assignments from other students in class, I had a new appreciation for following the flow of charts. Creating the proper breaks in flow for pagination, drawing arrows in the right direction, and picking the best verbs makes a big difference in what information a chart conveys. Even though 2c said the goal statement in the draft I presented in class was acceptable, I believe after re-reading Unit 1 Supplement, it can be improved to better clarify the learner, the real-life context, and the available tools for accomplishing goals. Right now, the goal I stated feels very heavy in what learners will be able to do.
Michelle and James far exceeded my expectations of time commitments to this group project, and I have met with them in person and by phone on several occasions outside regularly scheduled face-to-face class meetings. I will be meeting again with James on Monday to clarify terms in the team learner and context analysis.
The attached assignment includes a goal and subskills analysis, and learner and context analysis of a non-profit.
| Attachment | Size |
|---|---|
| HOTC Learner&Context Analysis 20051002 blacked out.pdf | 64.56 KB |
| HOTC goal&ssa 20051002 blacked out.pdf | 56.35 KB |
| HOTC analysis phase feedback.pdf | 45.45 KB |
Measurable Action Verbs for Generating Performance Objectives based on Bloom’s Taxonomy for Learned Outcomes.
| Knowledge Level | Comprehension Level | Application Level |
|
Arrange |
Classify |
Apply |
| Analysis Level | Synthesis Level | Evaluation Level |
|
Analyze |
Arrange |
Agree |
Alternative Methods for Chunking Units into Lessons based on 5E Instructional Strategy
| Instructional Unit 1 | ||||
|
Instructional Event (Engage) |
Lesson 1 |
|||
|
Instructional Event (Explore) |
||||
|
Instructional Event (Explain) |
||||
|
Instructional Event (Elaborate) |
||||
|
Instructional Event (Evaluate) |
||||
|
Instructional Unit 2 |
||||
|
Instructional Event (Engage) |
Lesson 2.1 |
|||
|
Instructional Event (Explore) |
Lesson 2.2 |
|||
|
Instructional Event (Explain) |
Lesson 2.3 |
|||
|
Instructional Event (Elaborate) |
Lesson 2.4 |
|||
|
Instructional Event (Evaluate) |
Lesson 2.5 |
|||
|
Instructional Unit 3 |
||||
|
Instructional Event (Engage) |
Lesson 3.1 |
|||
|
Instructional Event (Explore) |
Lesson 3.2 |
|||
|
Instructional Event (Explain) |
||||
|
Instructional Event (Elaborate) |
||||
|
Instructional Event (Evaluate) |
Lesson 3.3 |
|||
|
Instructional Unit 4 |
||||
|
Instructional Event (Engage) |
Lesson 4.1 |
|||
|
Instructional Event (Explore) |
||||
|
Instructional Event (Explain) |
Lesson 4.2 |
Lesson 4.3 |
||
|
Instructional Event (Elaborate) |
||||
|
Instructional Event (Evaluate) |
Lesson 4.4 |
|||
|
Instructional Unit 5 |
||||
|
Instructional Event (Engage) |
Lesson 5.1 |
Lesson 5.2 |
||
|
Instructional Event (Explore) |
||||
|
Instructional Event (Explain) |
||||
|
Instructional Event (Elaborate) |
||||
|
Instructional Event (Evaluate) |
||||
|
Instructional Unit 6 |
||||
|
Instructional Event (Engage) |
Lesson 6.1 |
|||
|
Instructional Event (Explore) |
||||
|
Instructional Event (Explain) |
Lesson 6.2 |
Lesson 6.2 |
Lesson 6.4 |
|
|
Instructional Event (Elaborate) |
||||
|
Instructional Event (Evaluate) |
||||
|
Instructional Unit 7 |
||||
|
Instructional Event (Engage) |
Unit Overview |
|||
|
Instructional Event (Explore) |
Lesson 7.1 |
|||
|
Instructional Event (Explain) |
Lesson 7.2 |
|||
|
Instructional Event (Elaborate) |
Lesson 7.3 |
|||
|
Instructional Event (Evaluate) |
Unit Summary |
|||
|
Instructional Unit 8 |
||||
|
Instructional Event (Engage) |
Unit Overview |
|||
|
Instructional Event (Explore) |
Lesson |
Lesson |
Lesson |
|
|
Instructional Event (Explain) |
||||
|
Instructional Event (Elaborate) |
||||
|
Instructional Event (Evaluate) |
Unit Summary |
|||
Dick, Carey, and Carey (2005) outline a set of requirements for performance objectives in an instructional unit, including audience, behavior, condition, and degree. The audience is the target population to complete the assigned objective. Behavior includes an action verb to describe what the learners are expected to know and/or be able to do. Cues, stimuli, tools, scope, and complexity are part of the condition in a performance objective. Finally, the acceptable performance is defined by the degree. A complete objective would have all four components, for example, "provided with a list of insects, first graders will write the list of insects in alphabetical order with 90% accuracy."
|
Domain |
Measurable Verbs/Behaviors |
||
|
Verbal Information |
Arrange |
Label |
Recognize |
|
Concepts |
Classify |
Represent |
Review |
|
Procedures & Rules |
Apply |
Interpret |
Set up |
|
Problem Solving |
Analyze |
Deduce |
Hypothesize |
|
Cognitive Strategy |
Agree |
Choose |
Modify |
The instructional treatment plan builds on the analysis phase of the instructional design process. Some of the elements of the subskills analysis could be plugged right into the assessment alignment table. The organization I've been working with has an uncommon element of attitudinal and emotional importance, therefore the objectives of this plan include attitudinal elements otherwise not seen in a "proper" instructional treatment plan. Version 2.1 is a draft and the name of the organization has been removed since I didn't ask them about posting this to the internet.
One of the major stumbling blocks in completing this assignment was choosing a grounded instructional strategy. The assignment had a template, however the default Gagné instructional strategy seemed to be better suited for classroom, face-to-face instruction. Part of the effort in this project has been to present a large part of the orientation material in a web-based form, and WebQuests, paired with job aids, seemed like the closest grounded instructional strategy to our goal.
In the process of researching WebQuests, I developed a list of helpful resources such as the WebQuest template. I even signed up for a QuestGarden account, a PHP-based site for generating WebQuests. My professor, Dr. Hirumi, studied under faculty at SDSU. A guide on the building blocks of a WebQuest was also helpful in guiding the instructional strategy details for the treatment plan in my assignment.
During this assignment, I realized I'm rusty on rules for creating surveys. I used to know some good tips on trying to dumb-proof surveys, but I need a refresher. I think the Ph.D. program will have a survey course later in my plan of study. During the implementation of assessment tools later in this project, I may need to refer to my old marketing research textbook for some of those rules on survey creation. All I remembered to do was to not make the feelings about HR a double-barreled question.
After receiving feedback from Dr. Hirumi about version 2.2 of the instructional treatment plan, it was easier to see just how much the WebQuest instructional strategy was being modified to fit the objectives of the instructional unit. Tracy gave an example of a WebQuest she had used before. The task was to research George Washington. The process was to visit a website, read about George, answer some questions, and write an essay. The resources were the initial links provided to the learner, and the evaluation was over the essay. In the case of the client for this project, much of the "questing" is just browsing documentation prepared specifically to guide the learner through filling out their new hire paperwork.
As a result of the feedback from Dr. Hirumi, each part of the plan received some sort of significant modification. Initially, the plan included content to teach some attitudinal content, but that was removed in the final version, because we thought it would be better to allow hospice culture subject matter experts to develop a face-to-face presentation on what they wanted new employees to know. The initial objectives were choppy, and didn't follow 2c's ABCD rule for objectives. The instructional plan also lacked some sort of activity to reinforce the information in the readings. What I imagine for the Accident/Incident Report lesson is to present the new employee with three scenarios. They will need to identify which one requires an Accident/Incident report, then take information from the scenario to fill out a practice form.
The important thing to monitor as revisions were made to the plan is continuity from one part to another. At one point during the revision process, the objective for the learning about the employee assistance program only required learners to identify uses of the program, when in fact the learner also needed to know it was free, voluntary, and confidential.
The other continuity problem surfaced during revisions when we added scenario activities to the process. The objectives only accounted for making choices based on the Hepatitis B information sheet. Since the learners should know from the objectives they will have to apply information from a scenario in addition to the Hepatitis B information page, it was necessary to go back and amend the objectives. There was some discussion during the revision that adding all that information to the objectives "isn't how things are normally done". That was the problem though, the way people normally write objectives is incomplete and/or doesn't align the instruction and evaluation. At this point, the one bit of knowledge of aligning objectives is a reoccurring issue that will probably be one of the educational highlights of this Ph.D. program.
| Attachment | Size |
|---|---|
| EME6613_HOTC_Instructional_Treatment_Plan_2.2_blacked_out.html | 14.64 KB |
| EME6613_Instructional_Plan_Final_Feedback.doc | 90.5 KB |
| EME6613_Instructional_Plan_Preliminary_Feedback.doc | 76 KB |
Designer's Notes: The objectives listed in this instructional treatment plan are based on the subordinate skills analysis conducted on [removed]'s new employee orientation. This treatment plan focuses on the goal analysis item 1.0, "Follow policy and procedures mandated by Human Resources." Proof to work in the United States should include a link to valid forms of identification on a website such as IRS.gov or an internal webpage.
Course title: Orientation for New Employees of [removed]
Unit Number and Title: Unit 1.0 - Human Resources Pre-orientation
Terminal Objective: Given new employee materials, complete all tasks assigned by Human Resources.
Enabling Objectives: When provided instructional resources, scenarios, and job aids, you should be able to:
Prerequisites: Present an original of the following items to a Human Resources representative, who will visually verify and copy all items:
Time Requirements: Approximately 1 hour
|
Designer's Notes: WebQuest This unit does not cover attitudinal parts of the orientation to give the [removed] culture subject matter experts an opportunity to develop a face-to-face presentation on [removed] culture. The WebQuest grounded instructional strategy has been modified to meet the needs of [removed] pre-orientation paperwork requirements. WebQuests are an inquiry-based strategy in which most or all of the information used by the learners is electronic. They focus learners' time and attention on using rather than looking for information. They are also used to support learners' effort to analyze, synthesize, and evaluate. The critical attributes are pulled from the WebQuest template. This portion of the training is intended to be completely web-based. |
| Instructional Events | Description | Media & Tool Selection | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Introduction |
Prepare and hook the reader and provide a short overview. Stress the importance of completing this unit and illustrate to new employees how this unit will enable employees to start work. Learners will be provided with an overview of each unit that clearly notes benefits and importance of each unit as well as identifies problems and limitations associated with failing to address related skills and/or knowledge. Overview: Many of you may have some experience filling out Human Resources paperwork. This paperwork is important for starting work. This unit will provide an overview of Hepatitis B, the Employee Assistance Program (EAP), and Accident/Incident Reports. Human Resources paperwork provides [removed] with information to pay you. This unit is relatively short and should take you approximately one hour to complete. |
Web page | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Task |
Describe the end result of what the learners' activities will be. This section should list the aforementioned enabling objectives included in this design document. Prerequisites should also be listed here, including what materials learners will need.
For this unit you will need:
|
Web page | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Process |
What steps should the learners go through? Use a numbered list here to show the flow of the instruction. Providing the checklist here is recommended in the WebQuest template. Learners will be prompted with links to resources about Hepatitis B, the Employee Assistance Program, Accident/Incident Report, and job aids. You will be provided with instructional resources, scenarios, and job aids. During this pre-orientation you will complete the following processes:
|
Web page | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Resources | Resources will be internally linked webpage's listing information about Hepatitis B, Employee Assistance Program, Accident/Incident Reports, and help documents for instructions on filling out each personnel file document. Each document for Hepatitis B, Employee Assistance Program, and Accident/Incident Report will have one or more scenarios to give learners practice with each area. Some type of webform will be used to allow users to answer questions about each scenario. Type and features of webform will be determined at a later date. Job aids will need to be designed to explain how to properly complete each form. A webpage describing acceptable Governmental IDs will be provided in this section. A link to IRS form W-7 and USCIS Form I-9 will be provided as a resource of acceptable Governmental IDs. [contact information removed] |
Web page | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Evaluation | New employees will complete the checklist of items and turn it in to Human Resources. Checklist is included as part of the process of the instructional strategy and in the appendix of this document. | Checklist and multiple choice survey | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Conclusion | A couple sentences here will summarize what the new employees have accomplished during the orientation. Including some rhetorical questions and additional links is recommended by the WebQuest template for extending the experience beyond orientation. | Web page |
Webpages were selected o deliver most instructional events for a number of reasons:
|
Designer's Notes: The enabling objectives for Unit 1.0 focus on the acquisition of verbal information, declarative knowledge, and attitudes rather than higher order thinking skills, therefore a checklist is suitable for assessing new employee success in orientation. The terminal objectives for the new hire orientation focus on conceptual, verbal, and attitudinal domains. Each objective addresses the audience, required behavior, condition, and criteria or degree to which the performance will be measured. |
| Skill | Objective | Domain | Method | Item/Criteria |
| Turn in required personnel paperwork to Human Resources | Terminal objective: 1.0 - Given new employee materials complete all tasks assigned by Human Resources. | Rules | Post test: New employee checklist |
Checklist item: ___ New employee paperwork complete |
|
Make an informed choice about receiving a Hepatitis B vaccination |
Enabling objective: 1.1 - Given information and a practice scenario about Hepatitis B, new employees will choose to receive or decline a Hepatitis B vaccination. | Cognitive | Post test: Assessment Rubric |
Assessment Rubric is listed below |
|
Identify characteristics of the Employee Assistance Program |
Enabling objective 1.2 - Given information and a practice scenario about the Employee Assistance Program, you should be able to identify characteristics of the Employee Assistance Program in a quiz with 100% accuracy. | Verbal |
Post test: true/false quiz |
T/F - Family members can participate in EAP |
|
File an Accident/Incident Report |
Enabling objective 1.3 - Given information and a practice accident scenario, you should be able to accurately file an incident report with 100% accuracy. | Rules | Post test: Paperwork checklist |
Checklist item: ___ Sample practice Accident/Incident Report |
| Complete and submit all personnel file paperwork | Enabling objective 1.4 - Given job aids, you should be able to accurately complete and submit all personnel file paperwork and supporting documentation. | Rules | Post test: Paperwork checklist |
Checklist item: ___ All checklist items are turned in to Human Resources and accepted as complete |
|
Designer's Notes: Sample assessments are a compilation of the assessment items listed in the assessment alignment table. The assessment items specified for enabling objectives 1.1-1.4 were compiled to generate checklists to measure the achievement of the terminal objective 1.0. Contact information on how to submit paperwork to Human Resources could be included in the checklist instructions. |
New Employee ChecklistUse this checklist as a guide for which documents must be completed, signed, and submitted to the Human Resources office.
All checklist items are turned in to Human Resources and accepted as complete __________ Initials of Human Resources Representative _____/______/_____ Date
|
| Complete success |
|
| Marginal success |
|
| Incomplete file |
|
| Accepted |
|
| Declined |
|
| Prohibited |
|
| Undecided |
|