Math 124/5 Calculus Reform:
Summary Report for 2001-2002

Department of Mathematics
University of Washington


Introduction

In this document, we report on the progress the Department of Mathematics made during the 2001-2002 academic year in revising Math 124/125. We begin with a short review.

In the fall of 1997, Doug Lind, then Chair of the Mathematics Department, formed an Ad Hoc Committee on Calculus to review the Math 124/5/6 calculus sequence. The committee, chaired by Paul Goerss, presented a report to the department in the spring of 1998. The report is attached as Appendix D. It led to revision efforts on several fronts, including some changes implemented the following year with departmental resources. These are outlined in Appendix E, Two major changes involved courses outside the traditional Math 124/5/6 calculus track: the reduction of class size in business calculus Math 111/112 and the introduction of a life sciences calculus course, Math 144/5/6. At the same time, we planned a revision of the traditional calculus sequence, which resulted in the Tools for Transformation (TFT) proposal attached as Appendix F. This proposal to reform Math 124/5 was funded for a three-year period. It is coupled with an agreement (see Appendix G) between the department and the College of Arts and Sciences.

The academic year 2001-2002 was the first year of the three-year TFT project. A new version of 124 was introduced in Autumn 2001, followed in Winter 2002 by a new version of Math 125. We believe that our first-year reform effort has been a success. As we will detail below, student and collegial assessments indicate that most components of the courses worked well. A few components were identified as needing further adjustment or assessment. We believe that the revised courses engaged the students, faculty and teaching assistants in a satisfying learning/teaching experience. We intend to maintain the positive trajectory of student satisfaction during the coming academic year. We will also initiate a dialog with client departments regarding the revisions and begin tracking the progress of students who have taken our Math 124/5 sequence.

This report will discuss how reform objectives were met - or not met - during the first year, and detail our plans for the second year of the project. We will present both OEA and CIDR assessment data. In the autumn of 2001, Ron Irving (then department chair) and David Collingwood, undergraduate program coordinator, met with Nana Lowell (OEA) to design a supplementary survey for use in conjunction with the usual student evaluation forms. This OEA survey data was gathered at the end of each quarter. In addition, Karen Freisem, a CIDR member with substantial experience in working with Mathematics faculty and TAs, carried out mid-term surveys. These Small Group Interactive Diagnostic surveys (SGIDs) were based on facilitated discussions with all Math 124/5 classes taught during the 2001-02 academic year. The statements we make below are based on the data collected through these surveys. We will often refer to specific survey questions to make this clear. The OEA data may be found in Appendix A and Appendix B. The summaries of the SGIDs, as prepared by Karen Freisem, may be found in Appendix C.

We will discuss each of the four key objectives listed in our TFT proposal as a separate item.

1. Student learning

This objective refers to the learning of calculus skills, manipulative skills, problem-solving skills, reasoning skills, and an overall vision of the usefulness of calculus as a tool in the modern world. Ideally, we would like our students to master all of these. We are also aware of the need to strike a balance between computational skills and modeling skills. (The history of calculus teaching in our department, and in the nation generally, has been that, after teaching a computation-oriented sequence for many years, we shifted to a modeling-oriented mode in the late 1980s. These experiences with the two "extremes" led to the current realization of the need for a compromise between the two competing demands.)

We have adopted a traditional textbook that emphasizes computational skills. Both students and instructors now feel that computational needs are being adequately covered. Little modification of the 2001-2002 textbook syllabus is anticipated during the next two years. Student satisfaction with the textbook component of the course was high - see Questions #8 and 9 in Tables A1, A2 and A3 of Appendix A.

Problem-solving skills are highly valued by our client departments. Two components of our reform effort, worksheets and supplementary homework problems, target problem-solving skills, as well as reasoning skills and a vision of calculus usefulness. We now comment in detail on these two core components.

Worksheets. Each week the students meet for 80 minutes with a TA in a section of 27 and work through a carefully choreographed discovery-based worksheet. The main goal is to introduce a key problem or idea from the course and allow the students to work on it in groups of 3-5 for an extended period of time. This use of active learning is not a new idea in calculus instruction, but it is the first time our department has attempted its integration into the calculus curriculum.

Worksheets were the subject of substantial discussion and revision over the year. (Weekly instructor meetings were one of the forums for this discussion.) In Autumn 2001, there was not yet a focused vision of what was going to take place during the 80-minute worksheet sessions. The extent to which the worksheet sessions factored into the course grade was not uniform across lecture sections. Not surprisingly, the opinion of students as to the relevance and value of the worksheet component of the course was highly varied. If you refer to Question #11 in Tables A1, A2 and A3, you will see that this question produced the second largest response variation on the supplementary survey, though the median ratings are positive. (It is interesting to note that students in Math 125 were more satisfied with worksheets than students in Math 124. Whether this reflects the quality of the Math 125 worksheets versus those of 124, or a gradual adaptation of the students to the worksheet model is unclear.) Karen Freisem documented that in the SGIDs the topic of worksheets always came up, and that there were two opposing factions of roughly equal size. A group of students would highly value the worksheet sessions, with a few students going to the extreme of viewing them as the best component of the course. On the other hand, there would be a group who did not value them, and even a subset characterizing them as "a waste of time" or "having little to do with the rest of the course". (Summaries of SGID reports are in Appendix C.)

After discussing this extensively, we came to three conclusions that will guide our implementation of worksheets during the second year of the project:

a) We need to better prepare TAs. It has not been sufficient to provide the worksheets in advance and stress the importance of preparation. The facilitator must anticipate a large variety of mistakes that can come up as student groups get stuck at various stages of the worksheet. We will produce a detailed solution/lesson plan with each worksheet. In addition, TAs will attend a weekly training session to discuss the key objectives and subtle points of each upcoming worksheet. This ongoing TA-training component will be overseen by our TA coordinator, Pat Averbeck. The solution/lesson plans were prepared during the summer of 2002 by two advanced TAs, who worked with the respective course coordinators. The materials produced can be viewed at http://www.math.washington.edu/~m124/instructorindex.html . The need for such plans was anticipated in our TFT proposal, which included the required TA and faculty summer salary support.

b) A lack of uniformity in the material covered on worksheets may be a source of confusion and concern to the some students. We will not offer a selection of worksheets during Autumn 2002; every section will do the same worksheet on any given week. Once we have assessed the success of worksheets in Autumn 2002, we will intend to provide an alternative instructional syllabus, less dependent on weekly worksheets. This alternative pathway will ensure that each week students have one item (a quiz, a worksheet or a midterm) rigorously graded. By the end of the 2002-03 academic year, there will be two syllabi available for the course.

c) All instructors will be strongly encouraged to make participation in the worksheet sessions a non-trivial part of the course grade. This may be done by giving credit for working on the worksheet, or through the occurrence of worksheet components on future quizzes or exams.

Supplementary Homework. In order to help our students push their envelopes of understanding, a battery of supplementary homework problems was developed. Each homework assignment contained a number of textbook problems, typically relying on basic skills related to the topic, and a more challenging collection of supplementary problems. As an example, here is the sixth homework assignment in Math 124: http://www.math.washington.edu/~m124/source/homework/week6/s6a/s6a.pdf

We discovered a large variation in students' perception of the supplementary homework, as there was with the worksheets. In fact, Question #10 (Tables A1, A2 and A3) displays the largest variation among all the questions in the surveys. During SGIDs (Appendix C), there were again two opposing viewpoints. It is certainly true that supplementary problems make up the most challenging component of the courses. Some students would be happy to see them go away. However, one could argue that forcing students to push their envelopes of understanding on these problems is precisely why, in the end, they have a better understanding of calculus. In any case, we want them to feel that this is a useful component. We plan the following changes for next year.

a) A cosmetic change, which some instructors felt was important, will be to no longer use the terms "textbook homework" and "supplemental homework". Some instructors thought that the term "supplemental homework" might have led to the impression that these were "extra" and not a central part of the course. Each set of homework will consist of a single handout that lists textbook problems and the problems designed by us.

b) We will make sure student expectations are aligned with ours by making it clear that all of the homework is important. The common final exam will be used to motivate this. We will clearly inform the students, from the beginning of the quarter, that multi-step problem solving is a central part of the training provided by the course and that questions testing this skill will be included on the final exam.

Pass Rates. As a final point related to student learning, we include a comparison of student "pass rates" between the last academic year prior to the implementation of any changes, 1997-98, and 2001-02.

Math 124/125 Pass Rate Comparison

 

Course

1997-98*

2001-02*

Math 124

81% (=1375/1693)

88% (=1590/1801)

Math 125

82% (=1048/1281)

85% (=1405/1662)

* Pass Rate is defined to mean the number of students with a grade of 2.0 or higher, the Mathematics Department
requirement for progression into the successor course, Math 125 or Math 126. Fractional numbers in parenthesis
indicate (# students with grade 2.0 or higher) / (# students with a grade between 0.0 and 4.0).

2. Student satisfaction and behavior

We attempted to measure this core objective through the following: learning, student involvement, student commitment, and alignment of expectations.

Learning. We will highlight several key items below. In the aggregate, we feel they point to a sustainable upward trend in student satisfaction with their learning in Math 124 and Math 125.

Student complaints. During the 2001-2002 academic year our Student Services Office fielded only one student complaint regarding Math 124/5. This complaint involved a midterm grading issue. To our knowledge, complaints at the College and University level occurred seldom, if ever, during this time period. We intend this to be the beginning of a long tradition of satisfaction among our calculus students.

Student evaluations. We have tabulated below a comparison of the student evaluation data for Math 124 between 1997-98, the last academic year prior to the implementation of any changes, and 2001-02. We focus on questions 1,3,4 and 18. Question 2 is omitted as it varies with the type of evaluation form used. The scoring system runs from 5=Excellent to 0=Very Poor.

Math 124 Student Evaluation Comparison

 

Question

1997-98*

2001-02*

1. The course as a whole was:

3.6

3.9

3. The instructors contribution to the course was:

3.8

4.1

4.The instructor's effectiveness in teaching the subject matter was:

3.7

4.0

18. The amount you learned in the course was:

3.1

3.3

* The numbers for questions 1,3 and 4 are adjusted scores; the numbers for question 18 are unadjusted. The numbers given are weighted averages (using the count of students who turned in evaluation forms) of OEA data.

Supplementary questions. Responses to Question #12 in Tables A1, A2 and A3 support the view that students are satisfied. We will aim, in the coming year, to tighten the variation on the responses to this question. We point to the results of Question #7 as further evidence of satisfaction with the reform package.

Math 126 survey. In Spring 2002, we surveyed all Math 126 students who had taken one or both of Math 124 and Math 125 under the revised format. The questions and results are in Appendix B. Recall that the format of Math 126 has not been revised: It is taught in lecture classes of size 160 students. The quiz sections are of size 40, and use a 50-minute period for each of the two weekly meetings. The responses to this survey indicate that students find that the smaller lecture and quiz section sizes in the revised Math 124/5 contribute to their learning. (The revised courses are taught in lecture sections of 80 and quiz sections of 27 students.) The additional time spent in quiz section focused on worksheets is not clearly viewed as a benefit. It will be interesting to study this data during 2002-2003, after we make the changes described in item 1 above. We should point out a significant benefit of the 80-minute TA section: Both midterm exams were given during the 80-minute TA section, and this eliminated student complaints and concerns about time pressure.

SGIDs. The results (Appendix C) of the SGIDs, as summarized by Karen Freisem, support our opinion that students were engaged in the courses and taking an active role in learning the material.

Web Resources. One final point on student learning surfaced unexpectedly. The SGIDs found many students commenting favorably on the usefulness of the course web site. An extensive and stable web site is now in place to accompany Math 124 and Math 125. All course materials (aside from the text) are available online, along with an archive of old quizzes and exams. The web organization of the course can be gleaned by visiting the Math 124 homepage at http://www.math.washington.edu/~m124/ or the Math 125 homepage at http://www.math.washington.edu/~m125/ . For example, on the Math 124 homepage, the grid organizes the course by week, highlighting the syllabus (right-hand column), old archived exams (middle columns) and detailed weekly outlines (left-hand column). The weekly outline provides a student guide, and access to the worksheet and homework.

Student involvement. A central belief of our reforms is that smaller class sizes, in both lecture and quiz sections, will lead to an increase in communication and, in particular, to a larger number of question-answer exchanges. Questions #1,2,3 and 4 in Tables A1, A2 and A3 relate to this. We are happy with the ratings for the first three questions. We suspect that the lower ratings for Question #4 are related to our previous discussion of Question #11 in item 1 above; we expect them to improve with the modifications we plan for next year.

Student initiative. We would like to see our students become committed to learning the subject. The survey results on supplementary Question #5 in Tables A1, A2 and A3 are satisfying to us.

Alignment of expectations. It is common for students to not fully understand the expectations placed upon them for success in a course. The results on Question #6 are very positive, but actually somewhat surprising. We might have expected the student displeasure with the problem-solving component of the course, as addressed by Question #10 and discussed above, to bring these scores down.

 

3.Satisfaction of client departments

During the first year of the project we focused on course content, student learning and student satisfaction. The students who took our courses during 2001-02 will begin in 2002-03 to take courses for which calculus is a prerequisite. Don Marshall will chair our Math Services Committee and consult closely with a representative selection of client departments to gauge their satisfaction with the revised courses. We will address related concerns client departments may have.

4.Satisfaction of instructors

Feedback from weekly instructor meetings was very positive. Most instructors felt the smaller lecture class size was an improvement. Most TAs commented positively on the smaller quiz sections of size 27 students. Some TAs thought the burden of teaching a longer quiz section each week was offset by the smaller size of the sections. A few instructors, namely Dave Collingwood and John Sylvester in Math 124 and Jerry Folland in Math 125, ran TA sections themselves and commented very favorably on their experiences. However, we do not expect that faculty will often teach TA sections.

5.Community College connections

One component of our reform proposal envisioned bringing community college instructors to the UW during sabbatical leaves. These visitors would teach one calculus course per quarter, bringing their salary up to 100%. The dialog between the visitors and department members would be of benefit both parties. We had three community college participants: Dale Hoffman (Bellevue Community College), Ted Coskey (South Seattle Community College) and Marina Frost (Clark County Community College). We received some valuable input from the instructors, particularly Dale Hoffman, who spent a good deal of Spring Quarter helping the Math 125 course coordinator create supplementary homework problems. The participants valued the opportunity to integrate into a major university setting, and took advantage of the courses available to audit.

The extent of the difference between our teaching model and the model at community colleges became evident to everyone involved in the exchange. The community college instructors teach more courses per term, but their classes are much smaller. In fact, as one community college participant pointed out, the number of students each participant teaches while on sabbatical leave at UW is about the same as the number he/she would teach in a regular year. Since community colleges typically measure workload by the number of students taught, this has the result that the year at UW does not look quite look like a sabbatical. For this reason alone, it is possible that our "sabbatical program" may not be viewed well. One of the positive outcomes was that the three visitors became aware of the challenges we face in teaching large numbers of undergraduate students while simultaneously engaging in research and graduate education. They found out that the methods they use at community college would be hard to apply in our setting because of the numbers involved. Whether these two cultures can cross-fertilize each other, beyond a sharing of teaching strategies, is not clear.

We held our second annual community college symposium in the autumn of 2001. However, we were unable to attract any participants for the 2002-2003 academic year. Consequently, for the coming year, the funding earmarked for community college participants will be used to hire one-year lecturers who will focus on courses other than Math 124/5, freeing up more of our faculty to teach Math 124/5. This aligns with the department's core belief that involvement of tenured faculty in the teaching of our calculus courses is beneficial to the students, as well as the long-term health of the courses.

We are unsure whether the community college component of the calculus reform should continue in a formal way. We need to cover the teaching that this component was intended for, but this can also be done through a small number of temporary appointments not restricted to community colleges. We would include sabbatical visits by community college faculty when such opportunities arise. An ad hoc approach may be more effective in connecting community college instructors with our calculus program. For 2002-2003, we do not plan another symposium. The difficulties of moving a family make it unlikely that we will attract many community college instructors from outside the Puget Sound region. Instead, we will make a strong effort to create interest in the program through visits to nearby community colleges.


Appendix A
Supplementary Questions Tables A1,A2,A3


Table A1: Math 124/5 Supplementary Questions Results, 2001-2002.
Based on 21 sections of Math 124 and 13 sections of Math 125;
all sections approximately size 80 students. Data gathered by OEA in conjunction with end of quarter student evaluations.
(Key: labeled bar = median; box= 25% through 75% quartiles; line = range of scores. Survey scores range from "7=strongly agree" to "4=neutral" to "1=strongly disagree".)


Questions:

  1. Class sessions (lecture) provided opportunities for student questions.
  2. Class sessions (quiz sections) provided opportunities for student questions.
  3. Time spent in lecture was useful to my learning.
  4. Time spent in quiz section was useful to my learning.
  5. The course encouraged student commitment to learning.
  6. The instructor made efforts to align instructor and student expectations.
  7. The lectures and the textbook worked well together in this course.
  8. The textbook was useful to my learning in this course.
  9. The textbook homework contributed to my learning in this course.
  10. Supplementary homework contributed to my learning in this course.
  11. Worksheets contributed to my understanding of course content. (Leave blank if worksheets were not used in your class.)
  12. I was satisfied with my learning in this course.


Table A2: Math 124 Supplementary Questions Results, 2001-2002.
Based on 21 sections of Math 124;
all sections approximately size 80 students. Data gathered by OEA in conjunction with end of quarter student evaluations.
(Key: labeled bar = median; box= 25% through 75% quartiles; line = range of scores. Survey scores range from "7=strongly agree" to "4=neutral" to "1=strongly disagree".)


Questions:

  1. Class sessions (lecture) provided opportunities for student questions.
  2. Class sessions (quiz sections) provided opportunities for student questions.
  3. Time spent in lecture was useful to my learning.
  4. Time spent in quiz section was useful to my learning.
  5. The course encouraged student commitment to learning.
  6. The instructor made efforts to align instructor and student expectations.
  7. The lectures and the textbook worked well together in this course.
  8. The textbook was useful to my learning in this course.
  9. The textbook homework contributed to my learning in this course.
  10. Supplementary homework contributed to my learning in this course.
  11. Worksheets contributed to my understanding of course content. (Leave blank if worksheets were not used in your class.)
  12. I was satisfied with my learning in this course.


Table A3: Math 125 Supplementary Questions Results, 2001-2002.
Based on 13 sections of Math 125;
all sections approximately size 80 students. Data gathered by OEA in conjunction with end of quarter student evaluations.
(Key: labeled bar = median; box= 25% through 75% quartiles; line = range of scores. Survey scores range from "7=strongly agree" to "4=neutral" to "1=strongly disagree".)


Questions:

  1. Class sessions (lecture) provided opportunities for student questions.
  2. Class sessions (quiz sections) provided opportunities for student questions.
  3. Time spent in lecture was useful to my learning.
  4. Time spent in quiz section was useful to my learning.
  5. The course encouraged student commitment to learning.
  6. The instructor made efforts to align instructor and student expectations.
  7. The lectures and the textbook worked well together in this course.
  8. The textbook was useful to my learning in this course.
  9. The textbook homework contributed to my learning in this course.
  10. Supplementary homework contributed to my learning in this course.
  11. Worksheets contributed to my understanding of course content. (Leave blank if worksheets were not used in your class.)
  12. I was satisfied with my learning in this course.


Appendix B
Math 126 Survey Table

Table B: Math 126 Supplementary Questions Result, Spring 2002.
Based on 3 sections of Math 126;
all sections approximately size 140 students. Data gathered by OEA in conjunction with end of quarter student evaluations.
(Key: labeled bar = median; line = range of scores. Survey scores range from "7=strongly agree" to "4=neutral" to "1=strongly disagree".)

  1. The Monday/Wednesday/Friday lecture class size in Math 126 (160 students) contributed to student learning.
  2. The Monday/Wednesday/Friday lecture class size in Math 124 and Math 125 (80 students) contributed to student learning.
  3. The Tuesday/Thursday quiz section size in Math 126 (40 students) contributed to student learning.
  4. The Tuesday/Thursday quiz section size in Math 124 and Math 125 (27 students) contributed to student learning.
  5. The Tuesday/Thursday quiz section time in Math 126 (50 minutes + 50 minutes) contributed to student learning.
  6. The Tuesday/Thursday quiz section time in Math 124 and Math 125 (80 minutes + 50 minutes) contributed to student learning.

Appendix C
Small Group Interactive Diagnostic Summary Reports

During Autumn 2001, Winter 2002 and Spring 2002, CIDR conducted SGIDs on ALL Math 124 and Math 125 sections. Karen Freisem of CIDR wrote up detailed anonymous summaries of these sessions which are available here:

Autumn 2001 SGID summary
Winter 2002 SGID summary
Spring 2002 SGID summary



Appendix D
Goerss Report (June 1998)



Ad Hoc Committee on Calculus
June 1998


In the fall of 1997, Doug Lind, Chair of the Mathematics Department, for med an Ad Hoc Committee on Calculus to review the Math 124/5/6 sequence and to recommend ways to improve calculus instruction. The other versions of calcu lus taught by this department (Math 111/2 and Math 134/5/6) are not part of thi s review. The committee consisted of Paul Goerss (Chair), Ken Bube, Ramesh Gangolli, and Don Marshall.

After a transition period in the early 1990s, this department began teac hing the main calculus sequence for first-year student using locally produced materials, sometimes supplemented by paperback workbooks. As this system ha s been in place for sometime it was time for a review of the Math 124/5/6. Th e questions before the committee included:

1.)
Are we teaching the right kind of calculus? The current system emphas izes mathematical modeling and word problems. Is this best emphasis?
2.)
Are the topics and ideas we now cover best for our client departments ? Are they good for the math department?
3.)
Are the instructional materials the best possible?
4.)
What is the level of instructor satisfaction with these courses?
5.)
How can we improve instruction?
In order to answer these questions, we interviewed members of the client departments, senior administrators concerned with undergraduate education, the faculty of the m ath department, the graduate students in the math department, and, with the aid of Thomas Taggert and Ken Etzkorn, we held student focus groups to try to get an accurate picture of the student experience.


Contents

1.
Summary of Results of Interviews
(a)
Physical Sciences
(b)
Engineering
(c)
Life and Behavioral Sciences
(d)
The Drop Policy Committee
(e)
Debra Friedman and Fred Campbell
(f)
Mathematics
(g)
Student
2.
Conclusions on the State of Calculus
3.
Recommendations
(a)
Summary
(b)
Calculus for Physical Sciences and Engineering
(c)
New Courses
4.
Toward the Ideal Calculus


1. Summary of results of interviews


In deciding who to talk with about our calculus program, we began by making a list of who took Math 124 and what majors they eventually graduated with. Then we looked at the departments and programs with large representation. Some, such as English and Music, simply reflected the fact that these are popular majors. Discarding these, we talked with members of the following departments, offices, and programs.

a. Physical Sciences

In Chemistry we talked with Professors Mike Heinecky and Leon Slutsky. The former is chairman of the undergraduate program committee, the latter a physical chemist. Surprisingly, chemistry in general uses little calculus. Physical chemistry uses a great deal, often couched in notation we would find vague and confusing. Professor Slutsky concluded that the best service we can supply these students is training in mathematical sophistication. The chemistry department in general is deeply aware of the great range of students on this campus, and strongly supports the efforts of this department to teach sophisticated first-year courses. Professor Heinecky did mention the Mathematics Study Center, calling it a ``class operation'' and mentioning that Chemistry had adopted the model for its own study center.

From Physics we received a report from a committee consisting of Professors Oscar Vilches (Undergraduate Program Director), Vic Cook, Steve Ellis, and Stamatis Vokos. They need a lot of calculus, often earlier than we can possibly supply it, but in general they were not dissatisfied. They would definitely like vectors introduced earlier, and would certainly not like to see multi-dimensional material moved from the first to the second year. In general, they were supportive of the idea of introducing mathematical concepts in the context of applications, as they hope their students will be adept at this skill.

b. Engineering

Perhaps our most illuminating interview was with Professors Uy-Loi Ly and Adam Bruckner of Aeronautics and Astronautics. Professor Bruckner is the Undergraduate Program Advisor for that department. The meeting began with criticisms of calculus. Professor Ly felt the students were deficient in various routine skills, and Professor Bruckner was critical of what might be called standard, old-fashioned calculus courses. Upon examining the Koblitz notes, however, they ended by praising what we were trying to do with the emphasis on word problems, applications, and modeling. This experience emphasized to us the value of communication with other departments - by the end we had their sympathy and support. We did, however, continue to hear lurid tales about the inability of many students to do even basic differentiation and integration.

We also talked with Professors Per Reinhall and Duane Storti from Mechanical Engineering. Reinhall is the chair and Storti a member of the committee that oversees the second year introductory engineering courses. They also underscored the importance of problem solving skills.

An examination of the second-year engineering texts was very illuminating. From the very start, the students are asked to do calculus in the setting of concrete applications - in particular, they must be conversant with the language of vectors. If the books are any guide, these courses are quite difficult.

From Computer Science and Electrical Engineering, we had an extensive e-mail communication from Professor Paul Beame. Their concerns were more with various kinds of discrete math.

At about the same time, Jim Morrow talked with Professor Jim Reilly, chairman of Mechanical Engineering, who had some scathing criticisms of the calculus course we taught ten years ago (and which he thought we still teach), and of the differential equations course we now teach. He said, among other things, that differential equations should be taught by the people who use them. Indeed, from all the engineers we got the sense that our Math 307/8/9 sequence could use a thorough revamping. In light of a national trend for engineering schools to absorb these classes into themselves, it behooves us to pay attention to this warning.

Finally, we talked with Dave Prince of the Minority Students in Engineering Program. Deeply aware of the needs of his students in the second year engineering courses, he is very supportive of the emphasis of word problems and applications. In general he is very supportive of the emphasis and direction of our current notes. However, his students find our current course materials difficult, or even impossible, and Dave has written an extensive supplement of his own for their use.

c. Life and Behavioral Sciences

On different occasions we met with Professors Johnny Palka, Tom Daniel, and Gary Odell of Biology, and Professor Mark Cooper, chair of the Zoology undergraduate program committee. While no concrete proposals were made, the first three seemed to agree that a two-quarter calculus sequence emphasizing biological examples and including some multi-variable techniques would sit very well with their students. They also agreed that such a course would be mostly to make the students happier, and not necessarily make them better biology students. Mark Cooper seconded this last thought, and it was from him that we had a warning about not diluting fundamentals. All four were pleased we talked with them and would welcome further dialogue.

From Biology, we also talked with Joyce Fagel, head undergraduate advisor. While very polite, she was highly sceptical of our current calculus, as she perceives a high failure rate among otherwise good students. (We have a hearsay report that Dean Hunt, of the medical school, has expressed a similar sentiment: too many otherwise good students are derailed by calculus.) She has warm things to say about the QSci 291/2 sequence. We also talked with Jay Johnson, Professor of Wood and Paper Science, who teaches that sequence. It was from him, among others (see part d. below), that we heard the idea we are regarded, on campus, as being unresponsive by not addressing the needs of life science students.

We talked with Professors Beth Kerr (Vice Chair) and John Miyamoto (head of the quantitative group) of Psychology. Their requirements are difficult to summarize and even more difficult to fulfill. A large proportion of their students enter the university thinking they will be business majors; thus, for better or worse, they accept Math 111/2. What they really need is some mixture of statistics, probability, and linear algebra.

At a later date we also talked with Bus Hunt, professor and a former chair of the psychology department. He offered his expertise in developing placement and gateway tests.

d. The Drop Policy Committee

During this process, Paul Goerss and Brooke Miller were asked to meet with the University's Oversight Committee on Student Services and Administrative Changes, known as the Drop Policy Committee for short. We were asked a number of questions about our drop rates (which do not deviate much from the national norm), why we don't teach in small classes, what we were doing in response to administrative changes, and so on. We were invited to make a radical proposal to improve our classes in general and our calculus courses in particular. However, a significant portion of the meeting dwelt on the question of why we don't offer some calculus course more appropriate to life and behavioral sciences. Even members of the committee, such as Jerry Gilmore, the director of the Office of Education Assessment, who were sympathetic to strains on our program, wondered why we were tardy in doing this. Among the committee members were Jay Johnson, who waved away the idea that there might be some conflict of priorities with the QSci program, and an undergraduate, a biology major, who was openly hostile to our department. She was, not to put to fine a point on it, sarcastic, patronizing, and rude. If she reflects the general opinion of our department among biology students, we have trouble.

e. Debra Friedman and Fred Campbell

Of the University's top level administrators, these are the two most concerned with undergraduate teaching. Debra Friedman is the Associate Provost for Academic Planning and Fred Campbell is the Dean of Undergraduate Education and Vice Provost. We met with them separately, but both meetings began with the assertion that Campbell's office gets more complaints about first-year math courses than all other entry-level courses combined. Feeling that a systematic review of these complaints would be valuable to the work of this committee, we asked to see them, but Campbell said he doesn't actually keep them on file after he deals with them and that, in fact, many were not written. (There are only two in Doug Lind's files.) Nonetheless, Campbell and Friedman were happy to summarize the substance. The salient points, according to them, were these: 1.) the calculus courses we teach are too different from what students expect and the students often misjudge how prepared they are; 2.) students with good credentials often do badly; 3.) the math faculty is not respectful of the students - in particular, we are not interested in student success; 4.) math courses are as much a ``screen'' as an intellectual endeavor; 5.) the approach is objectionable - specifically, students complain about the huge leap in difficulty, the lack of a text book, the difference between exams and class, the lack of easier problems building to the hard ones, and the large lecture/quiz section format; and 6.) old study habits no longer work. Many of these complaints, whatever their source, could be addressed by better screening the students and better informing them of what to expect. Both Campbell and Friedman underscored the importance of this, and both offered resources to make it work. Fred Campbell specifically mentioned that we could change the placement tests and if we needed the approval of the HEC board, he could arrange it. Campbell strongly suggested we think about other kinds of calculus. Both Friedman and Campbell solicited a radical proposal from us, one that ``takes some risks and allows for experimentation.'' They suggested that the President and the Provost would look favorably upon such a proposal. Both also invited us to work with them. The influence of these two administrators is enormous, and an effective partnership with them or their successors could yield enormous benefits.

f. Mathematics

In the fall we solicited the comments of the faculty of the math department. We got a large number of responses, ranging from detailed criticisms of the syllabus, to polemics for or against the current system. Rather than try to build a consensus where none seemed evident, our major conclusion is that we needed introduce more flexibility in the system. Hence one of our major recommendation is for greater independence, within carefully prescribed boundaries. Other criticisms centered on the extremely tight grading schedule of the common final. Perhaps the one comment on detail we heard the most often is that there is need for many more and different problems, that currently our problems are all of a type and neglect some fundamentals and other aspects of calculus. It is also possible to learn the type of problems without learning calculus. Other remarks addressed topics that have been omitted, but should be included. There were a number of such, but several people pointed out that in Math 307 the students are assumed to have a working knowledge of limits and continuity.

One of the main questions we set out to answer, was the following: Why are so few professors volunteering to teach calculus? The responses were varied. Certainly large classes, low pay and ambiguous teaching evaluations are all factors. However, there were a variety of responses to the effect that the problem wasn't calculus itself, or even calculus in large lecture format, but the rigidity and style of the current system. Among other remarks, we had echoes of Debra Friedman's sentiment that we don't respect our students.

We also sought the opinion of the graduate students. Larry King gathered a group of students who, in turn, went around and interviewed every graduate student in the department. As can be imagined, the results were widely spread. In general, though, there is a substantial preference for increasing the amount of drill and the amount of theory in our courses, and at least half of the respondents were in favor of using fewer word problems. Moreover, the grad students were nearly unanimous in agreeing that potential math majors are not being well-served by the current program. Indeed, a majority of grad students who responded stated that, had they been undergraduates in the current U.W. program, they would not have chosen to go into mathematics.

One aspect of the current program that was regarded as a success by almost everyone in the department is that Math Study Center. This corresponds to remarks we heard from others on campus, most notably from the undergraduate advising office.

g. Students

We tried various ways to gauge student responses to our calculus courses, but, finally, we resorted to focus groups, run by Tom Taggert, Assistant Director of the Office of Education Assessment, and Ken Etzkorn of Undergraduate Education. There were two groups of students: one had recently completed a calculus class, and the other had done so some years earlier and were using it their majors. There was a cross-section of abilities, but we excluded students with final grades below 2.0. There were nine students in the former group and six in the latter. These groups are very small, and the results should be balanced by other means, perhaps by follow-up groups. These focus groups were held on May 12 and 13 and we received the report on May 22.

First, both groups of students felt that story problems were important and were not critical of that approach. They felt the emphasis on them should continue.

Second, in contrast to the ratings on the student evaluations, the general feeling was that the present text for Math 124/5 was adequate, but would be greatly helped if it could be cross referenced to a good, standard, more traditional text that included additional explanations and problems. (This was a spontaneous suggestion, not one we included in our questions as a possibility.) This would take care of several objections to the current text:

1. Not enough examples, sample solutions, and explanations.

2. Difficult to use as a reference. Students complained about having to read the entire chapter in order to find the point they were particularly interested in. An index would be helpful here.

3. Dense type-setting.

This would also speak to student's concerns that they have a reference that they could keep, and use easily in the future. An $80 price didn't seem to bother them, assuming the text would be used for the whole sequence.

Third, there were a number of comments about the Math 126 text. Specifically, some students felt that there were not enough problems, and that some of the materials could be easier to read.

Fourth, several students mentioned that it was nice having a smaller text.

Fifth, student misunderstand the point of the common final, and there is a myth that the final is written by a small number of the instructors, giving an advantage to the students of those professors. Whereas in fact problem submissions come from all instructors and the exam is compiles by someone not instructing the course in that quarter.

Finally, the student reaction to the TA sections was very mixed. Some said the TA was better than the lecturer. Others regarded the sections as basically ``busy work''. This perception seemed to be independent of what the TA actually did, whether it be going over homework or worksheets. Indeed, worksheets not fully integrated into some sort of lecture drew very mixed responses from the students. Even quizzes drew mixed responses. Unless they were graded and handed back very quickly, students felt they were not performing the feed-back function we'd like them to fulfill. (As a side note, an early, hard quiz designed to help the students gauge their chances of success in the class is regarded, instead, as an attempt to ``scare'' them out of over-full courses.) One of the major recommendations of these focus groups is that there should be more TA training. This may not be practical or even advisable, but this recommendation is a reflection of student perceptions and sentiment.

2. Conclusions on the state of calculus

First, the form of our current calculus is highly suitable for students going into engineering and the physical sciences. Beyond basic calculus techniques, the most important skill these students need is the ability to model real-world problems and the current emphasis on this skill in our calculus class serves them well. However, the percentage of such students in our Math 124/5/6 sequence is not as large as one might think. Roughly the same number go into the behavioral and life sciences, and these students might be better served by a different mathematics track, one that might not even be entirely calculus. We also note that one department that might not be so well served is mathematics, for the art and rigor of our subject is de-emphasized in the current version of calculus. At the level of instructional material, we did hear from a variety of sources that all students would benefit from working a greater variety of problems than we now supply. This would include, but not be limited by, more problems that are purely mathematical or even manipulative in nature. As one engineering professor put it, ``They can model okay, but they can't integrate sin(2x).

Second, the other members of the university community have only a hazy idea of what we are doing and why we are doing it. A number of the people we talked with had a very clear idea of what our calculus was, and it was false; indeed, these ideas more suitably described what calculus was like when they took it. Another common perception is that we should face the biology clientele more squarely. And, with the current scrutiny of ``high demand-high drop'' courses, we are marked across campus as teaching one of the problem courses. Most people recognize that we have a difficult job, but it is probably fair to say that these same people think we are doing a tough job in a mediocre manner. Whether or not we are providing a good service, we are not necessarily seen as doing so. There is a need for communication and outreach. As a side note, everyone we approached was pleased and happy to talk to us.

Third, there is a certain amount of dissatisfaction in this department with teaching calculus. This has many sources. For example, the large lecture sections and concomitant student incivility is draining to many people, as are the poor skills and unrealistic expectations of many of our students. The TA/Professor relationship can range from trying to rewarding without much predictability. However, one central complaint turns ultimately on the following point. For many of us, learning calculus was a central intellectual experience, one that informed the direction of our lives. We have taught it often and many of us have loved it. The current text and materials do not let us, in our own ways, express what we find beautiful about the subject. In sum, faculty and graduate student morale would improve considerably if there were more freedom and independence in the curriculum.

Finally, the largest impediment to teacher and to student satisfaction is the poor preparation and unrealistic expectations of our students. Our classrooms hold an incredible mixture: students newly out of high schools, transfers, returning students, and so on. The first group - those newly out of high school - is surprisingly small, as over 40% of the students on campus are transfers, and the trend is for these students to postpone their mathematics until arrival here. (Math is seen as hard and adversely affecting qualifications for admission.) Many have not had math for several years and even those right out of high school may not have taken math in their last year. The skills tested on the placement test are very different from what we expect our students to be able to do and someone with a three-year-old community college credit for Math 120 (and who is thus eligible for 124) can easily have forgotten many fundamentals. The level and amount of work we expect from our students is far higher than anything they've ever seen before. And yet the students think that an adequate score on the placement test or transfer credit should be a guarantee of success. The dissonance that results from thwarting this expectation is enormous. By some estimates, as many as a quarter of our students do not belong in Math 124.

3. Recommendations

Before detailing our recommendations, this committee would like to reaffirm the commitment of this department to high-quality calculus courses emphasizing word problems and mathematical modeling. Such a course is necessarily difficult for many students, but an easier course does neither the students nor client departments the service they need. There are many ways to try to keep the standard up, but none will be effective without widespread support or without a commitment by the regular faculty to teach the class. A course taught be a jumble of adjunct faculty or disaffected professors will necessarily be of less than the highest quality.

a. Summary of Recommendations

b. Physical Science and Engineering Calculus

A primary recommendation of this committee is to better integrate the syllabus of the basic service course sequence consisting of the five quarters 124-125-126-307-324. These courses should be regarded as a single, coherent stream, and the computer adjuncts 187 and 387 should be integrated into this stream. This department needs to collectively decide on the content, order of topics, and emphasis for these courses. This examination should begin immediately and it should heavily involve the client departments.

Linear algebra probably needs to be thought about also, but that's a topic for another day.

Here are some specific recommendations on the mechanics of the course.

First, we would respond to the desire for more flexibility in teaching calculus. This would consist of three points: improving and expanding the texts, a loosening of the syllabus, and a moderation of the common final. We emphasize, however, that we must maintain the emphasis on mathematical modeling, which means, among other things, that teachers would be expected to address and assign a significant number of hard word problems. Second, we would also immediately begin to address the problem of assessing student preparation and expectations. Third, we recommend the immediate revival of the Math Services Committee as a vehicle for communication with other departments about these and all our courses.

As far as we can tell, this department is deeply divided on the subject of textbooks for calculus. A lengthy open meeting on a draft copy of this remark did very little to resolve this issue. Some of that ambivalence is shared by the members of this committee. On the one hand, locally developed notes are concise, focused, cheap, and make the course easy to explain to client departments. More specifically, there is no doubt about what is to be covered. On the other hand, a published text is flexible, does not need constant maintenance by members of the department, and could easily be adapted to a year-long sequence for the 100 level courses. We recommend that the department experiment with and then choose one of the following two courses of action.

A. The current notes for 124/5 and, perhaps 126, could be thoroughly reworked and expanded. This could include, but not be limited by, rewriting, re-type setting, indexing, and the addition of some topics and problems. What we have in mind here is the model that was successful in Math 120: the project was begun by one faculty member and carried forward by another. The Math 120 notes continue to evolve on a quarterly basis through frequent instructor discussions of the material. Ken Bube has agreed to work on this, and Ramesh Gangolli has agreed to help. Both feel that there is enough support in the department to start, but to proceed beyond a certain point they would want the guidance of a syllabus committee to proceed, and an explicit agreement in advance that product produced would have to be thoroughly vetted by the rest of the department before going into widespread use. These notes could be cross-referenced to a standard text; however, we note that past attempts at multiple texts haven't worked well. The time estimate is that it would require about a year's worth of work for each of the 100 level courses. There are funds on campus for such projects.

B. The department could choose a published textbook that is mathematically clear and precise, has a significant number of applications, has a wide variety of problems of all levels of difficulty, including many word problems in sections that are, on the face of it, not directly concerned with applications. Some areas of application should be developed early and returned to repeatedly throughout the book. It is difficult to recommend any one text without having used it. Therefore, we would recommend a pilot program using such a text for the year 1998-99. We note that there are texts that are not completely incompatible with the current course we teach, and it would be possible to write a common final of the type we suggest below that covered both the current and experimental versions. Robin Graham and Dan Pollack have tentatively decided to carry out such an experiment in Math 125 in the Fall of 1998.

Whatever the choice this department makes, we would like to see each syllabus pared to eight weeks, leaving two weeks free and at the discretion of the individual instructor. However, we would expect that any new syllabus would supply detailed examples on the type and difficulty of word problems that we would expect any successful student to be able to do. The new syllabus should result from examination process suggested above. As part of this development process, it might make sense to have a period of experimentation, wherein interested professors to try new ideas and approaches.

This forces a change in the common final; in a word, it could not be completely common. However the common final is a very effective method of enforcing the syllabus and for defending the instructor against the pressure to teach an easier course. Therefore, we suggest that 75% of any final be in common, and the the other 25% at the discretion of the instructor. There are some logistic difficulties to this proposal, of course, but we have given it some thought and believe it is feasible. We also recommend that the grading period be slightly lengthened - the current Saturday night sessions are draconian to many - and that there be more flexibility in the types of problems considered. The current finals are very stylized, and in some ways very predictable. This could start immediately.

To address the problem of getting students up to speed in a course that is appropriate for them, we have two suggestions. One is to change the placement test. The current test is not very different from an SAT test and is not suitable for our students. Fred Campbell has indicated that we could design and implement our own test. We are told that the university would help us distribute sample tests to incoming students, including transfers, and to high schools. The test itself and the active dissemination of it contents - Debra Friedman even suggested advisory mailings to new students and high schools - could have a very significant impact on student expectations and the design of prerequisite classes in high schools and community colleges. The second suggestion is to implement a sequence of proficiency and diagnostic tests that the students could take to gauge their abilities. These last could be bought - the University of Nebraska has a battery of on-line tests that would be suitable - and they could be expected of all students.

c. New courses

We suggest the introduction of two new calculus sequences, the first intended for the behavioral and life sciences, and the second - which we envision as much smaller in enrollment, but not in importance - would be intended for students interested in calculus as mathematics.

The largest single program on campus is biology with, in 1997-98, roughly 1850 students in the biology, microbiology, zoology, and botany majors. Furthermore, there are about 400 biochemistry majors and 600 psychology majors. By contrast there are roughly 600 majors in chemistry, physics, and mathematics combined, and 2700 in all the engineering majors. One of the main questions we set out to address was how well this cohort of biologists and psychologists was served by our current calculus.

There are several ways to answer this question. Concentrating on biologists for the moment, these students need certain mathematical skills, including math modeling skills, which our current calculus certainly supplies. They also need certain concepts from statistics and probability which they currently obtain from 400 level QSci courses. So, in some sense, we are doing our job. Nonetheless, the students feel badly used, complaining that they are forced into a mold that doesn't fit them. They vastly prefer the QSci 291-2 sequence, often stating explicitly that they like the biological emphasis of the examples. And, to be fair to them, there is probably more material in the 124/5/6 sequence than they need. Finally, many people on campus look at our block of 24,000 student credit hours in calculus and wonder why we can't break it up to serve this clientele.

We are told that biology majors arrive on campus as such, and rarely change to other scientific majors; hence there would be no pedagogical harm in targeting this audience. Psychology is a different matter, in this regard, as many of these majors arrive late to awareness of Psychology as an intellectual discipline; nonetheless, they may be well served by a different calculus as well.

For all these reasons, we recommend developing a course with this audience. Part of the development would be discussing with thasier'' class, and the biologists would be upset if we neglected certain fundamentals.

Any such course should only be developed with thorough consultation with the client departments. We recommend beginning this process as soon as possible.

We also recommend a calculus for mathematicians, perhaps with a slightly higher entrance requirement than our current Math 124, but without the stringent requirements of Math 134. The target audience would be bright, interested students who may not have a strong calculus background. Presumably such a course would be easy to develop and there would be any number of volunteers to teach it.

This ``mathematical calculus'' could have several beneficial effects. The first is that we notices that very few math majors are created by the current hones sequence: at most one or two a year. Designing a good calculus sequence that would appeal to a broader range of students should increase the number of students who are interested in majoring in mathematics, and who are better equipped to enter the ACMS major. Certain physics majors would also easily profit from such a class. The second benefit of a mathematical calculus would be that we could put here the rigor and machinery needed or wanted by certain students while, at the same time, orienting the basic calculus courses in the direction of the client departments. This could give us more latitude to demonstrate to these departments that we are responsive to their students.

4. Toward the ideal calculus

Postulating infinite resources and an ideal world, we would offer calculus as follows. First, we would have an extensive screening and placement system to make sure students are in the right class. Second, we would teach in small classes - no more than twenty-five students. The class would consist of two parts: a four-credit course meeting four times a week, plus a one-credit three-hour ``lab" which would not do homework, but would use worksheets, group work, computer modeling, etc. The model, of course, is a science lab and, as with most science labs, our lab would have its own syllabus and agenda and students from any lecture could register for any lab. (A by-product of this approach would be a week-by-week enforcement of uniformity among lectures.) Labs could trail lectures by a few days to allow lecture instructors some flexibility. Third, we would have on hand an extensive battery of materials - quizzes, worksheets, proposed group projects, exams, interactive computer workouts, and so on - to encourage a variety of teaching techniques and experiments. Indeed, we would do everything possible to encourage an atmosphere where each instructor would seek to teach the course best suited to his or her talents, inclinations, and strengths. Fourth, we would have a wide variety of faculty and graduate students involved in calculus. In short, we would make the teaching of calculus in this department into a living, dynamic process, with broad involvement.

Fred Campbell, Debra Friedman, and Nancy Kenney have all invited us to make a ``radical proposal'' for teaching calculus. The calculus program envisioned in the previous paragraph would certainly be radical. We recommend that this department put together a proposal to find the resources for such a program, using the experiences of the University of Michigan and the University of Nebraska as a guide.

The fundamental obstacle to this program is one of personnel. We emphasize that with the level of freedom we would like to grant individual instructors, we would require successful, experienced mathematicians, or highly-motivated, closely supervised graduate students. It would take about 225 twenty-five-student sections to teach our current Math 124/5/6 sequence. For comparison, it would take 160 forty-student section, and we now have roughly 40 calculus sections, each with a lecturer and two graduate students. There would also be a need for support personnel - staffing the study center, collecting and maintaining materials, including computer materials, enough competent graders to correct the homework accurately, and so on. There would also need to be a faculty member to oversee the entire program, to prevent descent into anarchy.

We make this recommendation knowing full well that, as part of this proposal, this department would have to offer something. We could not expect, for example, that the university would fund a battery of teaching AAPs simply so that we could teach in small classes. The exact nature of what we would be willing to offer and what we could expect in return is something for this department as whole to decide. But we are very aware that the status quo will not serve. If we continued to be perceived as stagnating, aloof, disinterested in our students, and generally doing a mediocre job, we feel certain that this department will fare poorly.


Appendix E
Changes as of September 2000

There are a number of changes we've made already:

According to the Department Ratings Summary, prepared by the Office of Educational Assessment, for the period Autumn 1998-Summer 1999, the adjusted mean rating for 100-200 level Math Faculty on ``The instructor's effectiveness in teaching the subject matter" was 4.21 (52 classes). This rating was higher than the average for the sciences (4.08) and higher than the average for the University (4.08). Note that we do not offer 200 level courses, and that essentially all of our 100 level classes are precalculus and calculus. The rating for ``The course as a whole" was slightly lower than the average in the Sciences and the University, but there are many aspects of these courses which are not under the control of the instructor, such as the text and syllabus, and thus this rating should not be used to evaluate instructors. Most of the changes (except in Business Calculus 111-112) listed here had not yet taken effect at the time of these ratings, so we expect that this latter rating will rise.


Appendix F
Tools for Transformation Proposal

Calculus Proposal


During the academic year 1997-98, the Math Department conducted an extensive review of its calculus program, including focus groups of students and faculty, surveys of teaching assistants and faculty, and interviews with selected client departments and administrators (Appendix A). In 1998-99, we visited a number of mathematics departments around the country in order to identify ``best practices'' used elsewhere. Last year we experimented with many of the better ideas and suggestions developed over the previous year. At the same time we began implementation of many of the recommendations of the calculus review committee (Appendix B). The change proposed here involves significant contributions from the department in terms of increased teaching load, and from the administration in terms of new resources.


Recommended changes to the class format of the first two quarters of Calculus:

Why support smaller classes in mathematics? Math is like a foreign language. Interactive communication is necessary for better teaching. There is a lot of information and technique that must be covered in a small time slot. Students must follow or create a sequence of logical deductions, and many will get stuck at very different places. If you miss a point you may be lost for much of the lecture. But if you have a chance to ask a question, you may get around your difficulties or discover where you need to review prerequisite material. Asking questions is clearly easier in a small class.

English composition courses in some sense provide a similar service role for arts and humanities students as our entry level courses provide for science students. The total enrollment in English composition courses is approximately the same as entry level math classes, yet they are limited to a maximum of 22 students per class. Small classes are also found in foreign language classes.

The smaller lecture sections will allow more flexible formats. For example, one configuration would be a faculty member running the lecture plus one of the quiz sections, while a TA runs the other two quiz sections. This will result in closer contact between the faculty member and at least a portion of the class. We expect that this might have a positive effect on the atmosphere in the lecture section since these students would be more familiar with and hence more comfortable with the faculty member. Organization and synchronization with just one TA would also be easier for the faculty member. Some of the faculty in the past have left the organization of the quiz section up to the TA. In this model, the professor will be more intimately involved. Other benefits might accrue to the students who will in some cases have regular class meetings with full professors in small (27) classes.

Another advantage of smaller classes is increased access. There will be more sections offered at more times through the day. Currently if there are more students needing a 10:30 calculus class, we have to decide if there are enough to warrant adding a full 160-sized class. This is easier to do with size 80. Another way to put it, instead of having to choose to add a 160-sized class at either 9:30 or 10:30, we can put a size 80 class at both. Smaller classes are also easier to add just before classes begin if the demand is there. We can also add one more quiz section to a lecture without much difficulty.

One of the main objections by faculty to teaching calculus is the anonymity of students in large (160) lecture sections. A quick glance at the enclosed table of available classrooms (Appendix C) shows that few are of the size of our current calculus lectures (160). This has led to using even larger rooms, and thus greater distances between the lecturer and the back of the audience. The oft-heard reason for top-notch Washington high school students choosing schools other than UW is the size of classes. We have brought a number of high school teachers on campus this year to discuss their concerns. Some have volunteered that they advise their students to either go to Universities with smaller classes or to take their introductory math at community colleges where they can get more individual attention. Last year we experimented with size 25 (Math 124), size 50-70 (Math 144-145), and size 80 (Math 125) and two hour quiz sections (Math 144-145, Math 124). The instructors were uniformly enthusiastic about the benefits.

Here's a table comparing UW student evaluations in our small classes this year versus large classes 95-99. The ratings are ``unadjusted'' since data prior to last year did not have adjusted means.

Item #3
(``instructor overall'' or ``instructor contribution'')

Professor

Large Classes

Small

 

95-99 average

99-00

P. S.

2.50

3.63

S. T.

2.89

4.40

K. P.

3.73

4.55

H. S.

4.04

4.17


Item #18 (``amount learned'')

Professor

Large Classes

Small

 

95-99 average

99-00

P. S.

2.71

3.00

S. T.

2.93

3.66

K. P.

3.48

3.85

H. S.

3.80

3.75

The adjusted mean in all of these ratings are higher than the unadjusted mean. See also Questions #3 and #6 in the Autumn and Winter Math 144-145 class survey (Appendix D) showing that the students like smaller classes. That same survey shows very favorable comments by the students about the longer quiz sections, Questions #4, #7. The students were very happy with this change even though it meant more class time without additional credit. The students in Math 144-145 (Calculus for Biological Sciences) performed so well that the instructors (H. Smith, S. Tuncel) were not able to keep the mean grades as low as our traditional mean (2.7-2.9). The faculty and students were enthusiastic about this new class partly because of the format and partly because the material was geared toward the students' interest in Biology, without compromising the difficulty of the course.

In our visitations to other universities we found good pedagogical results obtained with a variety of techniques. Having the students work together in small groups during the TA's quiz section can be managed by one instructor only with small classes, according to faculty at several of the schools we visited. This agrees with an experiment in precalculus done here several years ago. For example, a group can work together on a common ``worksheet'' that leads them through the major ideas in a particular lesson. This has greater pedagogical effect than simply having the TA answer questions on homework. The testing and development of worksheets takes a lot of time, as we saw when observing the implementation in Physics classes by Lillian McDermott's group. Part of the proposal is for a significant effort to develop worksheets and to fine-tune the new syllabus for our new text, including extensive testing during Spring and Summer 2001, by teams consisting of 1 faculty and two teaching assistants, one for the first quarter of calculus (Math 124) and one for the second (Math 125).

Many math departments around the country are moving to smaller classes, though usually much smaller than 80: Minnesota, Michigan, Arizona and Maryland, for example. What we like most is the enthusiasm of our instructors who ran the small experimental classes. Ken Plochinski was one such instructor who had to go back to a size 160 class last spring. He remarked that he can't believe how much worse it is than size 80.

Part of the proposal is to provide partial salary support for community college teachers so that they can spend their sabbaticals at the University of Washington. We are required to accept precalculus and calculus transfer credits from Community Colleges. Thus it makes sense to ensure that their courses are equivalent to ours and to work with the community college teachers to ease the transition for students from community colleges to the UW. If 40% of UW students are transfer students, certainly a large number are coming to UW math classes from the community colleges. We will run weekly seminars where faculty and community college teachers will present the techniques and materials they use in common courses. We will also have faculty discuss the material students would be required to know in subsequent courses to calculus at the UW. The community college teachers who needed additional financial support would gain first hand experience with our precalculus and calculus courses. We would benefit greatly from their ideas and suggestions for improvement, since they have a lot of experience teaching these courses. I had email conversations with a number of very interested community college teachers. Shannon Flynn, Chair of Sciences at Shoreline Community College, was very excited about the possibility and would encourage her math faculty to participate. In fact she had already planned to do something similar for her own sabbatical before taking her current job. This outreach program will also provide the opportunity to community college teachers to ``reconnect'' with mathematics, to rekindle their interest in mathematics through attending seminars and advanced courses, or working directly with a faculty member.


Implementation

Department Contribution

Administration Contribution

The department and administration contributions are roughly equal: 50 faculty will average a 10% increase in teaching load (2.9 to 3.2 units), which is equivalent to 5 FTE. Five TA positions are equivalent to 2.5 FTE, so including the two positions devoted to sabbatical supplements, the administration would contribute a total of 4.5 FTE. This proposal is limited to the first two quarters of calculus because of the associated costs.


Development

Summer 2000: Hart Smith and Dan Pollack developed suggested homework sets and continued to improve the new syllabus for the new text: Stewart, Early Transcendentals, for 124 and 125. The emphasis on applications problems will set the tone for individual instructors in the autumn quarter. It is important to keep the emphasis of the course on applications, as needed by the client departments. Each quarter thereafter, the syllabus will be revised to reflect the experiences fe autumn and winter quarters, the committee will construct seven basic worksheets for math 124, and seven for math 125 designed to be used in the extended-length quiz sections. Work will also be done on sample proficiency (skills) tests and quizzes. During the spring quarter, these materials will be tested in classes, reevaluated and rewritten by the committee. A second iteration of this process will occur during the summer. We will not be able to test the worksheets completely, since they will be designed for 75 minute quiz sections, yet the quiz sections during the spring and summer will only be 50 minutes long. We'll probably have to divide them into smaller pieces for testing.


Each participating faculty member can choose to receive compensation either in the form of partial summer salary, or partial teaching credit. As I have explained before, our department assigns a value to each course, roughly 0.8 for a large lecture, 0.7 for a senior level or graduate course and 0.6 for sophomore-junior courses. The average faculty load is approximately 2.9 of these teaching units. Each year the load for each faculty member is computed and any excess or debit is carry forward to the next year. The average faculty buyout cost for teaching related activities is approximately $1,000 per 0.1 teaching unit. The committee will decide how to distribute these funds to various faculty depending on how much effort was contributed. A similar process will be developed to compensate the teaching assistants or provide them with release time from teaching. The portion of the funds corresponding to release time will be used by the department to hire part time faculty to replace the lost teaching capacity. Since the total effort will not be known until next summer, each faculty member choosing to take teaching credit instead of partial summer salary, will carry that credit forward into the next academic year.

Annual Symposium for Community College Teachers

On November 17, 2000, we will hold a symposium for Washington Community College mathematics faculty. We expect for this symposium to be an annual event. The purpose of the symposium is to foster cooperation and communication with community college mathematics faculty, with emphasis on courses that we teach in common. This first meeting of the symposium will be devoted to informing CC faculty of recent and planned changes to our curriculum. It is anticipated that future meetings of the symposium with contain sessions on teaching techniques, technology use in the classroom, and roundtable discussions of other timely issues.

There will be a plenary session at 11:00 a.m. giving an overview of our recent and planned changes in first and second year courses. At the plenary session we will also announce and describe the Sabbatical Program. This will be followed by a luncheon and special sessions. Patrick Averbeck has invited those interested to attend his Math 111 class at 12:30. This will be followed by a discussion of issues that arise in teaching business precalculus. There will be a session at 1:00 on Math 120 and a concurrent session on Math 124/5/6. At 2:00 there will be a session devoted to course equivalency questions and a concurrent session on 300 level courses.

The expected cost, including room rental and the luncheon, is $1000.


Assessment

This proposal deals with a revision of math 124 and math 125. A natural subsequent course in which to study outcomes is math 126, the third quarter of the first year of calculus. To reduce the costs of the program, we did not propose reducing the size of math 126 which will continue to be taught in classes of size 160. Thus after taking math 126, students will have had experience in both size 80 classes and size 160, and extended quiz sections versus classes without extended quiz sections. Each June, beginning in 2002, we will assess the effectiveness of the program through interviews and surveys of the students and faculty. The results will be used during the summer to improve the program for the subsequent year. We do not have experience in designing assessment methods, so we will work with CIDR and OEA to design methods of assessing the outcome of this experiment. We will also seek the advice of community college teachers who come here on sabbatical. We will also work more closely with advisors and administrators to assure that we collect all complaints about our calculus courses so that we can understand the problems. Assessment is difficult because there are many variables, and few controls. For example, students will have some knowledge of the effectiveness of the course they take, but generally will not take the same course taught from a different perspective and thus cannot compare. Some of the items we might seek to measure are: What is the level of satisfaction with these courses, by the students and by the faculty? Are the client departments happy with the balance of emphasis on word or application problems versus basic skills? Do the students prefer the longer quiz sections? Do they prefer worksheets or other materials? Do the students and faculty feel that the smaller lecture and quiz sections significantly benefit the learning environment? We will also seek to poll students who take 124 or 125 but do not continue on to math 126. Some of these students are pursing degrees which do not require a full year and some will be students who are not successful in 124 and 125. We will seek to understand some of the reasons that students do not do well in these courses.


Permanent Funding

This program will be run on a trial basis for three years. Given a successful outcome to the trial experience, and informed by analysis of the effectiveness of each of the components of the program, Dean David Hodge has reserved $150,000 of New enrollment funding for this purpose and has agreed to provide an appropriate level of on-going funding, including additional funding if warranted, to continue the program at the conclusion of the Tools for Transformation support. The allocation of funds for the Tools project and the reserved new enrollment funding are independent of other resource issues that may involve the Department and the College.

Karen Freisem and Don Wulff of the Center for Instructional Development and Research (CIDR) and Jerry Gillmore of the Office of Educational Assessment (OEA) have agreed to assist the mathematics department in developing methods of assessment of the success of the program.

This proposal was developed by the math department calculus revisions committee over the course of the academic year 1999-2000 and further revised through a series of open departmental meetings culiminating in a vote 30 for, 7 opposed and 2 abstensions. Departmental contribution beyond the level in this proposal would significantly increase the number opposed.
















Budget - Year 1

2

Lecturer level positions to be used for sabbatical supplement support for up to six community college teachers @ $45,000 per year

$90,000

 

21.8% benefits

19,620

 

 

 

4

TA positions (entry level) @ $1212 per mo. x 9 mos.

43,632

 

10.2% benefits

4,450

 

tuition @ 1800 per quarter

21,600

 

 

 

1

PDTA I (TA mentor) @ $1299 per mo. x 9 mos.

11,691

 

10.2% benefits

1,192

 

tuition

5,400

 

 

 

 

Development

18,000

 

Assessment

2,000

 

Symposium

1,000

 

 

 

 

Total

218,585

Budget - Year 2
2

Lecturer level positions to be used for sabbatical supplement support for up to six community college teachers (4% increase)

$93,600

 

21.8% benefits

20,405

 

 

 

4

TA positions (entry level) @ $1260 per mo. x 9 mos. (4% increase)

45,360

 

10.2% benefits

4,627

 

tuition (4% increase)

22,464

 

 

 

1

PDTA I (TA mentor) @ $1351 per mo. x 9 mos. (4% increase)

12,159

 

10.2% benefits

  1,240

 

tuition (4% increase)

5,616

 

 

 

 

Assessment

2,000

 

Symposium

1,000

 

 

 

 

Total

208,471

Budget - Year 3
2

Lecturer level positions to be used for sabbatical supplement support for up to six community college teachers (4% increase)

$97,344

 

21.8% benefits

21,221

4

TA positions (entry level) @ $1311 per mo. x 9 mos. (4% increase)

47,196

 

10.2% benefits

4,814

 

 

 

 

tuition (4% increase)

23,362

1

PDTA I (TA mentor) @ $1405 per mo. x 9 mos. (4% increase)

12,645

 

10.2% benefits

  1,290

 

tuition (4% increase)

5,841

 

 

 

 

Assessment

2,000

 

Symposium

1,000

 

 

 

 

Total

216,713

Budget -- 3 Year
2

Lecturer level positions to be used for sabbatical supplement support for up to six community college teachers @ $45,000 per year

$280,944

 

21.8% benefits

61,246

 

 

 

4

TA positions (entry level)

136,188

 

10.2% benefits

13,891

 

tuition

67,426

 

 

 

1

PDTA I (TA mentor)

36,495

 

10.2% benefits

  3,722

 

tuition

16,857

 

 

 

 

Development

18,000

 

Assessment

6,000

 

Symposium

3,000

 

 

 

 

Total

643,769


Appendix G
Assessment Document