ࡱ> 7 *bjbjUU *7|7|l  {{{8{ | Nfp ։"7^iPRRRRRR$ ?v U37UUv ;U PUP-0 Z @B p{ H0hd Writing tests at Universities ESF Testing project, Vilnius, January 29-30, 2007 Vita Kalnberzina, Dr.Phil., Assist.Prof., Latvia University Contents  TOC \o "1-4" \h \z  HYPERLINK \l "_Toc157166754" Writing tests at Universities  PAGEREF _Toc157166754 \h 1  HYPERLINK \l "_Toc157166755" Contents  PAGEREF _Toc157166755 \h 1  HYPERLINK \l "_Toc157166756" List of Tables  PAGEREF _Toc157166756 \h 1  HYPERLINK \l "_Toc157166757" Course Programme  PAGEREF _Toc157166757 \h 2  HYPERLINK \l "_Toc157166758" 'Writing' as a concept  PAGEREF _Toc157166758 \h 3  HYPERLINK \l "_Toc157166759" What do you understand by the term 'writing'?  PAGEREF _Toc157166759 \h 3  HYPERLINK \l "_Toc157166760" What does the term 'writing' mean to the student/test-taker?  PAGEREF _Toc157166760 \h 5  HYPERLINK \l "_Toc157166761" How is written language different from spoken?  PAGEREF _Toc157166761 \h 5  HYPERLINK \l "_Toc157166762" Is writing informational, interactional or both?  PAGEREF _Toc157166762 \h 6  HYPERLINK \l "_Toc157166763" Teaching Writing at University Level  PAGEREF _Toc157166763 \h 7  HYPERLINK \l "_Toc157166764" Product approach  PAGEREF _Toc157166764 \h 7  HYPERLINK \l "_Toc157166765" Conventions For Term Paper Writing  PAGEREF _Toc157166765 \h 7  HYPERLINK \l "_Toc157166766" Process approach  PAGEREF _Toc157166766 \h 8  HYPERLINK \l "_Toc157166767" Help for students at Dartmouth University  PAGEREF _Toc157166767 \h 8  HYPERLINK \l "_Toc157166768" Instructions to Writing assistants:  PAGEREF _Toc157166768 \h 8  HYPERLINK \l "_Toc157166769" Moving from Writer-Based to Reader-Based Prose  PAGEREF _Toc157166769 \h 9  HYPERLINK \l "_Toc157166770" Writing test development  PAGEREF _Toc157166770 \h 9  HYPERLINK \l "_Toc157166771" Indirect approach  PAGEREF _Toc157166771 \h 9  HYPERLINK \l "_Toc157166772" Direct approach  PAGEREF _Toc157166772 \h 10  HYPERLINK \l "_Toc157166773" What do you need to know to develop a task?  PAGEREF _Toc157166773 \h 10  HYPERLINK \l "_Toc157166774" Writing Tests at University  PAGEREF _Toc157166774 \h 13  HYPERLINK \l "_Toc157166775" Qualspell  PAGEREF _Toc157166775 \h 13  HYPERLINK \l "_Toc157166776" What task types can be used to test writing proficiency at the University?  PAGEREF _Toc157166776 \h 13  HYPERLINK \l "_Toc157166777" Which text/task-types are appropriate for your students?  PAGEREF _Toc157166777 \h 14  HYPERLINK \l "_Toc157166778" How do you know that you have produced a good task?  PAGEREF _Toc157166778 \h 15  HYPERLINK \l "_Toc157166779" What does a test-taker need to know to do a task: develop the test specification  PAGEREF _Toc157166779 \h 15  HYPERLINK \l "_Toc157166780" Marking writing tests  PAGEREF _Toc157166780 \h 15  HYPERLINK \l "_Toc157166781" Formative Assessment  PAGEREF _Toc157166781 \h 16  HYPERLINK \l "_Toc157166782" Summative Assessment  PAGEREF _Toc157166782 \h 16  HYPERLINK \l "_Toc157166783" Holistic marking scales  PAGEREF _Toc157166783 \h 16  HYPERLINK \l "_Toc157166784" Analytic marking scales  PAGEREF _Toc157166784 \h 18  HYPERLINK \l "_Toc157166785" Assurance of test quality  PAGEREF _Toc157166785 \h 20  HYPERLINK \l "_Toc157166786" Validity  PAGEREF _Toc157166786 \h 20  HYPERLINK \l "_Toc157166787" Reliability of the examination  PAGEREF _Toc157166787 \h 21  HYPERLINK \l "_Toc157166788" Inter and Intra-marker reliability  PAGEREF _Toc157166788 \h 21  HYPERLINK \l "_Toc157166789" Bibliography  PAGEREF _Toc157166789 \h 23  HYPERLINK \l "_Toc157166790" Online sources  PAGEREF _Toc157166790 \h 23  List of Tables  TOC \h \z \c "Table"  HYPERLINK \l "_Toc157166791" Table 1 You as a writer  PAGEREF _Toc157166791 \h 3  HYPERLINK \l "_Toc157166792" Table 2 What is writing?  PAGEREF _Toc157166792 \h 4  HYPERLINK \l "_Toc157166793" Table 3 Writing from the point of view of the test-taker  PAGEREF _Toc157166793 \h 5  HYPERLINK \l "_Toc157166794" Table 4 Comparison between written and spoken language  PAGEREF _Toc157166794 \h 5  HYPERLINK \l "_Toc157166795" Table 5 Interactional versus informational writing  PAGEREF _Toc157166795 \h 6  HYPERLINK \l "_Toc157166796" Table 6 Comparison between direct and indirect writing tests  PAGEREF _Toc157166796 \h 10  HYPERLINK \l "_Toc157166797" Table 7 Topics for writing tasks, Compare with Language Domains in CEF  PAGEREF _Toc157166797 \h 11  HYPERLINK \l "_Toc157166798" Table 8 Writing as a process (Callaghan, Knapp, and Noble 1993, p.193)  PAGEREF _Toc157166798 \h 14  HYPERLINK \l "_Toc157166799" Table 9 Impressionistic marking scale  PAGEREF _Toc157166799 \h 16  HYPERLINK \l "_Toc157166800" Table 10 CEF levels of writing production  PAGEREF _Toc157166800 \h 16  HYPERLINK \l "_Toc157166801" Table 11 Holistic scale (British Council IELTS written production evaluation)  PAGEREF _Toc157166801 \h 17  HYPERLINK \l "_Toc157166802" Table 12 BC analytical writing evaluation scale  PAGEREF _Toc157166802 \h 18  HYPERLINK \l "_Toc157166803" Table 13 Validity of the writing tasks  PAGEREF _Toc157166803 \h 21  HYPERLINK \l "_Toc157166804" Table 14 Reliability of the Year 12 examination in 1999  PAGEREF _Toc157166804 \h 22  HYPERLINK \l "_Toc157166805" Table 15 Intercorrelations between the different tests in 2001  PAGEREF _Toc157166805 \h 22 Course Programme January 29 9:00 10:30sessionIntroduction, Writing as a concept10:30coffee break11:00 12:30sessionApproaches to testing writing 13:30Lunch15:00 16:30sessionWriting tests and tasks16:30tea break17:00 18:30sessionMarking scale types and marking reliability 30 January9:00 10:30sessionDevelopment of new writing tasks10:30coffee break11:00 12:30sessionDevelopment of marking scales13:30Lunch15:00 16:30sessionPretesting of the new writing tasks and marking scales16:30tea break17:00 18:30sessionFeedback on the new writing tasks and marking scales and evaluation of the course 'Writing' as a concept Objective: Discuss the concept of writing and hence validity of writing tests What do you understand by the term 'writing'? Take a couple of minutes to answer the following questions: Table  SEQ Table \* ARABIC 1 You as a writer QuestionAnswerWhat do you write? How do you write? What are three main things you want your students to learn about writing?  How would you define 'writing' as a skill?  Read the 5 texts and fill in the table 3 below: Writing is both tool and art, but it is not a body of knowledge. Those who have taught writing and observed writers at work are convinced that writing is a complex, multifaceted, dynamic skill, affected by cognitive demands, affect (whether the writer feels good on that day, whether he or she likes the topic, or the reader of the writing, or the reasons of writing) and variations in test conditions. Above all writing is a cognitive activity that calls on many components of personal experience, attitude, knowledge of ideas, issues and factual information, but that requires a person to take and shape some parts of this complex web of material into a rhetorical, syntactic and mechanical whole (Hamp-Lyons 1993, p.11). The writing test tests the test-takers ability to write correct and appropriate sentences, use conventions peculiar to written language, think creatively and develop thought excluding irrelevant information, manipulate sentences and paragraphs to use language effectively, write in an appropriate manner with a particular audience in mind, organise and order the written material (Year 12 test specification). Textual competence includes the knowledge of the conventions for joining utterances together to form a text consisting of two or more sentences which are structured according to the rules of cohesion (marked relationships among sentences) and rhetorical organisation (development of the text) (Bachman 1990) A successful writer needs to have content knowledge (knowledge of the concepts involved in the subject area), context knowledge (social context in which the text will be read, the reader's expectations, knowledge of the cotexts alongside which this text will be read), language system knowledge (lexis, syntax) and writing process knowledge (the most appropriate way of preparing for a writing task) (Tribble 1995). Table  SEQ Table \* ARABIC 2 What is writing? Year 12 test specification (1999)Hamp-Lyons (1993)Tribble/Bachman (1990)What is writing?  What subskills does writing consist of?  What is it affected by?  What does the term 'writing' mean to the student/test-taker? Table  SEQ Table \* ARABIC 3 Writing from the point of view of the test-taker QuestionAnswerWhat do your students write? In what settings do they like/do not like to write?What factors inhibit/encourage them to write?What contexts stimulate them to write well? How is written language different from spoken? Read the extract below and say what language aspects are lost when we transform spoken language to written language? How can we compensate for the loss? Is this enough? Contemporary views of the differences between written and spoken language support the idea that written and spoken language do possess distinctive features and that texts can be distributed along the continuum from the most typically spoken to the most typically written. Apart from the loss of the contextual information that is available to the people who participate in a conversation (for example, knowledge of the background and the histories of the individuals concerned) two of the most important aspects of speaking that are normally lost in any transcription are prosodic (rhythm, phrasing, pauses) and paralinguistic features (the way someone is speaking, facial expressions and gestures). To compensate for this loss we use punctuation and other features (Tribble 1995, p.17, 18). Fill in the table choosing from the box below: Table  SEQ Table \* ARABIC 4 Comparison between written and spoken language spokenwrittenvocabulary Grammar Text  Incomplete utterances, full word forms, rare words, 'incorrect' grammar, vocabulary of Latin origin, complete sentences, hesitations, reduced word forms, informal vocabulary, many phrasal verbs, common words, conventional abbreviations, polysyllabic words, high density of content words, sophisticated and intricate grammatical resources, heavily nominalized style, clauses instead of sentences as a minimum unit, carefully planned paragraphs Is writing informational, interactional or both? Weir (1995) considers that there are two types of writing operations: interactional and informational. Fill in the table choosing the operations from the box below Table  SEQ Table \* ARABIC 5 Interactional versus informational writing Type of operationOperations/actionProductInteractional in social and service texts: Informational in academic contexts  Summary checklist of writing operations (Weir 1995) Describing process which might involve: purpose, describing means, results, process, change of state, sequential description, instructions, summary Describing phenomena and ideas: definition, classification, identification, comparison and contrast, exemplification, Arguing: stating a proposition, stating assumptions, induction, deduction, substantiation, concession, summary, generalisation, speculation, comment, evaluation Expressing thanks, requirements, opinions, attitude, confirmation, apology, wants, needs, lacks, ideas, information, complaints, reasons, justifications Eliciting information, directions, service, clarification, help, permission Directing: ordering, instructing, persuading, advising, warning Teaching Writing at University Level Product approach Conventions For Term Paper Writing http://www.lu.lv/mvf/Studij_bak.htm Students having registered for the academic BA programme (English Philology) will be eligible to write 3 term papers before writing their Bachelor Paper (BA paper). Students can choose themes for term papers in the following areas: Aspects of the English Language (Phonetics, Grammar, Lexis); British (American, Canadian) studies; English Language Teaching (ELT) Methodologies; Linguistics; Translation and Interpreting; Literature. Length Of The Term Paper The term paper will be between 5000 words and 7500 words. You are not required to produce a term paper embodying totally original work and ideas that will be a contribution to knowledge, although if you do, you will receive appropriate credit for it. Organisation And Content Of The Term Paper Conventionally, there will be: Title page Declaration of academic integrity Abstract in English and Abstract in Latvian Table of contents Introduction; Chapters; Conclusions; Theses; Bibliography; Appendix (or appendices). Plagiarism You plagiarize if you take someone elses work, ideas, words and use them as if they were your own. You can avoid plagiarism by using correct methods for quoting, paraphrasing and referencing. Quoting means using the exact words of the writer/speaker, whereas paraphrasing means restating the words and ideas from a book, an article, or a lecture in your own words. Failure to produce references amounts to plagiarism, and your work will be deemed invalid. Layout And Presentation Use A4 size white paper on one side. Word process the text using Times New Roman. Use twelve point for the main text; fourteen point for headings. Use margins: top/bottom/right -2.5 cm; left-3.5 cm (for binding); Use 1.5 line spacing; Indent quotes longer than three lines by five characters; use single space between the lines; Process approach http://www.dartmouth.edu/~writing/services/support_student.shtml Principles of process pedagogy at Dartmouth University: writing can be understood as the culmination of several steps in a complicated process, which include prewriting, writing, rewriting, and all their attendant strategies use of dialogue as a teaching technique. challenge the traditional, authoritative models of teaching, in which professors (who know everything) talk "at" students (who know very little). empower students by getting them to talk about their writing at every step of the writing process. Help for students at Dartmouth University If you are a first-year student, we will help you understand the expectations of college writing. We will help you generate, research, and organize ideas. We will talk to you about your structure, grammar, and style. If you are a student for whom English is a second language, we will help you work on English grammar and style. We will also help you understand the conventions for writing an essay in English. If you are a senior, we will provide strategies for writing a thesis or culminating experience paper. We will even help you with multi-media compositions, such as Web sites, videos, or PowerPoint presentations. Instructions to Writing assistants: Re-read the assignment, if the professor has written one. Make careful notes regarding what, precisely, the professor is asking the students to do. Read through all (or several) of the papers once, without marking. This strategy helps you to get a sense of the range of essays you'll be reading. Read through each paper twice: once to get the gist, the second time to respond. This strategy helps you to see where the writer is going before you jump in with your advice. Respond the first time through, but in pencil. That way, you can erase your remarks if something the writer says on page four changes the way you feel about page two. Take notes, on the side. Sometimes writing assistants want to keep a running commentary of their reading responses, but don't wish to share these responses with the writer. Keep a pad and a pen nearby. Moving from Writer-Based to Reader-Based Prose http://www.dartmouth.edu/~writing/materials/tutor/pedagogy/process.shtml At some point in the writing process, writers must turn their attention from the writing process to the written product. They must transform writer-based prose into reader-based prose. To do this, they must be ready to revise, paying close attention to their prose and to the effect it may be having on their audience. Often it's precisely at this point in the process that a writer will come to you for help. He has a draft completed, his argument seems logical and even persuasive, but he wants a second opinion. You read the essay and have some trouble following his line of reasoning. You point to a paragraph that is particularly confusing, and you ask what the writer is trying to say. He responds, "But it's all right there!" and goes on to summarize a point that he clearly hasn't made. What's happened? The writer's point is so firmly entrenched in his mind that he really believes that it's "in" the essay. You show him that it's not. You've just given him a lesson in the difference between writer-based and reader-based prose. Writing test development How do you develop writing tests? How do you test writing? How often do you test? How do you mark writing? What problems do you have? Indirect approach Hamp-Lyons (1993, p.5): Indirect tests (recognize correct word order or structure, choose the correct phrase for the gap, underline the phrase that contains error etc.) do not require the test-taker to write continuous prose, there is little room for personal interpretation, a key is provided for the marker, the role of human judgement is less obvious, as scores are not tied to essay samples or rating scales, but to the judgement of the test developers who have developed questions and decided on the correct answers. In this case training of markers is not necessary and scoring can be done clerically. In indirect discrete element writing tests (TOEFF, MELAB) knowledge of grammar rules and vocabulary items tend to dominate. While these skills may be related to proficient writing, most of us do not accept that they can represent what proficient writers do. Therefore indirect writing assessment is invalid. It has extremely negative educational consequences on the learning/teaching process as it creates the impression that writing is the same as recognizing errors in sentences, knowing grammar rules, and of not writing about ideas and emotions. Direct approach A direct test of writing has the following characteristics: each individual taking the assessment must actually physically write at least one piece of continuous text of 100 words and may write several considerably longer pieces the writer is provided with a set of instructions and a text, picture or other prompt material, he or she is given considerable room within which to create a response to the prompt every text written by a candidate is read by at least one , usually two or more, human reader-judges who have been through some form of preparation process the judgements of the readers are tied in some way to some common yardstick, such as a set of sample essays, description of the expected performance or one or several marking scales scores on the text are recorded and can be retrieved for review The ability of a writing test to give reliable results is affected by the amount of variation in things like: topic he or she is asked to write about the type of written task (narrative, argumentative, etc.) the amount of time available whether it is done on word processors how many samples we get from each writer Fill in the table: Table  SEQ Table \* ARABIC 6 Comparison between direct and indirect writing tests Sample taskPositiveNegativeDirect approach to testing writing   Indirect approach to testing writing    What do you need to know to develop a task? Questions: What is a test task? How is it different from a learning task? What does a test task consist of? What are the criteria in a test task evaluation? Hughes (1989) offers a following writing task framework: Operations (describe, explain, compare, contrast, argue) Text type: letter, form, essay, postcard Addressee: native speaker, non-native speaker or as specified under topics Topic (see Table 7) Table  SEQ Table \* ARABIC 7 Topics for writing tasks, Compare with Language Domains in CEF Topic:Rank order of appropriacy for your studentsocial interaction with native and non-native speakers of Englishshopping and using servicestravelling and arranging for traveldealing with official and semi-official bodiesvisiting places of interest and entertainmentusing media for information and entertainmentstudying for academic, occupational and social purposes.medical attention and health Use Hugh's (1989) framework to analyse Year 12 examination tasks in 2001 What operations, addressee, text type and what topic? Task 1Task 2Task 3Operations Text type: Addressee: Topic  Year 12 Writing test Task 1 Your friend wants to rent his seaside house to Mr and Mrs Crawford for the summer holidays. They asked him to describe it in detail, but his English is not very good. Help him to write the letter (100 words). Here are his notes: A wooden cottage near the Lielupe A kitchen and living room downstairs Two bedrooms and a bathroom upstairs Garden, a garage Task 2 Describe the diagram in 100 words and compare the popularity of the different study programmes (Diena June 2000). Task 3 The role of sports in the modern world Justice Earl Warren says that the sports page records people's accomplishments, but the front page nothing but their failures. Write an essay on the role of sports in the modern world (200-250 words) and discuss: What sports means to you and your friends Whether you follow the results of Latvian athletes in international competitions Whether it is important for Latvian athletes to win international competitions or not (why) Whether the government of Latvia should support sports clubs, teams (if yes then how and why) or spend money for more urgent needs of the Latvian people Writing Tests at University Qualspell  HYPERLINK "http://www.esp-c.org" ESP:C, an English Course for Chemists With the support of  HYPERLINK "http://europa.eu.int/comm/education/programmes/leonardo/leonardo_en.html"  INCLUDEPICTURE "http://www.esp-c.org/uploads/images/42/l_logo.gif" \* MERGEFORMATINET   HYPERLINK "http://moodle.esp-c.org/mod/resource/view.php?id=727" http://moodle.esp-c.org/mod/resource/view.php?id=727 Task 1 Give written instructions to a new laboratory assistant on how to prepare a solution of salt in water. Say where the necessary chemicals can be found, in which vessel(s) they must put in order to dissolve the salt, how the solution is treated after use and how it is stored. (It is important that your instructions are logically structured, easy to understand and very clearly expressed. Give your instructions in 8 10 short sentences.) Task 2 Genetics is most important in modern science. Do you agree with this statement or would you rather disagree with it? Present your arguments in 120 - 150 words. Structure your ideas logically. Do not forget to make clearly visible paragraphs. Task 3 Write an e-mail to an important customer in which you inform the company about a serious delay and in which you apologize for this delay. The reasons for the delay: You bought a new analytical instrument but you have problems with this machine as the machine cannot be operated. You hope the maintenance works will not take too long. You have had very good relations with this customer for many years. So you hope that despite this delay you will be able to continue this good the co-operation. Your reply should be very polite and explain the situation as given. What task types can be used to test writing proficiency at the University? Year 12 test specification says: The test-takers demonstrate their ability to do three of the following: to write a letter, a postcard, a set of instructions, a report or a guided essay or fill in forms. In all cases test-takers are asked to respond to leaflets, notices, announcements, personal notes and messages, directions, tables and graphs. Which text/task-types are appropriate for your students? Look through the Table 11and tick the text types that would be appropriate for your students, choose one type and develop the task as you would present to your students Include the text type, length, addressee and time limit, criteria, optional. Table  SEQ Table \* ARABIC 8 Writing as a process (Callaghan, Knapp, and Noble 1993, p.193) ActionProcessProductYes/NoDescribeThrough the process of sequencing phenomena in temporal and causal relationshipsPersonal descriptionsTechnical descriptionsInformation reportsScientific reportsDefinitionsExplainThrough the process of sequencing phenomena in temporal or causal relationshipsExplanations of howExplanations of whyElaborationsIllustrationsAccountsExplanation essayInstructThrough the process of logically ordering a sequence of actions or behavioursProceduresInstructionsManualsScience experimentsRecipesDirectionsNarrateThrough the process of sequencing people and events in time and spacePersonal recountsStoriesFairytalesMyths and fablesNarrativesArgueThrough the process of persuading readers to accept a logical ordering of propositions Essays ExpositionsDiscussionsDebatesReviewsEvaluationsHow do you know that you have produced a good task? How difficult the task will be? ConcreteAbstractPersonal12Public34 Weir 1995 p.22-25: Specific guidelines for moderation of a task: format Is the level of difficulty appropriate? Will the task discriminate? Is it appropriate? Is it clear? Is the timing appropriate? Is the layout appropriate? Is there a bias against some group of students? What does a test-taker need to know to do a task: develop the test specification What are the student's rights? What do they know before they start writing? Hamp-Lyons (1993, p.61) considers that a student has the right to full knowledge about the test she or he is taking and should be informed about: test purpose formattest-lengthnumber of questions and score weighting if anykinds of writing to be evaluatedcriteriascoring methodscore reliabilityqualification of judges  Tick the information in the table above that was available for the year 12 exam test takers in year 2001 (see below) Marking writing tests http://www.provost.cmich.edu/assessment/toolkit/formativesummative.htm Formative Assessment Formative assessment is often done at the beginning or during a program, thus providing the opportunity for immediate evidence for student learning in a particular course or at a particular point in a program. Classroom assessment is one of the most common formative assessment techniques. The purpose of this technique is to improve quality of student learning and should not be evaluative or involve grading students. Summative Assessment Summative assessment is comprehensive in nature, provides accountability and is used to check the level of learning at the end of the program. For example, if upon completion of a program students will have the knowledge to pass an accreditation test, taking the test would be summative in nature since it is based on the cumulative learning experience. Holistic marking scales Holistic scoring involves the assignment of a single score to a piece of writing on the basis of an overall impression of it (hence the name 'impressionistic scoring'). It is rapid and therefore each paper can be scored several times. Sample scale used at an English medium university Table  SEQ Table \* ARABIC 9 Impressionistic marking scale NSNative speaker standardNS-Close to a native speaker standardMAClearly more that adequateMA-Possibly more than adequateAAdequate for study at this universityDDoubtfulNAClearly not adequateFBAFar below adequacy Holistic scales are based on overall level descriptions, which can also be expressed in 'can statements'. CEF describes its levels of overall written production in a following scale starting with A1 (the lowest level) and finishing with C2 (the top level). Fill in the names of the levels in Table 13 Table  SEQ Table \* ARABIC 10 CEF levels of writing production DescriptionLevelCan write straightforward connected texts on a range of familiar subjects within his field of interest by linking a series of shorter discrete elements into linear sequenceCan write simple isolated phrases and sentencesCan write clear, well structured texts of complex subjects, underlining the relevant salient issues, expanding and supporting points of view at some length with subsidiary points, reasons and relevant examples, and rounding off with an appropriate conclusionCan write clear, detailed texts on a variety of subjects related to his/her field of interest, synthesising and evaluating information and arguments from a number of sourcesCan write a series of simple phrases and sentences linked with simple connectors like 'and', 'but', 'because'Can write clear, smoothly flowing, complex texts in an appropriate and effective style and a logical structure which helps the reader to find significant points What are the criteria used to differentiate between the levels in CEF writing production level description? Table  SEQ Table \* ARABIC 11 Holistic scale (British Council IELTS written production evaluation) 9The writing displays an ability to communicate in a way which gives the reader full satisfaction. It displays a complete logical organisational structure which enables the message to be followed effortlessly. Relevant arguments are presented in an interesting way, with the main ideas prominently and clearly stated, with completely effective supporting material, arguments are effectively related to the writer's experience or views. There are no errors of vocabulary, spelling punctuation or grammar and the writing shows an ability to manipulate the linguistic systems with complete appropriacy8The writing displays an ability to communicate without causing the reader any difficulties. It displays a logical organisational structure, which enables the message to be followed easily. Relevant arguments are presented in an interesting way, with main ideas highlighted, effective supporting material and they are well related to the authors own experience or views. There are no significant errors of vocabulary, spelling, punctuation or grammar and the writing reveals an ability to manipulate the linguistic systems appropriately.7Writing displays an ability to communicate with few difficulties for the reader. It displays good organisational structure, which enables the message to follow without much effort. Arguments are well presented with relevant supporting material and an attempt to relate them to writer's experience or views. The reader is aware of but not troubled by occasional minor errors of vocabulary, spelling, punctuation and grammar or some limitations to the writer's ability to manipulate the linguistic systems appropriately.6The writing displays an ability to communicate although there is occasional strain for the reader. It is organized well enough for the message to be followed throughout. Arguments are presented but it may be difficult for the reader to distinguish main ideas from supporting material; main ideas may not be supported; their relevance may be dubious; arguments may not be related to the writer's experience or views. The reader is aware of errors of vocabulary, spelling, punctuation or grammar, and/or limited ability to manipulate the linguistic systems appropriately, but these intrude only occasionally.5The writing displays an ability to communicate although there is often strain for the reader. It is organized well enough for the message to be followed most of the time. Arguments are presented but may back relevance, clarity, consistency or support; they may not be related to the writer's experience or views. The reader is aware of errors of vocabulary, spelling, punctuation or grammar, which intrude frequently, and of limited ability to manipulate the linguistic systems appropriately.4The writing displays a limited ability to communicate, which puts strain on the reader throughout. It lacks a clear organizational structure and the message is difficult to follow. Arguments are inadequately presented and supported; they may be irrelevant; if the writers experience or views are presented, their relevance may be difficult to see. The control of vocabulary, spelling, punctuation and grammar is inadequate, and the writer displays inability to manipulate the linguistic systems appropriately.3The writing does not display an ability to communicate although meaning comes through spasmodically. The reader cannot find any organizational structure and cannot follow a message. Some with an argument is mainly irrelevant. The reader is primarily aware of gross inadequacies of vocabulary, spelling, linguistic appropriacy, although there is no evidence of sentence structure.2The writing displays no ability to communicate. No organisational structure or message is recognizable. A meaning comes through occasionally but it is not relevant. There is no evidence of control of vocabulary, spelling, punctuation or grammar and no sense of linguistic appropriacy1A true non-writer who has not produced any assessable strings of English writing. An answer which is wholly or almost wholly copied from the input text or task is in this category0Should only be used where a candidate did not attend or attempt this part of the test in any way  Analytic marking scales Methods of scoring that require a separate score for each of a number of aspects of tasks are said to be analytic. Transform the holistic marking scale in Table 11 into an analytical marking scale in Table 12 Table  SEQ Table \* ARABIC 12 BC analytical writing evaluation scale 9 8 7 6 5 4 3 2 1  QUALSPELL Marking scale Grammar Mechanical AccuracyVocabularyStructureContent and Style5Wide range and correct use of complex structures, very few minor errorsAlmost no errors of spelling, punctuation, capitalizationWide range of vocabulary, appropriate register, consistent styleCompletely logical, varied use of cohesive structures, complex sentence structuresArguments effectively related to specific area within topic, interesting presentation of topic, appropriate tone and register4Good general command of grammar with no systematic errorsOccasional errors that do not obscure the meaningGood range of vocabulary (not necessarily outstanding, some circumlocutions, some errors of word forms, choice, usage, but meaning not confusedGenerally logical, sufficient use of various cohesive devices, complex sentence structure with occasional errorsArguments mostly related to the specific area within the topic, mostly appropriate tone and register3Accuracy high, some gross or systematic errors and more minor errors which do not distort communicationFrequent or systematic errors, but meaning mostly not confused or obscuredLimited vocabulary, but largely correct, sometimes adventurous choice of words, meaning not confused Inconsistent structure, but easily to follow most of the time, occasionally repetitive, some variety of sentence structure, some use of cohesive structureArguments related to the general topic, occasional inappropriate tone and register2Has a basic grasp of the grammar system which is not applied consistently, frequent occurrence of errorsFrequent or systematic errors, meaning confused or obscured, poor handwritingRange inadequate to express ideas effectively, frequent errors of words, idioms, form, usage, meaning sometimes confusedLoosely organised, but main ideas expressed, can be followed, but requires some re-reading, sentences short and stereotyped, attempts at using cohesionWritten mostly to the point with occasional lapses, inconsistent in tone and register1Very frequent occurrence of gross errors, grammatical patterns based on direct translationDominated by errors, meaning confused or obscured, serious misspellings of elementary wordsLimited range, Misuse of words makes communication difficult, essentially translation from L1Lack of basic organisation, only simple sentences or serious, frequent errors in sentence structure, not cohesiveLimited treatment of topic, major points left out, insufficient length, mostly inappropriate style0Completely ungrammaticalMisspellings of basic words, illegible handwritingMisuse of words breaks down communicationVague, confused and disconnected ideas Assurance of test quality Validity  HYPERLINK "http://exchanges.state.gov/forum/vols/vol40/no2/p14.htm" http://exchanges.state.gov/forum/vols/vol40/no2/p14.htm Validity is the degree to which a test or assignment actually measures what it is intended to measure. There are five important aspects of validity (Hamp-Lyons 1991; Jacobs et al. 1981): Face validity Does the test appear to measure what it purports to measure? Content validity Does the test require writers to perform tasks similar to what they are normally required to do in the classroom? Does it sample these tasks representatively? Concurrent validity Does the test require the same skill or sub-skills that other similar tests require? Construct validity Do the test results provide significant information about a learners ability to communicate effectively in English? Predictive validity Does the test predict learners performance at some future time? Hughes (1989): Specific guidelines for moderation of a task: contents Is the task properly representative of tasks that we should expect the test-takers to be able to perform Will the tasks elicit samples of writing which truly represent the students' ability? Will the tasks help markers score reliably? Does the task test writing ability and nothing else? In language testing we are not normally interested in knowing whether students are creative, imaginative, or even intelligent, have wide general knowledge or have good reasons for the opinions they hold. For that reason we should not set tasks which measure these abilities. What do you think the following tasks test? Table  SEQ Table \* ARABIC 13 Validity of the writing tasks TaskWhat does the task test?Write the conversation you have with a friend about the holiday you plan to have together You spend a year abroad. While you are there, you are asked to talk to a group of young people about life in your country. Write down what you would say. The advantages and disadvantages of being born into a wealthy family. 'Envy is the sin which most harms the sinner' Discuss  Reliability of the examination http://exchanges.state.gov/forum/vols/vol40/no2/p14.htm Reliability is the degree to which the scores assigned to students work accurately and consistently indicate their levels of performance or proficiency. Inter and Intra-marker reliability Correlation coefficients of .80 and above between readers scores (inter-rater reliability) as well as between the scores assigned by the same reader (intra-rater reliability) to the same task are considered acceptable for decision making (Bachman 1990). There is research that indicates that the gender, background, and training of the reader can affect the reliability of scores (Brown 1991; Cushing-Weigle 1994). Thus, to maintain reliability many programs put heavy emphasis on the training of raters and as a result have obtained high positive correlations (Jacobs et al. 1981; Hamp-Lyons 1991). Hughes (1989) suggests the following steps to make the scoring of writing tasks more reliable: set as many tasks as possible : the more scores that scorers provide for each candidate, the more reliable the total score restrict candidates: the greater the restrictions imposed on the candidates (writing tasks should be well defined and candidates should know just what is required of them) the more reliable should be the total score give no choice of tasks: making the candidates perform all tasks also makes comparisons between candidates easier ensure long enough samples: the samples should be long enough for judgements to be made reliably, especially if you are evaluating organisation Once we have written a task and pretested it, we can start developing a marking scale (holistic or analytical)  HYPERLINK "http://www.rtlib.com/vita/home.nsf/content/y12" http://www.rtlib.com/vita/home.nsf/content/y12 Table  SEQ Table \* ARABIC 14 Reliability of the Year 12 examination in 1999 TaskpointsSEMAlphaCorrelation with the total***Reading 372.40.8950.885Matching111.30.7110.640Gap-filling201.70.8660.858Multiple-choice61.00.6220.643Listening 402.30.7760.812Gap-filling171.20.7080.683Multiple-choice121.40.5550.683true/false111.30.4210.558Language Use 512.90.9320.700Multiple choice191.70.8150.642Editing161.70.7990.608Gap-filling161.50.8750.671Writing 601.3No data*0.761Postcard150.2No data0.542Letter200.5No data0.670Report250.7No data0.725Speaking250.6.572**0.823Total100%0.2Not appropriateNot appropriate* In 1999 CEC data package did not contain the results of the first and second marking **Correlation between the first and the second marking ***See Intercorrelations between the different tests in Appendix 12 Table  SEQ Table \* ARABIC 15 Intercorrelations between the different tests in 2001 TotalListeningReadingLang.useSpeakingWritingTotal1.0000.9150.8840.8720.8490.869Listening0.9151.0000.8140.7660.6880.709Reading0.8840.8141.0000.7420.6510.682Language use0.8720.7660.7421.0000.6380.685Speaking0.8490.6880.6510.6381.0000.763Writing0.8690.7090.6820.6850.7631.000 Bibliography Bachman, L.F. 1990: Fundamental considerations in language testing. Oxford: Oxford University Press. Common European Framework of language learning, teaching and assessment, Strasbourg 1996 Cushing-Weigle S., Assessing Writing Cambridge University Press, 2002 Hamp-Lyons, L. & W. Condon (1993) Questioning the assumptions about portfolio-based assessment College Composition and Communication, 44/2: 176-190. Hughes, A. Testing for Language Teachers. Cambridge: Cambridge University Press, 1989. Tribble C. Writing. Oxford University Press,1995 Weir, C. Communicative Language Testing. Prentice Hall, 1995 Online sources  HYPERLINK "http://www.lu.lv/mvf/Studij_bak.htm" http://www.lu.lv/mvf/Studij_bak.htm  HYPERLINK "http://exchanges.state.gov/forum/vols/vol40/no2/p14.htm" http://exchanges.state.gov/forum/vols/vol40/no2/p14.htm  HYPERLINK "http://www.dartmouth.edu/~writing/services/support_student.shtml" http://www.dartmouth.edu/~writing/services/support_student.shtml  HYPERLINK "http://moodle.esp-c.org/mod/resource/view.php?id=727" http://moodle.esp-c.org/mod/resource/view.php?id=727  HYPERLINK "http://www.provost.cmich.edu/assessment/toolkit/formativesummative.htm" http://www.provost.cmich.edu/assessment/toolkit/formativesummative.htm  HYPERLINK "http://www.britishcouncil.org/lithuania-education-exams-ielts.htm" www.britishcouncil.org/lithuania-education-exams-ielts.htm  HYPERLINK "http://www.rtlib.com/vita/home.nsf/content/y12" http://www.rtlib.com/vita/home.nsf/content/y12 Testing Writing Seminar Evaluation Sheet Please evaluate the usefulness of the seminar from 1 (not useful)- 5 (very useful), please give your comment and suggestions for the further seminars The topic of the seminar 12345 The format of the seminar 12345 Session 1: Writing as a concept 12345 Session 2: Approaches to testing writing 2345 Session 3: Writing tests and tasks 12345 Session 4: Marking scale types and marking reliability 12345 Session 5: New task development 12345 Session 6: Marking scale development 12345 Session 7: Pretesting test tasks 12345 Session 8: Feedback on the tasks developed 12345 Suggestions for the further seminars Thank you for your help! PAGE  PAGE 5      )*+,456PQRST巯sgYjwUmHnHu0J#aJmHnHsH&u&j>*B*UmHnHphuOJQJaJmHnHtH uj}UmHnHujUmHnHumHnHu0J#aJ mHnHsH&u&j>*B*UmHnHphu mHnHu0J#mHnHuj0J#UmHnHujUmH&sH&mH&sH&"P VSC'F  k 7 M  w"  w"  w"  w" )TUVWXtuvw󵭡ugjkUmHnHu0J#aJmHnHu&j>*B*UmHnHphujqUmHnHujUmHnHumHnHu0J#aJmHnHsH&u&j>*B*UmHnHphu mHnHu0J#mHnHuCJOJQJaJmHnHtH uj0J#UmHnHu&123MNOPQRSTUqrst!"#ͳߣߛsߣߛ_&j>*B*UmHnHphuj_UmHnHu&j>*B*UmHnHphu mHnHu0J#mHnHuCJOJQJaJmHnHtH ujeUmHnHujUmHnHumHnHu0J#aJmHnHuj0J#UmHnHu&j>*B*UmHnHphu%#=>?@ABCDEabcd!"#$%&'ѹѕѹsѕejMUmHnHu&j>*B*UmHnHphujSUmHnHu0J#aJmHnHu&j>*B*UmHnHphu mHnHu0J#mHnHuCJOJQJaJmHnHtH uj0J#UmHnHujUmHnHujYUmHnHumHnHu''()EFGHlmn  ǿǿs_&j >*B*UmHnHphujA UmHnHu&j >*B*UmHnHphuCJOJQJaJmHnHtH ujG UmHnHujUmHnHumHnHu0J#aJmHnHu&j>*B*UmHnHphu mHnHu0J#mHnHuj0J#UmHnHu%  $ % & @ A B C D E F G H d e f g w x y  sej/ UmHnHu&j >*B*UmHnHphuj5 UmHnHu0J#aJmHnHu&j >*B*UmHnHphu mHnHuCJOJQJaJmHnHtH uj; UmHnHujUmHnHumHnHu0J#mHnHuj0J#UmHnHu'       # $ % & I J K e f g h i j k l m ǭNj}i&j>*B*UmHnHphuj#UmHnHu&j>*B*UmHnHphuj)UmHnHu&j >*B*UmHnHphu mHnHu0J#mHnHuCJOJQJaJmHnHtH uj0J#UmHnHujUmHnHumHnHu)    1 2 3 4 5 6 7 8 9 U V W X i j k 󯩯z󯩯f&j>*B*UmHnHphujUmHnHu0J#6]aJmHnHu&j>*B*UmHnHphu mHnHu0J#mHnHuCJOJQJaJmHnHtH ujUmHnHujUmHnHumHnHu0J#aJmHnHuj0J#UmHnHu% * + , F G H J K L M N O k l m n ѹѕއѹsѕejUmHnHu&j>*B*UmHnHphuj UmHnHu0J#aJmHnHu&j>*B*UmHnHphu mHnHu0J#mHnHuCJOJQJaJmHnHtH uj0J#UmHnHumHnHujUmHnHujUmHnHu'     d e f ȼȮȼОȼ|ȼОhȼ&jv>*B*UmHnHphujUmHnHu&j|>*B*UmHnHphuCJOJQJaJmHnHtH ujUmHnHujUmHnHumHnHuj0J#UmHnHu&j>*B*UmHnHphu mHnHu0J#mHnHu( zgr*v>c9'1$' w"  w"  w"  w"  !"#$WXYstuwxyz{|    ,-ѹѹѹ}ѹoѹjUmHnHu&jj>*B*UmHnHphujUmHnHu&jp>*B*UmHnHphu mHnHu0J#mHnHuCJOJQJaJmHnHtH uj0J#UmHnHujUmHnHujUmHnHumHnHu+-./DEF`abdefghiͳߣߛsߣߛ_&jX>*B*UmHnHphujUmHnHu&j^>*B*UmHnHphu mHnHu0J#mHnHuCJOJQJaJmHnHtH ujUmHnHujUmHnHumHnHu0J#aJmHnHuj0J#UmHnHu&jd>*B*UmHnHphu%5678OPQklmopqrstѹєѹrєdjUmHnHu&jL>*B*UmHnHphujUmHnHu0J#6]mHnHu&jR>*B*UmHnHphu mHnHu0J#mHnHuCJOJQJaJmHnHtH uj0J#UmHnHujUmHnHujUmHnHumHnHu' #$%'()*+,HIJKSTUopqstuvwxǿǿs_&j: >*B*UmHnHphujUmHnHu&j@>*B*UmHnHphuCJOJQJaJmHnHtH ujUmHnHujUmHnHumHnHu0J#aJmHnHu&jF>*B*UmHnHphu mHnHu0J#mHnHuj0J#UmHnHu%789;<=>?@\]^_klm󯩯󯩯sej"UmHnHu&j.">*B*UmHnHphuj!UmHnHu&j4!>*B*UmHnHphu mHnHu0J#mHnHuCJOJQJaJmHnHtH uj UmHnHujUmHnHumHnHu0J#aJmHnHuj0J#UmHnHu'   '()*ABC]ǭߣφ||h&j"$>*B*UmHnHphu jUmH&sH&jCJOJQJUmH&sH&j#UmHnHu0J#aJmHnHu&j(#>*B*UmHnHphu mHnHu0J#mHnHuCJOJQJaJmHnHtH uj0J#UmHnHujUmHnHumHnHu#]^_`abcde3456789:;WXѹѹޑѹ}ѹoѹj&UmHnHu&j&>*B*UmHnHphuj%UmHnHu&j%>*B*UmHnHphu mHnHu0J#mHnHuCJOJQJaJmHnHtH uj0J#UmHnHumHnHujUmHnHuj$UmHnHu*XYZ!"#$%&'()EFGHϵߥן׋}ߥןi&j)>*B*UmHnHphuj(UmHnHu&j (>*B*UmHnHphu mHnHuCJOJQJaJmHnHtH uj'UmHnHujUmHnHumHnHu0J#mHnHuj0J#UmHnHu&j'>*B*UmHnHphu&*+,./0123OPQRѹѹޑѹ}ѹoѹju+UmHnHu&j*>*B*UmHnHphuj{*UmHnHu&j)>*B*UmHnHphu mHnHu0J#mHnHuCJOJQJaJmHnHtH uj0J#UmHnHumHnHujUmHnHuj)UmHnHu*!"#$%&BCDEnopϵߥן׋}ߥןi&j->*B*UmHnHphuji-UmHnHu&j,>*B*UmHnHphu mHnHuCJOJQJaJmHnHtH ujo,UmHnHujUmHnHumHnHu0J#mHnHuj0J#UmHnHu&j+>*B*UmHnHphu&$"z+3V]$$Ifl40 4 la$If$If' w"  !"#$@ABCrstѹѹޑѹ}ѹoѹjW0UmHnHu&j/>*B*UmHnHphuj]/UmHnHu&j.>*B*UmHnHphu mHnHu0J#mHnHuCJOJQJaJmHnHtH uj0J#UmHnHumHnHujUmHnHujc.UmHnHu* WXYstuwxyz{| /ϵߥן׋}ߥxssjsgCJCJOJQJ^JmH&sH& jUjK2UmHnHu&j1>*B*UmHnHphu mHnHuCJOJQJaJmHnHtH ujQ1UmHnHujUmHnHumHnHu0J#mHnHuj0J#UmHnHu&j0>*B*UmHnHphu&VW]jklz}Tuuu}uuu}8uuu}$If$$IflFj30    4 la 45uHu u4$$IflFj30    4 la$If 56ABOWx$If]$$Ifl40 4 la$Ifxy}Tuuu}uuu}8uuu}8$If$$IflFj30    4 la %/01?GuHuus$$IflFj30    4 la$If /kl\Xk$$IfF0@"064 Fa$If%$/lrsZb!c!!""%%%%%%%&'' ' '' '!'"'T']'d'e'(I((,>,D,E,Z,[,\,],,,,,,,../\/b/c/x/y/z/{/////00b0t001n1v12222227333CJOJQJaJ>*CJ\CJCJ5\ mHnHu jU 56\]T%&'()*+VWXYZDk$$IfF0@"064 Fa$IfZ[\c!""3$4$%&&(&:&Q&$If%$dh & F*dh & F*dhQ&R&c&d&e&f&g&h&i&j&k&ndeeeeeeeen dh$If$$IfF\J 9! i 0!64 Fa k&&&&&&&&&&&&&&&$If&&&&&&&&&&&&neeeeeeeen`dh dh$If$$IfF\J 9! i 0!64 Fa &&''T']'d'e'''''''}s}s xx$Ifk$$IfF0@"064 Fa $If$If%$ '''''((((I(((S))*~yy$ & F:$$If xx$Ifk$$IfF0@"064 Fa* ,,,>,,,,,,,,,n@~$$IfFFi "   06    4 Fa$If%$$<^<$ ,,,,,,,,,,,,,,,{8{$~$$IfFFi "   06    4 Fa$If,,,,,-....XXVT"&dh$d%d&d'dNOPQ~$$IfFFi "   06    4 Fa ./\///////0000k|$$IfFF"^i F0    4 Fa"$If "$d$Ifa$%$" 000(0)0*0+0,0|p "$d$Ifa$|$$IfFF"^i F0    4 Fa"$If,0-0.0b00n122263RRRRRR-$ & F8dh$d%d&d'dNOPQa$"~$$IfF4F"^i F0    4 Fa 6373\3]3n3333]444 5<5L5m5z55566667;7N7]7h7$ & Fd & F$dha$33\4]44444 5 5;5<5K5L5l5m5z55556666666:7;7M7N7\7]7g7h7u7v7~77777777}9~999999+:,:m:o:::::<*<?8@@@@'AwAA CJOJPJQJ^JaJnH tH 5\CJOJQJaJmH sH  OJQJaJCJOJPJQJaJ CJOJQJCJOJQJaJ5CJOJQJ\aJEh7v777777~9999,:o:::::8;9;q;<E<<<===g== & Fdd[$\$ & F=>C>?l????@'AA}BGCHCwCCCEEGGG)HYHtHuHH & Fdd[$\$ & Fdd[$\$AB}BBwCCuHHHM MQQQQQQQQ~RRLTMTbTcTdTeTNVPV#W9WAW'XXY(Y%ZZZ[[[[[\\\r\s\t\\\\\\\\]]]K]L]M]侹0J#j =Uj2B*Uph B*phjB*Uph CJOJQJ6CJOJQJ]\CJ mHnHu jU 56\]mH sH 6]PJ5\>HHHJJM M\MNNVO PLPPPQ9Q_QQQQQQQQRR$If%$ & F0 & F/dhdhRR5R6R7R8R9R:R;RR?Rnhhhhhhhhhhh$If$$IfF\"   064 Fa ?R@RARBRCRDRERFRGRlRmRnRoRh$$IfF\"   064 Fa$If oRpRqRrRsRtRuRvRwRxRyRzR{R|R}R$If}R~RRRRRSISJSSSSnljleeelll` & F? & F'$$IfF\"   064 Fa SS1TETFTTTTTUUU8U9U:U^Uxk$$IfF0""064 Fa$If%$ & F?^U_U`UUUUUUUUUU*V+V,VIVJV|k$$IfF0""064 Fa$IfJVKVLVMV $Ifk$$IfF0""064 FaMVNVOVPVVVVVVVkkig[UUU$If  & F$If&$$d%d&d'dNOPQa$m$$IfF?0""064 Fa VVVVVVVVWWWWWn@hhhhhn@hhhhh$If$$IfF\~A"064 Fa WWWWWWWWWWWW Wn@hhhhhn,hhhhh$If$$IfF\~A"064 Fa W!W"W#W9W@WAW&XnllgeAA#$d%d&d'dNOPQ$a$$$IfF\~A"064 Fa&X'XIXnXXXXXXY Y'Y(YOYPYY%ZOZZZ['&$d%d&d'dNOPQ^#$d%d&d'dNOPQ[[[\M]U]W]k^m^____I_K___````#$d%d&d'dNOPQ#$d%d&d'dNOPQM]T]U]W]]]j^k^l^m^_______H_I_J_K_______````````kala bbRbUbbbcc5e6eKeLeMeNeeeeeefff1f CJmH sH mH sH  5CJ\55\ mHnHu jU 6CJ]CJ OJQJ^J CJOJPJQJ^JaJnH tH B*CJOJQJ^JphCJOJQJ^JCJPJ0J.OJQJ^J;`labTbUbbbc7dd.e/eeeeee dh$If$If$If%$$a$$da$#$d%d&d'dNOPQeeefffnhhh_ dh$If$If$$IfF\9!?  0!64 Faff f!f8f9fllfff] dh$If$If$$IfF4\9!`?`  0!64 Fa1f9f:f?@ABC?$$$IfFֈh ?"064 Fa d$IfCEFGHIJK d$IfKLNOPQRSH$?????? d$If$$IfFֈh ?"064 FaSTUWXYZ[?$$$IfFֈh ?"064 Fa d$If[\]^`x?22 $dd@&[$\$a$$$IfFֈh ?"064 Fa d$Ifxy$dd$@&If[$\$a$B֌H\66666$dd$@&If[$\$a$$$Iflֈf ""1064 la֌TUWÍS6T$$Iflֈf ""1064 la$dd$@&If[$\$a$WÍRSÎĎ(,ޏߏEFG48ghUYCF OPQEFSAT3F178MNPQpCJ mHnHu 56\]6]PJ0J#jj>U jU5\5OJQJ\^J5CJOJQJ\^JaJJSĎ)*,ߏ60$$Iflֈf ""1064 la$dd$@&If[$\$a$ߏFG5686$$Iflֈf ""1064 la$dd$@&If[$\$a$8hVW6$$Iflֈf ""1064 la$dd$@&If[$\$a$WYnC$dd$@&If[$\$a$CDF_H66666$dd$@&If[$\$a$$$Iflֈf ""1064 la6)' $dd@&[$\$a$$$Iflֈf ""1064 la$dd$@&If[$\$a$ FA3ϙ81pu$If%$$ & Fx & Fdd[$\$ѝҝӝԝ՝xx($Ifk$$IfF0LU"  064 Fa՝ /g%%&Ƞ|zzxzzz$a$ $dd@&[$\$a$k$$IfF0LU"  064 Fa$If Ƞɠ^689inuy $$Ifa$ $$Ifa$%$a$hx^h & Fx & F7 5689hiإ٥:;Z[~ ?@^_{|¨èب٨ۨܨ#$+,45=>Eݶ5CJ\mHsH 5CJ\mH sH  \mH sH CJ\mH sH CJ\CJ55CJCJ mHnHu0J# jUj?UGYtPGGGG $$Ifa$ $$Ifa$$$Ifl44r Yn04 laťȥ̥ҥإ٥[tRIIII[R $$Ifa$ $$Ifa$$$Ifl4r Yn04 la RI $$Ifa$$$Ifl4r Yn04 la $$Ifa$'*.4:R|I $$Ifa$$$Ifl4r Yn04 la $$Ifa$:;GJNTZ[k[RIIII[R $$Ifa$ $$Ifa$$$Ifl4r Yn04 laknrx~R|I $$Ifa$$$Ifl4r Yn04 la $$Ifa$RI $$Ifa$$$Ifl4r Yn04 la $$Ifa$ЦӦצݦ[RIIII[pR $$Ifa$ $$Ifa$$$Ifl4r Yn04 la RI $$Ifa$$$Ifl4r Yn04 la $$Ifa$ ),09RA$0$If^`0a$$$Ifl4r Yn04 la $$Ifa$9?@ILPX^_R|IRt $$Ifa$$$Ifl4r Yn04 la $$Ifa$_fimu{|It$$Ifl4r Yn04 la $$Ifa$ $$Ifa$RxI $$Ifa$$$Ifl4r Yn04 la $$Ifa$§Ƨ֧RA$0$If^`0a$$$Ifl4r Yn04 la $$Ifa$?v[YYRPPMG$If%$ & F,$$Ifl4r Yn04 la$,5>FGMSY_ekqr|FfPEFf8C $$Ifa$Ff A$IfEGLMRSXY^_dejkpqr{|Ʃǩ̩ͩΩک۩  !&',-.56;<ACJPJCJ5CJPJ\ 5CJ\CJPJmHsH PJmHsHmHsH CJmHsHQǩͩΩ۩ !'-.6<BHNFfKFfI$IfFfhG $$Ifa$ABGHMNSTYZ[.w 7deӬԬ<=>?PQRSˮ̮ͮή"#$jkjDUUjSUjRRUjPU0J#jOU jU 56\]OJQJmH sH 0J0CJCJOJQJaJB*CJOJQJaJph CJOJQJCJCJPJ:NTZ[\]^lmnժ.eӬԬլ>Rͮlxx$dxFfM $$Ifa$klm789ghjn."#$%&)*Ƚ0J*mHnHu0J* j0J*UmH&sH&5CJjtXCJU0J#CJjVCJU0J/CJj0J/CJU ijklm./gh߱$%ef12qrx&'()*h]h&`#$ (PP&P . A!"#$%}DyK _Toc157166754}DyK _Toc157166754}DyK _Toc157166755}DyK _Toc157166755}DyK _Toc157166756}DyK _Toc157166756}DyK _Toc157166757}DyK _Toc157166757}DyK _Toc157166758}DyK _Toc157166758}DyK _Toc157166759}DyK _Toc157166759}DyK _Toc157166760}DyK _Toc157166760}DyK _Toc157166761}DyK _Toc157166761}DyK _Toc157166762}DyK _Toc157166762}DyK _Toc157166763}DyK _Toc157166763}DyK _Toc157166764}DyK _Toc157166764}DyK _Toc157166765}DyK _Toc157166765}DyK _Toc157166766}DyK _Toc157166766}DyK _Toc157166767}DyK _Toc157166767}DyK _Toc157166768}DyK _Toc157166768}DyK _Toc157166769}DyK _Toc157166769}DyK _Toc157166770}DyK _Toc157166770}DyK _Toc157166771}DyK _Toc157166771}DyK _Toc157166772}DyK _Toc157166772}DyK _Toc157166773}DyK _Toc157166773}DyK _Toc157166774}DyK _Toc157166774}DyK _Toc157166775}DyK _Toc157166775}DyK _Toc157166776}DyK _Toc157166776}DyK _Toc157166777}DyK _Toc157166777}DyK _Toc157166778}DyK _Toc157166778}DyK _Toc157166779}DyK _Toc157166779}DyK _Toc157166780}DyK _Toc157166780}DyK _Toc157166781}DyK _Toc157166781}DyK _Toc157166782}DyK _Toc157166782}DyK _Toc157166783}DyK _Toc157166783}DyK _Toc157166784}DyK _Toc157166784}DyK _Toc157166785}DyK _Toc157166785}DyK _Toc157166786}DyK _Toc157166786}DyK _Toc157166787}DyK _Toc157166787}DyK _Toc157166788}DyK _Toc157166788}DyK _Toc157166789}DyK _Toc157166789}DyK _Toc157166790}DyK _Toc157166790}DyK _Toc157166791}DyK _Toc157166791}DyK _Toc157166792}DyK _Toc157166792}DyK _Toc157166793}DyK _Toc157166793}DyK _Toc157166794}DyK _Toc157166794}DyK _Toc157166795}DyK _Toc157166795}DyK _Toc157166796}DyK _Toc157166796}DyK _Toc157166797}DyK _Toc157166797}DyK _Toc157166798}DyK _Toc157166798}DyK _Toc157166799}DyK _Toc157166799}DyK _Toc157166800}DyK _Toc157166800}DyK _Toc157166801}DyK _Toc157166801}DyK _Toc157166802}DyK _Toc157166802}DyK _Toc157166803}DyK _Toc157166803}DyK _Toc157166804}DyK _Toc157166804}DyK _Toc157166805}DyK _Toc157166805A Dd  s fAdhttp://www.esp-c.org/uploads/images/42/l_logo.gifyK yK http://europa.eu.int/comm/education/programmes/leonardo/leonardo_en.htmlyX;H,]ą'cbc\^!/8? 3\n7\^!/8PNG  IHDRpXPLTEam]i}yݙ-=htܻ7EZj)9*ǾYf1."2>MUaDR77MZAOQ^fq&6ny곸ڮڶنġ%;kvv2A&r|BPKY"GU$)$4:I(901@韦 10?#蠧O\IW5D9HWdu7FS`'7p{npMĢn_?55=o?u_~ H愾XGce .矞ǔ8S]T+t}O~SC¯Fh2Cjvk[$[7$_YPœ5~tr!uaX;UM1. q+'G ;,"p䈉=2sWz,>Q֤yHYxVВ[mYZk!bhKJ9گCDӝ\/hy.K.9jkuVl=O f=z/E@T˭71k 2PP  Um#R$}ʸұyfJg>[O^$6m&t ӬDFj&W܍i womԃX-KLCgbFjB7SRP|Ljõ䳸4o(ç\)`qhP5 뷌T}2D\Ǝ#gT\̳&r8a4  A9Y'4ԃ|O\e|l\)6&X˚p=l_0F V4hN@π w@A<+xr_Irb!6սD.lk0Q:^F0p"%,Mqjb'+&5edb%)Kl{Y޺##8<$D ؋ r<™9~#5J 츏RUxviXp"һ}xď*B*ph4Q@B4 Body Text 3$dhCJ4"@4 Caption %xx 5CJ\DC@bD Body Text Indent &^OJ QJ D#@D Table of Figures'H^`H>V@> FollowedHyperlink >*B* ph2 @2 Index 1)$^`$&)@& Page NumberHOHTableTxt+$da$CJOJQJmHnHu<O< TableText ,$xa$ CJOJQJV^@V Normal (Web)-dd[$\$CJOJPJQJ^JaJtH &X@& Emphasis6]O a(a@( HTML Cite6]*  P VSC'Fk7M  z  g  r * v >c9'1$"z+3VW]jklz456ABOWxy%/01?G/kl%&'()*+VWXYZ[\c3 4 !""(":"Q"R"c"d"e"f"g"h"i"j"k"""""""""""""""""""""""""""##T#]#d#e###########$$$$I$$$S%%& (((>((((((((((((((((((((((((((()****+\+++++++,,,,,,(,),*,+,,,-,.,b,,n-...6/7/\/]/n////]000 1<1L1m1z11122223;3N3]3h3v333333~5555,6o666668797q78E88<9=9g99:C:;l;;;;<'==}>G?H?w???AACCC)DYDtDuDDDDFFI I\IJJVK LLLLLM9M_MMMMMMMMNNN5N6N7N8N9N:N;NN?N@NANBNCNDNENFNGNlNmNnNoNpNqNrNsNtNuNvNwNxNyNzN{N|N}N~NNNNNOIOJOOOOO1PEPFPPPPPQQQ8Q9Q:Q^Q_Q`QQQQQQQQQQ*R+R,RIRJRKRLRMRNRORPRRRRRRRRRRRRRRSSSSSSSSSSSSSSSS S!S"S#S9S@SAS&T'TITnTTTTTTU U'U(UOUPUU%VOVVVWWWXMYUYWYkZmZ[[[[K[[[\\\\l]^T^U^^^_7``.a/aaaaaaaabbbb b!b8b9b:b;b?@ABCEFGHIJKLNOPQRSTUWXYZ[\]^`xyBֈTUWÉSĊ)*,ߋFG568hVWYnCDF_ FA3ϕ81puљҙәԙՙ /g%%&Ȝɜ^689inuyšȡ̡ҡء١ '*.4:;GJNTZ[knrx~ТӢעݢ  ),09?@ILPX^_fimu{|£ƣ֣?v$,5>FGMSY_ekqr|ǥͥΥۥ !'-.6<BHNTZ[\]^lmnզ.eӨԨը>Rͪlijklm./gh߭$%ef12qr&'+0000000000000000000000000000000000000000000'0'0'0'0'0'0'0'0'0'0'0'0'0'0'00000000000000000000000000000000000000000000000000000000000000000000(000%000000000000000000000000000000* 0* 00* 00* 0%00000000000000000000000000000000000000000(00"%0"0"0"0"0"0"0"0"0"0"0"0"0"0"0"0"0"0"(00$0$$0$: $0$: $0$@$0$@$0$0$0$%0$0$0$0$0$0$0$0$0$0$0$0$0$0$0$0$0$0$0$0$0$0$0$0$0$0$0$0$0$(0"0*"0*"0*%0*"0*"0*"0*0*"0*"0*"0*"0*"0*"0*0*"0*"0*"0*"0*"0*0*"0*"0*8 0*8 0*8 0*8 0*8 0*8 0*0*007/(07/80]/0n/0n/0n/0n/!0n/!0n/!0n/!0n/!0n/!$0n/@0n/0z10z1@0n/020202020202020202020202@0n/03@0n/0~50~50~50~50~50~50~5(07/060606!06!06!06!0606806!0=9!0=9!0=9!0=9!0=9!0=98060;!0;!0;!0;!0;!0;0;8060H?0H?0H?0H?0H?0H?00C0C0C0C(0C0uD0uD0uD0uD0uD(0C0I/ 0I/ 0I/ 0I/ 0I/ 0I0I0 0I0 0I0 0I0 0I0 0I0I0I0I%0I0I0I0I0I0I0I0I0I0I0I0I0I0I0I0I0I0I0I0I0I0I0I0I0I0I0I0I0I0I0I0I0I0I0I0I0I0I0I0I0I0I0I0I0I(0C0N' 0N' 0N' 0N0N0N0N? 0N? 0N? 0N? 0N0N%0N0N0N0N0N0N0N0N0N0N0N0N0N0N0N0N0N0N0N0N0N0N0N0N0N0N0N0N0N0N0N`0N`0Np0OR0PR0PR0PR0PR0PR0PR0PR0PR0PR0PR0PR0PR0PR0PR0PR0PR0PR0PR0PR0PR0PR0PR0PR0PR0PR0PR0PR0PR0PR0PR0PR0PR`0N`0N09S09S09S09S09S09S09S09S`0N0T0T0T`0N0 U0 U0 U0 U0 U0 U0 U&0 U0 U(0C80W0W0W@0W0MY0MY0MY0MY0MY@0W0[0[0[0[0[0[@0W0\0\0\0\0\0\80W0U^0U^00W0_0_0_%0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_0_80WH0Je0~e0~e0~e0~e0~e0~e0~e0~e0~e0~e0~e0~e0~e0~e@0Je%0e!0e!0e!0e!0e!0e!0e!0e0e0e80W0f0f0f0f0f0f0f0f0f0f0f0f0f0f0f0f0f0f0f0f0f0f0f0f00Ni(0Ni0i0i(0Ni0hk0hk0hk80hk0l$0l0l%0l0l0l0l0l0l0l0l0l0l0l0l0l0l0l0l0l0l0l0l0l0l0l0l0l0l0l0l0l%0l0l0l0l0l0l0l0l0l0l0l0l0l0l0l0l0l0l0l0l0l0l0l0l%0l0l0l0l0l0l0l0l0l0l0l0l0l0l0l0l0l0l0l0l0l0l0l0l0l0l0l0l0l0l0l0l0l0l80hk0҅0҅0҅0҅%0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅0҅80hk80hk0`0`0`0`0`0`0`0`0`0`0`0`0`0`0`0`0`0`0`0`0`0`0`0`0`0`0`0`0`0`0`0`0`0`0`0`0`0`0`0`0`0`0`0`0`0`0`0`0`0`0`0`80hk0 0000!0!0!0!0!00@0!0!0!0!0$0$0%00000000000000000000000080(00000000000007 07 07 07 00!0000%0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000,0,0000%0000000000000000000000000000000000000000000000000000000000800000$0000000000000000000000000000000000000000000000000@0@0@0 0 T#'  -]X/3AM]1f9rWEAk*[^_`abcdefhijklmnopqst{ $V5xZQ&k&&&'*,,.0,063h7=HR?RoR}RS^UJVMVVW W&X[`ef9fhfff!gDgggggZhfhhii-iIiij.ldmsrstw{҉ $,4<CKS[x֌Sߏ8WC՝Ƞ:k9_N*\gruvwxyz|}~)]  +5QSTVv2NPQSs">@ACc"$%'Gm%ACDFfx%Jfhik2457Wj+GJKMm e   # X t w x z   . E a d e g     7 P l o p r  $ ' ( * J T p s t v 8;<>^l )B^`ac4679Y"$%'G+./1Q!"$Do "BsXtwxzr!!! ##!#D(Z(\(b+x+z+MMMLPbPdPWWWXrXsXXXXXYKY5aKaMa n6n8nwppptttĆچ݆ P7MP58¤ؤۤ<>PR˪ͪ#jl8g* tX%TX%TX%TX%TX%TX%TX%TX%TX%TX%TX%TX%TX%TX%TX%TX%TX%TX%TX%TX%TX%TX%TX%TX%TX%TX%TX%TX%TX%TX%TX%TX%TX%TX%TX%TX%TX%T̕ tX%TX%TX%TX%TX%TX%TX%TX%TX%TX%TX%TX%TX%TX%TX%T̕ t t t t t t tXXCX t t t t tX tX t tXXXXXXX !!T/XR$ MCeh!טR޵-R$ O.EIR$#D6-@0(  B S  ?*: _Toc157166754 _Toc157166755 _Toc157166756 _Toc157166757 _Toc157166758 _Toc157166759 _Toc157166791 _Toc157166792 _Toc157166760 _Toc157166793 _Toc157166761 _Toc157166794 _Toc157166762 _Toc157166795 _Hlt157081357 _Toc157166763 _Toc157166764 _Toc157166765 _Toc157166766 _Toc157166767 _Toc157166768 _Toc157166769 _Toc157166770 _Toc157166771 _Toc157166772 _Toc157166796 _Toc157166773 _Toc157166797 _Toc157166774 _Toc157166775 _Toc157166776 _Toc157166777 _Toc157166798 _Toc157166778 _Toc157166779 _Toc157166780 _Toc157166781 _Toc157166782 _Toc157166783 _Toc157166799 _Toc157166800 _Toc157166801 _Toc157166784 _Toc157166802 _Toc477774019 _Toc525912707 _Toc471373901 _Toc477772288 _Toc525912512 _Toc157166785 _Toc157166786 _Toc157166803 _Toc157166787 _Toc157166788 _Toc157166804 _Toc157166805 _Toc157166789 _Toc157166790l!"#$>(*\+w-7/]/n/6=9;H?CuDIMNFPWWU^_/aJefNiihklnqpt҅^^^^^1_ը+ @ !"#$%&'()*+45/01,-.236789 ."#S#H$(*+w-[/m//6f9;v?CDIMNPWW^4`a}e4gcii|klWnpAuo#...$hk+13ilVWjl46ABxy~/1JN!!!!(",":"A"p"y"''#*.**** +|++++DDPPATHT UUWW+b1bdeeee egghkqk~kkllXn[ntnxnnnnnnnoooowwQ\ $ns›Ǜ!ptYb}ݤ,4>EGLMRSXY^_dejkp6<w{el/HIJKLMNOPQRh­íĭŭƭǭȭɭʭ˭ %GHIJKLMNOPQfҮӮԮծ֮׮خٮڮۮܮ2RSTUVWXYZ[\rۯ(+OP*+23UW\]ilyz36@BNOVWwy~$%.1>?FGv}S%Z%%% (((((((())3366w6{6q7x788E8N888@@BBDD\I`IJJJJVKYK LLLLLLMM9M@M_MbMPPQ$Q:QDQ`QgQQQQQQQ,R3RWWMYTY.Z6Z[[[[!\%\ ]]N`Y`hh&h,h.h2h;hAhkhphhhhhhhhhhi9nWnXnZntnwnnnnnnnoooot uYu[uuuvvxy]hYf^f6:nt>EGLMRSXY^_dejkp?K/fhޭ#%df02pr(+3333333333333333333333333333333333333333333333333333333333333333333333+6O:"R"T#]# ((..33~55uDDOORRSSSSMYWYaaaakbxbccc ccccddddd$e+eiillXn[noojl !(*13:<CELNUWy68>Mr| .6ը(+Vita KalnberzinaLC:\data\Es\Application Data\Microsoft\Word\AutoRecovery save of Schedule.asdVita KalnberzinaDC:\data\Es\Mes documents\mamma from Karlis\BC\seminars2\Schedule.docVita Kalnberzina#C:\data\Es\Bureau\zita\Schedule.docVita Kalnberzina#C:\data\Es\Bureau\zita\Schedule.docVita Kalnberzina#C:\data\Es\Bureau\zita\Schedule.docVita Kalnberzina#C:\data\Es\Bureau\zita\Schedule.docVita Kalnberzina#C:\data\Es\Bureau\zita\Schedule.docVita Kalnberzina#C:\data\Es\Bureau\zita\Schedule.docVita Kalnberzina#C:\data\Es\Bureau\zita\Schedule.doc uzsienioki 1HC:\My Documents\Projekto_seminarai\Vita-Kalnberzina-Writing_handouts.doc0!`8 8 f lw +!2mT ~ c7B άZAf 4B<\:Cc`B]V52V7'` b\7\  C \ ҕH 5 h  \x֊j0,n\FJ1`p\ P4F" |;32T3Jh[x ktnĥ V20gx ,+fb ,F x$  +n (  H 0P0^    t]   }q O%  $u  U  NB~&`7:Vn YA EX #Y ftΈ v w }X9F1naA ,st xucth^" ~J}l+@6A H0a;Q]4r Nu bt< EJO,mn/p ]RN +J HsXkC2S 8j!:0?  y`-9 J * R  uR 4 ;_= ;MpnPxnHo?W8 GYL$>XS4:fP#[~U8|  * @cF NP HZ( N&_ ʔx-!NN2d!٨-sV"Hgt"K8"8'D("`,l# $#2jU# %z$ #$ #$ .%%  8%}(d%8Ze%:Dp% =% 5%.: q& &Z&NGnr& i' O' 0 (un\! ( =tz)!'~n`*0e~* fd+&hf0+thX, fH"$, 8ie, Y,N k-&5-Vhu '- 3z.^d. t.* ;/8f/l/ >^A0/q`'0HƞN1|1@R7K2R$N2 uf 3fX)#3Nu33 ?3~B4@PIE4<+i4 5?8}5 A5zzTS5 l`5ڑ51nP6H 6 c@60T|6='`6"p6J+Ƣz7 ]H"73("8`-4NN8r(e 8QQc>>9fX3v9pm59 {9 ;1:o HQb2: L?: +: N;}(5; bQ; r?< NU<  g< @~J=LXR=|qiK=TyF;=@D= u>N0W?)br!? /@*-#@:Jo)@ntaF@ B@||GA>jg.A dA6D"xAAJ0L[ K |K W0 LU Ly4M\g$MN CrN,~;N w]N#O*{+HPĵp!sP MTlb3P#,P ziQD4rUQd{1?QbIQ``lQ r8R RfR0inR>NRLU@i.0SFcy]mPS hS*TBWSZ*,LTj&&fT'tT $6TP.F|_T T IYTސp9aU F9 Uf4+VD[TV_"|A}Vj6eV EVp}0W OX UO:Y <@YJ\|FYNY&JVPaY6g?yY:e5ZP:}Z Z *r)[ӎH?[ ~[[Zm[nz4\rZD\ U\{WVA\N"]2_^jxU^'v|^ X^BؗMLd_\jv_ _"a]_ vO_ ! _xP` <9`ҁsw`Ć.` RD`z `B0r>:tZa2f;ta M'b 6tb wTbv$ Bc c qcNd ^HdO;m.dSTdVhFdFWe aMe Nf2f f&f{-g )?gNIp00g Wg6h~hPhuhx^1iNr,(BQ{i̱2Di0: ;i mPi(SHjƜ,j idzk wIk.b[#5kvkl-4m  n)b],n 72nVfqU2n&Gpbn nR[XLo K;p8+_p/up"p pzbVsp0z3q [Iqp)>QZq!44Sq |zr r gs:Bls ]"&t w\(t dRt tx&ueDuuBuF'uf1{qvnLv oaw h~xr9HE&xD`L*y Uay N_y,U *z GU)zNV7[zr`=vcz z@PdSB{*p J{ M{$Jd{ {ȩ{HJj| +s| uV|"T|F!|f|l2^X} c}$% } <~X'<~"MD~ e~~ jXG~ |( hh^h`OJQJo(* hh^h`OJQJo( hh^h`OJQJo(hh^h`.hh^h`.77^7`nn^n`.^`..u ^`...  ^` ....  ^` ..... E ^` ...... E ^`.......  ^`........hh^h`.h hh^h`OJQJo(h 88^8`OJ QJ o(oh ^`OJ QJ o(h   ^ `OJQJo(h   ^ `OJ QJ o(oh xx^x`OJ QJ o(h HH^H`OJQJo(h ^`OJ QJ o(oh ^`OJ QJ o(hh^h`.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.^`CJOJ QJ o(^`CJOJ QJ o(pp^p`CJOJ QJ o(@ @ ^@ `CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(PP^P`CJOJ QJ o(h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.@^`56>*CJOJQJo(. h ^`OJQJo(h ^`OJ QJ o(oh pp^p`OJ QJ o(h @ @ ^@ `OJQJo(h ^`OJ QJ o(oh ^`OJ QJ o(h ^`OJQJo(h ^`OJ QJ o(oh PP^P`OJ QJ o( hh^h`OJQJo( hh^h`OJQJo(@Q^Q`. hh^h`OJQJo( hh^h`OJQJo(hh^h`.h  ^ `.h^`.hL^`L.h| | ^| `.hLL^L`.hL^`L.h^`.h^`.hL^`L.^`CJOJ QJ o(^`CJOJ QJ o(pp^p`CJOJ QJ o(@ @ ^@ `CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(PP^P`CJOJ QJ o(h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.@^`. hh^h`OJQJo(h88^8`.h^`.h L ^ `L.h  ^ `.hxx^x`.hHLH^H`L.h^`.h^`.hL^`L.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.@^`.@^`. hh^h`OJQJo(^`.^`.pLp^p`L.@ @ ^@ `.^`.L^`L.^`.^`.PLP^P`L.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L. P^`Po( Chapter @@^@`o(.0^`0o(..``^``o(... ^`o( .... ^`o( ..... ^`o( ...... `^``o(....... 00^0`o(........@^`.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.@^`.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L. hh^h`OJQJo(hh^h`.hh^h`.P^`P@@^@`.0^`0..``^``... ^` .... ^` ..... ^` ...... `^``....... 00^0`........hh^h`. hh^h`OJQJo(hh^h`.77^7` 77^7`.nn^n`.. >^`...  ^` ....  E ^` .....  E ^`......   ^`.......   ^`........ h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.@^`.hh^h`.hh^h`.hh^h`.hh^h`.^`CJOJ QJ o(^`CJOJ QJ o(pp^p`CJOJ QJ o(@ @ ^@ `CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(PP^P`CJOJ QJ o(h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.hh^h`.hh^h`.h  ^ `.h^`.hL^`L.h| | ^| `.hLL^L`.hL^`L.h^`.h^`.hL^`L.hh^h`CJOJ QJ o(qhh^h`.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.hh^h`.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L. hh^h`OJQJo(h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.77^7`77^7`.nn^n`..^`...M k ^M `...M M ^M `...M k ^M `...M M ^M `...M M ^M `...hh^h`.h ^`OJQJo(h ^`OJ QJ o(oh pp^p`OJ QJ o(h @ @ ^@ `OJQJo(h ^`OJ QJ o(oh ^`OJ QJ o(h ^`OJQJo(h ^`OJ QJ o(oh PP^P`OJ QJ o(h ^`OJQJo(h ^`OJ QJ o(oh pp^p`OJ QJ o(h @ @ ^@ `OJQJo(h ^`OJ QJ o(oh ^`OJ QJ o(h ^`OJQJo(h ^`OJ QJ o(oh PP^P`OJ QJ o(hh^h`. hh^h`OJQJo(hh^h`.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L. hh^h`OJQJo(h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.@h^`.@^`.hh^h`.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.^`CJOJQJo(^`CJOJ QJ o(opp^p`CJOJ QJ o(@ @ ^@ `CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(PP^P`CJOJ QJ o(h  ^ `.h^`.hL^`L.h| | ^| `.hLL^L`.hL^`L.h^`.h^`.hL^`L.^`CJOJQJo(^`CJOJ QJ o(opp^p`CJOJ QJ o(@ @ ^@ `CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(PP^P`CJOJ QJ o(@^`. hh^h`OJQJo(h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L. hh^h`OJQJo( hh^h`OJQJo(hh^h`. hh^h`OJQJo(@^`.@^`.@ ^`56CJ. h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.h^`.H H^H` o(.808^8`0o(..808^8`0o(... 808^8`0o( .... ^`o( ..... ^`o( ...... `^``o(....... `^``o(........h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.@^`.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.hh^h`.hh^h`.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.@hh^h`. @^`56>*CJOJQJo(. h ^`OJQJo(h ^`OJ QJ o(oh pp^p`OJ QJ o(h @ @ ^@ `OJQJo(h ^`OJ QJ o(oh ^`OJ QJ o(h ^`OJQJo(h ^`OJ QJ o(oh PP^P`OJ QJ o(h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.@hh^h`.h^`.^`.pLp^p`L.@ @ ^@ `.^`.L^`L.^`.^`.PLP^P`L.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.h ^`OJQJo(h ^`OJ QJ o(oh pp^p`OJ QJ o(h @ @ ^@ `OJQJo(h ^`OJ QJ o(oh ^`OJ QJ o(h ^`OJQJo(h ^`OJ QJ o(oh PP^P`OJ QJ o( hh^h`OJQJo(h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L. hh^h`OJQJo(hh^h`. hh^h`OJQJo(hh^h`. hh^h`OJQJo(^`CJOJQJo(^`CJOJ QJ o(opp^p`CJOJ QJ o(@ @ ^@ `CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(PP^P`CJOJ QJ o(^`CJOJQJo(^`CJOJ QJ o(opp^p`CJOJ QJ o(@ @ ^@ `CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(PP^P`CJOJ QJ o(@^`56>*CJOJQJo(. hh^h`. hh^h`OJQJo(h ^`OJQJo(h ^`OJ QJ o(oh pp^p`OJ QJ o(h @ @ ^@ `OJQJo(h ^`OJ QJ o(oh ^`OJ QJ o(h ^`OJQJo(h ^`OJ QJ o(oh PP^P`OJ QJ o(hh^h`.h88^8`.h^`.h L ^ `L.h  ^ `.hxx^x`.hHLH^H`L.h^`.h^`.hL^`L.hh^h`. hh^h`OJQJo(hh^h`.@^`.hh^h`.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.h  ^ `.h^`.hL^`L.h| | ^| `.hLL^L`.hL^`L.h^`.h^`.hL^`L. hh^h`OJQJo(@^`56>*CJOJQJo(. h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.@^`. hh^h`OJQJo(hh^h`.P^`P..^`...x^`x....  ^` .....  X@ ^ `X ......  ^ `....... 8x^`8........ `H^``.........@hh^h`.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.hh^h`.h88^8`.h^`.h L ^ `L.h  ^ `.hxx^x`.hHLH^H`L.h^`.h^`.hL^`L.hh^h`.^`CJOJ QJ o(^`CJOJ QJ o(pp^p`CJOJ QJ o(@ @ ^@ `CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(PP^P`CJOJ QJ o(h88^8`.h^`.h L ^ `L.h  ^ `.hxx^x`.hHLH^H`L.h^`.h^`.hL^`L.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.hh^h`.@^`.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.^`CJOJQJo(^`CJOJ QJ o(opp^p`CJOJ QJ o(@ @ ^@ `CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(PP^P`CJOJ QJ o(77^7`77^7`.nn^n`..>^`...  ^` ....  ^` ..... E ^` ...... E ^`.......  ^`........hh^h`.h^`.^`.pLp^p`L.@ @ ^@ `.^`.L^`L.^`.^`.PLP^P`L.@hh^h`.hh^h`.h^`77^7`.nn^n`..^`...M k ^M `...M M ^M `...M k ^M `...M M ^M `...M M ^M `...P^`P@@^@`.0^`0..``^``... ^` .... ^` ..... ^` ...... `^``....... 00^0`........h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L. hh^h`OJQJo(h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.hh^h`.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.hh^h`.^`CJOJQJo(^`CJOJ QJ o(opp^p`CJOJ QJ o(@ @ ^@ `CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(PP^P`CJOJ QJ o(hh^h`CJOJ QJ o(q @^`56>*CJOJQJo(. hh^h`.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.h ^`OJQJo(h ^`OJ QJ o(oh pp^p`OJ QJ o(h @ @ ^@ `OJQJo(h ^`OJ QJ o(oh ^`OJ QJ o(h ^`OJQJo(h ^`OJ QJ o(oh PP^P`OJ QJ o(h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.hh^h`.^`CJOJQJo(^`CJOJ QJ o(opp^p`CJOJ QJ o(@ @ ^@ `CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(PP^P`CJOJ QJ o(@^`.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.^`CJOJQJo(^`CJOJ QJ o(opp^p`CJOJ QJ o(@ @ ^@ `CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(PP^P`CJOJ QJ o(@^`.hh^h`.hh^h`.@^`.hh^h`.hh^h`.hh^h`.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.hh^h`. hh^h`OJQJo(hh^h`.hh^h`.hh^h`.@^`.@^`.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.^`CJOJQJo(^`CJOJ QJ o(opp^p`CJOJ QJ o(@ @ ^@ `CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(PP^P`CJOJ QJ o( hh^h`OJQJo(@hh^h`.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.hh^h`. @^`56>*CJOJQJo(. @^`.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.hh^h`.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.h  ^ `.h^`.hL^`L.h| | ^| `.hLL^L`.hL^`L.h^`.h^`.hL^`L.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L. ^`OJQJo( ^`OJ QJ o(o pp^p`OJ QJ o( @ @ ^@ `OJQJo( ^`OJ QJ o(o ^`OJ QJ o( ^`OJQJo( ^`OJ QJ o(o PP^P`OJ QJ o(h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.hh^h`.@^`. hh^h`OJQJo(@^`.@Q^Q`.hh^h`.@^`.hh^h`.hh^h`.@^`.^`CJOJQJo(^`CJOJ QJ o(opp^p`CJOJ QJ o(@ @ ^@ `CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(PP^P`CJOJ QJ o(hh^h`.hh^h`.hh^h`.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.hh^h`.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.h  ^ `.h^`.hL^`L.h| | ^| `.hLL^L`.hL^`L.h^`.h^`.hL^`L.h ^`OJQJo(h ^`OJ QJ o(oh pp^p`OJ QJ o(h @ @ ^@ `OJQJo(h ^`OJ QJ o(oh ^`OJ QJ o(h ^`OJQJo(h ^`OJ QJ o(oh PP^P`OJ QJ o(hh^h`. hh^h`OJQJo(^`CJOJQJo(^`CJOJ QJ o(opp^p`CJOJ QJ o(@ @ ^@ `CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(PP^P`CJOJ QJ o(h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.hh^h`.P^`P..^`...x^`x....  ^` .....  X@ ^ `X ......  ^ `....... 8x^`8........ `H^``.........hh^h`.h ^`OJQJo(h ^`OJ QJ o(oh pp^p`OJ QJ o(h @ @ ^@ `OJQJo(h ^`OJ QJ o(oh ^`OJ QJ o(h ^`OJQJo(h ^`OJ QJ o(oh PP^P`OJ QJ o(h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.$@^`56>*CJOJQJo() hh^h`.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.hh^h`.^`CJOJQJo(^`CJOJ QJ o(opp^p`CJOJ QJ o(@ @ ^@ `CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(PP^P`CJOJ QJ o( @^`56>*CJOJQJo(. h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.^`CJOJQJo(^`CJOJ QJ o(opp^p`CJOJ QJ o(@ @ ^@ `CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(PP^P`CJOJ QJ o( hh^h`OJQJo(@^`.@^`.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.@^`. hh^h`OJQJo(hh^h`.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.@^`.^`CJOJQJo(^`CJOJ QJ o(opp^p`CJOJ QJ o(@ @ ^@ `CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(PP^P`CJOJ QJ o( hh^h`OJQJo(@^`.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L. hh^h`OJQJo(@^`. hh^h`OJQJo( hh^h`OJQJo(^`CJOJQJo(^`CJOJ QJ o(opp^p`CJOJ QJ o(@ @ ^@ `CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(PP^P`CJOJ QJ o(h ^`OJQJo(h ^`OJ QJ o(oh pp^p`OJ QJ o(h @ @ ^@ `OJQJo(h ^`OJ QJ o(oh ^`OJ QJ o(h ^`OJQJo(h ^`OJ QJ o(oh PP^P`OJ QJ o(@^`.^`CJOJQJo(^`CJOJ QJ o(opp^p`CJOJ QJ o(@ @ ^@ `CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(PP^P`CJOJ QJ o(h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.hh^h`.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L. hh^h`OJQJo( hh^h`OJQJo(hh^h`.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.^`CJOJQJo(^`CJOJ QJ o(opp^p`CJOJ QJ o(@ @ ^@ `CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(PP^P`CJOJ QJ o(h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.hh^h`.hh^h`.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L. hh^h`OJQJo(h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.@^`.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.hh^h`.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.@hh^h`.@^`.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.@^`56>*CJOJQJo(.  hh^h`OJQJo(h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.hh^h`.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.hh^h`. hh^h`OJQJo(h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L. hh^h`OJQJo(h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.@^`.hh^h`. ^`OJQJo( ^`OJ QJ o(o pp^p`OJ QJ o( @ @ ^@ `OJQJo( ^`OJ QJ o(o ^`OJ QJ o( ^`OJQJo( ^`OJ QJ o(o PP^P`OJ QJ o(h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.^`CJOJQJo(^`CJOJ QJ o(opp^p`CJOJ QJ o(@ @ ^@ `CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(PP^P`CJOJ QJ o(hh^h`.hh^h`. hh^h`OJQJo(h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.hh^h`.hh^h`.@hh^h`. hh^h`OJQJo(h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.@^`. hh^h`OJQJo(hh^h`.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.hh^h`.^`CJOJQJo(^`CJOJ QJ o(opp^p`CJOJ QJ o(@ @ ^@ `CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(PP^P`CJOJ QJ o( hh^h`OJQJo(h  ^ `.h^`.hL^`L.h| | ^| `.hLL^L`.hL^`L.h^`.h^`.hL^`L.hh^h`.^`CJOJQJo(^`CJOJ QJ o(opp^p`CJOJ QJ o(@ @ ^@ `CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(PP^P`CJOJ QJ o(hhh^h`.h88^8`.hL^`L.h  ^ `.h  ^ `.hxLx^x`L.hHH^H`.h^`.hL^`L.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.^`.^`.pp^p`.@ @ ^@ `.^`.^`.^`.^`.PP^P`.@^`.@<^`<@<^`<.@L<^L`<..@ <^ `<...@  <^ `< ....@ <^`< .....@ \<^\`< ......@  <^ `<.......@ <^`<........h  ^ `.h^`.hL^`L.h| | ^| `.hLL^L`.hL^`L.h^`.h^`.hL^`L. hh^h`OJQJo(h^`.^`.pLp^p`L.@ @ ^@ `.^`.L^`L.^`.^`.PLP^P`L.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L. hh^h`OJQJo(hh^h`.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.^`CJOJQJo(^`CJOJ QJ o(opp^p`CJOJ QJ o(@ @ ^@ `CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(PP^P`CJOJ QJ o(77^7`P^`P..^`...xp^`x....  ^` .....  X ^ `X ......  ^ `....... 8^`8........ `H^``......... hh^h`OJQJo(77^7` 77^7`.nn^n`.. ^`...   ^` ....  E ^` .....  E ^`......   ^`.......   ^`........ hh^h`.h 88^8`OJQJo(h ^`OJ QJ o(oh   ^ `OJ QJ o(h   ^ `OJQJo(h xx^x`OJ QJ o(oh HH^H`OJ QJ o(h ^`OJQJo(h ^`OJ QJ o(oh ^`OJ QJ o(h^`.^`.pLp^p`L.@ @ ^@ `.^`.L^`L.^`.^`.PLP^P`L.hh^h`.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L. hh^h`OJQJo(@^`.@W^W`.77^7`77^7`.nn^n`..>^`...  ^` ....  ^` ..... E ^` ...... E ^`.......  ^`........hh^h`.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L. hh^h`OJQJo(^`.^`.pLp^p`L.@ @ ^@ `.^`.L^`L.^`.^`.PLP^P`L.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L. hh^h`OJQJo( hh^h`OJQJo(hh^h`.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L. hh^h`OJQJo(h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.hh^h`.hh^h`.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.@q^q`.@^`.@^`.hh^h`. hh^h`OJQJo(h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.@^`. hh^h`OJQJo( hh^h`OJQJo(@<^`<@<^`<.@L<^L`<..@ <^ `<...@  <^ `< ....@ <^`< .....@ \<^\`< ......@  <^ `<.......@ <^`<........hh^h`.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.^`CJOJQJo(^`CJOJ QJ o(opp^p`CJOJ QJ o(@ @ ^@ `CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(^`CJOJ QJ o(PP^P`CJOJ QJ o(hh^h`.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.hh^h`.@^`.hh^h`.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L. hh^h`OJQJo(hh^h`.h88^8`.h^`.h L ^ `L.h  ^ `.hxx^x`.hHLH^H`L.h^`.h^`.hL^`L.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.@^`56>*CJOJQJo(. hh^h`.@^`.hh^h`.h^`.h^`.hpLp^p`L.h@ @ ^@ `.h^`.hL^`L.h^`.h^`.hPLP^P`L.h 55^5`OJQJo(h ^`OJ QJ o(oh   ^ `OJ QJ o(h   ^ `OJQJo(h uu^u`OJ QJ o(oh EE^E`OJ QJ o(h ^`OJQJo(h ^`OJ QJ o(oh ^`OJ QJ o( hh^h`OJQJo( hh^h`OJQJo(h 88^8`OJQJo(h ^`OJ QJ o(oh   ^ `OJ QJ o(h   ^ `OJQJo(h xx^x`OJ QJ o(oh HH^H`OJ QJ o(h ^`OJQJo(h ^`OJ QJ o(oh ^`OJ QJ o(hh^h`.h  ^ `.h^`.hL^`L.h| | ^| `.hLL^L`.hL^`L.h^`.h^`.hL^`L.?3?3l+e~l+e~le~le~7K2le~lle~upup n+ nN+NN+NN+N>QZqB]qcaY_e 8&fT4NN8MLd_{+HPnRSB{p6'` GGU)z8f/D("a;g.A<~0W?x]"&t)@gx z4\ `1?Q<@Ytx&usV"BWSEFEFHTZ;_=;_=TZ"]"]TZc}c}PUZ;1:X,X,UZVZxU^\\dVZqvqvVZ( ( WZK;pK;plWZhShSWZ+k|E+k|EXZNu8l/L?:(5;r8R 6H|K1ES9XDj-4m0WT-gR L[ KaMe 8ie,% }H"$,]_UO:YEFcF VA\)#3RtXZx-!Y,u>("8XZxn yS5pbn4r+s|% `,l#r!?FSG\7\;"C^X}OXd.{9:}Zidzkv*zrJ Ji'EXnr&6tb5FP6P XR=XR=^A0>^A0DZZ&x&xZZ3J3JZZ@~J=@~J=L[Z:f:f[Z0 (0 ([Z/@#O+DD+DDT\ZFdFd\ZM{M{]Z-#@-#@\]Z  ]ZaF@O'Qb2:U ^ uRaA! (bt<Jj|v|^Vn g<;N6AZD\Bc"pBQ{iN_y|2fd+uu ^ZziQziQd^ZJ1J1^Zsw`sw`_Z3v93v9l_Z^1i^1i_Zy4MIQIQ`ZNRNRt`ZrUQrUQ`Z``$aZ$6T$6T|aZMpMpaZ+_pZm[Zm[,bZZe%MD~9 U9 UbZj-Dj-DbZz7vczLo(t8}5qCqC4cZ'u'ucZ 'tTbQ;d{],nlw59jv_m2H%z$$N2{Jc@6CrNXSh~x] 4BYAg$MNr?<G~ '-th #$f+:dRtZNU<c7BEp% }q .`"F+i4lQ C2f2mT q&c 4HEVw4M'bTVRfR5uukRD`B4b 3z.mPiH[Iq4Sq4hJL*y[x=e~*p\lst] taz3qdP`8/p|zrH?[#,PUay_T=%vlEp J{U#*]mPSvO_J|Weu3395 ;i$u .%%#Yoaw#$^"wIkNfHjFYNY=tz)! _ W8,sdAgsH  Hs"6HpT|TdwTb'`6$#oe5Z[~N1)?gX^spN;P4uV|N2d!T|6uf 3AJgt"B@~J|GA_^ k-~n`*EJO*,LT"^HdPh@HE4iK=qU2n~EFI{'<~!sP* <9`72nHp9aUW0 Lc&Z&`'0 L A5~Z( \x}nz-*r)[|<YLi5%0+,n ;/ 8|(xA]H"7l`5c>>9IYT#5kt. 8%g?yYfu?JkC(d%1F;=f&ff j!:WgV.0Sw]N|A}V:tZam.dKFV7[zb3PU\t6h~[[chTTZ b@^`.TZ g@^`.UZ d@^`.\UZ H@^`.UZ @^`. VZ .@ ^`OJQJo(pVZ @Q^Q`.VZ @^`. WZ @^`.xWZ @^`.WZ @^`.(XZ @^`.XZ @h h^h`OJQJo(XZ @ ^`OJQJo(*HYZ @^`.YZ h@^`.YZ @^`.PZZ a@^`.ZZ @^`.[Z @^`.X[Z @^`.[Z p@^`.\Z @^`.`\Z @Q^Q`.\Z @^`.]Z o@^`.h]Z @^`.]Z @^`.^Z @q^q`.p^Z @^`.^Z @^`. _Z @^`.x_Z @^`._Z @^`.(`Z @^`.`Z @^`.`Z @^`.0aZ @^`.aZ @^`.aZ @^`.8bZ @^`.bZ @^`.bZ a@^`.@cZ @^`.cZ @^`.VP4T^>)z< _                                    lgE<9xtr4opxxd>ʞ hFp rI b3/,^$txxƲǸ^pJӔM"         u8                  .8f0p^,j~t1bؙ                 (3>F F`Ufw0%F2HlXMX,^kn| 3rm2y*KPhfxX         &֬^R|8nw r$?3                   zP]<6L|'FB6 6qf j $"T,. ree Z;n,@9 sx/                                    o՞(P¨crZJ䜀N*f"T,         l`9dDOR؀m,UrhH&j].nUL9J"vOA:^P"c         n;Dlf  EDFy(:ld{p          x3H>$x,\>          lHHvJbb^1lԎRޣJ*+_ <)*}$h                  $MT]ؒKO,IÀ'89PG֓                                             z <2J`Æ:IvzΞh          zJIdش@E$zD@ pTO )>LL+Nn#]P.( ~:؄NeZf         n4,"21TvPfHըs6p{„8         h"<4daWXh⚴,~> v                                    QVZ RbdRɂmd]                                             +3VW]jklz45ABOWxy%/01?G'*+XYZ""(":"Q"R"f"g"i"j"k"""""""""""T#]#d#e##########$$$(((((((((((((((((++++++,,,(,+,,,-,MMMNNN9NANENFNGNpNxN|N}N~NPPPPQQQ8Q9Q:Q^Q_Q`QQQQQQQQQQ*R+R,RIRJRKRLRMRNRRRRRRRRRRRRSSSSSSSSSSSSS S!Saaaaaaabbbb b!b8b9b:b;b?@ABCEGHIJKLNPQRSTUWYZ[\]^xyBֈTUWÉSĊ)*,ߋG568hVWYnCDF_puәԙՙ inuyšȡ̡ҡء١ '*.4:;GJNTZ[knrx~ТӢעݢ  ),09?@ILPX^_fimu{|£ƣ֣$,5>FGMSY_ekqr|ǥͥΥۥ !'-.6<BHNTZ[+@ ( (L ( (*@Unknown G:Times New Roman5Symbol3& :Arial7& UniversW& ??Arial Unicode MSTahomaWCenturyTimes New Roman7& VerdanaSTimesTimes New RomanmCentury SchoolbookTimes New Roman9Garamond?5 :Courier New;Wingdings"qh۱۱ƞ:bx,J5Y20dHg& 2Q5Item Writers Course: L+gatne, 14 - 17 February, 2002 sandra prince uzsienioki 1ZOh+'0, DP l x  6Item Writers Course: Lgatne, 14 - 17 February, 20021temsandra princeCoandandNormalp uzsienioki 1Co3zsMicrosoft Word 9.0e@G@@xB@*Bx,Z՜.+,0, hp  The British Council5JH 6Item Writers Course: Lgatne, 14 - 17 February, 2002 Title  !"#$%&'()*+,-./0123456789:;<=>?@ABCDEFGHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuvwxyz{|}~      !"#$%&'()*+,-./0123456789:;<=>?@ABCDEFGHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuvwxyz{|}~      !"#$%&'()*+,-./0123456789:;<=>?@ABCDEFGHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuvwxyz{|}~Root Entry F BData Y1TableWordDocument*SummaryInformation(DocumentSummaryInformation8CompObjjObjectPool B B  FMicrosoft Word Document MSWordDocWord.Document.89q