Users of corpora have noticed that a query may return exact copies of sentences, paragraphs and even larger portions of articles. This is not a mistake in corpus compilation, but these repetitions occur in the original material already. Some examples are the following.
<s> See on tõsi . </s>
occurs 202 times in our newspaper corpus.<s> Avaldatud foto honorar 750 krooni puhtalt ! </s>
occurs 34 times in the corpus of Eesti Ekspress. The sentence<s> Minu kolmapäevased autoritekstid ilmuvad ainult Päevalehe paberversioonis . </s>
occurs 53 times in the corpus of Eesti Päevaleht, ending the opinion piece by Aavo Kokk, published every Wednesday.<s> Antud kulude number ei sisalda finantseerimist välisabi arvelt . </s>
7 times in different articles. The sentences before and after it were different; 2 examples:<p> <s> Eelarve kulusid on kahe kuuga finantseeritud 5,367 miljardi krooni ehk 11,25 protsendi ulatuses . </s> <s> Seal hulgas veebruaris 2,799 miljardi krooni ehk 5,9 protsendi ulatuses . </s> <s> Antud kulude number ei sisalda finantseerimist välisabi arvelt . </s> </p>
<p> <s> Eelmisel aastal laekus riigieelarvesse esimese kuuga 7,35 protsenti aasta laekumisest . </s> <s> Eelarve kulusid on ühe kuuga finantseeritud 2,568 miljardi krooni ehk 5,38 protsendi ulatuses . </s> <s> Antud kulude number ei sisalda finantseerimist välisabi arvelt . </s> </p>
<p> <s> Sharon sai ränga insuldi kolmapäeva õhtul ning ööl vastu neljapäeva tehti talle operatsioon . </s> <s> Ka reedel viidi ta operatsioonituppa tagasi , kuna tal tekkis uus ajuverejooks ja koljusisene rõhk suurenes . </s> </p>
This paragraph accurred always in the end of the article, and was always preceded by a different paragraph. 2 examples:<p> <s> Arstid püüavad stimuleerida Sharoni meeli ka sellega , et panid tema juurde taldriku shwarmaga , mis on kohalik liharoog ning peaministri lemmiktoit . </s> <s> See pandi talle piisavalt lähedale , et ta saaks selle lõhna tunda . </s> </p> <p> <s> Sharon sai ränga insuldi kolmapäeva õhtul ning ööl vastu neljapäeva tehti talle operatsioon . </s> <s> Ka reedel viidi ta operatsioonituppa tagasi , kuna tal tekkis uus ajuverejooks ja koljusisene rõhk suurenes . </s> </p>
<p> <s> Sharoni pojad Omri ja Gilad rääkisid isaga ja Ariel Sharon reageeris kõnetamisele kõrgema vererõhuga . </s> </p> <p> <s> Sharon sai ränga insuldi kolmapäeva õhtul ning ööl vastu neljapäeva tehti talle operatsioon . </s> <s> Ka reedel viidi ta operatsioonituppa tagasi , kuna tal tekkis uus ajuverejooks ja koljusisene rõhk suurenes . </s> </p>
<div3 type="artikkel"><head> Kohus otsustab homme Ruth Martini tööle ennistamise õigsuse </head> <p rend="vahepealkiri"> <s> Tallinna ringkonnakohus teeb homme otsuse teede ja -sideministeeriumi kantsleri Ruth Martini ( pildil ) tööle ennistamise seaduslikkuses . </s> </p> <p> <s> Tallinna halduskohus rahuldas mais Ruth Martini taotluse valitsuse 11. jaanuari korralduse tühistamiseks , millega vabastati Ruth Martin ametist ja nimetati uueks kantsleriks Margus Leivo . </s> </p> <p> <s> Martin taotles halduskohtult teede- je sideministeeriumi poolt talle määratud distsiplinaarkaristuse ja valitsuse määruse tühistamist , millega ta ametist vabastati , ning nõudis enda tööle ennistamist . </s> </p> <p> <s> Halduskohus leidis , et valitsuse korraldus on õigusvastane ja ennistas Martini tööle . </s> </p> <p> <s> " See oli juba minu ametist vabastamise esimesest päevast selge , et mul on vaja süüdistused , mis olid distsiplinaarkaristuse ja vallandamise aluseks , ümber lükata läbi kohtu , " ütles Martin ETAle vahetult pärast vallandamist . </s> </p> <p> <s> " Kui ma oleksin tundnud end mingilgi määral süüdi , oleksin võtnud vastu peaministri pakkumise ise lahkumisavaldus kirjutada , " lisas Martin . </s> </p> <p> <s> Valitsus vabastas Ruth Martini teede- ja sideministri Toivo Jürgensoni ettepanekul . </s> </p> <p> <s> Jürgensoni hinnangul ei olnud Ruth Martin oma ülesannete kõrgusel , töö ministeeriumis ja allasutustes oli halvasti korraldatud ning ministeeriumi juhtimist takistas kantsleri suutmatus meeskonnatööks . </s> </p> <p> <s> Lisaks oli Martin ministri hinnangul seotud mitmete ebaeetiliste ja riigi huve kahjustavate tegudega . </s> <s> Ekskantslerile pannakse süüks ka tema ametiauto BMW 523 kapitalirendilepingu katkestamisega riigile 134.500 krooni suuruse kahju tekitamist . </s> </div3>
<div3 type="artikkel"><head> Ruth Martini tööle ennistamise vaidlus jätkub ringkonnakohtus </head> <p rend="vahepealkiri"> <s> Tallinna ringkonnakohus arutab neljapäeval valitsuse kaebust Tallinna halduskohtu 10. mai otsuse tühistamiseks , millega ennistati tööle teede ja -sideministeeriumi kantsler Ruth Martin . </s> </p> <p> <s> Tallinna halduskohus rahuldas mais Ruth Martini taotluse valitsuse 11. jaanuari korralduse tühistamiseks , millega vabastati Ruth Martin ametist ja nimetati uueks kantsleriks Margus Leivo . </s> </p> <p> <s> Martin taotles halduskohtult teede- je sideministeeriumi poolt talle määratud distsiplinaarkaristuse ja valitsuse määruse tühistamist , millega ta ametist vabastati , ning nõudis enda tööle ennistamist . </s> </p> <p> <s> Halduskohus leidis , et valitsuse korraldus on õigusvastane ja ennistas Martini tööle . </s> </p> <p> <s> " See oli juba minu ametist vabastamise esimesest päevast selge , et mul on vaja süüdistused , mis olid distsiplinaarkaristuse ja vallandamise aluseks , ümber lükata läbi kohtu , " ütles Martin ETAle vahetult pärast vallandamist . </s> </p> <p> <s> " Kui ma oleksin tundnud end mingilgi määral süüdi , oleksin võtnud vastu peaministri pakkumise ise lahkumisavaldus kirjutada , " lisas Martin . </s> </p> <p> <s> Valitsus vabastas Ruth Martini teede- ja sideministri Toivo Jürgensoni ettepanekul . </s> </p> <p> <s> Jürgensoni hinnangul ei olnud Ruth Martin oma ülesannete kõrgusel , töö ministeeriumis ja allasutustes oli halvasti korraldatud ning ministeeriumi juhtimist takistas kantsleri suutmatus meeskonnatööks . </s> </p> <p> <s> Lisaks oli Martin ministri hinnangul seotud mitmete ebaeetiliste ja riigi huve kahjustavate tegudega . </s> <s> Ekskantslerile pannakse süüks ka tema ametiauto BMW 523 kapitalirendilepingu katkestamisega riigile 134.500 krooni suuruse kahju tekitamist . </s> </div3>
<div3 type="artikkel"><head> Kohus otsustab Ruth Martini tööle ennistamise õigsuse 13. oktoobril </head> <p rend="vahepealkiri"> <s> Tallinna ringkonnakohus teeb otsuse teede ja -sideministeeriumi kantsleri Ruth Martini ( pildil ) tööle ennistamise seaduslikkuses 13. oktoobril . </s> </p> <p> <s> Tallinna halduskohus rahuldas mais Ruth Martini taotluse valitsuse 11. jaanuari korralduse tühistamiseks , millega vabastati Ruth Martin ametist ja nimetati uueks kantsleriks Margus Leivo . </s> </p> <p> <s> Martin taotles halduskohtult teede- je sideministeeriumi poolt talle määratud distsiplinaarkaristuse ja valitsuse määruse tühistamist , millega ta ametist vabastati , ning nõudis enda tööle ennistamist . </s> </p> <p> <s> Halduskohus leidis , et valitsuse korraldus on õigusvastane ja ennistas Martini tööle . </s> </p> <p> <s> " See oli juba minu ametist vabastamise esimesest päevast selge , et mul on vaja süüdistused , mis olid distsiplinaarkaristuse ja vallandamise aluseks , ümber lükata läbi kohtu , " ütles Martin ETAle vahetult pärast vallandamist . </s> </p> <p> <s> " Kui ma oleksin tundnud end mingilgi määral süüdi , oleksin võtnud vastu peaministri pakkumise ise lahkumisavaldus kirjutada , " lisas Martin . </s> </p> <p> <s> Valitsus vabastas Ruth Martini teede- ja sideministri Toivo Jürgensoni ettepanekul . </s> </p> <p> <s> Jürgensoni hinnangul ei olnud Ruth Martin oma ülesannete kõrgusel , töö ministeeriumis ja allasutustes oli halvasti korraldatud ning ministeeriumi juhtimist takistas kantsleri suutmatus meeskonnatööks . </s> </p> <p> <s> Lisaks oli Martin ministri hinnangul seotud mitmete ebaeetiliste ja riigi huve kahjustavate tegudega . </s> <s> Ekskantslerile pannakse süüks ka tema ametiauto BMW 523 kapitalirendilepingu katkestamisega riigile 134.500 krooni suuruse kahju tekitamist . </s> </div3>
Repetitions are part of the source texts of our corpus, thus we consider them rightful parts of it. However, corpus user should be aware of them and interpret the repetitive sentences in accordance with his research question.