Word Frequency Studies

The present book finds and collects absolutely new aspects of word frequency. First, eminent characteristics (such as the h-point, first used in scientometrics, the k-, m-, and n-points) are introduced - it can be shown that the geometry of word frequency is fundamentally based on them. Furthermore, various indicators of text properties are proposed for the first time, such as thematic concentration, autosemantic text compactness, autosemantic density, etc. In detail, the autosemantic structure of a given text is evaluated by means of a graph representation and its properties (according to a problem from network research). Special emphasis is given to the part-of-speech differentiation, which plays a significant role in stylistics. On the basis of a general theory, which has been developed especially for linguistic research, problems of the frequency structure of texts with respect to word occurrence are investigated and discussed in detail. Methodologically, specific reference is made to synergetic linguistics, including some exemplary analyses, showing that there are points of contact with this field. A separate chapter is dedicated to within-sentence word position; this issue considers grammar as well as language genesis; another chapter is dedicated to the type-token ratio, discussing all established methods and their relevance for word frequency analysis. All methods presented in the book are statistically tested; to this end, some new tests have been developed. All procedures and calculations are conducted for 20 languages, ranging from Polynesia, Indonesia, India, and Europe to a North American Indian language. The broad distribution of the data and texts from all genres allows generalizations with respect to language typology.

This book is a comprehensive introduction to the statistical analysis of word frequency distributions, intended for computational linguists, corpus linguists, psycholinguists, and researchers in the field of quantitative stylistics. It aims to make these techniques more accessible for non-specialists, both theoretically, by means of a careful introduction to the underlying probabilistic and statistical concepts, and practically, by providing a program library implementing the main models for word frequency distributions.

The frequency with which particular words are used in a text can tell us something meaningful both about that text and also about its author because their choice of words is seldom random. Focusing on the most frequent lexical items of a number of generated word frequency lists can help us to determine whether all the texts are written by the same author. Alternatively, they might wish to determine whether the most frequent words of a given text (captured by its word frequency list) are suggestive of potentially meaningful patterns that could have been overlooked had the text been read manually. This edited collection brings together cutting-edge research written by leading experts in the field on the construction of word-lists for the analysis of both frequency and keyword usage. Taken together, these papers provide a comprehensive and up-to-date survey of the most exciting research being conducted in this subject.

A Frequency Dictionary of German is an invaluable tool for all learners of German, providing a list of the 4,034 most frequently used words in the language. Based on a 4.2 million-word corpus which is evenly divided between spoken, fiction and non-fiction texts, the dictionary provides a detailed frequency-based list plus alphabetical and part of speech indexes. All entries in the rank frequency list feature the English equivalent, a sample sentence plus an indication of major register variation. The dictionary also contains twenty-one thematically organized lists of frequently used words on a variety of topics as well as eleven special vocabulary lists. A Frequency Dictionary of German aims to enable students of all levels to maximize their study of German vocabulary in an efficient and engaging way.

Word Frequencies in Written and Spoken English is a landmark volume in the development of vocabulary frequency studies. Whereas previous books have in general given frequency information about the written language only, this book provides information on both speech and writing. It not only gives information about the language as a whole, but also about the differences between spoken and written English, and between different spoken and written varieties of the language. The frequencies are derived from a wide ranging and up-to-date corpus of English: the British National Corpus, which was compiled from over 4,000 written texts and spoken transcriptions representing the present day language in the UK. The book is based on a new version of the corpus (available from 2001) providing more accurate grammatical information, which is essential (for example) for distinguishing words like leaves (noun) and leaves (verb) with different meanings. The book begins with a general introduction, explaining why such information is important and highlighting interesting linguistic findings that emerge from the statistical analysis of the British National Corpus vocabulary. It also contains twenty four 'interest boxes' which highlight and comment on different aspects of frequency - for example, the most common colour words in English in order of frequency, and a comparison of male words (e.g. man) and female words (e.g. woman) in terms of their frequency.

This study of word frequency effects on sound change provides a resolution of the Neogrammarian controversy. Betty S. Phillips discusses the implications for phonology and historical linguistics of certain types of change affecting the most frequent words first and other types of change affecting the least frequent words first.