000 02294nam a2200253 i 4500
001 UUN-OA-637
005 20260922220311.0
020 _a9783961100903
100 1 _aSteven Moran
245 1 0 _aThe Unicode cookbook for linguists: Managing writing systems using orthography profiles
264 1 _bLanguage Science Press
_c2018
300 _a1 online resource
336 _atext
_btxt
_2rdacontent
337 _acomputer
_bc
_2rdamedia
338 _aonline resource
_bcr
_2rdacarrier
520 _aThis text is a practical guide for linguists, and programmers, who work with data in multilingual computational environments. We introduce the basic concepts needed to understand how writing systems and character encodings function, and how they work together at the intersection between the Unicode Standard and the International Phonetic Alphabet. Although these standards are often met with frustration by users, they nevertheless provide language researchers and programmers with a consistent computational architecture needed to process, publish and analyze lexical data from the world's languages. Thus we bring to light common, but not always transparent, pitfalls which researchers face when working with Unicode and IPA. Having identified and overcome these pitfalls involved in making writing systems and character encodings syntactically and semantically interoperable (to the extent that they can be), we created a suite of open-source Python and R tools to work with languages using orthography profiles that describe author- or document-specific orthographic conventions. In this cookbook we describe a formal specification of orthography profiles and provide recipes using open source tools to show how users can segment text, analyze it, identify errors, and to transform it into different written forms for comparative linguistics research.
650 4 _aComputer Science
650 4 _aHumanities - Linguistics
650 4 _aB. Sc. Artificial Intelligence
_2local
650 4 _aB. Sc. Cyber Security
_2local
540 _aAttribution
856 4 0 _uhttps://langsci-press.org/catalog/book/176
_yRead online
856 4 2 _uhttps://open.umn.edu/opentextbooks/textbooks/the-unicode-cookbook-for-linguists-managing-writing-systems-using-orthography-profiles
_yOpen Textbook Library record
999 _c340
_d340