Python_Unified_Parser
This parser attempts to unify the languages based on the Common Label Set. It is designed across all the languages capitalising on the syllable structure of Indian languages. The Unified Parser converts UTF-8 text to common label set, applies letter-to-sound rules and generates the corresponding phoneme sequences. The effort is a step towards natural language understanding system that operates on Indian languages and generates the parsed output. This structured method requires only knowledge of the basic language. With good lexicons it is possible to get more than 95% correctness of words in a language. This method can be further extended for a number of other Indian languages in minimal time and effort. Given the unity in the diversity of Indian languages, developing parsers for new languages is easy using the unified approach.
Our python parser - uparser.py - Combines lex and yacc functionality in a single python script using the PLY framework.
Publications
Installation
pip install indic_unified_parser
How to use
from indic_unified_parser.uparser import wordparse
parsed_output_string = wordparse(<word : str>, <lsflag : int>, <wfflag : int>, <clearflag : int>)
lsflag: always 0. Deprecated.wfflag: 0 for Monophone parsing, 1 for syllable parsing, 2 for Akshara Parsing"clearflag: 1 for removing the lisp like format of output and to just produce space separated output. Otherwise, 0.
Examples
check run_parser_all_lang_all_opt.py file for the use of wordparse function.