Skip to content

Latest commit

 

History

History
78 lines (54 loc) · 2.83 KB

README.org

File metadata and controls

78 lines (54 loc) · 2.83 KB
Raw

MorphoBr - resources for morphological analysis of Portuguese

LICENSE
see LICENSE file

Unless otherwise stated, the present resources are derived from the dictionaries of the:

Unitex-PB project
http://www.nilc.icmc.usp.br/nilc/projects/unitex-pb/web/dicionarios.html
Freeling Portuguese data
https://github.com/TALP-UPC/FreeLing/tree/master/data/pt/dictionary/entries

Repository contents

Entries are separated by class, each in its own directory. Entries are divided in small files, so that they can be previewed on GitHub and processed in less powerful computers. The repository structure is meant for development: if you would like a copy of the data, you should go to our releases page.

Code (and its documentation) employed in the resource’s development can be found in the tools/ directory.

Tagset

The tagset used in the above projects was converted to a more mnemonical one which generally follows the notational conventions of the descriptive linguistic and finite-state morphology literatures, see the TAGSET file.

Morphological analysis

In order to use MorphoBr resources for morphological analysis in the context of syntactic parsing (e.g. with PorGram), they must be compiled into finite-state transducers. The easier way is to load and compile it with Foma:

% ./compile.sh
% foma -f compile.foma
% echo "fortinho" | flookup -i morphobr.bin
fortinho	forte+N+DIM+M+SG
fortinho	forte+A+DIM+M+SG

% echo "comprei-o" | flookup -i morphobr.bin
comprei-o	comprar+V+ele.ACC.3.M.SG+PRF+1+SG

For that, you need to:

  1. change the MAX_STACK value in the int_stack.c file in Foma source code to at least 9097152. Compile Foma.

See mhulden/foma#146 and mhulden/foma#130

Python modules as well as XFST and bash scripts for performing this task are available in the tools/ folder. Inadequacies and errors found in the source dictionaries were corrected using these tools. See the respective incode documentation for a detailed description of the changes made to the source entries.

Download

See our releases page.

Bibliography

See https://github.com/LFG-PTBR/MorphoBr/wiki#publicações. To cite this resource, please use http://www.periodicos.letras.ufmg.br/index.php/textolivre/article/view/14294 (first in the publications list).