Recent Changes in GRM Web retrieved at 12:54 (GMT)
OpenGrm Advanced Usage Below are a variety of topics covered in greater depth or of more specialized interest than found in the Quick Tour. Reading the Quick...
OpenGrm NGram Library Quick Tour This tour is organized around the stages of n gram model creation, modification and use: corpus I/O ( ngramsymbols , farcompilestrings...
Pynini Download Release downloads: Current version: pynini 2.0.7.tar.gz SHA 1: e36b888d1d8dcbff3b8c902e4fd3eb4ef37822a3 SHA 256: eeea03cecd1501f9dd69c227c7f86a813e00464689b...
Thrax Download Release downloads: Current version: thrax 1.2.9.tar.gz (requires C 11) SHA 1: a23741834a5045c288b594afb4193f507d1de9ce SHA 256: 3cfbc003609d208d50d98659166086d...
OpenGrm Pynini: Finite state grammar development in Python Version 2.0.7 is now available for download. OpenGrm Pynini , like Thrax , compiles grammars expressed...
OpenGrm Thrax Grammar Development Tools Version 1.2.9 now available for download. The OpenGrm Thrax tools compile grammars expressed as regular expressions...
Pynini: Grammar compilation in Python ,ggggggggggg, dP```88``````Y8, Yb, 88 `8b `` 88 ,8P gg...
OpenGrm NGram Library Version 1.3.6 is now available for download. The OpenGrm NGram library is used for making and modifying n gram language models encoded...
OpenGrm NGram Download Release downloads: Current version: ngram 1.3.6.tar.gz (requires C 11) SHA 1: e6870a7403623cd368a7a08acd3ea9f21f5ba9d0 SHA 256: 7b0588d873a9cee836ba3c...
OpenGrm Thrax Grammar Compiler The OpenGrm Thrax Grammar Compiler is a set of tools for compiling grammars expressed as regular expressions and context dependent...
Extended libraries The following are additional free libraries built using Pynini: pynini rewrite 0.2.tar.gz: Python module for applying rewrite rules
Symbol table operations This describes functions for symbol table operations. Each FST arc has an input ( ilabel ) and output ( olabel ) label. Symbol tables can be...
Path iteration This describes classes for iterating over paths in an FST. fst::PathIterator This template class provides a basic iterator over paths. It is constructed...
Thrax Release 0.1 (Alpha version.) Thrax Release 1.0 Removed dependency on ICU for UTF8 string parsing: with icu configuration flag no longer needed and...
OpenGrm Libraries OpenGrm is a collection of open source libraries for constructing, combining, applying and searching formal grammars and related representations...
OpenGrm SFst Available Operations The following operations are provided for SFSTs. Care must be taken that the input FSTs meet the specified requirements (e.g. canonical...
OpenGrm SFST Glossary $ backoff FST : a canonical FST for which each state s that has a failure transition to a state s` and another transition with a label...
OpenGrm SFst Library: Stochastic Finite State Transducer Library OpenGrm SFst Version 1.0.0 is now available for download. SFst is a library for normalizing...
OpenGrm SFst Background Material The following is provided as background reading about stochastic finite state transducers and related material. For material...
OpenGrm SFst Download Release downloads: Current version: openfst 1.0.0.tar.gz (requires C 11) From the current release: list README ( includes system...
OpenGrm SFst README OpenGrm SFst Release 1.0 OpenGrm SFst is a library for normalizing, sampling, combining, and approximating stochastic (or probabilistic) finite...
OpenGrm SFst INSTALL html version Installation Instructions Copyright (C) 1994, 1995, 1996, 1999, 2000, 2001, 2002, 2004, 2005, 2006,...
OpenGrm SFst COPYING Licensed under the Apache License, Version 2.0 (the `License`); you may not use these files except in compliance with the License. You may obtain...
Specialty operators This describes specialty FST functions for grammar compilation. fst::CrossProduct The cross product operation generates a transducer from two...
OpenGrm NGram README OpenGrm NGram Release 1.3 The OpenGrm NGram library is used for making and modifying n gram language models encoded as weighted finite state...
String (de)compilation This directory contains functions useful for mapping strings into FSAs ( compilation ) and for mapping string FSTs onto strings ( printing...
Statistics for GRM Web Month: Topic views: Topic saves: File uploads: Most popular topic views: Top contributors for topic save and...
FST optimization There are several ways to `optimize` a weighted finite state transducer (WFST). The C template function fst::Optimize underlies Pynini`s optimize...
Thrax README Thrax Release 1.2 Thrax is a toolkit for compiling grammars based on regular expressions and context dependent rewrite rules into weighted finite state...
Known Bugs Temporary bug in thrax 1.2.2 where AssertNull and AssertEmpty are not being properly registered. This will get fixed soon, but in the meantime as a...
OpenGrm: Contributed and related projects Coming soon
GRM Web Preferences The following settings are web preferences of the GRM web. These preferences overwrite the site level preferences in . and...
NGramMarginal Description (Available in versions 1.1.0 and higher.) This operation re estimates smoothed n gram models by imposing marginalization constraints...
Thrax COPYING Licensed under the Apache License, Version 2.0 (the `License`); you may not use these files except in compliance with the License. You may obtain a copy...
OpenGrm NGram Authors Principal Author: Brian Roark roarkbr AT gmail.com Contributors: Cyril Allauzen allauzen AT google.com Michael Riley...
OpenGrm NGram COPYING Licensed under the Apache License, Version 2.0 (the `License`); you may not use these files except in compliance with the License. You may obtain...
OpenGrm NGram Library Suggestions 1. Improve memory usage of ngramread uses 14 gb for 1.5gb input (Brian) 2. Counting from cyclic FSTs (Cyril) 3. support...
NGramShrink Description This operation shrinks or prunes an n gram language model in one of three ways: count pruning: prunes based on count cutoffs for...
NGramMake Description This operation produces a smoothed, normalized language model from input n gram count FST. It smooths the model in one of six ways: witten...
NGramCount Description This utility counts n grams from an input FST archive. This produces a count FST with the same topology as the eventual normalized model,...
NGramMerge Description This operation merges two n gram language models or two n gram count FSTs. The operation provides options for weighting the two input FSTs...
OpenGrm NGram Library Known Bugs 1. ngramcount using epsilon as backoff has problem finding state if counting order different from model order
NGramInfo Description The command line utility ngraminfo prints various information about an n gram model obtained from the NGramModel class and the underlying...
NGramPerplexity Description Command line utility to calculate the perplexity of a corpus given a model. Verbose mode gives the per word contribution to the perplexity...
NGramPrint Description By default, only n grams are printed (without backoff epsilon transitions), in the same format as discussed above for reading in n gram...
NGram Model Format The following gives the encoding of all n gram models produced by the utilities here, including those with unnormalized counts, as a cyclic weighted...
NGramRead Description It has flags for specifying the format of the text input, currently one of two options: By default, the text file is read as a sorted...
NGramSymbols Description Command line utility to produce a symbol table from an input text corpus. Creates a symbol entry for every type in the corpus, as well as...
NGramRandGen Description This operation randomly generates a set of successful sentences in the input FST and outputs them in finite state archive format. Backoff...
NGramApply Description This utility intersects an n gram model with each FST in an input FST archive. It produces an output FST archive that contains each FST after...
RSS feed, ATOM feed, WebNotify, site changes, site map 
Edit | Attach | Topic revision: r2 - 2005-03-28 - TWikiContributor
GRM Web
Create New Topic
Index
Search
Changes
Notifications
Statistics
Preferences
Contrib |
|
Copyright © 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors. Ideas, requests, problems regarding TWiki? Send feedback