aboutsummaryrefslogtreecommitdiffstats
path: root/src/libstat/tokenizers/osb.c
Commit message (Collapse)AuthorAgeFilesLines
* Some more fixes to OSB algorithmVsevolod Stakhov2015-12-211-1/+4
|
* Allow conditional build of snowball.Vsevolod Stakhov2015-10-231-1/+0
|
* Fix statistics.Vsevolod Stakhov2015-10-061-2/+2
|
* More logging updates.Vsevolod Stakhov2015-08-291-7/+7
|
* Fix sqlite3 backend initialization.Vsevolod Stakhov2015-07-271-0/+1
|
* Some more fixes to tokenizator init.Vsevolod Stakhov2015-07-271-0/+6
|
* Fix issues with compatibility tokenization.Vsevolod Stakhov2015-07-271-1/+9
|
* Fix tokenizers and mmapped file.Vsevolod Stakhov2015-07-271-18/+49
|
* Use new tokenization by default for created statfiles.Vsevolod Stakhov2015-07-271-1/+1
|
* Allow adding of prefix for tokenizers.Vsevolod Stakhov2015-07-261-2/+14
|
* Save OSB window index inside token.Vsevolod Stakhov2015-04-131-0/+2
|
* Use new siphash implementation.Vsevolod Stakhov2015-04-081-5/+6
|
* Add compatibility layer for tokenization.Vsevolod Stakhov2015-04-011-2/+63
|
* Rework osb configuration.Vsevolod Stakhov2015-04-011-56/+112
|
* Rework tokenization:Vsevolod Stakhov2015-02-231-29/+123
| | | | | | - Use normalized words if needed - Allow using of seeded XXHash instead of hand-made legacy shit - Allow secure hashing using siphash
* Allow configurable tokenizers.Vsevolod Stakhov2015-02-221-1/+1
|
* Add initial processing routines.Vsevolod Stakhov2015-01-231-3/+3
|
* Rework types for tokenizers functions.Vsevolod Stakhov2015-01-231-14/+7
|
* Rework statistics runtime structures.Vsevolod Stakhov2015-01-231-3/+6
|
* New statistics token definition.Vsevolod Stakhov2015-01-181-11/+6
|
* Reorganize statfiles and classifiers into libstat.Vsevolod Stakhov2015-01-161-0/+122