index
:
rspamd.git
external-maps
libev-migration
log_json
master
mime-rework
rdns-tcp-rework
rework-symcache
rspamd-0.5
rspamd-0.6
rspamd-0.7
rspamd-0.8
rspamd-0.9
rspamd-1.0
rspamd-1.1
rspamd-1.2
rspamd-1.3
rspamd-1.4
rspamd-1.5
rspamd-1.6
rspamd-1.9
rspamd-3.10
rspamd-3.7
rspamd-3.8
rspamd-3.9
torch-removal
vstakhov-anonymize-mime
vstakhov-another-grow-factor-fix
vstakhov-ci-try
vstakhov-conf-reorg
vstakhov-cpu-detection
vstakhov-cumulative-tcp-timeout
vstakhov-fasttext-langdet
vstakhov-fix-2047-encode
vstakhov-fix-dcc
vstakhov-fuzzy-cxx
vstakhov-fuzzy-limits-display
vstakhov-fuzzy-tcp
vstakhov-gpt-ollama
vstakhov-keypair-encoding
vstakhov-known-senders
vstakhov-llm-anonymize
vstakhov-llm-embeddings
vstakhov-lua-text-api
vstakhov-new-hiredis
vstakhov-openssl-provider-message
vstakhov-remove-control-block
vstakhov-some-build-fixes
vstakhov-ssl-fixes
vstakhov-stringzilla
vstakhov-strip-attachments
vstakhov-surbl-conf-fix
vstakhov-universal-hashing-lua
vstakhov-utf8-mime
vstakhov-zstd-headers
Rapid spam filtering system: https://github.com/rspamd/rspamd
www-data
about
summary
refs
log
tree
commit
diff
stats
log msg
author
committer
range
path:
root
/
src
/
libmime
/
lang_detection.c
Commit message (
Expand
)
Author
Age
Files
Lines
...
*
[Minor] Disable extra verbose lang_detection logs
Vsevolod Stakhov
2018-03-17
1
-0
/
+7
*
[Minor] Add extra logic for short texts in language detector
Vsevolod Stakhov
2018-02-08
1
-43
/
+53
*
[Minor] Use more words and remove some languages
Vsevolod Stakhov
2018-02-07
1
-1
/
+1
*
[Minor] Add more filtering for ngramm chains
Vsevolod Stakhov
2018-02-07
1
-0
/
+51
*
[Minor] Use ngramm chains structure
Vsevolod Stakhov
2018-02-05
1
-25
/
+29
*
[Minor] Various tweaks towards improvements in language detection
Vsevolod Stakhov
2018-02-04
1
-24
/
+26
*
[Minor] Apply more aggressive filtering
Vsevolod Stakhov
2018-02-03
1
-1
/
+1
*
[Project] Further improvements to language detector
Vsevolod Stakhov
2018-02-03
1
-15
/
+47
*
[Feature] Further improvements in language detection
Vsevolod Stakhov
2018-02-01
1
-3
/
+31
*
[Feature] Further improvements in language detection algorithm
Vsevolod Stakhov
2018-01-31
1
-14
/
+43
*
[Minor] Fix latin languages detection
Vsevolod Stakhov
2018-01-29
1
-3
/
+33
*
[Minor] Treat English as Tier0 language
Vsevolod Stakhov
2018-01-29
1
-2
/
+19
*
[Minor] Print ticks in language detection debug mode
Vsevolod Stakhov
2018-01-28
1
-2
/
+7
*
[Minor] Further adjustments of coefficients
Vsevolod Stakhov
2018-01-27
1
-1
/
+1
*
[Minor] Adjust heuristic coefficients
Vsevolod Stakhov
2018-01-27
1
-2
/
+2
*
[Project] Improve weighting in lang_detection
Vsevolod Stakhov
2018-01-27
1
-8
/
+37
*
[Project] Detect some languages based on unicode script
Vsevolod Stakhov
2018-01-27
1
-21
/
+100
*
[Project] Add more flags to languages
Vsevolod Stakhov
2018-01-27
1
-48
/
+141
*
[Project] Start rework of language detection to improve quality
Vsevolod Stakhov
2018-01-27
1
-43
/
+46
*
[Rework] Use frequencies distribution in language detector
Vsevolod Stakhov
2018-01-24
1
-98
/
+108
*
[Minor] Store occurencies numbers for languages
Vsevolod Stakhov
2018-01-23
1
-1
/
+9
*
[Minor] Show more stats about ngramms
Vsevolod Stakhov
2018-01-23
1
-1
/
+6
*
[Feature] Allow to enable/disable languages from the detector
Vsevolod Stakhov
2018-01-22
1
-2
/
+38
*
[Project] Enable fast debug lookup for some modules
Vsevolod Stakhov
2018-01-20
1
-2
/
+4
*
[Fix] Plug memory leak
Vsevolod Stakhov
2018-01-16
1
-0
/
+1
*
[Project] Rework language detection ngramms structure
Vsevolod Stakhov
2018-01-16
1
-167
/
+164
*
[Minor] Improve language detection debug logging
Vsevolod Stakhov
2018-01-15
1
-27
/
+67
*
[Minor] Another adjustment to lang_detection
Vsevolod Stakhov
2018-01-15
1
-4
/
+5
*
[Minor] Lowercase ucs data
Vsevolod Stakhov
2018-01-14
1
-0
/
+14
*
[Fix] Do not crash if no words defined
Vsevolod Stakhov
2018-01-14
1
-0
/
+5
*
[Fix] Use n_words attribute from ngramms
Vsevolod Stakhov
2018-01-14
1
-3
/
+20
*
[Minor] Improve trigramms switch
Vsevolod Stakhov
2018-01-13
1
-2
/
+2
*
[Fix] Various improvements in language detection
Vsevolod Stakhov
2018-01-13
1
-37
/
+125
*
[Project] Preliminary version of ngramms based language detector
Vsevolod Stakhov
2018-01-13
1
-19
/
+24
*
[Project] Implement logic of ngramms application
Vsevolod Stakhov
2018-01-13
1
-11
/
+105
*
[Project] Add detection logic for words
Vsevolod Stakhov
2018-01-13
1
-4
/
+100
*
[Project] Add ngramms frequencies detector
Vsevolod Stakhov
2018-01-13
1
-1
/
+195
*
[Project] Add random words selection logic
Vsevolod Stakhov
2018-01-13
1
-2
/
+69
*
[Project] Remove old language detector
Vsevolod Stakhov
2018-01-13
1
-1
/
+2
*
[Minor] Fix format string issues
Vsevolod Stakhov
2018-01-09
1
-2
/
+2
*
[Project] Add unigramms to language detection as well
Vsevolod Stakhov
2018-01-01
1
-3
/
+48
*
[Project] Start language detection project
Vsevolod Stakhov
2017-12-30
1
-0
/
+204
[prev]