]> source.dussan.org Git - rspamd.git/log
rspamd.git
9 years agoFix some issues in learning.
Vsevolod Stakhov [Mon, 26 Jan 2015 22:54:36 +0000 (22:54 +0000)]
Fix some issues in learning.

9 years agoFixing learning.
Vsevolod Stakhov [Mon, 26 Jan 2015 22:20:29 +0000 (22:20 +0000)]
Fixing learning.

9 years agoInit mmaped file runtime function.
Vsevolod Stakhov [Mon, 26 Jan 2015 21:53:15 +0000 (21:53 +0000)]
Init mmaped file runtime function.

9 years agoCreate fuzzy db if it does not exist.
Vsevolod Stakhov [Mon, 26 Jan 2015 21:12:30 +0000 (21:12 +0000)]
Create fuzzy db if it does not exist.

9 years agoAdd libstat to the main rspamd routines.
Vsevolod Stakhov [Mon, 26 Jan 2015 21:06:33 +0000 (21:06 +0000)]
Add libstat to the main rspamd routines.

9 years agoInitialize missing fields.
Vsevolod Stakhov [Mon, 26 Jan 2015 16:19:35 +0000 (16:19 +0000)]
Initialize missing fields.

9 years agoImplement learning function.
Vsevolod Stakhov [Mon, 26 Jan 2015 16:17:33 +0000 (16:17 +0000)]
Implement learning function.

9 years agoImplement classifying.
Vsevolod Stakhov [Mon, 26 Jan 2015 16:10:29 +0000 (16:10 +0000)]
Implement classifying.

9 years agoUpdate bayes.
Vsevolod Stakhov [Mon, 26 Jan 2015 14:07:19 +0000 (14:07 +0000)]
Update bayes.

9 years agoImplement min and max tokens.
Vsevolod Stakhov [Mon, 26 Jan 2015 13:22:59 +0000 (13:22 +0000)]
Implement min and max tokens.

9 years agoWrite statfiles revisions to the runtime.
Vsevolod Stakhov [Mon, 26 Jan 2015 13:05:08 +0000 (13:05 +0000)]
Write statfiles revisions to the runtime.

9 years agoAdd tokens processing.
Vsevolod Stakhov [Sun, 25 Jan 2015 23:22:46 +0000 (23:22 +0000)]
Add tokens processing.

9 years agoAdd functions for getting values from files.
Vsevolod Stakhov [Sun, 25 Jan 2015 22:17:50 +0000 (22:17 +0000)]
Add functions for getting values from files.

9 years agoAdd preprocessing routine for classifiers.
Vsevolod Stakhov [Sat, 24 Jan 2015 22:42:41 +0000 (22:42 +0000)]
Add preprocessing routine for classifiers.

9 years agoStart statistics preprocessing implementation.
Vsevolod Stakhov [Fri, 23 Jan 2015 22:45:11 +0000 (22:45 +0000)]
Start statistics preprocessing implementation.

9 years agoImplement statfiles runtime initialization.
Vsevolod Stakhov [Fri, 23 Jan 2015 22:24:19 +0000 (22:24 +0000)]
Implement statfiles runtime initialization.

9 years agoRework tokenization invocation.
Vsevolod Stakhov [Fri, 23 Jan 2015 21:55:14 +0000 (21:55 +0000)]
Rework tokenization invocation.

9 years agoDisable statistics in rspamd till reworking is done.
Vsevolod Stakhov [Fri, 23 Jan 2015 16:53:28 +0000 (16:53 +0000)]
Disable statistics in rspamd till reworking is done.

9 years agoAdd initial processing routines.
Vsevolod Stakhov [Fri, 23 Jan 2015 16:49:42 +0000 (16:49 +0000)]
Add initial processing routines.

9 years agoRefactor structures names.
Vsevolod Stakhov [Fri, 23 Jan 2015 16:26:55 +0000 (16:26 +0000)]
Refactor structures names.

9 years agoRework types for tokenizers functions.
Vsevolod Stakhov [Fri, 23 Jan 2015 16:26:38 +0000 (16:26 +0000)]
Rework types for tokenizers functions.

9 years agoRework classifiers configuration and naming.
Vsevolod Stakhov [Fri, 23 Jan 2015 15:36:31 +0000 (15:36 +0000)]
Rework classifiers configuration and naming.

Now it is possible to register multiple classifiers with the same type.

9 years agoReorganize libstat API.
Vsevolod Stakhov [Fri, 23 Jan 2015 13:50:17 +0000 (13:50 +0000)]
Reorganize libstat API.

9 years agoRework statistics runtime structures.
Vsevolod Stakhov [Fri, 23 Jan 2015 12:18:04 +0000 (12:18 +0000)]
Rework statistics runtime structures.

9 years agoRemove statfile invalidation.
Vsevolod Stakhov [Thu, 22 Jan 2015 22:23:48 +0000 (22:23 +0000)]
Remove statfile invalidation.

9 years agoIgnore broken TXT records when parsing include.
Vsevolod Stakhov [Thu, 22 Jan 2015 21:58:59 +0000 (21:58 +0000)]
Ignore broken TXT records when parsing include.

9 years agoFix another critical composites issue and memory corruption.
Vsevolod Stakhov [Thu, 22 Jan 2015 01:11:02 +0000 (01:11 +0000)]
Fix another critical composites issue and memory corruption.

9 years agoFix critical issue with composites weights.
Vsevolod Stakhov [Wed, 21 Jan 2015 22:05:38 +0000 (22:05 +0000)]
Fix critical issue with composites weights.

9 years agoFix mmaped files initialization.
Vsevolod Stakhov [Wed, 21 Jan 2015 17:33:32 +0000 (17:33 +0000)]
Fix mmaped files initialization.

9 years agoAnother err dereference for dkim module.
Vsevolod Stakhov [Wed, 21 Jan 2015 11:04:29 +0000 (11:04 +0000)]
Another err dereference for dkim module.

9 years agoAdd initialization prototype.
Vsevolod Stakhov [Tue, 20 Jan 2015 22:44:20 +0000 (22:44 +0000)]
Add initialization prototype.

9 years agoRestore statfile resize logic.
Vsevolod Stakhov [Tue, 20 Jan 2015 22:44:06 +0000 (22:44 +0000)]
Restore statfile resize logic.

9 years agoAdd backend option for statfiles, remove legacy
Vsevolod Stakhov [Tue, 20 Jan 2015 22:43:18 +0000 (22:43 +0000)]
Add backend option for statfiles, remove legacy

9 years agoFix crash on broken DKIM DNS records.
Vsevolod Stakhov [Tue, 20 Jan 2015 13:39:02 +0000 (13:39 +0000)]
Fix crash on broken DKIM DNS records.

9 years agoMore rework.
Vsevolod Stakhov [Tue, 20 Jan 2015 01:20:32 +0000 (01:20 +0000)]
More rework.

9 years agoStart reworking of mmaped files backend.
Vsevolod Stakhov [Mon, 19 Jan 2015 23:49:22 +0000 (23:49 +0000)]
Start reworking of mmaped files backend.

9 years agoRemove legacy statfile pool.
Vsevolod Stakhov [Sun, 18 Jan 2015 23:11:14 +0000 (23:11 +0000)]
Remove legacy statfile pool.

9 years agoRemove direct statfiles manipulation from bayes.
Vsevolod Stakhov [Sat, 17 Jan 2015 22:29:37 +0000 (22:29 +0000)]
Remove direct statfiles manipulation from bayes.

9 years agoNew statistics token definition.
Vsevolod Stakhov [Sat, 17 Jan 2015 22:11:02 +0000 (22:11 +0000)]
New statistics token definition.

9 years agoRemove old statfile_pool logic.
Vsevolod Stakhov [Sat, 17 Jan 2015 21:59:44 +0000 (21:59 +0000)]
Remove old statfile_pool logic.

9 years agoStart refactoring of statistics in rspamd.
Vsevolod Stakhov [Sat, 17 Jan 2015 21:53:49 +0000 (21:53 +0000)]
Start refactoring of statistics in rspamd.

9 years agoDo not reset case of settings if parsed from lua.
Vsevolod Stakhov [Sun, 18 Jan 2015 15:25:20 +0000 (15:25 +0000)]
Do not reset case of settings if parsed from lua.

9 years agoMerge pull request #129 from wiedi/master
Vsevolod Stakhov [Sun, 18 Jan 2015 13:39:48 +0000 (13:39 +0000)]
Merge pull request #129 from wiedi/master

Fix build on SunOS

9 years agoFix build on SunOS 129/head
Sebastian Wiedenroth [Sun, 18 Jan 2015 01:30:28 +0000 (02:30 +0100)]
Fix build on SunOS
- the struct dirent d_type is not available on SunOS
- tm_gmtoff is not a POSIX field

9 years agoRevert "Preserve destructors order as LIFO."
Vsevolod Stakhov [Sat, 17 Jan 2015 16:57:46 +0000 (16:57 +0000)]
Revert "Preserve destructors order as LIFO."

That change was completely incorrect.

This reverts commit 1f2c83f096f28ce79e828edd1ab545a341f10451.

9 years agoFix static build.
Vsevolod Stakhov [Fri, 16 Jan 2015 16:42:48 +0000 (16:42 +0000)]
Fix static build.

9 years agoRemove binlog and statfile_sync: never ever used.
Vsevolod Stakhov [Fri, 16 Jan 2015 15:36:40 +0000 (15:36 +0000)]
Remove binlog and statfile_sync: never ever used.

9 years agoNo more winnow.
Vsevolod Stakhov [Fri, 16 Jan 2015 15:32:30 +0000 (15:32 +0000)]
No more winnow.

9 years agoReorganize statfiles and classifiers into libstat.
Vsevolod Stakhov [Fri, 16 Jan 2015 15:28:40 +0000 (15:28 +0000)]
Reorganize statfiles and classifiers into libstat.

9 years agoUpdate version to 0.9 WIP.
Vsevolod Stakhov [Fri, 16 Jan 2015 14:06:31 +0000 (14:06 +0000)]
Update version to 0.9 WIP.

9 years agoFix double format output.
Vsevolod Stakhov [Fri, 16 Jan 2015 12:24:16 +0000 (12:24 +0000)]
Fix double format output.

9 years agoMerge pull request #128 from fatalbanana/master
Vsevolod Stakhov [Thu, 15 Jan 2015 19:50:55 +0000 (19:50 +0000)]
Merge pull request #128 from fatalbanana/master

Oops: fix regression

9 years agoFix regression 128/head
Andrew Lewis [Thu, 15 Jan 2015 19:41:06 +0000 (21:41 +0200)]
Fix regression

9 years agoMerge pull request #127 from fatalbanana/master
Vsevolod Stakhov [Thu, 15 Jan 2015 17:02:37 +0000 (17:02 +0000)]
Merge pull request #127 from fatalbanana/master

Update RPM packaging

9 years agoUpdate RPM packaging 127/head
Andrew Lewis [Thu, 15 Jan 2015 12:35:12 +0000 (14:35 +0200)]
Update RPM packaging

9 years agoAdd toggle for disabling installation of systemd units on Linux
Andrew Lewis [Thu, 15 Jan 2015 11:43:48 +0000 (13:43 +0200)]
Add toggle for disabling installation of systemd units on Linux

9 years agoMerge pull request #126 from fatalbanana/master
Vsevolod Stakhov [Fri, 9 Jan 2015 14:20:18 +0000 (14:20 +0000)]
Merge pull request #126 from fatalbanana/master

Fix building on Fedora

9 years agoFix building on Fedora 126/head
Andrew Lewis [Fri, 9 Jan 2015 14:05:31 +0000 (16:05 +0200)]
Fix building on Fedora

9 years agoSilent warnings.
Vsevolod Stakhov [Tue, 6 Jan 2015 14:50:12 +0000 (14:50 +0000)]
Silent warnings.

9 years agoMerge pull request #125 from fatalbanana/master
Vsevolod Stakhov [Sun, 4 Jan 2015 10:09:49 +0000 (10:09 +0000)]
Merge pull request #125 from fatalbanana/master

Make Exim pass hostnames to rspamd

9 years agoMake Exim pass hostnames to rspamd 125/head
Andrew Lewis [Sat, 3 Jan 2015 21:46:21 +0000 (23:46 +0200)]
Make Exim pass hostnames to rspamd

9 years agoMerge pull request #124 from fatalbanana/master
Vsevolod Stakhov [Fri, 2 Jan 2015 13:00:26 +0000 (13:00 +0000)]
Merge pull request #124 from fatalbanana/master

Remove whitelist.lua from RPM file list

9 years agoRemove whitelist.lua from RPM file list 124/head
Andrew Lewis [Fri, 2 Jan 2015 12:58:45 +0000 (14:58 +0200)]
Remove whitelist.lua from RPM file list

9 years agoMerge pull request #123 from fatalbanana/master
Vsevolod Stakhov [Fri, 2 Jan 2015 12:41:55 +0000 (12:41 +0000)]
Merge pull request #123 from fatalbanana/master

Add sqlite as dependency for RPM/Debian packages

9 years agoAdd Perl as build dependency for Debian/RPM packages 123/head
Andrew Lewis [Fri, 2 Jan 2015 12:30:09 +0000 (14:30 +0200)]
Add Perl as build dependency for Debian/RPM packages

9 years agoAdd sqlite as dependency for RPM/Debian packages
Andrew Lewis [Fri, 2 Jan 2015 12:19:41 +0000 (14:19 +0200)]
Add sqlite as dependency for RPM/Debian packages

9 years agoRelease 0.8.0 0.8.0
Vsevolod Stakhov [Fri, 2 Jan 2015 11:17:33 +0000 (11:17 +0000)]
Release 0.8.0

* New fuzzy check logic:
- use shingles algorithm for fuzzy matching
- use blake2 instead of md5 for larger output space
- combine fuzzy and strict matching
- allow to organize private storages by means of keys
- preserve compatibility with previous versions
* New fuzzy storage:
- use sqlite instead of own memory based hash tables
- rework commands interface
- add conversion from the old format
- add fuzzy match by shignles
- support old rspamd versions
* Add lemmatizing for words used in fuzzy hashes that allows to improve match
quality by using of the first forms of all words
* Rework language detection
* Fix several critical bugs, memory leaks and deadlocks:
- memory leak in HTML nodes parsing
- deadlock in logger code
- deadlock in signals processing
- crashes in fuzzy_storage
- crashes in tokenizers if the input was empty
* Import new libucl with several bugfixes and improvements
* Support listening on ipv6 addresses only
* Fix macro expansion in SPF module
* Several bugfixes in DKIM module
* Add load headers support for mime parts to the lua API
* Add documentation for:
- workers in general
- fuzzy_storage worker
- fuzzy_check plugin
- mimepart and textpart lua API modules

Signed-off-by: Vsevolod Stakhov <vsevolod@highsecure.ru>
9 years agoUpdate docs.
Vsevolod Stakhov [Fri, 2 Jan 2015 11:09:48 +0000 (11:09 +0000)]
Update docs.

9 years agoMerge pull request #122 from fatalbanana/master
Vsevolod Stakhov [Fri, 2 Jan 2015 09:38:04 +0000 (09:38 +0000)]
Merge pull request #122 from fatalbanana/master

Fix typo in fuzzy_check.md

9 years agoFix typo in fuzzy_check.md 122/head
Andrew Lewis [Fri, 2 Jan 2015 06:49:47 +0000 (08:49 +0200)]
Fix typo in fuzzy_check.md

9 years agoAdd documentation for fuzzy_check module.
Vsevolod Stakhov [Fri, 2 Jan 2015 00:38:31 +0000 (00:38 +0000)]
Add documentation for fuzzy_check module.

9 years agoPreserve destructors order as LIFO.
Vsevolod Stakhov [Thu, 1 Jan 2015 15:45:22 +0000 (15:45 +0000)]
Preserve destructors order as LIFO.

9 years agoFix memory leak in html nodes.
Vsevolod Stakhov [Thu, 1 Jan 2015 15:12:00 +0000 (15:12 +0000)]
Fix memory leak in html nodes.

9 years agoFix macro expansion length calculation.
Vsevolod Stakhov [Thu, 1 Jan 2015 12:21:49 +0000 (12:21 +0000)]
Fix macro expansion length calculation.

9 years agoSome fixes to macro expansion in spf.
Vsevolod Stakhov [Tue, 30 Dec 2014 18:52:58 +0000 (18:52 +0000)]
Some fixes to macro expansion in spf.

9 years agoZero memory for inet address.
Vsevolod Stakhov [Tue, 30 Dec 2014 18:24:37 +0000 (18:24 +0000)]
Zero memory for inet address.

9 years agoFix some leaks.
Vsevolod Stakhov [Tue, 30 Dec 2014 14:54:33 +0000 (14:54 +0000)]
Fix some leaks.

9 years agoDo not tokenize empty input.
Vsevolod Stakhov [Tue, 30 Dec 2014 13:44:57 +0000 (13:44 +0000)]
Do not tokenize empty input.

9 years agoDo not dereference null pointer.
Vsevolod Stakhov [Tue, 30 Dec 2014 13:14:31 +0000 (13:14 +0000)]
Do not dereference null pointer.

9 years agoAdd documentation for fuzzy worker.
Vsevolod Stakhov [Mon, 29 Dec 2014 16:57:56 +0000 (16:57 +0000)]
Add documentation for fuzzy worker.

9 years agoValue of fuzzy is signed actually.
Vsevolod Stakhov [Mon, 29 Dec 2014 16:57:39 +0000 (16:57 +0000)]
Value of fuzzy is signed actually.

9 years agoAdd lua API for getting raw headers from mime part.
Vsevolod Stakhov [Mon, 29 Dec 2014 12:08:22 +0000 (12:08 +0000)]
Add lua API for getting raw headers from mime part.

9 years agoSave raw headers for all normal parts.
Vsevolod Stakhov [Mon, 29 Dec 2014 12:03:33 +0000 (12:03 +0000)]
Save raw headers for all normal parts.

9 years agoUpdate libucl.
Vsevolod Stakhov [Sat, 27 Dec 2014 16:36:08 +0000 (16:36 +0000)]
Update libucl.

9 years agoMerge pull request #121 from notandy/case-insensitive-find-headers
Vsevolod Stakhov [Fri, 26 Dec 2014 20:46:19 +0000 (20:46 +0000)]
Merge pull request #121 from notandy/case-insensitive-find-headers

make rspamd_http_message_find_header case-insensitive

9 years agomake rspamd_http_message_find_header case-insensitive 121/head
Andrew Karpow [Fri, 26 Dec 2014 15:50:27 +0000 (16:50 +0100)]
make rspamd_http_message_find_header case-insensitive

9 years agoUse safe iters for bind_socket parameter.
Vsevolod Stakhov [Thu, 25 Dec 2014 23:55:57 +0000 (23:55 +0000)]
Use safe iters for bind_socket parameter.

9 years agoUpdate ucl for safe iterators.
Vsevolod Stakhov [Thu, 25 Dec 2014 23:53:20 +0000 (23:53 +0000)]
Update ucl for safe iterators.

9 years agoAllow to listen on ipv6 IP.
Vsevolod Stakhov [Thu, 25 Dec 2014 18:35:49 +0000 (18:35 +0000)]
Allow to listen on ipv6 IP.

9 years agoArrays are no longer lists in UCL.
Vsevolod Stakhov [Thu, 25 Dec 2014 18:24:54 +0000 (18:24 +0000)]
Arrays are no longer lists in UCL.

9 years agoAdd workers documentation.
Vsevolod Stakhov [Thu, 25 Dec 2014 17:46:15 +0000 (17:46 +0000)]
Add workers documentation.

9 years agoSave flag in fuzzy reply.
Vsevolod Stakhov [Wed, 24 Dec 2014 16:53:55 +0000 (16:53 +0000)]
Save flag in fuzzy reply.

9 years agoLearn legacy fuzzy as well for now.
Vsevolod Stakhov [Wed, 24 Dec 2014 16:02:34 +0000 (16:02 +0000)]
Learn legacy fuzzy as well for now.

9 years agoLemmatize words for fuzzy check.
Vsevolod Stakhov [Tue, 23 Dec 2014 15:57:14 +0000 (15:57 +0000)]
Lemmatize words for fuzzy check.

9 years agoRework language detection.
Vsevolod Stakhov [Tue, 23 Dec 2014 15:28:27 +0000 (15:28 +0000)]
Rework language detection.

9 years agoRework text tokenizaton.
Vsevolod Stakhov [Tue, 23 Dec 2014 14:32:22 +0000 (14:32 +0000)]
Rework text tokenizaton.

9 years agoRework words tokenization.
Vsevolod Stakhov [Tue, 23 Dec 2014 14:09:01 +0000 (14:09 +0000)]
Rework words tokenization.

9 years agoAdd sequential order for upstreams.
Vsevolod Stakhov [Tue, 23 Dec 2014 13:42:14 +0000 (13:42 +0000)]
Add sequential order for upstreams.

9 years agoFix for fuzzy matching.
Vsevolod Stakhov [Mon, 22 Dec 2014 22:23:51 +0000 (22:23 +0000)]
Fix for fuzzy matching.

9 years agoSome fixes to fuzzy matching
Vsevolod Stakhov [Mon, 22 Dec 2014 17:57:04 +0000 (17:57 +0000)]
Some fixes to fuzzy matching