]> source.dussan.org Git - rspamd.git/log
rspamd.git
9 years agoFix building on Fedora 126/head
Andrew Lewis [Fri, 9 Jan 2015 14:05:31 +0000 (16:05 +0200)]
Fix building on Fedora

9 years agoSilent warnings.
Vsevolod Stakhov [Tue, 6 Jan 2015 14:50:12 +0000 (14:50 +0000)]
Silent warnings.

9 years agoMerge pull request #125 from fatalbanana/master
Vsevolod Stakhov [Sun, 4 Jan 2015 10:09:49 +0000 (10:09 +0000)]
Merge pull request #125 from fatalbanana/master

Make Exim pass hostnames to rspamd

9 years agoMake Exim pass hostnames to rspamd 125/head
Andrew Lewis [Sat, 3 Jan 2015 21:46:21 +0000 (23:46 +0200)]
Make Exim pass hostnames to rspamd

9 years agoMerge pull request #124 from fatalbanana/master
Vsevolod Stakhov [Fri, 2 Jan 2015 13:00:26 +0000 (13:00 +0000)]
Merge pull request #124 from fatalbanana/master

Remove whitelist.lua from RPM file list

9 years agoRemove whitelist.lua from RPM file list 124/head
Andrew Lewis [Fri, 2 Jan 2015 12:58:45 +0000 (14:58 +0200)]
Remove whitelist.lua from RPM file list

9 years agoMerge pull request #123 from fatalbanana/master
Vsevolod Stakhov [Fri, 2 Jan 2015 12:41:55 +0000 (12:41 +0000)]
Merge pull request #123 from fatalbanana/master

Add sqlite as dependency for RPM/Debian packages

9 years agoAdd Perl as build dependency for Debian/RPM packages 123/head
Andrew Lewis [Fri, 2 Jan 2015 12:30:09 +0000 (14:30 +0200)]
Add Perl as build dependency for Debian/RPM packages

9 years agoAdd sqlite as dependency for RPM/Debian packages
Andrew Lewis [Fri, 2 Jan 2015 12:19:41 +0000 (14:19 +0200)]
Add sqlite as dependency for RPM/Debian packages

9 years agoRelease 0.8.0 0.8.0
Vsevolod Stakhov [Fri, 2 Jan 2015 11:17:33 +0000 (11:17 +0000)]
Release 0.8.0

* New fuzzy check logic:
- use shingles algorithm for fuzzy matching
- use blake2 instead of md5 for larger output space
- combine fuzzy and strict matching
- allow to organize private storages by means of keys
- preserve compatibility with previous versions
* New fuzzy storage:
- use sqlite instead of own memory based hash tables
- rework commands interface
- add conversion from the old format
- add fuzzy match by shignles
- support old rspamd versions
* Add lemmatizing for words used in fuzzy hashes that allows to improve match
quality by using of the first forms of all words
* Rework language detection
* Fix several critical bugs, memory leaks and deadlocks:
- memory leak in HTML nodes parsing
- deadlock in logger code
- deadlock in signals processing
- crashes in fuzzy_storage
- crashes in tokenizers if the input was empty
* Import new libucl with several bugfixes and improvements
* Support listening on ipv6 addresses only
* Fix macro expansion in SPF module
* Several bugfixes in DKIM module
* Add load headers support for mime parts to the lua API
* Add documentation for:
- workers in general
- fuzzy_storage worker
- fuzzy_check plugin
- mimepart and textpart lua API modules

Signed-off-by: Vsevolod Stakhov <vsevolod@highsecure.ru>
9 years agoUpdate docs.
Vsevolod Stakhov [Fri, 2 Jan 2015 11:09:48 +0000 (11:09 +0000)]
Update docs.

9 years agoMerge pull request #122 from fatalbanana/master
Vsevolod Stakhov [Fri, 2 Jan 2015 09:38:04 +0000 (09:38 +0000)]
Merge pull request #122 from fatalbanana/master

Fix typo in fuzzy_check.md

9 years agoFix typo in fuzzy_check.md 122/head
Andrew Lewis [Fri, 2 Jan 2015 06:49:47 +0000 (08:49 +0200)]
Fix typo in fuzzy_check.md

9 years agoAdd documentation for fuzzy_check module.
Vsevolod Stakhov [Fri, 2 Jan 2015 00:38:31 +0000 (00:38 +0000)]
Add documentation for fuzzy_check module.

9 years agoPreserve destructors order as LIFO.
Vsevolod Stakhov [Thu, 1 Jan 2015 15:45:22 +0000 (15:45 +0000)]
Preserve destructors order as LIFO.

9 years agoFix memory leak in html nodes.
Vsevolod Stakhov [Thu, 1 Jan 2015 15:12:00 +0000 (15:12 +0000)]
Fix memory leak in html nodes.

9 years agoFix macro expansion length calculation.
Vsevolod Stakhov [Thu, 1 Jan 2015 12:21:49 +0000 (12:21 +0000)]
Fix macro expansion length calculation.

9 years agoSome fixes to macro expansion in spf.
Vsevolod Stakhov [Tue, 30 Dec 2014 18:52:58 +0000 (18:52 +0000)]
Some fixes to macro expansion in spf.

9 years agoZero memory for inet address.
Vsevolod Stakhov [Tue, 30 Dec 2014 18:24:37 +0000 (18:24 +0000)]
Zero memory for inet address.

9 years agoFix some leaks.
Vsevolod Stakhov [Tue, 30 Dec 2014 14:54:33 +0000 (14:54 +0000)]
Fix some leaks.

9 years agoDo not tokenize empty input.
Vsevolod Stakhov [Tue, 30 Dec 2014 13:44:57 +0000 (13:44 +0000)]
Do not tokenize empty input.

9 years agoDo not dereference null pointer.
Vsevolod Stakhov [Tue, 30 Dec 2014 13:14:31 +0000 (13:14 +0000)]
Do not dereference null pointer.

9 years agoAdd documentation for fuzzy worker.
Vsevolod Stakhov [Mon, 29 Dec 2014 16:57:56 +0000 (16:57 +0000)]
Add documentation for fuzzy worker.

9 years agoValue of fuzzy is signed actually.
Vsevolod Stakhov [Mon, 29 Dec 2014 16:57:39 +0000 (16:57 +0000)]
Value of fuzzy is signed actually.

9 years agoAdd lua API for getting raw headers from mime part.
Vsevolod Stakhov [Mon, 29 Dec 2014 12:08:22 +0000 (12:08 +0000)]
Add lua API for getting raw headers from mime part.

9 years agoSave raw headers for all normal parts.
Vsevolod Stakhov [Mon, 29 Dec 2014 12:03:33 +0000 (12:03 +0000)]
Save raw headers for all normal parts.

9 years agoUpdate libucl.
Vsevolod Stakhov [Sat, 27 Dec 2014 16:36:08 +0000 (16:36 +0000)]
Update libucl.

9 years agoMerge pull request #121 from notandy/case-insensitive-find-headers
Vsevolod Stakhov [Fri, 26 Dec 2014 20:46:19 +0000 (20:46 +0000)]
Merge pull request #121 from notandy/case-insensitive-find-headers

make rspamd_http_message_find_header case-insensitive

9 years agomake rspamd_http_message_find_header case-insensitive 121/head
Andrew Karpow [Fri, 26 Dec 2014 15:50:27 +0000 (16:50 +0100)]
make rspamd_http_message_find_header case-insensitive

9 years agoUse safe iters for bind_socket parameter.
Vsevolod Stakhov [Thu, 25 Dec 2014 23:55:57 +0000 (23:55 +0000)]
Use safe iters for bind_socket parameter.

9 years agoUpdate ucl for safe iterators.
Vsevolod Stakhov [Thu, 25 Dec 2014 23:53:20 +0000 (23:53 +0000)]
Update ucl for safe iterators.

9 years agoAllow to listen on ipv6 IP.
Vsevolod Stakhov [Thu, 25 Dec 2014 18:35:49 +0000 (18:35 +0000)]
Allow to listen on ipv6 IP.

9 years agoArrays are no longer lists in UCL.
Vsevolod Stakhov [Thu, 25 Dec 2014 18:24:54 +0000 (18:24 +0000)]
Arrays are no longer lists in UCL.

9 years agoAdd workers documentation.
Vsevolod Stakhov [Thu, 25 Dec 2014 17:46:15 +0000 (17:46 +0000)]
Add workers documentation.

9 years agoSave flag in fuzzy reply.
Vsevolod Stakhov [Wed, 24 Dec 2014 16:53:55 +0000 (16:53 +0000)]
Save flag in fuzzy reply.

9 years agoLearn legacy fuzzy as well for now.
Vsevolod Stakhov [Wed, 24 Dec 2014 16:02:34 +0000 (16:02 +0000)]
Learn legacy fuzzy as well for now.

9 years agoLemmatize words for fuzzy check.
Vsevolod Stakhov [Tue, 23 Dec 2014 15:57:14 +0000 (15:57 +0000)]
Lemmatize words for fuzzy check.

9 years agoRework language detection.
Vsevolod Stakhov [Tue, 23 Dec 2014 15:28:27 +0000 (15:28 +0000)]
Rework language detection.

9 years agoRework text tokenizaton.
Vsevolod Stakhov [Tue, 23 Dec 2014 14:32:22 +0000 (14:32 +0000)]
Rework text tokenizaton.

9 years agoRework words tokenization.
Vsevolod Stakhov [Tue, 23 Dec 2014 14:09:01 +0000 (14:09 +0000)]
Rework words tokenization.

9 years agoAdd sequential order for upstreams.
Vsevolod Stakhov [Tue, 23 Dec 2014 13:42:14 +0000 (13:42 +0000)]
Add sequential order for upstreams.

9 years agoFix for fuzzy matching.
Vsevolod Stakhov [Mon, 22 Dec 2014 22:23:51 +0000 (22:23 +0000)]
Fix for fuzzy matching.

9 years agoSome fixes to fuzzy matching
Vsevolod Stakhov [Mon, 22 Dec 2014 17:57:04 +0000 (17:57 +0000)]
Some fixes to fuzzy matching

9 years agoFix shingles key init.
Vsevolod Stakhov [Mon, 22 Dec 2014 17:47:26 +0000 (17:47 +0000)]
Fix shingles key init.

9 years agoFix stupid deadlock in the logger.
Vsevolod Stakhov [Mon, 22 Dec 2014 17:31:53 +0000 (17:31 +0000)]
Fix stupid deadlock in the logger.

9 years agoFix replies waiting.
Vsevolod Stakhov [Mon, 22 Dec 2014 17:22:24 +0000 (17:22 +0000)]
Fix replies waiting.

9 years agoDo not learn with legacy data.
Vsevolod Stakhov [Mon, 22 Dec 2014 17:09:38 +0000 (17:09 +0000)]
Do not learn with legacy data.

9 years agoInit keys properly.
Vsevolod Stakhov [Mon, 22 Dec 2014 17:08:17 +0000 (17:08 +0000)]
Init keys properly.

9 years agoSkip short words.
Vsevolod Stakhov [Mon, 22 Dec 2014 17:05:13 +0000 (17:05 +0000)]
Skip short words.

9 years agoFix tagging.
Vsevolod Stakhov [Mon, 22 Dec 2014 17:05:04 +0000 (17:05 +0000)]
Fix tagging.

9 years agoFix initialization issues for some variables.
Vsevolod Stakhov [Mon, 22 Dec 2014 16:55:37 +0000 (16:55 +0000)]
Fix initialization issues for some variables.

9 years agoI will never ever use malloc in signal handler.
Vsevolod Stakhov [Mon, 22 Dec 2014 16:18:14 +0000 (16:18 +0000)]
I will never ever use malloc in signal handler.

I will never ever use malloc in signal handler.
I will never ever use malloc in signal handler.
I will never ever use malloc in signal handler.
I will never ever use malloc in signal handler.
I will never ever use malloc in signal handler.
I will never ever use malloc in signal handler.
I will never ever use malloc in signal handler.
...

9 years agoAvoid debug noise.
Vsevolod Stakhov [Mon, 22 Dec 2014 15:59:16 +0000 (15:59 +0000)]
Avoid debug noise.

9 years agoAdd keys initialization.
Vsevolod Stakhov [Mon, 22 Dec 2014 15:40:52 +0000 (15:40 +0000)]
Add keys initialization.

9 years agoRewrite fuzzy check plugin.
Vsevolod Stakhov [Mon, 22 Dec 2014 15:19:59 +0000 (15:19 +0000)]
Rewrite fuzzy check plugin.

9 years agoAdd tag for all commands and replies.
Vsevolod Stakhov [Mon, 22 Dec 2014 13:27:28 +0000 (13:27 +0000)]
Add tag for all commands and replies.

9 years agoPack fuzzy commands.
Vsevolod Stakhov [Mon, 22 Dec 2014 13:25:12 +0000 (13:25 +0000)]
Pack fuzzy commands.

9 years agoAdd abstract command sending function.
Vsevolod Stakhov [Mon, 22 Dec 2014 12:49:15 +0000 (12:49 +0000)]
Add abstract command sending function.

9 years agoAdd new commands support.
Vsevolod Stakhov [Mon, 22 Dec 2014 12:29:55 +0000 (12:29 +0000)]
Add new commands support.

9 years agoUpdate expired elements.
Vsevolod Stakhov [Sun, 21 Dec 2014 21:14:39 +0000 (21:14 +0000)]
Update expired elements.

9 years agoImplement shingles insertions.
Vsevolod Stakhov [Sat, 20 Dec 2014 23:17:35 +0000 (23:17 +0000)]
Implement shingles insertions.

9 years agoAdd fuzzy match by shingles.
Vsevolod Stakhov [Sat, 20 Dec 2014 22:55:21 +0000 (22:55 +0000)]
Add fuzzy match by shingles.

9 years agoUpdate version for testing.
Vsevolod Stakhov [Sat, 20 Dec 2014 17:08:08 +0000 (17:08 +0000)]
Update version for testing.

9 years agoRemove checks from debian build.
Vsevolod Stakhov [Sat, 20 Dec 2014 17:03:30 +0000 (17:03 +0000)]
Remove checks from debian build.

9 years agoRestore expired/count statistics.
Vsevolod Stakhov [Sat, 20 Dec 2014 16:47:30 +0000 (16:47 +0000)]
Restore expired/count statistics.

9 years agoRestore functions of fuzzy_check.
Vsevolod Stakhov [Sat, 20 Dec 2014 16:23:05 +0000 (16:23 +0000)]
Restore functions of fuzzy_check.

9 years agoImplement basic add and deletion.
Vsevolod Stakhov [Sat, 20 Dec 2014 14:33:53 +0000 (14:33 +0000)]
Implement basic add and deletion.

9 years agoImplement direct checking.
Vsevolod Stakhov [Sat, 20 Dec 2014 13:40:35 +0000 (13:40 +0000)]
Implement direct checking.

9 years agoFix old database conversion.
Vsevolod Stakhov [Sat, 20 Dec 2014 13:00:54 +0000 (13:00 +0000)]
Fix old database conversion.

9 years agoForgot to replace.
Vsevolod Stakhov [Fri, 19 Dec 2014 23:38:48 +0000 (23:38 +0000)]
Forgot to replace.

9 years agoAdd compatibility with old sqlite.
Vsevolod Stakhov [Fri, 19 Dec 2014 23:33:31 +0000 (23:33 +0000)]
Add compatibility with old sqlite.

9 years agoFix travis rules.
Vsevolod Stakhov [Fri, 19 Dec 2014 23:27:06 +0000 (23:27 +0000)]
Fix travis rules.

9 years agoFix SQL queries.
Vsevolod Stakhov [Fri, 19 Dec 2014 23:19:59 +0000 (23:19 +0000)]
Fix SQL queries.

9 years agoAdd simple insertion statement.
Vsevolod Stakhov [Fri, 19 Dec 2014 16:58:55 +0000 (16:58 +0000)]
Add simple insertion statement.

9 years agoAdd create database sql statements.
Vsevolod Stakhov [Fri, 19 Dec 2014 16:58:25 +0000 (16:58 +0000)]
Add create database sql statements.

9 years agoImplement transactions.
Vsevolod Stakhov [Fri, 19 Dec 2014 16:46:06 +0000 (16:46 +0000)]
Implement transactions.

9 years agoAdd prepared statements logic.
Vsevolod Stakhov [Fri, 19 Dec 2014 16:35:09 +0000 (16:35 +0000)]
Add prepared statements logic.

9 years agoAdd conversion function.
Vsevolod Stakhov [Fri, 19 Dec 2014 16:01:35 +0000 (16:01 +0000)]
Add conversion function.

9 years agoAdd backend open.
Vsevolod Stakhov [Fri, 19 Dec 2014 15:45:11 +0000 (15:45 +0000)]
Add backend open.

9 years agoStart total rework of fuzzy_storage.
Vsevolod Stakhov [Fri, 19 Dec 2014 14:35:31 +0000 (14:35 +0000)]
Start total rework of fuzzy_storage.

9 years agoSeveral improvements to the shingles calculations.
Vsevolod Stakhov [Fri, 19 Dec 2014 12:15:34 +0000 (12:15 +0000)]
Several improvements to the shingles calculations.

9 years agoCompile external tools with optimizations.
Vsevolod Stakhov [Fri, 19 Dec 2014 10:55:28 +0000 (10:55 +0000)]
Compile external tools with optimizations.

9 years agoResize hashes array properly.
Vsevolod Stakhov [Fri, 19 Dec 2014 10:55:06 +0000 (10:55 +0000)]
Resize hashes array properly.

9 years agoMeasure time for shingles generation.
Vsevolod Stakhov [Fri, 19 Dec 2014 10:53:22 +0000 (10:53 +0000)]
Measure time for shingles generation.

9 years agoUse blake2 as KDF instead of sha256.
Vsevolod Stakhov [Thu, 18 Dec 2014 21:05:02 +0000 (21:05 +0000)]
Use blake2 as KDF instead of sha256.

9 years agoAdd blake2 hash contrib code.
Vsevolod Stakhov [Thu, 18 Dec 2014 20:58:17 +0000 (20:58 +0000)]
Add blake2 hash contrib code.

9 years agoLiblmdb is not presented in precise repo.
Vsevolod Stakhov [Thu, 18 Dec 2014 15:28:05 +0000 (15:28 +0000)]
Liblmdb is not presented in precise repo.

9 years agoAdd missing lmdb dep.
Vsevolod Stakhov [Wed, 17 Dec 2014 23:59:21 +0000 (23:59 +0000)]
Add missing lmdb dep.

9 years agoMerge branch 'lmdb'
Vsevolod Stakhov [Wed, 17 Dec 2014 23:54:12 +0000 (23:54 +0000)]
Merge branch 'lmdb'

9 years agoProcess commands for lmdb.
Vsevolod Stakhov [Wed, 17 Dec 2014 23:53:41 +0000 (23:53 +0000)]
Process commands for lmdb.

9 years agoStart new fuzzy storage protocol implementation.
Vsevolod Stakhov [Wed, 17 Dec 2014 22:55:49 +0000 (22:55 +0000)]
Start new fuzzy storage protocol implementation.

9 years agoAdd lmdb initialization.
Vsevolod Stakhov [Wed, 17 Dec 2014 22:39:20 +0000 (22:39 +0000)]
Add lmdb initialization.

9 years agoRefactor function names.
Vsevolod Stakhov [Wed, 17 Dec 2014 22:03:11 +0000 (22:03 +0000)]
Refactor function names.

9 years agoRemove old lists mode.
Vsevolod Stakhov [Wed, 17 Dec 2014 21:47:25 +0000 (21:47 +0000)]
Remove old lists mode.

9 years agoSearch for liblmdb.
Vsevolod Stakhov [Wed, 17 Dec 2014 21:40:59 +0000 (21:40 +0000)]
Search for liblmdb.

9 years agoMerge branch 'shingles'
Vsevolod Stakhov [Wed, 17 Dec 2014 18:30:17 +0000 (18:30 +0000)]
Merge branch 'shingles'

9 years agoUpdate tests suite.
Vsevolod Stakhov [Wed, 17 Dec 2014 18:29:47 +0000 (18:29 +0000)]
Update tests suite.

9 years agoTune shingles settings.
Vsevolod Stakhov [Wed, 17 Dec 2014 18:29:33 +0000 (18:29 +0000)]
Tune shingles settings.

9 years agoAdd custom targets check and run-test.
Vsevolod Stakhov [Wed, 17 Dec 2014 17:28:07 +0000 (17:28 +0000)]
Add custom targets check and run-test.

9 years agoAdd some tests for shingles.
Vsevolod Stakhov [Wed, 17 Dec 2014 17:27:57 +0000 (17:27 +0000)]
Add some tests for shingles.