]>
source.dussan.org Git - rspamd.git/log
Andrew Lewis [Fri, 9 Jan 2015 14:05:31 +0000 (16:05 +0200)]
Fix building on Fedora
Vsevolod Stakhov [Tue, 6 Jan 2015 14:50:12 +0000 (14:50 +0000)]
Silent warnings.
Vsevolod Stakhov [Sun, 4 Jan 2015 10:09:49 +0000 (10:09 +0000)]
Merge pull request #125 from fatalbanana/master
Make Exim pass hostnames to rspamd
Andrew Lewis [Sat, 3 Jan 2015 21:46:21 +0000 (23:46 +0200)]
Make Exim pass hostnames to rspamd
Vsevolod Stakhov [Fri, 2 Jan 2015 13:00:26 +0000 (13:00 +0000)]
Merge pull request #124 from fatalbanana/master
Remove whitelist.lua from RPM file list
Andrew Lewis [Fri, 2 Jan 2015 12:58:45 +0000 (14:58 +0200)]
Remove whitelist.lua from RPM file list
Vsevolod Stakhov [Fri, 2 Jan 2015 12:41:55 +0000 (12:41 +0000)]
Merge pull request #123 from fatalbanana/master
Add sqlite as dependency for RPM/Debian packages
Andrew Lewis [Fri, 2 Jan 2015 12:30:09 +0000 (14:30 +0200)]
Add Perl as build dependency for Debian/RPM packages
Andrew Lewis [Fri, 2 Jan 2015 12:19:41 +0000 (14:19 +0200)]
Add sqlite as dependency for RPM/Debian packages
Vsevolod Stakhov [Fri, 2 Jan 2015 11:17:33 +0000 (11:17 +0000)]
Release 0.8.0
* New fuzzy check logic:
- use shingles algorithm for fuzzy matching
- use blake2 instead of md5 for larger output space
- combine fuzzy and strict matching
- allow to organize private storages by means of keys
- preserve compatibility with previous versions
* New fuzzy storage:
- use sqlite instead of own memory based hash tables
- rework commands interface
- add conversion from the old format
- add fuzzy match by shignles
- support old rspamd versions
* Add lemmatizing for words used in fuzzy hashes that allows to improve match
quality by using of the first forms of all words
* Rework language detection
* Fix several critical bugs, memory leaks and deadlocks:
- memory leak in HTML nodes parsing
- deadlock in logger code
- deadlock in signals processing
- crashes in fuzzy_storage
- crashes in tokenizers if the input was empty
* Import new libucl with several bugfixes and improvements
* Support listening on ipv6 addresses only
* Fix macro expansion in SPF module
* Several bugfixes in DKIM module
* Add load headers support for mime parts to the lua API
* Add documentation for:
- workers in general
- fuzzy_storage worker
- fuzzy_check plugin
- mimepart and textpart lua API modules
Signed-off-by: Vsevolod Stakhov <vsevolod@highsecure.ru>
Vsevolod Stakhov [Fri, 2 Jan 2015 11:09:48 +0000 (11:09 +0000)]
Update docs.
Vsevolod Stakhov [Fri, 2 Jan 2015 09:38:04 +0000 (09:38 +0000)]
Merge pull request #122 from fatalbanana/master
Fix typo in fuzzy_check.md
Andrew Lewis [Fri, 2 Jan 2015 06:49:47 +0000 (08:49 +0200)]
Fix typo in fuzzy_check.md
Vsevolod Stakhov [Fri, 2 Jan 2015 00:38:31 +0000 (00:38 +0000)]
Add documentation for fuzzy_check module.
Vsevolod Stakhov [Thu, 1 Jan 2015 15:45:22 +0000 (15:45 +0000)]
Preserve destructors order as LIFO.
Vsevolod Stakhov [Thu, 1 Jan 2015 15:12:00 +0000 (15:12 +0000)]
Fix memory leak in html nodes.
Vsevolod Stakhov [Thu, 1 Jan 2015 12:21:49 +0000 (12:21 +0000)]
Fix macro expansion length calculation.
Vsevolod Stakhov [Tue, 30 Dec 2014 18:52:58 +0000 (18:52 +0000)]
Some fixes to macro expansion in spf.
Vsevolod Stakhov [Tue, 30 Dec 2014 18:24:37 +0000 (18:24 +0000)]
Zero memory for inet address.
Vsevolod Stakhov [Tue, 30 Dec 2014 14:54:33 +0000 (14:54 +0000)]
Fix some leaks.
Vsevolod Stakhov [Tue, 30 Dec 2014 13:44:57 +0000 (13:44 +0000)]
Do not tokenize empty input.
Vsevolod Stakhov [Tue, 30 Dec 2014 13:14:31 +0000 (13:14 +0000)]
Do not dereference null pointer.
Vsevolod Stakhov [Mon, 29 Dec 2014 16:57:56 +0000 (16:57 +0000)]
Add documentation for fuzzy worker.
Vsevolod Stakhov [Mon, 29 Dec 2014 16:57:39 +0000 (16:57 +0000)]
Value of fuzzy is signed actually.
Vsevolod Stakhov [Mon, 29 Dec 2014 12:08:22 +0000 (12:08 +0000)]
Add lua API for getting raw headers from mime part.
Vsevolod Stakhov [Mon, 29 Dec 2014 12:03:33 +0000 (12:03 +0000)]
Save raw headers for all normal parts.
Vsevolod Stakhov [Sat, 27 Dec 2014 16:36:08 +0000 (16:36 +0000)]
Update libucl.
Vsevolod Stakhov [Fri, 26 Dec 2014 20:46:19 +0000 (20:46 +0000)]
Merge pull request #121 from notandy/case-insensitive-find-headers
make rspamd_http_message_find_header case-insensitive
Andrew Karpow [Fri, 26 Dec 2014 15:50:27 +0000 (16:50 +0100)]
make rspamd_http_message_find_header case-insensitive
Vsevolod Stakhov [Thu, 25 Dec 2014 23:55:57 +0000 (23:55 +0000)]
Use safe iters for bind_socket parameter.
Vsevolod Stakhov [Thu, 25 Dec 2014 23:53:20 +0000 (23:53 +0000)]
Update ucl for safe iterators.
Vsevolod Stakhov [Thu, 25 Dec 2014 18:35:49 +0000 (18:35 +0000)]
Allow to listen on ipv6 IP.
Vsevolod Stakhov [Thu, 25 Dec 2014 18:24:54 +0000 (18:24 +0000)]
Arrays are no longer lists in UCL.
Vsevolod Stakhov [Thu, 25 Dec 2014 17:46:15 +0000 (17:46 +0000)]
Add workers documentation.
Vsevolod Stakhov [Wed, 24 Dec 2014 16:53:55 +0000 (16:53 +0000)]
Save flag in fuzzy reply.
Vsevolod Stakhov [Wed, 24 Dec 2014 16:02:34 +0000 (16:02 +0000)]
Learn legacy fuzzy as well for now.
Vsevolod Stakhov [Tue, 23 Dec 2014 15:57:14 +0000 (15:57 +0000)]
Lemmatize words for fuzzy check.
Vsevolod Stakhov [Tue, 23 Dec 2014 15:28:27 +0000 (15:28 +0000)]
Rework language detection.
Vsevolod Stakhov [Tue, 23 Dec 2014 14:32:22 +0000 (14:32 +0000)]
Rework text tokenizaton.
Vsevolod Stakhov [Tue, 23 Dec 2014 14:09:01 +0000 (14:09 +0000)]
Rework words tokenization.
Vsevolod Stakhov [Tue, 23 Dec 2014 13:42:14 +0000 (13:42 +0000)]
Add sequential order for upstreams.
Vsevolod Stakhov [Mon, 22 Dec 2014 22:23:51 +0000 (22:23 +0000)]
Fix for fuzzy matching.
Vsevolod Stakhov [Mon, 22 Dec 2014 17:57:04 +0000 (17:57 +0000)]
Some fixes to fuzzy matching
Vsevolod Stakhov [Mon, 22 Dec 2014 17:47:26 +0000 (17:47 +0000)]
Fix shingles key init.
Vsevolod Stakhov [Mon, 22 Dec 2014 17:31:53 +0000 (17:31 +0000)]
Fix stupid deadlock in the logger.
Vsevolod Stakhov [Mon, 22 Dec 2014 17:22:24 +0000 (17:22 +0000)]
Fix replies waiting.
Vsevolod Stakhov [Mon, 22 Dec 2014 17:09:38 +0000 (17:09 +0000)]
Do not learn with legacy data.
Vsevolod Stakhov [Mon, 22 Dec 2014 17:08:17 +0000 (17:08 +0000)]
Init keys properly.
Vsevolod Stakhov [Mon, 22 Dec 2014 17:05:13 +0000 (17:05 +0000)]
Skip short words.
Vsevolod Stakhov [Mon, 22 Dec 2014 17:05:04 +0000 (17:05 +0000)]
Fix tagging.
Vsevolod Stakhov [Mon, 22 Dec 2014 16:55:37 +0000 (16:55 +0000)]
Fix initialization issues for some variables.
Vsevolod Stakhov [Mon, 22 Dec 2014 16:18:14 +0000 (16:18 +0000)]
I will never ever use malloc in signal handler.
I will never ever use malloc in signal handler.
I will never ever use malloc in signal handler.
I will never ever use malloc in signal handler.
I will never ever use malloc in signal handler.
I will never ever use malloc in signal handler.
I will never ever use malloc in signal handler.
I will never ever use malloc in signal handler.
...
Vsevolod Stakhov [Mon, 22 Dec 2014 15:59:16 +0000 (15:59 +0000)]
Avoid debug noise.
Vsevolod Stakhov [Mon, 22 Dec 2014 15:40:52 +0000 (15:40 +0000)]
Add keys initialization.
Vsevolod Stakhov [Mon, 22 Dec 2014 15:19:59 +0000 (15:19 +0000)]
Rewrite fuzzy check plugin.
Vsevolod Stakhov [Mon, 22 Dec 2014 13:27:28 +0000 (13:27 +0000)]
Add tag for all commands and replies.
Vsevolod Stakhov [Mon, 22 Dec 2014 13:25:12 +0000 (13:25 +0000)]
Pack fuzzy commands.
Vsevolod Stakhov [Mon, 22 Dec 2014 12:49:15 +0000 (12:49 +0000)]
Add abstract command sending function.
Vsevolod Stakhov [Mon, 22 Dec 2014 12:29:55 +0000 (12:29 +0000)]
Add new commands support.
Vsevolod Stakhov [Sun, 21 Dec 2014 21:14:39 +0000 (21:14 +0000)]
Update expired elements.
Vsevolod Stakhov [Sat, 20 Dec 2014 23:17:35 +0000 (23:17 +0000)]
Implement shingles insertions.
Vsevolod Stakhov [Sat, 20 Dec 2014 22:55:21 +0000 (22:55 +0000)]
Add fuzzy match by shingles.
Vsevolod Stakhov [Sat, 20 Dec 2014 17:08:08 +0000 (17:08 +0000)]
Update version for testing.
Vsevolod Stakhov [Sat, 20 Dec 2014 17:03:30 +0000 (17:03 +0000)]
Remove checks from debian build.
Vsevolod Stakhov [Sat, 20 Dec 2014 16:47:30 +0000 (16:47 +0000)]
Restore expired/count statistics.
Vsevolod Stakhov [Sat, 20 Dec 2014 16:23:05 +0000 (16:23 +0000)]
Restore functions of fuzzy_check.
Vsevolod Stakhov [Sat, 20 Dec 2014 14:33:53 +0000 (14:33 +0000)]
Implement basic add and deletion.
Vsevolod Stakhov [Sat, 20 Dec 2014 13:40:35 +0000 (13:40 +0000)]
Implement direct checking.
Vsevolod Stakhov [Sat, 20 Dec 2014 13:00:54 +0000 (13:00 +0000)]
Fix old database conversion.
Vsevolod Stakhov [Fri, 19 Dec 2014 23:38:48 +0000 (23:38 +0000)]
Forgot to replace.
Vsevolod Stakhov [Fri, 19 Dec 2014 23:33:31 +0000 (23:33 +0000)]
Add compatibility with old sqlite.
Vsevolod Stakhov [Fri, 19 Dec 2014 23:27:06 +0000 (23:27 +0000)]
Fix travis rules.
Vsevolod Stakhov [Fri, 19 Dec 2014 23:19:59 +0000 (23:19 +0000)]
Fix SQL queries.
Vsevolod Stakhov [Fri, 19 Dec 2014 16:58:55 +0000 (16:58 +0000)]
Add simple insertion statement.
Vsevolod Stakhov [Fri, 19 Dec 2014 16:58:25 +0000 (16:58 +0000)]
Add create database sql statements.
Vsevolod Stakhov [Fri, 19 Dec 2014 16:46:06 +0000 (16:46 +0000)]
Implement transactions.
Vsevolod Stakhov [Fri, 19 Dec 2014 16:35:09 +0000 (16:35 +0000)]
Add prepared statements logic.
Vsevolod Stakhov [Fri, 19 Dec 2014 16:01:35 +0000 (16:01 +0000)]
Add conversion function.
Vsevolod Stakhov [Fri, 19 Dec 2014 15:45:11 +0000 (15:45 +0000)]
Add backend open.
Vsevolod Stakhov [Fri, 19 Dec 2014 14:35:31 +0000 (14:35 +0000)]
Start total rework of fuzzy_storage.
Vsevolod Stakhov [Fri, 19 Dec 2014 12:15:34 +0000 (12:15 +0000)]
Several improvements to the shingles calculations.
Vsevolod Stakhov [Fri, 19 Dec 2014 10:55:28 +0000 (10:55 +0000)]
Compile external tools with optimizations.
Vsevolod Stakhov [Fri, 19 Dec 2014 10:55:06 +0000 (10:55 +0000)]
Resize hashes array properly.
Vsevolod Stakhov [Fri, 19 Dec 2014 10:53:22 +0000 (10:53 +0000)]
Measure time for shingles generation.
Vsevolod Stakhov [Thu, 18 Dec 2014 21:05:02 +0000 (21:05 +0000)]
Use blake2 as KDF instead of sha256.
Vsevolod Stakhov [Thu, 18 Dec 2014 20:58:17 +0000 (20:58 +0000)]
Add blake2 hash contrib code.
Vsevolod Stakhov [Thu, 18 Dec 2014 15:28:05 +0000 (15:28 +0000)]
Liblmdb is not presented in precise repo.
Vsevolod Stakhov [Wed, 17 Dec 2014 23:59:21 +0000 (23:59 +0000)]
Add missing lmdb dep.
Vsevolod Stakhov [Wed, 17 Dec 2014 23:54:12 +0000 (23:54 +0000)]
Merge branch 'lmdb'
Vsevolod Stakhov [Wed, 17 Dec 2014 23:53:41 +0000 (23:53 +0000)]
Process commands for lmdb.
Vsevolod Stakhov [Wed, 17 Dec 2014 22:55:49 +0000 (22:55 +0000)]
Start new fuzzy storage protocol implementation.
Vsevolod Stakhov [Wed, 17 Dec 2014 22:39:20 +0000 (22:39 +0000)]
Add lmdb initialization.
Vsevolod Stakhov [Wed, 17 Dec 2014 22:03:11 +0000 (22:03 +0000)]
Refactor function names.
Vsevolod Stakhov [Wed, 17 Dec 2014 21:47:25 +0000 (21:47 +0000)]
Remove old lists mode.
Vsevolod Stakhov [Wed, 17 Dec 2014 21:40:59 +0000 (21:40 +0000)]
Search for liblmdb.
Vsevolod Stakhov [Wed, 17 Dec 2014 18:30:17 +0000 (18:30 +0000)]
Merge branch 'shingles'
Vsevolod Stakhov [Wed, 17 Dec 2014 18:29:47 +0000 (18:29 +0000)]
Update tests suite.
Vsevolod Stakhov [Wed, 17 Dec 2014 18:29:33 +0000 (18:29 +0000)]
Tune shingles settings.
Vsevolod Stakhov [Wed, 17 Dec 2014 17:28:07 +0000 (17:28 +0000)]
Add custom targets check and run-test.
Vsevolod Stakhov [Wed, 17 Dec 2014 17:27:57 +0000 (17:27 +0000)]
Add some tests for shingles.