]> source.dussan.org Git - rspamd.git/log
rspamd.git
9 years agoDo not learn with legacy data.
Vsevolod Stakhov [Mon, 22 Dec 2014 17:09:38 +0000 (17:09 +0000)]
Do not learn with legacy data.

9 years agoInit keys properly.
Vsevolod Stakhov [Mon, 22 Dec 2014 17:08:17 +0000 (17:08 +0000)]
Init keys properly.

9 years agoSkip short words.
Vsevolod Stakhov [Mon, 22 Dec 2014 17:05:13 +0000 (17:05 +0000)]
Skip short words.

9 years agoFix tagging.
Vsevolod Stakhov [Mon, 22 Dec 2014 17:05:04 +0000 (17:05 +0000)]
Fix tagging.

9 years agoFix initialization issues for some variables.
Vsevolod Stakhov [Mon, 22 Dec 2014 16:55:37 +0000 (16:55 +0000)]
Fix initialization issues for some variables.

9 years agoI will never ever use malloc in signal handler.
Vsevolod Stakhov [Mon, 22 Dec 2014 16:18:14 +0000 (16:18 +0000)]
I will never ever use malloc in signal handler.

I will never ever use malloc in signal handler.
I will never ever use malloc in signal handler.
I will never ever use malloc in signal handler.
I will never ever use malloc in signal handler.
I will never ever use malloc in signal handler.
I will never ever use malloc in signal handler.
I will never ever use malloc in signal handler.
...

9 years agoAvoid debug noise.
Vsevolod Stakhov [Mon, 22 Dec 2014 15:59:16 +0000 (15:59 +0000)]
Avoid debug noise.

9 years agoAdd keys initialization.
Vsevolod Stakhov [Mon, 22 Dec 2014 15:40:52 +0000 (15:40 +0000)]
Add keys initialization.

9 years agoRewrite fuzzy check plugin.
Vsevolod Stakhov [Mon, 22 Dec 2014 15:19:59 +0000 (15:19 +0000)]
Rewrite fuzzy check plugin.

9 years agoAdd tag for all commands and replies.
Vsevolod Stakhov [Mon, 22 Dec 2014 13:27:28 +0000 (13:27 +0000)]
Add tag for all commands and replies.

9 years agoPack fuzzy commands.
Vsevolod Stakhov [Mon, 22 Dec 2014 13:25:12 +0000 (13:25 +0000)]
Pack fuzzy commands.

9 years agoAdd abstract command sending function.
Vsevolod Stakhov [Mon, 22 Dec 2014 12:49:15 +0000 (12:49 +0000)]
Add abstract command sending function.

9 years agoAdd new commands support.
Vsevolod Stakhov [Mon, 22 Dec 2014 12:29:55 +0000 (12:29 +0000)]
Add new commands support.

9 years agoUpdate expired elements.
Vsevolod Stakhov [Sun, 21 Dec 2014 21:14:39 +0000 (21:14 +0000)]
Update expired elements.

9 years agoImplement shingles insertions.
Vsevolod Stakhov [Sat, 20 Dec 2014 23:17:35 +0000 (23:17 +0000)]
Implement shingles insertions.

9 years agoAdd fuzzy match by shingles.
Vsevolod Stakhov [Sat, 20 Dec 2014 22:55:21 +0000 (22:55 +0000)]
Add fuzzy match by shingles.

9 years agoUpdate version for testing.
Vsevolod Stakhov [Sat, 20 Dec 2014 17:08:08 +0000 (17:08 +0000)]
Update version for testing.

9 years agoRemove checks from debian build.
Vsevolod Stakhov [Sat, 20 Dec 2014 17:03:30 +0000 (17:03 +0000)]
Remove checks from debian build.

9 years agoRestore expired/count statistics.
Vsevolod Stakhov [Sat, 20 Dec 2014 16:47:30 +0000 (16:47 +0000)]
Restore expired/count statistics.

9 years agoRestore functions of fuzzy_check.
Vsevolod Stakhov [Sat, 20 Dec 2014 16:23:05 +0000 (16:23 +0000)]
Restore functions of fuzzy_check.

9 years agoImplement basic add and deletion.
Vsevolod Stakhov [Sat, 20 Dec 2014 14:33:53 +0000 (14:33 +0000)]
Implement basic add and deletion.

9 years agoImplement direct checking.
Vsevolod Stakhov [Sat, 20 Dec 2014 13:40:35 +0000 (13:40 +0000)]
Implement direct checking.

9 years agoFix old database conversion.
Vsevolod Stakhov [Sat, 20 Dec 2014 13:00:54 +0000 (13:00 +0000)]
Fix old database conversion.

9 years agoForgot to replace.
Vsevolod Stakhov [Fri, 19 Dec 2014 23:38:48 +0000 (23:38 +0000)]
Forgot to replace.

9 years agoAdd compatibility with old sqlite.
Vsevolod Stakhov [Fri, 19 Dec 2014 23:33:31 +0000 (23:33 +0000)]
Add compatibility with old sqlite.

9 years agoFix travis rules.
Vsevolod Stakhov [Fri, 19 Dec 2014 23:27:06 +0000 (23:27 +0000)]
Fix travis rules.

9 years agoFix SQL queries.
Vsevolod Stakhov [Fri, 19 Dec 2014 23:19:59 +0000 (23:19 +0000)]
Fix SQL queries.

9 years agoAdd simple insertion statement.
Vsevolod Stakhov [Fri, 19 Dec 2014 16:58:55 +0000 (16:58 +0000)]
Add simple insertion statement.

9 years agoAdd create database sql statements.
Vsevolod Stakhov [Fri, 19 Dec 2014 16:58:25 +0000 (16:58 +0000)]
Add create database sql statements.

9 years agoImplement transactions.
Vsevolod Stakhov [Fri, 19 Dec 2014 16:46:06 +0000 (16:46 +0000)]
Implement transactions.

9 years agoAdd prepared statements logic.
Vsevolod Stakhov [Fri, 19 Dec 2014 16:35:09 +0000 (16:35 +0000)]
Add prepared statements logic.

9 years agoAdd conversion function.
Vsevolod Stakhov [Fri, 19 Dec 2014 16:01:35 +0000 (16:01 +0000)]
Add conversion function.

9 years agoAdd backend open.
Vsevolod Stakhov [Fri, 19 Dec 2014 15:45:11 +0000 (15:45 +0000)]
Add backend open.

9 years agoStart total rework of fuzzy_storage.
Vsevolod Stakhov [Fri, 19 Dec 2014 14:35:31 +0000 (14:35 +0000)]
Start total rework of fuzzy_storage.

9 years agoSeveral improvements to the shingles calculations.
Vsevolod Stakhov [Fri, 19 Dec 2014 12:15:34 +0000 (12:15 +0000)]
Several improvements to the shingles calculations.

9 years agoCompile external tools with optimizations.
Vsevolod Stakhov [Fri, 19 Dec 2014 10:55:28 +0000 (10:55 +0000)]
Compile external tools with optimizations.

9 years agoResize hashes array properly.
Vsevolod Stakhov [Fri, 19 Dec 2014 10:55:06 +0000 (10:55 +0000)]
Resize hashes array properly.

9 years agoMeasure time for shingles generation.
Vsevolod Stakhov [Fri, 19 Dec 2014 10:53:22 +0000 (10:53 +0000)]
Measure time for shingles generation.

9 years agoUse blake2 as KDF instead of sha256.
Vsevolod Stakhov [Thu, 18 Dec 2014 21:05:02 +0000 (21:05 +0000)]
Use blake2 as KDF instead of sha256.

9 years agoAdd blake2 hash contrib code.
Vsevolod Stakhov [Thu, 18 Dec 2014 20:58:17 +0000 (20:58 +0000)]
Add blake2 hash contrib code.

9 years agoLiblmdb is not presented in precise repo.
Vsevolod Stakhov [Thu, 18 Dec 2014 15:28:05 +0000 (15:28 +0000)]
Liblmdb is not presented in precise repo.

9 years agoAdd missing lmdb dep.
Vsevolod Stakhov [Wed, 17 Dec 2014 23:59:21 +0000 (23:59 +0000)]
Add missing lmdb dep.

9 years agoMerge branch 'lmdb'
Vsevolod Stakhov [Wed, 17 Dec 2014 23:54:12 +0000 (23:54 +0000)]
Merge branch 'lmdb'

9 years agoProcess commands for lmdb.
Vsevolod Stakhov [Wed, 17 Dec 2014 23:53:41 +0000 (23:53 +0000)]
Process commands for lmdb.

9 years agoStart new fuzzy storage protocol implementation.
Vsevolod Stakhov [Wed, 17 Dec 2014 22:55:49 +0000 (22:55 +0000)]
Start new fuzzy storage protocol implementation.

9 years agoAdd lmdb initialization.
Vsevolod Stakhov [Wed, 17 Dec 2014 22:39:20 +0000 (22:39 +0000)]
Add lmdb initialization.

9 years agoRefactor function names.
Vsevolod Stakhov [Wed, 17 Dec 2014 22:03:11 +0000 (22:03 +0000)]
Refactor function names.

9 years agoRemove old lists mode.
Vsevolod Stakhov [Wed, 17 Dec 2014 21:47:25 +0000 (21:47 +0000)]
Remove old lists mode.

9 years agoSearch for liblmdb.
Vsevolod Stakhov [Wed, 17 Dec 2014 21:40:59 +0000 (21:40 +0000)]
Search for liblmdb.

9 years agoMerge branch 'shingles'
Vsevolod Stakhov [Wed, 17 Dec 2014 18:30:17 +0000 (18:30 +0000)]
Merge branch 'shingles'

9 years agoUpdate tests suite.
Vsevolod Stakhov [Wed, 17 Dec 2014 18:29:47 +0000 (18:29 +0000)]
Update tests suite.

9 years agoTune shingles settings.
Vsevolod Stakhov [Wed, 17 Dec 2014 18:29:33 +0000 (18:29 +0000)]
Tune shingles settings.

9 years agoAdd custom targets check and run-test.
Vsevolod Stakhov [Wed, 17 Dec 2014 17:28:07 +0000 (17:28 +0000)]
Add custom targets check and run-test.

9 years agoAdd some tests for shingles.
Vsevolod Stakhov [Wed, 17 Dec 2014 17:27:57 +0000 (17:27 +0000)]
Add some tests for shingles.

9 years agoAdd comparision function for shingles.
Vsevolod Stakhov [Wed, 17 Dec 2014 17:10:21 +0000 (17:10 +0000)]
Add comparision function for shingles.

9 years agoAllow to allocate shingles without pool.
Vsevolod Stakhov [Wed, 17 Dec 2014 17:03:11 +0000 (17:03 +0000)]
Allow to allocate shingles without pool.

9 years agoLink siphash library.
Vsevolod Stakhov [Wed, 17 Dec 2014 16:46:17 +0000 (16:46 +0000)]
Link siphash library.

9 years agoAdd preliminary shingles version.
Vsevolod Stakhov [Wed, 17 Dec 2014 16:44:52 +0000 (16:44 +0000)]
Add preliminary shingles version.

9 years agoAdd siphash contrib code.
Vsevolod Stakhov [Wed, 17 Dec 2014 14:27:04 +0000 (14:27 +0000)]
Add siphash contrib code.

9 years agoMake words from text parts.
Vsevolod Stakhov [Wed, 17 Dec 2014 13:59:52 +0000 (13:59 +0000)]
Make words from text parts.

9 years agoRemove direct ucl access.
Vsevolod Stakhov [Wed, 17 Dec 2014 12:11:55 +0000 (12:11 +0000)]
Remove direct ucl access.

9 years agoAdd snowball stemmer to the build.
Vsevolod Stakhov [Wed, 17 Dec 2014 11:58:42 +0000 (11:58 +0000)]
Add snowball stemmer to the build.

9 years agoTry to read fuzzy reply even if we have timeout.
Vsevolod Stakhov [Tue, 9 Dec 2014 17:35:39 +0000 (17:35 +0000)]
Try to read fuzzy reply even if we have timeout.

9 years agoStart work on rspamd 0.8
Vsevolod Stakhov [Tue, 9 Dec 2014 17:20:49 +0000 (17:20 +0000)]
Start work on rspamd 0.8

9 years agoRemove broken whitelist module.
Vsevolod Stakhov [Mon, 8 Dec 2014 02:08:00 +0000 (02:08 +0000)]
Remove broken whitelist module.

9 years agoIncrease limit for DATE_IN_FUTURE to 2hr.
Vsevolod Stakhov [Sat, 6 Dec 2014 19:33:45 +0000 (19:33 +0000)]
Increase limit for DATE_IN_FUTURE to 2hr.

Suggested by: @citrin

9 years agoCheck DKIM fields length before decoding.
Vsevolod Stakhov [Thu, 4 Dec 2014 21:14:36 +0000 (21:14 +0000)]
Check DKIM fields length before decoding.

9 years agoAvoid descriptors leak in lua_http.
Vsevolod Stakhov [Wed, 3 Dec 2014 12:37:48 +0000 (12:37 +0000)]
Avoid descriptors leak in lua_http.

9 years agoSome fixes to lua_http.
Vsevolod Stakhov [Tue, 2 Dec 2014 13:55:08 +0000 (13:55 +0000)]
Some fixes to lua_http.

9 years agoFix url parser invocation.
Vsevolod Stakhov [Tue, 2 Dec 2014 13:42:53 +0000 (13:42 +0000)]
Fix url parser invocation.

9 years agoValidate inet_addr before connecting/listening.
Vsevolod Stakhov [Tue, 2 Dec 2014 13:42:23 +0000 (13:42 +0000)]
Validate inet_addr before connecting/listening.

9 years agoRefactor function names.
Vsevolod Stakhov [Sat, 29 Nov 2014 17:02:49 +0000 (17:02 +0000)]
Refactor function names.

9 years agoMerge pull request #117 from fatalbanana/master
Vsevolod Stakhov [Thu, 27 Nov 2014 20:23:47 +0000 (20:23 +0000)]
Merge pull request #117 from fatalbanana/master

Fix misinformation in RBL module doc

9 years agoFix misinformation in RBL module doc 117/head
Andrew Lewis [Wed, 26 Nov 2014 19:59:47 +0000 (21:59 +0200)]
Fix misinformation in RBL module doc

9 years agoUpdate manual page.
Vsevolod Stakhov [Tue, 25 Nov 2014 18:37:32 +0000 (18:37 +0000)]
Update manual page.

9 years agoTune extended urls output.
Vsevolod Stakhov [Tue, 25 Nov 2014 18:35:22 +0000 (18:35 +0000)]
Tune extended urls output.

9 years agoFix some issues with URLs normalization.
Vsevolod Stakhov [Tue, 25 Nov 2014 18:35:05 +0000 (18:35 +0000)]
Fix some issues with URLs normalization.

9 years agoAdd --extended-urls option to rspamc.
Vsevolod Stakhov [Tue, 25 Nov 2014 18:14:28 +0000 (18:14 +0000)]
Add --extended-urls option to rspamc.

9 years agoFill surbl field in struct uri.
Vsevolod Stakhov [Tue, 25 Nov 2014 18:07:58 +0000 (18:07 +0000)]
Fill surbl field in struct uri.

9 years agoAdd extended output format for URLs.
Vsevolod Stakhov [Tue, 25 Nov 2014 18:03:30 +0000 (18:03 +0000)]
Add extended output format for URLs.

9 years agoRelease 0.7.6 0.7.6
Vsevolod Stakhov [Mon, 24 Nov 2014 14:05:08 +0000 (14:05 +0000)]
Release 0.7.6

* Apply boundary fix for dkim simple canonization
* Fix ping command
* Return nil if header was not found in lua_task
* Fix hang in upstreams revive logic
* Decode entitles when normalizing HTML parts
* Fix logic of finding URLs in HTML parts
* Do not include \0 into length of text when performing conversion to utf8
* Fix raw vs parsed reperesentations
Raw parts are now:
- decoded b64/qp, but *NOT* converted to utf-8
Processed parts are now:
- converted to UTF-8
- normalized if needed (e.g. HTML tags are stripped)
* Rework DKIM canonization to line based
* Fix fuzzy hashes addding
* Use more specific hash function for fuzzy
* Fix leaking of iconv descriptors
* Fix PTR resolving in lua resolver
* Rework spf module.
- Copy data to memory pool as cached record might be destroyed causing
    freed memory being passed to the protocol output (use after free)
- Allow SPF_NEUTRAL policy to be handled separately
- Add R_SPF_NEUTRAL to the default config
* Rework `register_symbols` function
* Allow to disable components of hfilter

Signed-off-by: Vsevolod Stakhov <vsevolod@highsecure.ru>
9 years agoUpdate version to 0.7.6.
Vsevolod Stakhov [Sun, 23 Nov 2014 22:31:26 +0000 (22:31 +0000)]
Update version to 0.7.6.

9 years agoFix `register_symbols` lua function.
Vsevolod Stakhov [Sat, 22 Nov 2014 16:15:56 +0000 (16:15 +0000)]
Fix `register_symbols` lua function.

9 years agoAllow to disable components of hfilter.
Vsevolod Stakhov [Fri, 21 Nov 2014 15:40:29 +0000 (15:40 +0000)]
Allow to disable components of hfilter.

9 years agoRework `register_symbols` function.
Vsevolod Stakhov [Fri, 21 Nov 2014 15:39:04 +0000 (15:39 +0000)]
Rework `register_symbols` function.

9 years agoRework spf module.
Vsevolod Stakhov [Fri, 21 Nov 2014 14:22:06 +0000 (14:22 +0000)]
Rework spf module.

- Copy data to memory pool as cached record might be destroyed causing
  freed memory being passed to the protocol output (use after free).
- Allow SPF_NEUTRAL policy to be handled separately.
- Add R_SPF_NEUTRAL to the default config.

9 years agoFix indentation in hfilter.
Vsevolod Stakhov [Fri, 21 Nov 2014 14:02:31 +0000 (14:02 +0000)]
Fix indentation in hfilter.

9 years agoFix PTR resolving in lua resolver.
Vsevolod Stakhov [Fri, 21 Nov 2014 12:45:29 +0000 (12:45 +0000)]
Fix PTR resolving in lua resolver.

9 years agoFix leaking of iconv descriptors.
Vsevolod Stakhov [Fri, 21 Nov 2014 12:12:35 +0000 (12:12 +0000)]
Fix leaking of iconv descriptors.

9 years agoAnother try to fix race condition in the upstreams.
Vsevolod Stakhov [Fri, 21 Nov 2014 10:58:11 +0000 (10:58 +0000)]
Another try to fix race condition in the upstreams.

9 years agoUse more proper hashing for fuzzy.
Vsevolod Stakhov [Thu, 20 Nov 2014 15:28:55 +0000 (15:28 +0000)]
Use more proper hashing for fuzzy.

9 years agoAdd fuzzy hash utilities.
Vsevolod Stakhov [Thu, 20 Nov 2014 15:27:07 +0000 (15:27 +0000)]
Add fuzzy hash utilities.

9 years agoFix fuzzy hashes addding.
Vsevolod Stakhov [Wed, 19 Nov 2014 17:24:36 +0000 (17:24 +0000)]
Fix fuzzy hashes addding.

9 years agoRework DKIM canonization to line based.
Vsevolod Stakhov [Wed, 19 Nov 2014 16:30:13 +0000 (16:30 +0000)]
Rework DKIM canonization to line based.

9 years agoFix raw vs parsed reperesentations.
Vsevolod Stakhov [Wed, 19 Nov 2014 15:19:49 +0000 (15:19 +0000)]
Fix raw vs parsed reperesentations.

Raw parts are now:
- decoded b64/qp, but *NOT* converted to utf-8

Processed parts are now:
- converted to UTF-8
- normalized if needed (e.g. HTML tags are stripped)

9 years agoOne more try to fix dkim border issues.
Vsevolod Stakhov [Wed, 19 Nov 2014 15:06:51 +0000 (15:06 +0000)]
One more try to fix dkim border issues.

9 years agoDo not include \0 into length of text.
Vsevolod Stakhov [Wed, 19 Nov 2014 14:39:44 +0000 (14:39 +0000)]
Do not include \0 into length of text.

9 years agoFix logic of finding URLs in HTML parts.
Vsevolod Stakhov [Wed, 19 Nov 2014 14:24:03 +0000 (14:24 +0000)]
Fix logic of finding URLs in HTML parts.

9 years agoDecode entitles when normalizing HTML parts.
Vsevolod Stakhov [Wed, 19 Nov 2014 14:19:50 +0000 (14:19 +0000)]
Decode entitles when normalizing HTML parts.

9 years agoTry to fix hang in upstream events.
Vsevolod Stakhov [Wed, 19 Nov 2014 13:16:06 +0000 (13:16 +0000)]
Try to fix hang in upstream events.