]> source.dussan.org Git - rspamd.git/log
rspamd.git
8 years ago[Feature] Implement caching for hyperscan multipattern
Vsevolod Stakhov [Thu, 14 Apr 2016 18:09:04 +0000 (19:09 +0100)]
[Feature] Implement caching for hyperscan multipattern

8 years ago[Feature] Add common directory for hyperscan cache to config
Vsevolod Stakhov [Thu, 14 Apr 2016 17:27:51 +0000 (18:27 +0100)]
[Feature] Add common directory for hyperscan cache to config

8 years ago[Fix] Some more fixes for urls parser
Vsevolod Stakhov [Thu, 14 Apr 2016 16:36:27 +0000 (17:36 +0100)]
[Fix] Some more fixes for urls parser

8 years ago[Fix] Further fixes to urls parsing
Vsevolod Stakhov [Thu, 14 Apr 2016 14:45:10 +0000 (15:45 +0100)]
[Fix] Further fixes to urls parsing

8 years ago[Feature] Use more clever url matcher for hyperscan
Vsevolod Stakhov [Thu, 14 Apr 2016 14:26:19 +0000 (15:26 +0100)]
[Feature] Use more clever url matcher for hyperscan

8 years ago[Feature] Allow to have different flags for different patterns
Vsevolod Stakhov [Thu, 14 Apr 2016 14:17:24 +0000 (15:17 +0100)]
[Feature] Allow to have different flags for different patterns

8 years ago[Fix] Try to handle hyperscan error
Vsevolod Stakhov [Thu, 14 Apr 2016 14:12:17 +0000 (15:12 +0100)]
[Fix] Try to handle hyperscan error

8 years ago[Fix] Fix hyperscan callback invocation
Vsevolod Stakhov [Thu, 14 Apr 2016 14:11:00 +0000 (15:11 +0100)]
[Fix] Fix hyperscan callback invocation

8 years ago[Fix] Fix lua url
Vsevolod Stakhov [Thu, 14 Apr 2016 13:57:51 +0000 (14:57 +0100)]
[Fix] Fix lua url

8 years ago[Feature] Allow single and multiple urls extraction
Vsevolod Stakhov [Thu, 14 Apr 2016 13:57:28 +0000 (14:57 +0100)]
[Feature] Allow single and multiple urls extraction

8 years ago[Fix] Fix excraction of URLs from Subject
Vsevolod Stakhov [Thu, 14 Apr 2016 13:01:57 +0000 (14:01 +0100)]
[Fix] Fix excraction of URLs from Subject

8 years ago[Feature] Add helper to insert URLs in task structure
Vsevolod Stakhov [Thu, 14 Apr 2016 13:01:40 +0000 (14:01 +0100)]
[Feature] Add helper to insert URLs in task structure

8 years ago[Feature] Add generic function to extract multiple URLs
Vsevolod Stakhov [Thu, 14 Apr 2016 12:28:30 +0000 (13:28 +0100)]
[Feature] Add generic function to extract multiple URLs

8 years ago[Fix] Use multipattern in url matcher
Vsevolod Stakhov [Thu, 14 Apr 2016 12:07:40 +0000 (13:07 +0100)]
[Fix] Use multipattern in url matcher

8 years ago[Minor] Fix callback type
Vsevolod Stakhov [Wed, 13 Apr 2016 14:12:40 +0000 (15:12 +0100)]
[Minor] Fix callback type

8 years ago[Feature] Match the beginning of pattern as well
Vsevolod Stakhov [Wed, 13 Apr 2016 13:50:38 +0000 (14:50 +0100)]
[Feature] Match the beginning of pattern as well

8 years ago[Feature] Add utility methods for multipattern
Vsevolod Stakhov [Wed, 13 Apr 2016 12:46:33 +0000 (13:46 +0100)]
[Feature] Add utility methods for multipattern

8 years ago[Feature] Use mutlipattern for lua_trie code
Vsevolod Stakhov [Wed, 13 Apr 2016 11:09:12 +0000 (12:09 +0100)]
[Feature] Use mutlipattern for lua_trie code

8 years ago[Feature] Allow empty tries
Vsevolod Stakhov [Wed, 13 Apr 2016 11:09:00 +0000 (12:09 +0100)]
[Feature] Allow empty tries

8 years ago[Feature] Optimize rspamd_re_cache_type_from_string
Vsevolod Stakhov [Tue, 12 Apr 2016 18:21:44 +0000 (19:21 +0100)]
[Feature] Optimize rspamd_re_cache_type_from_string

8 years ago[Fix] Fix calling of process_regexp after flattening
Vsevolod Stakhov [Tue, 12 Apr 2016 18:21:21 +0000 (19:21 +0100)]
[Fix] Fix calling of process_regexp after flattening

8 years ago[Fix] Fix plain version for table args extraction
Vsevolod Stakhov [Tue, 12 Apr 2016 18:20:58 +0000 (19:20 +0100)]
[Fix] Fix plain version for table args extraction

8 years ago[Feature] Optimize hot paths in SA plugin
Vsevolod Stakhov [Tue, 12 Apr 2016 17:34:20 +0000 (18:34 +0100)]
[Feature] Optimize hot paths in SA plugin

8 years ago[Feature] Allow to optimize lua -> C transition by flattening table args
Vsevolod Stakhov [Tue, 12 Apr 2016 17:31:13 +0000 (18:31 +0100)]
[Feature] Allow to optimize lua -> C transition by flattening table args

8 years ago[Feature] Add escape functions for hyperscan
Vsevolod Stakhov [Tue, 12 Apr 2016 16:08:52 +0000 (17:08 +0100)]
[Feature] Add escape functions for hyperscan

8 years ago[Feature] Add implementation of abstract multipattern matcher
Vsevolod Stakhov [Tue, 12 Apr 2016 14:23:58 +0000 (15:23 +0100)]
[Feature] Add implementation of abstract multipattern matcher

8 years ago[Minor] Update version to 1.2.4
Vsevolod Stakhov [Tue, 12 Apr 2016 12:07:21 +0000 (13:07 +0100)]
[Minor] Update version to 1.2.4

8 years agoRelease 1.2.3 1.2.3
Vsevolod Stakhov [Tue, 12 Apr 2016 12:05:05 +0000 (13:05 +0100)]
Release 1.2.3

* New DCC module (by @smfreegard)
* Rework whitelist module:
- Now we check different elements for different checks
- MIME from for DMARC
- DKIM signature domain for DKIM
- SMTP from or HELO for SPF
* Fix regexps results combination (*critical*)
* Fix issue with expressions processing (*critical*)
* Optimize strlcpy for aligned input
* Add support of half-closed connection in lua_tcp
* Allow to print compact json in client
* Save required score in history (#581)
* Allow to attach file descriptors to control commands
* Allow to send descriptors from workers to main
* Allow to attach fd when broadcasting to workers
* Implement log pipe feature for rspamd logs analysis
* Add `log_helper` worker
* Add `URIBL_SBL_CSS` (by @smfreegard)
* Add worker scripts functionality
* Add on load hooks for rspamd_config
* Add lua scripts for log_helper worker
* Add generic maillist detector (#584)
* Implement FANN autolearn using log_helper worker
* Rework metrics configuration to allow includes
* Change default value of forced removal in composite rules
* Allow to use assembly version of blake2b on x86 cpu
* Use less precise (but faster) clock if possible
* Insert redirected URL to the urls list
* Allow to get and set callback data for rspamd symbols
* Add binary heap implementation
* Use binary heap for expire algorithms in the hash
* Use `least frequent used` expiration strategy
* Allow to get mime headers from a task
* Add support for mime headers in `regexp` module
* Update Exim patches (by @fatalbanana)
* Allow building rspamd with jemalloc
* Save multipart boundaries
* SA plugin changes:
- Properly handle MIME headers
- Fix eval:check_for_missing_to_header rule
- Implement SA compatible body regexps
- Use sabody rules in SA plugin
* LUA API changes:
- Add util.get_ticks function
- Add util.stat function
- Add task:get_symbols_numeric method
- Add method to get number of symbols in the cache
- Add lua methods to get redirected urls
- Allow to get callbacks for lua symbols
- Add config:set_symbol_callback function

Signed-off-by: Vsevolod Stakhov <vsevolod@highsecure.ru>
8 years ago[CritFix] Fix issue with expressions processing
Vsevolod Stakhov [Tue, 12 Apr 2016 10:56:49 +0000 (11:56 +0100)]
[CritFix] Fix issue with expressions processing

If the first rule in A + B + C + D > X matched then it was counted like
`1 + 1` and not as `0 + 1` as the accumulator was incorrectly treated in
that case.

8 years ago[Minor] Properly place timers calculations
Vsevolod Stakhov [Tue, 12 Apr 2016 10:00:42 +0000 (11:00 +0100)]
[Minor] Properly place timers calculations

8 years ago[Minor] Hold on with g_slice alteration
Vsevolod Stakhov [Mon, 11 Apr 2016 16:16:22 +0000 (17:16 +0100)]
[Minor] Hold on with g_slice alteration

8 years ago[Feature] Use sabody rules in SA plugin
Vsevolod Stakhov [Mon, 11 Apr 2016 16:07:37 +0000 (17:07 +0100)]
[Feature] Use sabody rules in SA plugin

8 years ago[Fix] Fix sabody rules in regexp cache
Vsevolod Stakhov [Mon, 11 Apr 2016 16:07:12 +0000 (17:07 +0100)]
[Fix] Fix sabody rules in regexp cache

8 years ago[CritFix] Fix regexps results combination
Vsevolod Stakhov [Mon, 11 Apr 2016 16:05:42 +0000 (17:05 +0100)]
[CritFix] Fix regexps results combination

When converting to vectored mode we need to remember results between
consequent calls of regexp match engine. Prior to this patch this
behaviour was broken and caused regexp rules to be matched incorrectly.

8 years ago[Feature] Implement SA compatible body regexps
Vsevolod Stakhov [Mon, 11 Apr 2016 15:04:19 +0000 (16:04 +0100)]
[Feature] Implement SA compatible body regexps

8 years ago[Feature] Save multipart boundaries
Vsevolod Stakhov [Mon, 11 Apr 2016 14:57:41 +0000 (15:57 +0100)]
[Feature] Save multipart boundaries

8 years ago[Feature] Save raw headers for mime parts
Vsevolod Stakhov [Mon, 11 Apr 2016 14:49:27 +0000 (15:49 +0100)]
[Feature] Save raw headers for mime parts

8 years ago[Fix] Properly handle MIME headers in SA plugin
Vsevolod Stakhov [Mon, 11 Apr 2016 14:05:18 +0000 (15:05 +0100)]
[Fix] Properly handle MIME headers in SA plugin

8 years ago[Fix] Fix eval:check_for_missing_to_header rule
Vsevolod Stakhov [Mon, 11 Apr 2016 13:54:11 +0000 (14:54 +0100)]
[Fix] Fix eval:check_for_missing_to_header rule

8 years ago[Test] More improvements to heap tests
Vsevolod Stakhov [Mon, 11 Apr 2016 13:08:19 +0000 (14:08 +0100)]
[Test] More improvements to heap tests

8 years ago[Fix] Priority of sink/swim should be reversed
Vsevolod Stakhov [Mon, 11 Apr 2016 13:01:25 +0000 (14:01 +0100)]
[Fix] Priority of sink/swim should be reversed

8 years ago[Fix] Add more guards for heap
Vsevolod Stakhov [Mon, 11 Apr 2016 12:51:08 +0000 (13:51 +0100)]
[Fix] Add more guards for heap

8 years ago[Feature] Use less frequent use strategy for caches
Vsevolod Stakhov [Mon, 11 Apr 2016 11:26:54 +0000 (12:26 +0100)]
[Feature] Use less frequent use strategy for caches

8 years ago[Minor] Enable jemalloc for debian builds
Vsevolod Stakhov [Mon, 11 Apr 2016 10:26:44 +0000 (11:26 +0100)]
[Minor] Enable jemalloc for debian builds

8 years ago[Feature] Allow building rspamd with jemalloc
Vsevolod Stakhov [Mon, 11 Apr 2016 10:23:47 +0000 (11:23 +0100)]
[Feature] Allow building rspamd with jemalloc

8 years ago[Minor] Use g_slice_alloc
Vsevolod Stakhov [Mon, 11 Apr 2016 09:50:30 +0000 (10:50 +0100)]
[Minor] Use g_slice_alloc

8 years ago[Test] Evaluate heap performance
Vsevolod Stakhov [Mon, 11 Apr 2016 09:08:52 +0000 (10:08 +0100)]
[Test] Evaluate heap performance

8 years ago[Minor] Slightly simplify swap for optimization
Vsevolod Stakhov [Mon, 11 Apr 2016 09:08:32 +0000 (10:08 +0100)]
[Minor] Slightly simplify swap for optimization

8 years ago[Minor] Improve tests for heap
Vsevolod Stakhov [Sun, 10 Apr 2016 12:43:47 +0000 (13:43 +0100)]
[Minor] Improve tests for heap

8 years ago[Minor] Add rspamd_min_heap_index helper method
Vsevolod Stakhov [Sun, 10 Apr 2016 12:43:26 +0000 (13:43 +0100)]
[Minor] Add rspamd_min_heap_index helper method

8 years agoMerge pull request #589 from fatalbanana/master
Vsevolod Stakhov [Sat, 9 Apr 2016 23:36:32 +0000 (00:36 +0100)]
Merge pull request #589 from fatalbanana/master

Update Exim patches

8 years agoUpdate Exim patches 589/head
Andrew Lewis [Sat, 9 Apr 2016 12:39:13 +0000 (14:39 +0200)]
Update Exim patches

8 years ago[Doc] Improve regexp module documentation
Vsevolod Stakhov [Sat, 9 Apr 2016 12:28:21 +0000 (13:28 +0100)]
[Doc] Improve regexp module documentation

8 years ago[Feature] Support mime regexps in the expressions
Vsevolod Stakhov [Sat, 9 Apr 2016 12:18:53 +0000 (13:18 +0100)]
[Feature] Support mime regexps in the expressions

8 years ago[Feature] Add support of mime headers expressions
Vsevolod Stakhov [Sat, 9 Apr 2016 12:18:20 +0000 (13:18 +0100)]
[Feature] Add support of mime headers expressions

8 years ago[Feature] Allow to get mime headers from a task
Vsevolod Stakhov [Sat, 9 Apr 2016 12:13:38 +0000 (13:13 +0100)]
[Feature] Allow to get mime headers from a task

8 years ago[Feature] Use heap in LRU caches
Vsevolod Stakhov [Fri, 8 Apr 2016 21:04:36 +0000 (22:04 +0100)]
[Feature] Use heap in LRU caches

Signed-off-by: Vsevolod Stakhov <vsevolod@highsecure.ru>
8 years ago[Feature] Allow removal from the heap
Vsevolod Stakhov [Fri, 8 Apr 2016 21:04:14 +0000 (22:04 +0100)]
[Feature] Allow removal from the heap

8 years ago[Feature] Add unit tests for heap
Vsevolod Stakhov [Fri, 8 Apr 2016 20:30:14 +0000 (21:30 +0100)]
[Feature] Add unit tests for heap

8 years ago[Fix] Fix couple of issues with heap code
Vsevolod Stakhov [Fri, 8 Apr 2016 20:29:50 +0000 (21:29 +0100)]
[Fix] Fix couple of issues with heap code

8 years ago[Minor] Use more simple swap algorithm
Vsevolod Stakhov [Fri, 8 Apr 2016 13:32:07 +0000 (14:32 +0100)]
[Minor] Use more simple swap algorithm

8 years ago[Feature] Add preliminary implementation of binary heap
Vsevolod Stakhov [Fri, 8 Apr 2016 13:18:26 +0000 (14:18 +0100)]
[Feature] Add preliminary implementation of binary heap

Signed-off-by: Vsevolod Stakhov <vsevolod@highsecure.ru>
8 years ago[Feature] Add config:set_symbol_callback function
Vsevolod Stakhov [Fri, 8 Apr 2016 10:24:12 +0000 (11:24 +0100)]
[Feature] Add config:set_symbol_callback function

8 years ago[Feature] Allow to get callbacks for lua symbols
Vsevolod Stakhov [Thu, 7 Apr 2016 22:11:19 +0000 (23:11 +0100)]
[Feature] Allow to get callbacks for lua symbols

8 years ago[Feature] Allow to get and set callback data for rspamd symbols
Vsevolod Stakhov [Thu, 7 Apr 2016 15:20:42 +0000 (16:20 +0100)]
[Feature] Allow to get and set callback data for rspamd symbols

8 years ago[Feature] Add magic for callback data in rspamd rules
Vsevolod Stakhov [Thu, 7 Apr 2016 12:43:09 +0000 (13:43 +0100)]
[Feature] Add magic for callback data in rspamd rules

8 years ago[Feature] Add lua methods to get redirected urls
Vsevolod Stakhov [Thu, 7 Apr 2016 11:20:52 +0000 (12:20 +0100)]
[Feature] Add lua methods to get redirected urls

8 years ago[Feature] Insert redirected URL to the urls list
Vsevolod Stakhov [Thu, 7 Apr 2016 11:14:01 +0000 (12:14 +0100)]
[Feature] Insert redirected URL to the urls list

8 years ago[Fetaure] Use less precise clock if possible
Vsevolod Stakhov [Wed, 6 Apr 2016 17:45:33 +0000 (18:45 +0100)]
[Fetaure] Use less precise clock if possible

8 years ago[Fix] Allow to use assembly version of blake2b on x86 cpu
Vsevolod Stakhov [Wed, 6 Apr 2016 15:02:32 +0000 (16:02 +0100)]
[Fix] Allow to use assembly version of blake2b on x86 cpu

8 years ago[Minor] Slightly improve logging for fann reload
Vsevolod Stakhov [Wed, 6 Apr 2016 13:26:54 +0000 (14:26 +0100)]
[Minor] Slightly improve logging for fann reload

8 years ago[Fix] Rework fann learning
Vsevolod Stakhov [Wed, 6 Apr 2016 13:22:01 +0000 (14:22 +0100)]
[Fix] Rework fann learning

8 years ago[Fix] Fix fann train
Vsevolod Stakhov [Wed, 6 Apr 2016 13:21:39 +0000 (14:21 +0100)]
[Fix] Fix fann train

8 years ago[Minor] Reformat dcc plugin code
Vsevolod Stakhov [Wed, 6 Apr 2016 12:14:19 +0000 (13:14 +0100)]
[Minor] Reformat dcc plugin code

8 years ago[Fix] Fix couple of issues with dcc plugin
Vsevolod Stakhov [Wed, 6 Apr 2016 12:13:50 +0000 (13:13 +0100)]
[Fix] Fix couple of issues with dcc plugin

8 years agoMerge pull request #586 from smfreegard/dcc_module
Vsevolod Stakhov [Wed, 6 Apr 2016 12:04:27 +0000 (13:04 +0100)]
Merge pull request #586 from smfreegard/dcc_module

New DCC module

8 years ago[Fix] Change default value of forced removal in composite rules
Vsevolod Stakhov [Wed, 6 Apr 2016 12:01:57 +0000 (13:01 +0100)]
[Fix] Change default value of forced removal in composite rules

8 years ago[Feature] Rework metrics configuration to allow includes
Vsevolod Stakhov [Wed, 6 Apr 2016 10:01:58 +0000 (11:01 +0100)]
[Feature] Rework metrics configuration to allow includes

8 years agoNew dcc module 586/head
Steve Freegard [Tue, 5 Apr 2016 18:28:10 +0000 (19:28 +0100)]
New dcc module

8 years ago[Feature] Add generic maillist detector
Vsevolod Stakhov [Tue, 5 Apr 2016 17:51:15 +0000 (18:51 +0100)]
[Feature] Add generic maillist detector

Issue: #584
Reported by: @piwats

8 years ago[Fix] Fix rfc2369 maillists detection
Vsevolod Stakhov [Tue, 5 Apr 2016 17:50:54 +0000 (18:50 +0100)]
[Fix] Fix rfc2369 maillists detection

8 years ago[Feature] Implement preliminary code for fann autolearn
Vsevolod Stakhov [Tue, 5 Apr 2016 16:26:43 +0000 (17:26 +0100)]
[Feature] Implement preliminary code for fann autolearn

8 years ago[Feature] Add method to get number of symbols in the cache
Vsevolod Stakhov [Tue, 5 Apr 2016 16:26:28 +0000 (17:26 +0100)]
[Feature] Add method to get number of symbols in the cache

8 years ago[Feature] Extend log structure
Vsevolod Stakhov [Tue, 5 Apr 2016 15:24:44 +0000 (16:24 +0100)]
[Feature] Extend log structure

8 years ago[Feature] Execute lua scripts by log helper
Vsevolod Stakhov [Tue, 5 Apr 2016 13:00:22 +0000 (14:00 +0100)]
[Feature] Execute lua scripts by log helper

8 years ago[Feature] Add on load hooks for rspamd_config
Vsevolod Stakhov [Tue, 5 Apr 2016 12:41:33 +0000 (13:41 +0100)]
[Feature] Add on load hooks for rspamd_config

8 years ago[Feature] Add worker scripts functionality
Vsevolod Stakhov [Tue, 5 Apr 2016 12:03:25 +0000 (13:03 +0100)]
[Feature] Add worker scripts functionality

8 years ago[Feature] Add task:get_symbols_numeric method
Vsevolod Stakhov [Tue, 5 Apr 2016 10:26:26 +0000 (11:26 +0100)]
[Feature] Add task:get_symbols_numeric method

8 years ago[Feature] Add util.stat function
Vsevolod Stakhov [Tue, 5 Apr 2016 09:06:13 +0000 (10:06 +0100)]
[Feature] Add util.stat function

8 years ago[Feature] Add util.get_ticks function
Vsevolod Stakhov [Tue, 5 Apr 2016 08:16:14 +0000 (09:16 +0100)]
[Feature] Add util.get_ticks function

8 years agoMerge pull request #583 from smfreegard/uribl_sbl_fix
Vsevolod Stakhov [Mon, 4 Apr 2016 17:23:15 +0000 (18:23 +0100)]
Merge pull request #583 from smfreegard/uribl_sbl_fix

Add URIBL_SBL_CSS

8 years ago[Fix] Some fixes for log pipe handling
Vsevolod Stakhov [Mon, 4 Apr 2016 17:21:33 +0000 (18:21 +0100)]
[Fix] Some fixes for log pipe handling

8 years ago[Feature] Add new auxiliary methods for symbols cache
Vsevolod Stakhov [Mon, 4 Apr 2016 17:21:11 +0000 (18:21 +0100)]
[Feature] Add new auxiliary methods for symbols cache

8 years ago[Minor] Add startup mutex
Vsevolod Stakhov [Mon, 4 Apr 2016 17:20:48 +0000 (18:20 +0100)]
[Minor] Add startup mutex

8 years ago[Minor] Some fixes
Vsevolod Stakhov [Mon, 4 Apr 2016 16:46:39 +0000 (17:46 +0100)]
[Minor] Some fixes

8 years agoAdd URIBL_SBL_CSS 583/head
Steve Freegard [Mon, 4 Apr 2016 16:46:09 +0000 (17:46 +0100)]
Add URIBL_SBL_CSS

8 years ago[Feature] Add preliminary version of log_helper worker
Vsevolod Stakhov [Mon, 4 Apr 2016 16:38:46 +0000 (17:38 +0100)]
[Feature] Add preliminary version of log_helper worker

8 years ago[Feature] Start client implementation for logging pipes in rspamd
Vsevolod Stakhov [Mon, 4 Apr 2016 15:40:26 +0000 (16:40 +0100)]
[Feature] Start client implementation for logging pipes in rspamd

8 years ago[Feature] Add magic for all workers' contexts
Vsevolod Stakhov [Mon, 4 Apr 2016 15:07:14 +0000 (16:07 +0100)]
[Feature] Add magic for all workers' contexts

8 years ago[Minor] Move shared parts of worker definition to a separated header
Vsevolod Stakhov [Mon, 4 Apr 2016 15:06:09 +0000 (16:06 +0100)]
[Minor] Move shared parts of worker definition to a separated header