]> source.dussan.org Git - rspamd.git/log
rspamd.git
8 years agoMore rework of hyperscan matching
Vsevolod Stakhov [Tue, 8 Dec 2015 21:48:57 +0000 (21:48 +0000)]
More rework of hyperscan matching

8 years agoImplement matching using hyperscan
Vsevolod Stakhov [Tue, 8 Dec 2015 19:12:24 +0000 (19:12 +0000)]
Implement matching using hyperscan

8 years agoImplement hyperscan loading by receiving signal
Vsevolod Stakhov [Tue, 8 Dec 2015 18:35:05 +0000 (18:35 +0000)]
Implement hyperscan loading by receiving signal

8 years agoSend notifications by hs_helper process
Vsevolod Stakhov [Tue, 8 Dec 2015 18:28:30 +0000 (18:28 +0000)]
Send notifications by hs_helper process

8 years agoAdd event for loading of hyperscan files
Vsevolod Stakhov [Tue, 8 Dec 2015 18:17:32 +0000 (18:17 +0000)]
Add event for loading of hyperscan files

8 years agoCleanup hs structures on cache destroy
Vsevolod Stakhov [Tue, 8 Dec 2015 17:39:04 +0000 (17:39 +0000)]
Cleanup hs structures on cache destroy

8 years agoAdd function to load hyperscan databases from caches
Vsevolod Stakhov [Tue, 8 Dec 2015 17:22:54 +0000 (17:22 +0000)]
Add function to load hyperscan databases from caches

8 years agoDo not assume invalid header regexps by default
Vsevolod Stakhov [Tue, 8 Dec 2015 16:28:24 +0000 (16:28 +0000)]
Do not assume invalid header regexps by default

8 years agoAdd logic to watch hyperscan compilation
Vsevolod Stakhov [Tue, 8 Dec 2015 16:03:42 +0000 (16:03 +0000)]
Add logic to watch hyperscan compilation

8 years agoFix replacing regexps in the cache
Vsevolod Stakhov [Tue, 8 Dec 2015 16:03:31 +0000 (16:03 +0000)]
Fix replacing regexps in the cache

8 years agoSave platform info as well
Vsevolod Stakhov [Tue, 8 Dec 2015 01:46:04 +0000 (01:46 +0000)]
Save platform info as well

8 years agoFix re-using of hyperscan files
Vsevolod Stakhov [Tue, 8 Dec 2015 01:23:18 +0000 (01:23 +0000)]
Fix re-using of hyperscan files

8 years agoFix re-using of hyperscan hashes
Vsevolod Stakhov [Tue, 8 Dec 2015 00:55:26 +0000 (00:55 +0000)]
Fix re-using of hyperscan hashes

8 years agoAdd routine to compare to rspamd_regexp_t
Vsevolod Stakhov [Tue, 8 Dec 2015 00:55:09 +0000 (00:55 +0000)]
Add routine to compare to rspamd_regexp_t

8 years agoAdd function to check validity of hyperscan cache
Vsevolod Stakhov [Tue, 8 Dec 2015 00:32:03 +0000 (00:32 +0000)]
Add function to check validity of hyperscan cache

8 years agoStore regexps into id indexed array
Vsevolod Stakhov [Tue, 8 Dec 2015 00:17:46 +0000 (00:17 +0000)]
Store regexps into id indexed array

8 years agoImplement re cache specific logger helpers
Vsevolod Stakhov [Mon, 7 Dec 2015 19:08:32 +0000 (19:08 +0000)]
Implement re cache specific logger helpers

8 years agoFix serializing of hyperscan regexps
Vsevolod Stakhov [Mon, 7 Dec 2015 18:26:21 +0000 (18:26 +0000)]
Fix serializing of hyperscan regexps

8 years agoFix hs_helper startup
Vsevolod Stakhov [Mon, 7 Dec 2015 18:16:44 +0000 (18:16 +0000)]
Fix hs_helper startup

8 years agoImplement starting of hs_helper process
Vsevolod Stakhov [Mon, 7 Dec 2015 18:11:02 +0000 (18:11 +0000)]
Implement starting of hs_helper process

8 years agoAdd hyperscan compilation support
Vsevolod Stakhov [Mon, 7 Dec 2015 17:24:55 +0000 (17:24 +0000)]
Add hyperscan compilation support

8 years agoAdd hyperscan helper worker
Vsevolod Stakhov [Mon, 7 Dec 2015 17:24:43 +0000 (17:24 +0000)]
Add hyperscan helper worker

8 years agoAdd hyperscan initialization
Vsevolod Stakhov [Mon, 7 Dec 2015 15:24:41 +0000 (15:24 +0000)]
Add hyperscan initialization

8 years agoFix cache initialization
Vsevolod Stakhov [Mon, 7 Dec 2015 15:06:41 +0000 (15:06 +0000)]
Fix cache initialization

8 years agoStart hyperscan support
Vsevolod Stakhov [Mon, 7 Dec 2015 14:29:25 +0000 (14:29 +0000)]
Start hyperscan support

8 years agoAdd LPeg support to rspamd
Vsevolod Stakhov [Mon, 7 Dec 2015 13:52:41 +0000 (13:52 +0000)]
Add LPeg support to rspamd

8 years agoFix error on adjusting url lengths after decoding
Vsevolod Stakhov [Mon, 7 Dec 2015 13:08:17 +0000 (13:08 +0000)]
Fix error on adjusting url lengths after decoding

8 years agoAdd support of 'special' SA headers to 'exists' function
Vsevolod Stakhov [Mon, 7 Dec 2015 11:31:28 +0000 (11:31 +0000)]
Add support of 'special' SA headers to 'exists' function

8 years agoAdd support for Mail::SpamAssassin::Plugin::MIMEHeader
Vsevolod Stakhov [Mon, 7 Dec 2015 11:14:59 +0000 (11:14 +0000)]
Add support for Mail::SpamAssassin::Plugin::MIMEHeader

8 years agoMore fixes for SA plugin to deal with the new cache
Vsevolod Stakhov [Mon, 7 Dec 2015 10:06:41 +0000 (10:06 +0000)]
More fixes for SA plugin to deal with the new cache

8 years agoAdd routine to convert string to re_class type
Vsevolod Stakhov [Mon, 7 Dec 2015 09:18:09 +0000 (09:18 +0000)]
Add routine to convert string to re_class type

8 years agoAdd re class to match all headers
Vsevolod Stakhov [Mon, 7 Dec 2015 09:12:29 +0000 (09:12 +0000)]
Add re class to match all headers

8 years agoAs we store re_class within re avoid extra lookup
Vsevolod Stakhov [Mon, 7 Dec 2015 09:03:07 +0000 (09:03 +0000)]
As we store re_class within re avoid extra lookup

8 years agoFix replacements in spamassassin plugin
Vsevolod Stakhov [Sun, 6 Dec 2015 18:33:42 +0000 (18:33 +0000)]
Fix replacements in spamassassin plugin

8 years agoFix re cache replacement method
Vsevolod Stakhov [Sun, 6 Dec 2015 13:55:59 +0000 (13:55 +0000)]
Fix re cache replacement method

8 years agoAdd method to set re class for any rspamd regexp
Vsevolod Stakhov [Sun, 6 Dec 2015 13:55:43 +0000 (13:55 +0000)]
Add method to set re class for any rspamd regexp

8 years agoAdd function rspamd_config:replace_regexp
Vsevolod Stakhov [Sat, 5 Dec 2015 13:42:33 +0000 (13:42 +0000)]
Add function rspamd_config:replace_regexp

8 years agoFix headers iteration
Vsevolod Stakhov [Sat, 5 Dec 2015 13:30:08 +0000 (13:30 +0000)]
Fix headers iteration

8 years agoFix more issues in the new re cache
Vsevolod Stakhov [Sat, 5 Dec 2015 13:21:50 +0000 (13:21 +0000)]
Fix more issues in the new re cache

8 years agoAdd replacement method for expressions in the confi
Vsevolod Stakhov [Sat, 5 Dec 2015 00:44:00 +0000 (00:44 +0000)]
Add replacement method for expressions in the confi

8 years agoMore rework for re_cache
Vsevolod Stakhov [Fri, 4 Dec 2015 17:08:45 +0000 (17:08 +0000)]
More rework for re_cache

8 years agoStart rework of spamassassin plugin
Vsevolod Stakhov [Fri, 4 Dec 2015 16:58:25 +0000 (16:58 +0000)]
Start rework of spamassassin plugin

8 years agoDo not re-set GError
Vsevolod Stakhov [Fri, 4 Dec 2015 16:58:14 +0000 (16:58 +0000)]
Do not re-set GError

8 years agoFix invalid tests
Vsevolod Stakhov [Fri, 4 Dec 2015 16:29:20 +0000 (16:29 +0000)]
Fix invalid tests

8 years agoFix issues with re_cache lua API
Vsevolod Stakhov [Fri, 4 Dec 2015 16:26:45 +0000 (16:26 +0000)]
Fix issues with re_cache lua API

8 years agoFix issue with zero length atoms
Vsevolod Stakhov [Fri, 4 Dec 2015 16:26:32 +0000 (16:26 +0000)]
Fix issue with zero length atoms

8 years agoZero memory before usage
Vsevolod Stakhov [Fri, 4 Dec 2015 16:26:15 +0000 (16:26 +0000)]
Zero memory before usage

8 years agoFix initialization order in fuzzy storage
Vsevolod Stakhov [Fri, 4 Dec 2015 16:25:58 +0000 (16:25 +0000)]
Fix initialization order in fuzzy storage

8 years agoFix couple of bugs in lua table to C convertor
Vsevolod Stakhov [Fri, 4 Dec 2015 15:54:31 +0000 (15:54 +0000)]
Fix couple of bugs in lua table to C convertor

8 years agoInit re cache on config post load
Vsevolod Stakhov [Fri, 4 Dec 2015 15:54:02 +0000 (15:54 +0000)]
Init re cache on config post load

8 years agoAdd rspamd_config:register_regexp
Vsevolod Stakhov [Fri, 4 Dec 2015 14:22:43 +0000 (14:22 +0000)]
Add rspamd_config:register_regexp

8 years agoAdd method to process new regexp cache
Vsevolod Stakhov [Fri, 4 Dec 2015 01:04:54 +0000 (01:04 +0000)]
Add method to process new regexp cache

8 years agoMake lua_regexp structure public
Vsevolod Stakhov [Fri, 4 Dec 2015 01:04:40 +0000 (01:04 +0000)]
Make lua_regexp structure public

8 years agoSlightly rework class names in table to c convertor
Vsevolod Stakhov [Fri, 4 Dec 2015 01:04:21 +0000 (01:04 +0000)]
Slightly rework class names in table to c convertor

8 years agoRework upstreams library
Vsevolod Stakhov [Thu, 3 Dec 2015 18:51:21 +0000 (18:51 +0000)]
Rework upstreams library

Now each address has its own errors count, so rspamd will prefer upstream addrs with no errors to addrs with errors. This might help to resolve issues on systems where ipv6 does not work.

8 years agoAdd missing function
Vsevolod Stakhov [Thu, 3 Dec 2015 17:39:53 +0000 (17:39 +0000)]
Add missing function

8 years agoFix code for the new cache
Vsevolod Stakhov [Thu, 3 Dec 2015 17:37:53 +0000 (17:37 +0000)]
Fix code for the new cache

8 years agoStart new era of regexp cache
Vsevolod Stakhov [Thu, 3 Dec 2015 17:10:34 +0000 (17:10 +0000)]
Start new era of regexp cache

8 years agoImplement real checks in re_cache
Vsevolod Stakhov [Thu, 3 Dec 2015 16:56:45 +0000 (16:56 +0000)]
Implement real checks in re_cache

8 years agoAdd more logic for the new re cache system
Vsevolod Stakhov [Thu, 3 Dec 2015 15:15:22 +0000 (15:15 +0000)]
Add more logic for the new re cache system

8 years agoAdd ability to ignore certain symbols in metric when validating cache
Vsevolod Stakhov [Thu, 3 Dec 2015 12:13:10 +0000 (12:13 +0000)]
Add ability to ignore certain symbols in metric when validating cache

8 years agoAdd cache id support for regexp
Vsevolod Stakhov [Thu, 3 Dec 2015 09:24:59 +0000 (09:24 +0000)]
Add cache id support for regexp

8 years agoTry to fix SUSPICIOUS_RECIPS rule
Vsevolod Stakhov [Wed, 2 Dec 2015 17:48:39 +0000 (17:48 +0000)]
Try to fix SUSPICIOUS_RECIPS rule

Issue: #437

8 years agoTry to fix bloody SORTED_RECIPS rule
Vsevolod Stakhov [Wed, 2 Dec 2015 17:44:25 +0000 (17:44 +0000)]
Try to fix bloody SORTED_RECIPS rule

Issue: #437

8 years agoFix parsing of url encoded href tags
Vsevolod Stakhov [Wed, 2 Dec 2015 17:16:14 +0000 (17:16 +0000)]
Fix parsing of url encoded href tags

8 years agoMatch any newline character in regexps
Vsevolod Stakhov [Wed, 2 Dec 2015 13:40:37 +0000 (13:40 +0000)]
Match any newline character in regexps

Issue: #438
Reported by: @moisseev

8 years agoAnother try to fix locked statements in sqlite
Vsevolod Stakhov [Tue, 1 Dec 2015 22:23:19 +0000 (22:23 +0000)]
Another try to fix locked statements in sqlite

8 years agoCleanup statement correctly
Vsevolod Stakhov [Tue, 1 Dec 2015 21:00:33 +0000 (21:00 +0000)]
Cleanup statement correctly

8 years agoFix old sqlite support
Vsevolod Stakhov [Tue, 1 Dec 2015 18:31:16 +0000 (18:31 +0000)]
Fix old sqlite support

8 years agoAnother try to fight with WAL growth
Vsevolod Stakhov [Tue, 1 Dec 2015 18:18:12 +0000 (18:18 +0000)]
Another try to fight with WAL growth

8 years agoAdd routines to get count of captures and backrefs
Vsevolod Stakhov [Tue, 1 Dec 2015 18:17:55 +0000 (18:17 +0000)]
Add routines to get count of captures and backrefs

8 years agoStart new regexp cache optimizer
Vsevolod Stakhov [Tue, 1 Dec 2015 17:09:06 +0000 (17:09 +0000)]
Start new regexp cache optimizer

8 years agoAdd support of g_int64 hash for old glib
Vsevolod Stakhov [Tue, 1 Dec 2015 15:38:10 +0000 (15:38 +0000)]
Add support of g_int64 hash for old glib

8 years agoRework ratelimit plugin
Vsevolod Stakhov [Mon, 30 Nov 2015 16:14:47 +0000 (16:14 +0000)]
Rework ratelimit plugin

- Switch to `rates` instead of old and stupid strings to setup
- Check if a bucket is zero and disable the corresponding limits
- Turn off all buckets by default
- Check either `rcpt` or `user` buckets, not all together
- Document new `rates` and `symbol` options
- Inform user about what buckets are used in the configuration

8 years agoRemove extra code for IP urls in surbl module
Vsevolod Stakhov [Mon, 30 Nov 2015 14:50:57 +0000 (14:50 +0000)]
Remove extra code for IP urls in surbl module

8 years agoRemove fake surbl symbols from metric
Vsevolod Stakhov [Mon, 30 Nov 2015 13:55:03 +0000 (13:55 +0000)]
Remove fake surbl symbols from metric

8 years agoUse mktemp when available
Vsevolod Stakhov [Mon, 30 Nov 2015 13:33:22 +0000 (13:33 +0000)]
Use mktemp when available

8 years agoFix configtest
Vsevolod Stakhov [Mon, 30 Nov 2015 12:56:07 +0000 (12:56 +0000)]
Fix configtest

8 years agoUse special flag for classifier symbols
Vsevolod Stakhov [Mon, 30 Nov 2015 12:56:00 +0000 (12:56 +0000)]
Use special flag for classifier symbols

8 years agoFix loop iteration for IP uribl.
Vsevolod Stakhov [Mon, 30 Nov 2015 11:47:16 +0000 (11:47 +0000)]
Fix loop iteration for IP uribl.

8 years agoMore fixes for learning IO
Vsevolod Stakhov [Mon, 30 Nov 2015 11:08:45 +0000 (11:08 +0000)]
More fixes for learning IO

8 years agoChange logic of fuzzy requests retransmitting
Vsevolod Stakhov [Mon, 30 Nov 2015 09:58:14 +0000 (09:58 +0000)]
Change logic of fuzzy requests retransmitting

9 years agoAdd routine to add events for a specific watcher structure
Vsevolod Stakhov [Sun, 29 Nov 2015 22:39:23 +0000 (22:39 +0000)]
Add routine to add events for a specific watcher structure

9 years agoAvoid treating of URLs as zero terminated strings
Vsevolod Stakhov [Sun, 29 Nov 2015 19:07:41 +0000 (19:07 +0000)]
Avoid treating of URLs as zero terminated strings

9 years agoAdd missing components normalization
Vsevolod Stakhov [Sat, 28 Nov 2015 22:22:21 +0000 (22:22 +0000)]
Add missing components normalization

9 years agoMore fixes to url numeric conversions
Vsevolod Stakhov [Sat, 28 Nov 2015 22:10:25 +0000 (22:10 +0000)]
More fixes to url numeric conversions

9 years agoStart to fix url decoding shifting
Vsevolod Stakhov [Sat, 28 Nov 2015 13:46:42 +0000 (13:46 +0000)]
Start to fix url decoding shifting

9 years agoAdd guard for ratelimit checks
Vsevolod Stakhov [Sat, 28 Nov 2015 13:13:38 +0000 (13:13 +0000)]
Add guard for ratelimit checks

9 years agoFix rules count
Vsevolod Stakhov [Fri, 27 Nov 2015 17:01:36 +0000 (17:01 +0000)]
Fix rules count

9 years agoAdd config for spamhaus SBL to uribl
Vsevolod Stakhov [Fri, 27 Nov 2015 16:55:41 +0000 (16:55 +0000)]
Add config for spamhaus SBL to uribl

9 years agoAdd alias for 'options = noip' as 'no_ip = true'
Vsevolod Stakhov [Fri, 27 Nov 2015 16:47:05 +0000 (16:47 +0000)]
Add alias for 'options = noip' as 'no_ip = true'

9 years agoSupport IP DNS black lists for URIBL
Vsevolod Stakhov [Fri, 27 Nov 2015 16:32:14 +0000 (16:32 +0000)]
Support IP DNS black lists for URIBL

Rspamd now can resolve URL's IP address and check it via the standard DNS IP blacklist (such as spamhaus SBL, for example)

9 years agoRemove escaping of log strings as it seems to be useless
Vsevolod Stakhov [Fri, 27 Nov 2015 15:34:52 +0000 (15:34 +0000)]
Remove escaping of log strings as it seems to be useless

9 years agoFix multiple classifiers support.
Vsevolod Stakhov [Fri, 27 Nov 2015 15:28:13 +0000 (15:28 +0000)]
Fix multiple classifiers support.

9 years agoFix forking and epoll/kqueue
Vsevolod Stakhov [Fri, 27 Nov 2015 15:02:46 +0000 (15:02 +0000)]
Fix forking and epoll/kqueue

9 years agoImprove informational message from regexp module
Vsevolod Stakhov [Fri, 27 Nov 2015 14:30:15 +0000 (14:30 +0000)]
Improve informational message from regexp module

9 years agoFix initialization order
Vsevolod Stakhov [Fri, 27 Nov 2015 13:53:48 +0000 (13:53 +0000)]
Fix initialization order

9 years agoAdd informational messages about modules initialization
Vsevolod Stakhov [Fri, 27 Nov 2015 13:43:32 +0000 (13:43 +0000)]
Add informational messages about modules initialization

9 years agoFix order of loading
Vsevolod Stakhov [Fri, 27 Nov 2015 13:14:14 +0000 (13:14 +0000)]
Fix order of loading

9 years agoUse atomic ops if possible
Vsevolod Stakhov [Thu, 26 Nov 2015 18:50:03 +0000 (18:50 +0000)]
Use atomic ops if possible