]> source.dussan.org Git - rspamd.git/log
rspamd.git
8 years agoMore rework for re_cache
Vsevolod Stakhov [Fri, 4 Dec 2015 17:08:45 +0000 (17:08 +0000)]
More rework for re_cache

8 years agoStart rework of spamassassin plugin
Vsevolod Stakhov [Fri, 4 Dec 2015 16:58:25 +0000 (16:58 +0000)]
Start rework of spamassassin plugin

8 years agoDo not re-set GError
Vsevolod Stakhov [Fri, 4 Dec 2015 16:58:14 +0000 (16:58 +0000)]
Do not re-set GError

8 years agoFix invalid tests
Vsevolod Stakhov [Fri, 4 Dec 2015 16:29:20 +0000 (16:29 +0000)]
Fix invalid tests

8 years agoFix issues with re_cache lua API
Vsevolod Stakhov [Fri, 4 Dec 2015 16:26:45 +0000 (16:26 +0000)]
Fix issues with re_cache lua API

8 years agoFix issue with zero length atoms
Vsevolod Stakhov [Fri, 4 Dec 2015 16:26:32 +0000 (16:26 +0000)]
Fix issue with zero length atoms

8 years agoZero memory before usage
Vsevolod Stakhov [Fri, 4 Dec 2015 16:26:15 +0000 (16:26 +0000)]
Zero memory before usage

8 years agoFix initialization order in fuzzy storage
Vsevolod Stakhov [Fri, 4 Dec 2015 16:25:58 +0000 (16:25 +0000)]
Fix initialization order in fuzzy storage

8 years agoFix couple of bugs in lua table to C convertor
Vsevolod Stakhov [Fri, 4 Dec 2015 15:54:31 +0000 (15:54 +0000)]
Fix couple of bugs in lua table to C convertor

8 years agoInit re cache on config post load
Vsevolod Stakhov [Fri, 4 Dec 2015 15:54:02 +0000 (15:54 +0000)]
Init re cache on config post load

8 years agoAdd rspamd_config:register_regexp
Vsevolod Stakhov [Fri, 4 Dec 2015 14:22:43 +0000 (14:22 +0000)]
Add rspamd_config:register_regexp

8 years agoAdd method to process new regexp cache
Vsevolod Stakhov [Fri, 4 Dec 2015 01:04:54 +0000 (01:04 +0000)]
Add method to process new regexp cache

8 years agoMake lua_regexp structure public
Vsevolod Stakhov [Fri, 4 Dec 2015 01:04:40 +0000 (01:04 +0000)]
Make lua_regexp structure public

8 years agoSlightly rework class names in table to c convertor
Vsevolod Stakhov [Fri, 4 Dec 2015 01:04:21 +0000 (01:04 +0000)]
Slightly rework class names in table to c convertor

8 years agoRework upstreams library
Vsevolod Stakhov [Thu, 3 Dec 2015 18:51:21 +0000 (18:51 +0000)]
Rework upstreams library

Now each address has its own errors count, so rspamd will prefer upstream addrs with no errors to addrs with errors. This might help to resolve issues on systems where ipv6 does not work.

8 years agoAdd missing function
Vsevolod Stakhov [Thu, 3 Dec 2015 17:39:53 +0000 (17:39 +0000)]
Add missing function

8 years agoFix code for the new cache
Vsevolod Stakhov [Thu, 3 Dec 2015 17:37:53 +0000 (17:37 +0000)]
Fix code for the new cache

8 years agoStart new era of regexp cache
Vsevolod Stakhov [Thu, 3 Dec 2015 17:10:34 +0000 (17:10 +0000)]
Start new era of regexp cache

8 years agoImplement real checks in re_cache
Vsevolod Stakhov [Thu, 3 Dec 2015 16:56:45 +0000 (16:56 +0000)]
Implement real checks in re_cache

8 years agoAdd more logic for the new re cache system
Vsevolod Stakhov [Thu, 3 Dec 2015 15:15:22 +0000 (15:15 +0000)]
Add more logic for the new re cache system

8 years agoAdd ability to ignore certain symbols in metric when validating cache
Vsevolod Stakhov [Thu, 3 Dec 2015 12:13:10 +0000 (12:13 +0000)]
Add ability to ignore certain symbols in metric when validating cache

8 years agoAdd cache id support for regexp
Vsevolod Stakhov [Thu, 3 Dec 2015 09:24:59 +0000 (09:24 +0000)]
Add cache id support for regexp

8 years agoTry to fix SUSPICIOUS_RECIPS rule
Vsevolod Stakhov [Wed, 2 Dec 2015 17:48:39 +0000 (17:48 +0000)]
Try to fix SUSPICIOUS_RECIPS rule

Issue: #437

8 years agoTry to fix bloody SORTED_RECIPS rule
Vsevolod Stakhov [Wed, 2 Dec 2015 17:44:25 +0000 (17:44 +0000)]
Try to fix bloody SORTED_RECIPS rule

Issue: #437

8 years agoFix parsing of url encoded href tags
Vsevolod Stakhov [Wed, 2 Dec 2015 17:16:14 +0000 (17:16 +0000)]
Fix parsing of url encoded href tags

8 years agoMatch any newline character in regexps
Vsevolod Stakhov [Wed, 2 Dec 2015 13:40:37 +0000 (13:40 +0000)]
Match any newline character in regexps

Issue: #438
Reported by: @moisseev

8 years agoAnother try to fix locked statements in sqlite
Vsevolod Stakhov [Tue, 1 Dec 2015 22:23:19 +0000 (22:23 +0000)]
Another try to fix locked statements in sqlite

8 years agoCleanup statement correctly
Vsevolod Stakhov [Tue, 1 Dec 2015 21:00:33 +0000 (21:00 +0000)]
Cleanup statement correctly

8 years agoFix old sqlite support
Vsevolod Stakhov [Tue, 1 Dec 2015 18:31:16 +0000 (18:31 +0000)]
Fix old sqlite support

8 years agoAnother try to fight with WAL growth
Vsevolod Stakhov [Tue, 1 Dec 2015 18:18:12 +0000 (18:18 +0000)]
Another try to fight with WAL growth

8 years agoAdd routines to get count of captures and backrefs
Vsevolod Stakhov [Tue, 1 Dec 2015 18:17:55 +0000 (18:17 +0000)]
Add routines to get count of captures and backrefs

8 years agoStart new regexp cache optimizer
Vsevolod Stakhov [Tue, 1 Dec 2015 17:09:06 +0000 (17:09 +0000)]
Start new regexp cache optimizer

8 years agoAdd support of g_int64 hash for old glib
Vsevolod Stakhov [Tue, 1 Dec 2015 15:38:10 +0000 (15:38 +0000)]
Add support of g_int64 hash for old glib

8 years agoRework ratelimit plugin
Vsevolod Stakhov [Mon, 30 Nov 2015 16:14:47 +0000 (16:14 +0000)]
Rework ratelimit plugin

- Switch to `rates` instead of old and stupid strings to setup
- Check if a bucket is zero and disable the corresponding limits
- Turn off all buckets by default
- Check either `rcpt` or `user` buckets, not all together
- Document new `rates` and `symbol` options
- Inform user about what buckets are used in the configuration

8 years agoRemove extra code for IP urls in surbl module
Vsevolod Stakhov [Mon, 30 Nov 2015 14:50:57 +0000 (14:50 +0000)]
Remove extra code for IP urls in surbl module

8 years agoRemove fake surbl symbols from metric
Vsevolod Stakhov [Mon, 30 Nov 2015 13:55:03 +0000 (13:55 +0000)]
Remove fake surbl symbols from metric

8 years agoUse mktemp when available
Vsevolod Stakhov [Mon, 30 Nov 2015 13:33:22 +0000 (13:33 +0000)]
Use mktemp when available

8 years agoFix configtest
Vsevolod Stakhov [Mon, 30 Nov 2015 12:56:07 +0000 (12:56 +0000)]
Fix configtest

8 years agoUse special flag for classifier symbols
Vsevolod Stakhov [Mon, 30 Nov 2015 12:56:00 +0000 (12:56 +0000)]
Use special flag for classifier symbols

8 years agoFix loop iteration for IP uribl.
Vsevolod Stakhov [Mon, 30 Nov 2015 11:47:16 +0000 (11:47 +0000)]
Fix loop iteration for IP uribl.

8 years agoMore fixes for learning IO
Vsevolod Stakhov [Mon, 30 Nov 2015 11:08:45 +0000 (11:08 +0000)]
More fixes for learning IO

8 years agoChange logic of fuzzy requests retransmitting
Vsevolod Stakhov [Mon, 30 Nov 2015 09:58:14 +0000 (09:58 +0000)]
Change logic of fuzzy requests retransmitting

8 years agoAdd routine to add events for a specific watcher structure
Vsevolod Stakhov [Sun, 29 Nov 2015 22:39:23 +0000 (22:39 +0000)]
Add routine to add events for a specific watcher structure

8 years agoAvoid treating of URLs as zero terminated strings
Vsevolod Stakhov [Sun, 29 Nov 2015 19:07:41 +0000 (19:07 +0000)]
Avoid treating of URLs as zero terminated strings

8 years agoAdd missing components normalization
Vsevolod Stakhov [Sat, 28 Nov 2015 22:22:21 +0000 (22:22 +0000)]
Add missing components normalization

8 years agoMore fixes to url numeric conversions
Vsevolod Stakhov [Sat, 28 Nov 2015 22:10:25 +0000 (22:10 +0000)]
More fixes to url numeric conversions

8 years agoStart to fix url decoding shifting
Vsevolod Stakhov [Sat, 28 Nov 2015 13:46:42 +0000 (13:46 +0000)]
Start to fix url decoding shifting

8 years agoAdd guard for ratelimit checks
Vsevolod Stakhov [Sat, 28 Nov 2015 13:13:38 +0000 (13:13 +0000)]
Add guard for ratelimit checks

8 years agoFix rules count
Vsevolod Stakhov [Fri, 27 Nov 2015 17:01:36 +0000 (17:01 +0000)]
Fix rules count

8 years agoAdd config for spamhaus SBL to uribl
Vsevolod Stakhov [Fri, 27 Nov 2015 16:55:41 +0000 (16:55 +0000)]
Add config for spamhaus SBL to uribl

8 years agoAdd alias for 'options = noip' as 'no_ip = true'
Vsevolod Stakhov [Fri, 27 Nov 2015 16:47:05 +0000 (16:47 +0000)]
Add alias for 'options = noip' as 'no_ip = true'

8 years agoSupport IP DNS black lists for URIBL
Vsevolod Stakhov [Fri, 27 Nov 2015 16:32:14 +0000 (16:32 +0000)]
Support IP DNS black lists for URIBL

Rspamd now can resolve URL's IP address and check it via the standard DNS IP blacklist (such as spamhaus SBL, for example)

8 years agoRemove escaping of log strings as it seems to be useless
Vsevolod Stakhov [Fri, 27 Nov 2015 15:34:52 +0000 (15:34 +0000)]
Remove escaping of log strings as it seems to be useless

8 years agoFix multiple classifiers support.
Vsevolod Stakhov [Fri, 27 Nov 2015 15:28:13 +0000 (15:28 +0000)]
Fix multiple classifiers support.

8 years agoFix forking and epoll/kqueue
Vsevolod Stakhov [Fri, 27 Nov 2015 15:02:46 +0000 (15:02 +0000)]
Fix forking and epoll/kqueue

8 years agoImprove informational message from regexp module
Vsevolod Stakhov [Fri, 27 Nov 2015 14:30:15 +0000 (14:30 +0000)]
Improve informational message from regexp module

8 years agoFix initialization order
Vsevolod Stakhov [Fri, 27 Nov 2015 13:53:48 +0000 (13:53 +0000)]
Fix initialization order

8 years agoAdd informational messages about modules initialization
Vsevolod Stakhov [Fri, 27 Nov 2015 13:43:32 +0000 (13:43 +0000)]
Add informational messages about modules initialization

8 years agoFix order of loading
Vsevolod Stakhov [Fri, 27 Nov 2015 13:14:14 +0000 (13:14 +0000)]
Fix order of loading

8 years agoUse atomic ops if possible
Vsevolod Stakhov [Thu, 26 Nov 2015 18:50:03 +0000 (18:50 +0000)]
Use atomic ops if possible

8 years agoFix stupid error when removing `words` member
Vsevolod Stakhov [Thu, 26 Nov 2015 18:45:37 +0000 (18:45 +0000)]
Fix stupid error when removing `words` member

8 years agoGenerate fuzzy hashes from task metadata (URLs and headers)
Vsevolod Stakhov [Thu, 26 Nov 2015 18:22:45 +0000 (18:22 +0000)]
Generate fuzzy hashes from task metadata (URLs and headers)

8 years agoUse the same hash seed for urls as we need some static order
Vsevolod Stakhov [Thu, 26 Nov 2015 17:07:30 +0000 (17:07 +0000)]
Use the same hash seed for urls as we need some static order

8 years agoRemove legacy words, use merely normalized_words
Vsevolod Stakhov [Thu, 26 Nov 2015 17:04:55 +0000 (17:04 +0000)]
Remove legacy words, use merely normalized_words

8 years agoAdd SUBJ_ALL_CAPS rule
Vsevolod Stakhov [Thu, 26 Nov 2015 15:30:23 +0000 (15:30 +0000)]
Add SUBJ_ALL_CAPS rule

8 years agoAdd is_uppercase utility for utf8 strings
Vsevolod Stakhov [Thu, 26 Nov 2015 15:30:04 +0000 (15:30 +0000)]
Add is_uppercase utility for utf8 strings

8 years agoFix delayed fork
Vsevolod Stakhov [Thu, 26 Nov 2015 15:19:23 +0000 (15:19 +0000)]
Fix delayed fork

8 years agoFix raw logic inversion in `get_header` method
Vsevolod Stakhov [Thu, 26 Nov 2015 15:13:55 +0000 (15:13 +0000)]
Fix raw logic inversion in `get_header` method

8 years agoAdd additional checks for mail addresses
Vsevolod Stakhov [Thu, 26 Nov 2015 14:20:08 +0000 (14:20 +0000)]
Add additional checks for mail addresses

8 years agoMore fixes for url parsing
Vsevolod Stakhov [Thu, 26 Nov 2015 13:56:35 +0000 (13:56 +0000)]
More fixes for url parsing

Hello my dear spammer, thank you for all your valueable test cases that you
are kindly providing for me!

8 years agoFix race condition when opening sqlite db
Vsevolod Stakhov [Wed, 25 Nov 2015 17:45:24 +0000 (17:45 +0000)]
Fix race condition when opening sqlite db

8 years agoMove all updates to a single transaction.
Vsevolod Stakhov [Wed, 25 Nov 2015 17:40:42 +0000 (17:40 +0000)]
Move all updates to a single transaction.

8 years agoImplement new fuzzy updates architecture
Vsevolod Stakhov [Wed, 25 Nov 2015 17:28:59 +0000 (17:28 +0000)]
Implement new fuzzy updates architecture

So far, fuzzy storage can run in multiple processes. However, merely one process is responsible for changes whilst others just work as proxies when dealing with updates. That should fix sqlite concurrency issues.

8 years agoUse the correct key to fix memory issues
Vsevolod Stakhov [Wed, 25 Nov 2015 16:00:58 +0000 (16:00 +0000)]
Use the correct key to fix memory issues

8 years agoDo not enable accept event with no handler
Vsevolod Stakhov [Wed, 25 Nov 2015 15:59:48 +0000 (15:59 +0000)]
Do not enable accept event with no handler

8 years agoClean log buffer when forking
Vsevolod Stakhov [Wed, 25 Nov 2015 15:18:47 +0000 (15:18 +0000)]
Clean log buffer when forking

8 years agoImplement listening for srv pipe in the main process
Vsevolod Stakhov [Wed, 25 Nov 2015 15:16:04 +0000 (15:16 +0000)]
Implement listening for srv pipe in the main process

8 years agoAdd method to send data to server pipe.
Vsevolod Stakhov [Wed, 25 Nov 2015 14:43:40 +0000 (14:43 +0000)]
Add method to send data to server pipe.

8 years agoStart work on worker->main pipe interface
Vsevolod Stakhov [Wed, 25 Nov 2015 14:14:09 +0000 (14:14 +0000)]
Start work on worker->main pipe interface

8 years agoCleanup controller session structure.
Vsevolod Stakhov [Wed, 25 Nov 2015 14:13:58 +0000 (14:13 +0000)]
Cleanup controller session structure.

8 years agoSlightly improve logging in fuzzy.
Vsevolod Stakhov [Tue, 24 Nov 2015 16:38:32 +0000 (16:38 +0000)]
Slightly improve logging in fuzzy.

8 years agoFix another stupid mistake for adding hashes
Vsevolod Stakhov [Tue, 24 Nov 2015 15:59:44 +0000 (15:59 +0000)]
Fix another stupid mistake for adding hashes

8 years agoParse more headers if they are missed in HTTP
Vsevolod Stakhov [Tue, 24 Nov 2015 15:22:37 +0000 (15:22 +0000)]
Parse more headers if they are missed in HTTP

8 years agoWhen returning headers, reverse list to restore the original order
Vsevolod Stakhov [Tue, 24 Nov 2015 15:13:07 +0000 (15:13 +0000)]
When returning headers, reverse list to restore the original order

8 years agoFix parsing of IPv6 received headers.
Vsevolod Stakhov [Tue, 24 Nov 2015 15:12:18 +0000 (15:12 +0000)]
Fix parsing of IPv6 received headers.

Issue: #434
Reported by: @vixns

8 years agoFix critical issue in adding fuzzy hashes
Vsevolod Stakhov [Tue, 24 Nov 2015 14:44:26 +0000 (14:44 +0000)]
Fix critical issue in adding fuzzy hashes

8 years agoAdd more diagnostic to fuzzy errors
Vsevolod Stakhov [Tue, 24 Nov 2015 14:11:57 +0000 (14:11 +0000)]
Add more diagnostic to fuzzy errors

8 years agoReduce the default limit
Vsevolod Stakhov [Tue, 24 Nov 2015 13:48:58 +0000 (13:48 +0000)]
Reduce the default limit

8 years agoFix parsing of tags with spaces used for obfuscation
Vsevolod Stakhov [Tue, 24 Nov 2015 13:19:20 +0000 (13:19 +0000)]
Fix parsing of tags with spaces used for obfuscation

8 years agoImprove numbers humanisation
Vsevolod Stakhov [Mon, 23 Nov 2015 18:57:15 +0000 (18:57 +0000)]
Improve numbers humanisation

8 years agoRestore '-c' flag in the client
Vsevolod Stakhov [Mon, 23 Nov 2015 18:38:02 +0000 (18:38 +0000)]
Restore '-c' flag in the client

8 years agoRestore multiple classifiers support
Vsevolod Stakhov [Mon, 23 Nov 2015 18:36:41 +0000 (18:36 +0000)]
Restore multiple classifiers support

8 years agoFix _NORESOLVE_MX symbols in hfilter
Vsevolod Stakhov [Mon, 23 Nov 2015 16:19:38 +0000 (16:19 +0000)]
Fix _NORESOLVE_MX symbols in hfilter

8 years agoAdd check_for_mime('mime_attachement') function
Vsevolod Stakhov [Mon, 23 Nov 2015 14:04:02 +0000 (14:04 +0000)]
Add check_for_mime('mime_attachement') function

8 years agoRework SA plugin for some problematic cases
Vsevolod Stakhov [Mon, 23 Nov 2015 13:48:11 +0000 (13:48 +0000)]
Rework SA plugin for some problematic cases

8 years agoFix some memory issues
Vsevolod Stakhov [Mon, 23 Nov 2015 12:20:03 +0000 (12:20 +0000)]
Fix some memory issues

8 years agoAdd 'check_relays_unparseable' support
Vsevolod Stakhov [Mon, 23 Nov 2015 11:36:36 +0000 (11:36 +0000)]
Add 'check_relays_unparseable' support

8 years agoFix indexing for received headers.
Vsevolod Stakhov [Mon, 23 Nov 2015 11:36:10 +0000 (11:36 +0000)]
Fix indexing for received headers.

8 years agoSome more fixes to OSB algorithm
Vsevolod Stakhov [Mon, 23 Nov 2015 10:04:00 +0000 (10:04 +0000)]
Some more fixes to OSB algorithm

8 years agoAdd 'reresolve' command to the control interface
Vsevolod Stakhov [Mon, 23 Nov 2015 09:29:59 +0000 (09:29 +0000)]
Add 'reresolve' command to the control interface