]> source.dussan.org Git - rspamd.git/log
rspamd.git
8 years agoAnother try to fix locked statements in sqlite
Vsevolod Stakhov [Tue, 1 Dec 2015 22:23:19 +0000 (22:23 +0000)]
Another try to fix locked statements in sqlite

8 years agoCleanup statement correctly
Vsevolod Stakhov [Tue, 1 Dec 2015 21:00:33 +0000 (21:00 +0000)]
Cleanup statement correctly

8 years agoFix old sqlite support
Vsevolod Stakhov [Tue, 1 Dec 2015 18:31:16 +0000 (18:31 +0000)]
Fix old sqlite support

8 years agoAnother try to fight with WAL growth
Vsevolod Stakhov [Tue, 1 Dec 2015 18:18:12 +0000 (18:18 +0000)]
Another try to fight with WAL growth

8 years agoAdd routines to get count of captures and backrefs
Vsevolod Stakhov [Tue, 1 Dec 2015 18:17:55 +0000 (18:17 +0000)]
Add routines to get count of captures and backrefs

8 years agoStart new regexp cache optimizer
Vsevolod Stakhov [Tue, 1 Dec 2015 17:09:06 +0000 (17:09 +0000)]
Start new regexp cache optimizer

8 years agoAdd support of g_int64 hash for old glib
Vsevolod Stakhov [Tue, 1 Dec 2015 15:38:10 +0000 (15:38 +0000)]
Add support of g_int64 hash for old glib

8 years agoRework ratelimit plugin
Vsevolod Stakhov [Mon, 30 Nov 2015 16:14:47 +0000 (16:14 +0000)]
Rework ratelimit plugin

- Switch to `rates` instead of old and stupid strings to setup
- Check if a bucket is zero and disable the corresponding limits
- Turn off all buckets by default
- Check either `rcpt` or `user` buckets, not all together
- Document new `rates` and `symbol` options
- Inform user about what buckets are used in the configuration

8 years agoRemove extra code for IP urls in surbl module
Vsevolod Stakhov [Mon, 30 Nov 2015 14:50:57 +0000 (14:50 +0000)]
Remove extra code for IP urls in surbl module

8 years agoRemove fake surbl symbols from metric
Vsevolod Stakhov [Mon, 30 Nov 2015 13:55:03 +0000 (13:55 +0000)]
Remove fake surbl symbols from metric

8 years agoUse mktemp when available
Vsevolod Stakhov [Mon, 30 Nov 2015 13:33:22 +0000 (13:33 +0000)]
Use mktemp when available

8 years agoFix configtest
Vsevolod Stakhov [Mon, 30 Nov 2015 12:56:07 +0000 (12:56 +0000)]
Fix configtest

8 years agoUse special flag for classifier symbols
Vsevolod Stakhov [Mon, 30 Nov 2015 12:56:00 +0000 (12:56 +0000)]
Use special flag for classifier symbols

8 years agoFix loop iteration for IP uribl.
Vsevolod Stakhov [Mon, 30 Nov 2015 11:47:16 +0000 (11:47 +0000)]
Fix loop iteration for IP uribl.

8 years agoMore fixes for learning IO
Vsevolod Stakhov [Mon, 30 Nov 2015 11:08:45 +0000 (11:08 +0000)]
More fixes for learning IO

8 years agoChange logic of fuzzy requests retransmitting
Vsevolod Stakhov [Mon, 30 Nov 2015 09:58:14 +0000 (09:58 +0000)]
Change logic of fuzzy requests retransmitting

8 years agoAdd routine to add events for a specific watcher structure
Vsevolod Stakhov [Sun, 29 Nov 2015 22:39:23 +0000 (22:39 +0000)]
Add routine to add events for a specific watcher structure

8 years agoAvoid treating of URLs as zero terminated strings
Vsevolod Stakhov [Sun, 29 Nov 2015 19:07:41 +0000 (19:07 +0000)]
Avoid treating of URLs as zero terminated strings

8 years agoAdd missing components normalization
Vsevolod Stakhov [Sat, 28 Nov 2015 22:22:21 +0000 (22:22 +0000)]
Add missing components normalization

8 years agoMore fixes to url numeric conversions
Vsevolod Stakhov [Sat, 28 Nov 2015 22:10:25 +0000 (22:10 +0000)]
More fixes to url numeric conversions

8 years agoStart to fix url decoding shifting
Vsevolod Stakhov [Sat, 28 Nov 2015 13:46:42 +0000 (13:46 +0000)]
Start to fix url decoding shifting

8 years agoAdd guard for ratelimit checks
Vsevolod Stakhov [Sat, 28 Nov 2015 13:13:38 +0000 (13:13 +0000)]
Add guard for ratelimit checks

8 years agoFix rules count
Vsevolod Stakhov [Fri, 27 Nov 2015 17:01:36 +0000 (17:01 +0000)]
Fix rules count

8 years agoAdd config for spamhaus SBL to uribl
Vsevolod Stakhov [Fri, 27 Nov 2015 16:55:41 +0000 (16:55 +0000)]
Add config for spamhaus SBL to uribl

8 years agoAdd alias for 'options = noip' as 'no_ip = true'
Vsevolod Stakhov [Fri, 27 Nov 2015 16:47:05 +0000 (16:47 +0000)]
Add alias for 'options = noip' as 'no_ip = true'

8 years agoSupport IP DNS black lists for URIBL
Vsevolod Stakhov [Fri, 27 Nov 2015 16:32:14 +0000 (16:32 +0000)]
Support IP DNS black lists for URIBL

Rspamd now can resolve URL's IP address and check it via the standard DNS IP blacklist (such as spamhaus SBL, for example)

8 years agoRemove escaping of log strings as it seems to be useless
Vsevolod Stakhov [Fri, 27 Nov 2015 15:34:52 +0000 (15:34 +0000)]
Remove escaping of log strings as it seems to be useless

8 years agoFix multiple classifiers support.
Vsevolod Stakhov [Fri, 27 Nov 2015 15:28:13 +0000 (15:28 +0000)]
Fix multiple classifiers support.

8 years agoFix forking and epoll/kqueue
Vsevolod Stakhov [Fri, 27 Nov 2015 15:02:46 +0000 (15:02 +0000)]
Fix forking and epoll/kqueue

8 years agoImprove informational message from regexp module
Vsevolod Stakhov [Fri, 27 Nov 2015 14:30:15 +0000 (14:30 +0000)]
Improve informational message from regexp module

8 years agoFix initialization order
Vsevolod Stakhov [Fri, 27 Nov 2015 13:53:48 +0000 (13:53 +0000)]
Fix initialization order

8 years agoAdd informational messages about modules initialization
Vsevolod Stakhov [Fri, 27 Nov 2015 13:43:32 +0000 (13:43 +0000)]
Add informational messages about modules initialization

8 years agoFix order of loading
Vsevolod Stakhov [Fri, 27 Nov 2015 13:14:14 +0000 (13:14 +0000)]
Fix order of loading

8 years agoUse atomic ops if possible
Vsevolod Stakhov [Thu, 26 Nov 2015 18:50:03 +0000 (18:50 +0000)]
Use atomic ops if possible

8 years agoFix stupid error when removing `words` member
Vsevolod Stakhov [Thu, 26 Nov 2015 18:45:37 +0000 (18:45 +0000)]
Fix stupid error when removing `words` member

8 years agoGenerate fuzzy hashes from task metadata (URLs and headers)
Vsevolod Stakhov [Thu, 26 Nov 2015 18:22:45 +0000 (18:22 +0000)]
Generate fuzzy hashes from task metadata (URLs and headers)

8 years agoUse the same hash seed for urls as we need some static order
Vsevolod Stakhov [Thu, 26 Nov 2015 17:07:30 +0000 (17:07 +0000)]
Use the same hash seed for urls as we need some static order

8 years agoRemove legacy words, use merely normalized_words
Vsevolod Stakhov [Thu, 26 Nov 2015 17:04:55 +0000 (17:04 +0000)]
Remove legacy words, use merely normalized_words

8 years agoAdd SUBJ_ALL_CAPS rule
Vsevolod Stakhov [Thu, 26 Nov 2015 15:30:23 +0000 (15:30 +0000)]
Add SUBJ_ALL_CAPS rule

8 years agoAdd is_uppercase utility for utf8 strings
Vsevolod Stakhov [Thu, 26 Nov 2015 15:30:04 +0000 (15:30 +0000)]
Add is_uppercase utility for utf8 strings

8 years agoFix delayed fork
Vsevolod Stakhov [Thu, 26 Nov 2015 15:19:23 +0000 (15:19 +0000)]
Fix delayed fork

8 years agoFix raw logic inversion in `get_header` method
Vsevolod Stakhov [Thu, 26 Nov 2015 15:13:55 +0000 (15:13 +0000)]
Fix raw logic inversion in `get_header` method

8 years agoAdd additional checks for mail addresses
Vsevolod Stakhov [Thu, 26 Nov 2015 14:20:08 +0000 (14:20 +0000)]
Add additional checks for mail addresses

8 years agoMore fixes for url parsing
Vsevolod Stakhov [Thu, 26 Nov 2015 13:56:35 +0000 (13:56 +0000)]
More fixes for url parsing

Hello my dear spammer, thank you for all your valueable test cases that you
are kindly providing for me!

8 years agoFix race condition when opening sqlite db
Vsevolod Stakhov [Wed, 25 Nov 2015 17:45:24 +0000 (17:45 +0000)]
Fix race condition when opening sqlite db

8 years agoMove all updates to a single transaction.
Vsevolod Stakhov [Wed, 25 Nov 2015 17:40:42 +0000 (17:40 +0000)]
Move all updates to a single transaction.

8 years agoImplement new fuzzy updates architecture
Vsevolod Stakhov [Wed, 25 Nov 2015 17:28:59 +0000 (17:28 +0000)]
Implement new fuzzy updates architecture

So far, fuzzy storage can run in multiple processes. However, merely one process is responsible for changes whilst others just work as proxies when dealing with updates. That should fix sqlite concurrency issues.

8 years agoUse the correct key to fix memory issues
Vsevolod Stakhov [Wed, 25 Nov 2015 16:00:58 +0000 (16:00 +0000)]
Use the correct key to fix memory issues

8 years agoDo not enable accept event with no handler
Vsevolod Stakhov [Wed, 25 Nov 2015 15:59:48 +0000 (15:59 +0000)]
Do not enable accept event with no handler

8 years agoClean log buffer when forking
Vsevolod Stakhov [Wed, 25 Nov 2015 15:18:47 +0000 (15:18 +0000)]
Clean log buffer when forking

8 years agoImplement listening for srv pipe in the main process
Vsevolod Stakhov [Wed, 25 Nov 2015 15:16:04 +0000 (15:16 +0000)]
Implement listening for srv pipe in the main process

8 years agoAdd method to send data to server pipe.
Vsevolod Stakhov [Wed, 25 Nov 2015 14:43:40 +0000 (14:43 +0000)]
Add method to send data to server pipe.

8 years agoStart work on worker->main pipe interface
Vsevolod Stakhov [Wed, 25 Nov 2015 14:14:09 +0000 (14:14 +0000)]
Start work on worker->main pipe interface

8 years agoCleanup controller session structure.
Vsevolod Stakhov [Wed, 25 Nov 2015 14:13:58 +0000 (14:13 +0000)]
Cleanup controller session structure.

8 years agoSlightly improve logging in fuzzy.
Vsevolod Stakhov [Tue, 24 Nov 2015 16:38:32 +0000 (16:38 +0000)]
Slightly improve logging in fuzzy.

8 years agoFix another stupid mistake for adding hashes
Vsevolod Stakhov [Tue, 24 Nov 2015 15:59:44 +0000 (15:59 +0000)]
Fix another stupid mistake for adding hashes

8 years agoParse more headers if they are missed in HTTP
Vsevolod Stakhov [Tue, 24 Nov 2015 15:22:37 +0000 (15:22 +0000)]
Parse more headers if they are missed in HTTP

8 years agoWhen returning headers, reverse list to restore the original order
Vsevolod Stakhov [Tue, 24 Nov 2015 15:13:07 +0000 (15:13 +0000)]
When returning headers, reverse list to restore the original order

8 years agoFix parsing of IPv6 received headers.
Vsevolod Stakhov [Tue, 24 Nov 2015 15:12:18 +0000 (15:12 +0000)]
Fix parsing of IPv6 received headers.

Issue: #434
Reported by: @vixns

8 years agoFix critical issue in adding fuzzy hashes
Vsevolod Stakhov [Tue, 24 Nov 2015 14:44:26 +0000 (14:44 +0000)]
Fix critical issue in adding fuzzy hashes

8 years agoAdd more diagnostic to fuzzy errors
Vsevolod Stakhov [Tue, 24 Nov 2015 14:11:57 +0000 (14:11 +0000)]
Add more diagnostic to fuzzy errors

8 years agoReduce the default limit
Vsevolod Stakhov [Tue, 24 Nov 2015 13:48:58 +0000 (13:48 +0000)]
Reduce the default limit

8 years agoFix parsing of tags with spaces used for obfuscation
Vsevolod Stakhov [Tue, 24 Nov 2015 13:19:20 +0000 (13:19 +0000)]
Fix parsing of tags with spaces used for obfuscation

8 years agoImprove numbers humanisation
Vsevolod Stakhov [Mon, 23 Nov 2015 18:57:15 +0000 (18:57 +0000)]
Improve numbers humanisation

8 years agoRestore '-c' flag in the client
Vsevolod Stakhov [Mon, 23 Nov 2015 18:38:02 +0000 (18:38 +0000)]
Restore '-c' flag in the client

8 years agoRestore multiple classifiers support
Vsevolod Stakhov [Mon, 23 Nov 2015 18:36:41 +0000 (18:36 +0000)]
Restore multiple classifiers support

8 years agoFix _NORESOLVE_MX symbols in hfilter
Vsevolod Stakhov [Mon, 23 Nov 2015 16:19:38 +0000 (16:19 +0000)]
Fix _NORESOLVE_MX symbols in hfilter

8 years agoAdd check_for_mime('mime_attachement') function
Vsevolod Stakhov [Mon, 23 Nov 2015 14:04:02 +0000 (14:04 +0000)]
Add check_for_mime('mime_attachement') function

8 years agoRework SA plugin for some problematic cases
Vsevolod Stakhov [Mon, 23 Nov 2015 13:48:11 +0000 (13:48 +0000)]
Rework SA plugin for some problematic cases

8 years agoFix some memory issues
Vsevolod Stakhov [Mon, 23 Nov 2015 12:20:03 +0000 (12:20 +0000)]
Fix some memory issues

8 years agoAdd 'check_relays_unparseable' support
Vsevolod Stakhov [Mon, 23 Nov 2015 11:36:36 +0000 (11:36 +0000)]
Add 'check_relays_unparseable' support

8 years agoFix indexing for received headers.
Vsevolod Stakhov [Mon, 23 Nov 2015 11:36:10 +0000 (11:36 +0000)]
Fix indexing for received headers.

8 years agoSome more fixes to OSB algorithm
Vsevolod Stakhov [Mon, 23 Nov 2015 10:04:00 +0000 (10:04 +0000)]
Some more fixes to OSB algorithm

8 years agoAdd 'reresolve' command to the control interface
Vsevolod Stakhov [Mon, 23 Nov 2015 09:29:59 +0000 (09:29 +0000)]
Add 'reresolve' command to the control interface

8 years agoDo not reresolve upstreams with no resolver defined
Vsevolod Stakhov [Mon, 23 Nov 2015 09:29:41 +0000 (09:29 +0000)]
Do not reresolve upstreams with no resolver defined

8 years agoTest for atomic ops.
Vsevolod Stakhov [Mon, 23 Nov 2015 09:10:12 +0000 (09:10 +0000)]
Test for atomic ops.

8 years agoImprove debugging for bayes.
Vsevolod Stakhov [Mon, 23 Nov 2015 01:23:50 +0000 (01:23 +0000)]
Improve debugging for bayes.

8 years agoFix calculations
Vsevolod Stakhov [Mon, 23 Nov 2015 01:23:38 +0000 (01:23 +0000)]
Fix calculations

8 years agoAvoid long double type
Vsevolod Stakhov [Mon, 23 Nov 2015 00:26:55 +0000 (00:26 +0000)]
Avoid long double type

8 years agoAdd rspamd_upstream_reresolve routine.
Vsevolod Stakhov [Sun, 22 Nov 2015 14:11:13 +0000 (14:11 +0000)]
Add rspamd_upstream_reresolve routine.

8 years agoUse context variables instead of default ones
Vsevolod Stakhov [Sun, 22 Nov 2015 13:54:36 +0000 (13:54 +0000)]
Use context variables instead of default ones

8 years agoUse new rotation logic in the code
Vsevolod Stakhov [Sat, 21 Nov 2015 13:31:26 +0000 (13:31 +0000)]
Use new rotation logic in the code

8 years agoRework rotation for upstreams
Vsevolod Stakhov [Sat, 21 Nov 2015 13:20:37 +0000 (13:20 +0000)]
Rework rotation for upstreams

8 years agoParse rotation type for upstreams list
Vsevolod Stakhov [Sat, 21 Nov 2015 13:17:05 +0000 (13:17 +0000)]
Parse rotation type for upstreams list

8 years agoAllow ratelimit plugin to set symbol instead of pre-result
Vsevolod Stakhov [Sat, 21 Nov 2015 00:18:41 +0000 (00:18 +0000)]
Allow ratelimit plugin to set symbol instead of pre-result

8 years agoAdd deinitialization for upstreams
Vsevolod Stakhov [Fri, 20 Nov 2015 17:09:32 +0000 (17:09 +0000)]
Add deinitialization for upstreams

8 years agoRework upstreams initialization
Vsevolod Stakhov [Fri, 20 Nov 2015 17:03:51 +0000 (17:03 +0000)]
Rework upstreams initialization

8 years agoRework FORGED_RECIPIENTS for common users
Vsevolod Stakhov [Fri, 20 Nov 2015 16:52:10 +0000 (16:52 +0000)]
Rework FORGED_RECIPIENTS for common users

8 years agoReduce weight of SUSPICIOUS_RECIPS
Vsevolod Stakhov [Fri, 20 Nov 2015 16:44:09 +0000 (16:44 +0000)]
Reduce weight of SUSPICIOUS_RECIPS

8 years agoFix plugins
Vsevolod Stakhov [Fri, 20 Nov 2015 16:37:23 +0000 (16:37 +0000)]
Fix plugins

8 years agoFix tests
Vsevolod Stakhov [Fri, 20 Nov 2015 16:33:34 +0000 (16:33 +0000)]
Fix tests

8 years agoFix upstreams usage
Vsevolod Stakhov [Fri, 20 Nov 2015 16:17:24 +0000 (16:17 +0000)]
Fix upstreams usage

8 years agoRework upstreams context
Vsevolod Stakhov [Fri, 20 Nov 2015 15:48:32 +0000 (15:48 +0000)]
Rework upstreams context

8 years agoAdd R_SUSPICIOUS_URL rule that detects obfusicated URL's
Vsevolod Stakhov [Fri, 20 Nov 2015 13:52:20 +0000 (13:52 +0000)]
Add R_SUSPICIOUS_URL rule that detects obfusicated URL's

8 years agoAdd is_obscured method for lua url API
Vsevolod Stakhov [Fri, 20 Nov 2015 13:52:08 +0000 (13:52 +0000)]
Add is_obscured method for lua url API

8 years agoFix parsing of IP URLs
Vsevolod Stakhov [Thu, 19 Nov 2015 16:29:48 +0000 (16:29 +0000)]
Fix parsing of IP URLs

8 years agoUse flags for urls
Vsevolod Stakhov [Thu, 19 Nov 2015 13:06:49 +0000 (13:06 +0000)]
Use flags for urls

8 years agoDo not use 'strchr' on rspamd_fstring_t
Vsevolod Stakhov [Thu, 19 Nov 2015 12:34:29 +0000 (12:34 +0000)]
Do not use 'strchr' on rspamd_fstring_t

8 years agoAnother try to improve sqlite3 interaction
Vsevolod Stakhov [Thu, 19 Nov 2015 10:58:48 +0000 (10:58 +0000)]
Another try to improve sqlite3 interaction

8 years agoFix cleaning of rspamd config
Vsevolod Stakhov [Thu, 19 Nov 2015 00:00:54 +0000 (00:00 +0000)]
Fix cleaning of rspamd config