]>
source.dussan.org Git - rspamd.git/log
Christian Göttsche [Mon, 6 Apr 2020 14:27:42 +0000 (16:27 +0200)]
[Minor] enable Wmissing-format-attribute
Christian Göttsche [Mon, 6 Apr 2020 14:27:41 +0000 (16:27 +0200)]
[Minor] silence warnings about unused function results
GCC does not respect `(void) func()`
Christian Göttsche [Mon, 6 Apr 2020 14:27:39 +0000 (16:27 +0200)]
[Minor] Enable missing_noreturn compiler warning
Christian Göttsche [Mon, 6 Apr 2020 14:27:38 +0000 (16:27 +0200)]
[Minor] Remove unused-but-set variables
../src/libserver/url.c: In function ‘rspamd_url_host_set_add’:
../src/libserver/url.c:3808:11: warning: variable ‘k’ set but not used [-Wunused-but-set-variable]
3808 | khiter_t k;
| ^
../src/lua/lua_task.c: In function ‘lua_task_has_urls’:
../src/lua/lua_task.c:2406:11: warning: variable ‘need_emails’ set but not used [-Wunused-but-set-variable]
2406 | gboolean need_emails = FALSE, ret = FALSE;
| ^~~~~~~~~~~
Christian Göttsche [Mon, 6 Apr 2020 14:27:36 +0000 (16:27 +0200)]
[Minor] Print always IPO status
Christian Göttsche [Mon, 6 Apr 2020 14:27:29 +0000 (16:27 +0200)]
[Minor] move static keyword to beginning of function declarations
In file included from ../src/libserver/logger/logger_file.c:23:
../src/libserver/logger/logger_private.h:106:1: warning: ‘static’ is not at beginning of declaration [-Wold-style-declaration]
106 | const static struct rspamd_logger_funcs file_log_funcs = {
| ^~~~~
../src/libserver/logger/logger_private.h:130:1: warning: ‘static’ is not at beginning of declaration [-Wold-style-declaration]
130 | const static struct rspamd_logger_funcs syslog_log_funcs = {
| ^~~~~
../src/libserver/logger/logger_private.h:154:1: warning: ‘static’ is not at beginning of declaration [-Wold-style-declaration]
154 | const static struct rspamd_logger_funcs console_log_funcs = {
| ^~~~~
Vsevolod Stakhov [Fri, 10 Apr 2020 11:45:26 +0000 (12:45 +0100)]
[Test] Fix tests
Vsevolod Stakhov [Fri, 10 Apr 2020 10:44:25 +0000 (11:44 +0100)]
[Minor] Add sanity check for base32 decoding
Vsevolod Stakhov [Fri, 10 Apr 2020 10:38:39 +0000 (11:38 +0100)]
[Feature] Allow multiple base32 encodings in Lua API
Vsevolod Stakhov [Fri, 10 Apr 2020 10:27:08 +0000 (11:27 +0100)]
[Minor] Add helper to get base32 type
Vsevolod Stakhov [Fri, 10 Apr 2020 07:28:11 +0000 (08:28 +0100)]
Merge pull request #3329 from moisseev/patch-3
[Minor] Add application/7z CT
Alexander Moisseev [Fri, 10 Apr 2020 07:06:53 +0000 (10:06 +0300)]
[Minor] Add application/7z CT
Vsevolod Stakhov [Thu, 9 Apr 2020 16:46:25 +0000 (17:46 +0100)]
[Feature] Add multiple base32 alphabets for decoding
Vsevolod Stakhov [Thu, 9 Apr 2020 16:15:55 +0000 (17:15 +0100)]
[Minor] Add rfc3548 base32 alphabet
Vsevolod Stakhov [Thu, 9 Apr 2020 16:13:12 +0000 (17:13 +0100)]
[Feature] Support multiple base32 alphabets
Vsevolod Stakhov [Thu, 9 Apr 2020 13:05:48 +0000 (14:05 +0100)]
[Minor] Support gcc static analyzer (from gcc 10)
Vsevolod Stakhov [Wed, 8 Apr 2020 15:23:57 +0000 (16:23 +0100)]
[Minor] Log key id on DKIM failures
Vsevolod Stakhov [Wed, 8 Apr 2020 13:11:55 +0000 (14:11 +0100)]
[Minor] Lua_html: Return empty table if no images are there in html
Vsevolod Stakhov [Wed, 8 Apr 2020 13:09:12 +0000 (14:09 +0100)]
[Project] Process composites separately for each shadow result
Vsevolod Stakhov [Wed, 8 Apr 2020 10:23:30 +0000 (11:23 +0100)]
[Minor] Fix doc string
Vsevolod Stakhov [Wed, 8 Apr 2020 09:12:21 +0000 (10:12 +0100)]
[Minor] Support flatten attribute in rspamd_config:register_re_selector
Vsevolod Stakhov [Wed, 8 Apr 2020 08:14:01 +0000 (09:14 +0100)]
Merge pull request #3327 from moisseev/patch-3
[Minor] Remove whitespaces
Alexander Moisseev [Wed, 8 Apr 2020 06:02:31 +0000 (09:02 +0300)]
[Minor] Remove whitespaces
Vsevolod Stakhov [Tue, 7 Apr 2020 21:50:26 +0000 (22:50 +0100)]
Merge pull request #3326 from membero/patch-1
[Fix] rbl.lua: Helo Check always skipped
Oliver Dick [Tue, 7 Apr 2020 21:05:29 +0000 (23:05 +0200)]
Fix Helo Check
Vsevolod Stakhov [Tue, 7 Apr 2020 20:37:47 +0000 (21:37 +0100)]
[Minor] Add a small helper function
Vsevolod Stakhov [Tue, 7 Apr 2020 20:22:34 +0000 (21:22 +0100)]
[Project] Rework scan result functions to support shadow results
Vsevolod Stakhov [Tue, 7 Apr 2020 10:17:09 +0000 (11:17 +0100)]
[Minor] Clickhouse: Fix extra columns that are arrays
Vsevolod Stakhov [Mon, 6 Apr 2020 16:09:18 +0000 (17:09 +0100)]
[Minor] Allow to add named results via lua API
Vsevolod Stakhov [Mon, 6 Apr 2020 14:17:54 +0000 (15:17 +0100)]
[Project] Implement symbols insertion in multiple results mode
Vsevolod Stakhov [Mon, 6 Apr 2020 13:28:02 +0000 (14:28 +0100)]
[Project] Add routine to call a generic lua function
Vsevolod Stakhov [Sat, 4 Apr 2020 07:44:19 +0000 (08:44 +0100)]
Merge pull request #3320 from heirecka/fix-build-with-gcc10
[Minor] Cherry-pick a fix for replxx to build with gcc10
Heiko Becker [Fri, 3 Apr 2020 22:15:28 +0000 (00:15 +0200)]
[Minor] Cherry-pick a fix for replxx to build with gcc10
723d9c84869511dfb5e63f5c3d3372ac38114713 in replxx's git.
Building rspamd with gcc10 errors out with "'runtime_error' is not a
member of 'std'" otherwise.
Vsevolod Stakhov [Fri, 3 Apr 2020 19:06:43 +0000 (20:06 +0100)]
Merge pull request #3318 from HeinleinSupport/dkim_signing
[Minor] dkim_signing - fix log messages
Carsten Rosenberg [Fri, 3 Apr 2020 18:56:35 +0000 (20:56 +0200)]
[Minor] dkim_signing - fix log messages
Vsevolod Stakhov [Fri, 3 Apr 2020 10:42:37 +0000 (11:42 +0100)]
[Minor] Add missing cast to satisfy gcc understanding of c++
Vsevolod Stakhov [Fri, 3 Apr 2020 10:37:54 +0000 (11:37 +0100)]
[Minor] Remove strange conversion sources from replxx
Issue: #3317
Vsevolod Stakhov [Fri, 3 Apr 2020 10:13:56 +0000 (11:13 +0100)]
[Project] Start results chain implementation
Vsevolod Stakhov [Thu, 2 Apr 2020 12:58:01 +0000 (13:58 +0100)]
[Fix] Fix headers passing in rspamd_proxy
Vsevolod Stakhov [Thu, 2 Apr 2020 12:14:44 +0000 (13:14 +0100)]
[Minor] Improve http in milter mode error reporting
Vsevolod Stakhov [Wed, 1 Apr 2020 13:58:52 +0000 (14:58 +0100)]
[Minor] Update version to 2.6
Vsevolod Stakhov [Wed, 1 Apr 2020 13:57:55 +0000 (14:57 +0100)]
Release 2.5
* [Conf] Mark Rspamd emailbl as ignore whitelist
* [Conf] RBL: Add missing emails = true option
* [Feature] Add support for scripts in fuzzy storage
* [Feature] Arc: Add whitelisted_signers_map option
* [Feature] Implement hosts file processing
* [Feature] Neural: Introduce classes bias that allows non-equal classes learning
* [Feature] Update libev to 4.33
* [Fix] Another brain damage html standard adoptions
* [Fix] Another fix for brain damaged obs-fws state
* [Fix] Fix flags that caused force_actions failure
* [Fix] Fix logging issue
* [Fix] Fix lua symbols scores registration when config does not define scores
* [Fix] Fix opaque maps logic
* [Fix] Fix parsing of the html tags with no spaces after attributes
* [Fix] Fix some corner cases in urls parsing, add limits
* [Fix] Fix tlds extraction if custom composition rules are used
* [Fix] Fix variables replacement in mempool
* [Fix] Improve base64 detection
* [Fix] Normalize dynamic scores in ANN correctly
* [Fix] Plug memory leak introduced by #3153
* [Fix] Stat_redis_backend: Fix memory leak and simplify learn path
* [Fix] Try hard to deal with ghost workers
* [Fix] metadata_exporter default formatter
* [Rework] Change the way to extract URLs when dealing with alternative parts
* [Rework] Fix various url extraction issues
* [Rework] Re cache: Load compiled hyperscan in the main process as well
* [Rework] Re cache: Load hyperscan early
* [Rework] Rework URL structure: adjust tld part
* [Rework] Rework URL structure: host field
* [Rework] Rework URL structure: more structure optimisations
* [Rework] Rework URL structure: user field
* [Rework] URL: Another update for urls extraction logic
* [Rework] Urls: Improve query urls handling
* [Rework] Urls: adopt html related stuff
* [Rework] Urls: more rework of the urls sets
* [Rework] Urls: process query urls in HTML urls correctly
* [Rework] Urls: rework urls hash structure
* [Rework] Urls: update lua libraries
* [Rework] Use multiple search tries for different url extraction types
Signed-off-by: Vsevolod Stakhov <vsevolod@highsecure.ru>
Vsevolod Stakhov [Tue, 31 Mar 2020 13:38:48 +0000 (14:38 +0100)]
[Minor] Use stack for keep-alive pool
Vsevolod Stakhov [Tue, 31 Mar 2020 12:12:35 +0000 (13:12 +0100)]
[Minor] Show count of workers to be killed
Vsevolod Stakhov [Tue, 31 Mar 2020 11:19:59 +0000 (12:19 +0100)]
[Minor] Check socket error when reusing redis pool connections
Vsevolod Stakhov [Tue, 31 Mar 2020 11:09:24 +0000 (12:09 +0100)]
[Minor] Check for socket error before reusing keep-alive connection
Vsevolod Stakhov [Tue, 31 Mar 2020 10:25:27 +0000 (11:25 +0100)]
[Fix] Another fix for brain damaged obs-fws state
Vsevolod Stakhov [Tue, 31 Mar 2020 10:25:16 +0000 (11:25 +0100)]
[Minor] Try to fix OOB reads
Vsevolod Stakhov [Tue, 31 Mar 2020 09:26:11 +0000 (10:26 +0100)]
Merge pull request #3315 from moisseev/patch-2
[Minor] Add missing CT badness values
Alexander Moisseev [Tue, 31 Mar 2020 06:19:45 +0000 (09:19 +0300)]
[Minor] Add missing CT badness values
Vsevolod Stakhov [Mon, 30 Mar 2020 11:18:58 +0000 (12:18 +0100)]
[Minor] Fix another close/ev_modify race
Vsevolod Stakhov [Mon, 30 Mar 2020 11:18:47 +0000 (12:18 +0100)]
[Minor] Add missing function
Vsevolod Stakhov [Mon, 30 Mar 2020 11:18:22 +0000 (12:18 +0100)]
[Minor] Slghtly improve cmake reporting + use -O0 with full debug
Vsevolod Stakhov [Mon, 30 Mar 2020 11:18:09 +0000 (12:18 +0100)]
[Minor] Fix build with leak sanitizer
Vsevolod Stakhov [Sun, 29 Mar 2020 13:19:22 +0000 (14:19 +0100)]
[Minor] Fix order of objects destruction for http keepalive conns
Vsevolod Stakhov [Sun, 29 Mar 2020 12:10:14 +0000 (13:10 +0100)]
[Minor] Fix double close in rspamc
Vsevolod Stakhov [Sat, 28 Mar 2020 16:37:50 +0000 (16:37 +0000)]
[Minor] Try harder to avoid races on child termination
Vsevolod Stakhov [Thu, 26 Mar 2020 17:59:23 +0000 (17:59 +0000)]
[Minor] Do not use signalfd - it is totally broken in libev
Vsevolod Stakhov [Thu, 26 Mar 2020 17:36:53 +0000 (17:36 +0000)]
[Fix] Try hard to deal with ghost workers
Vsevolod Stakhov [Thu, 26 Mar 2020 17:36:34 +0000 (17:36 +0000)]
[Minor] Do not try to set title on osx: it is totally broken
Vsevolod Stakhov [Thu, 26 Mar 2020 17:05:02 +0000 (17:05 +0000)]
[Minor] Fix usage of signalfd and timerfd
Vsevolod Stakhov [Thu, 26 Mar 2020 15:51:27 +0000 (15:51 +0000)]
[Conf] Mark Rspamd emailbl as ignore whitelist
Vsevolod Stakhov [Thu, 26 Mar 2020 15:50:42 +0000 (15:50 +0000)]
Merge pull request #3309 from ricalfieri/patch-1
Update rbl.conf
Vsevolod Stakhov [Thu, 26 Mar 2020 12:36:31 +0000 (12:36 +0000)]
[Minor] Settings: Fix parsing of the settings map
Vsevolod Stakhov [Thu, 26 Mar 2020 09:45:36 +0000 (09:45 +0000)]
[Minor] Fix return values
Vsevolod Stakhov [Wed, 25 Mar 2020 16:43:52 +0000 (16:43 +0000)]
[Conf] RBL: Add missing emails = true option
Vsevolod Stakhov [Wed, 25 Mar 2020 16:40:36 +0000 (16:40 +0000)]
[Feature] Arc: Add whitelisted_signers_map option
Issue: #3308
Vsevolod Stakhov [Wed, 25 Mar 2020 15:36:14 +0000 (15:36 +0000)]
[Minor] Arc: Improve symbols options format
Riccardo Alfieri [Wed, 25 Mar 2020 13:44:20 +0000 (14:44 +0100)]
Update rbl.conf
MSBL list a lot of gmail dropboxes, but these are being excluded from the checks due to gmail.com being whitelisted. Same happens for other freemail providers.
Ignoring the whitelist in this case should be safe enough.
Vsevolod Stakhov [Wed, 25 Mar 2020 10:19:56 +0000 (10:19 +0000)]
[Minor] Slightly improve ev backend selection
Vsevolod Stakhov [Tue, 24 Mar 2020 16:59:07 +0000 (16:59 +0000)]
[Minor] Disable EVBACKEND_IOURING for now as recommended
Vsevolod Stakhov [Tue, 24 Mar 2020 16:36:43 +0000 (16:36 +0000)]
[Feature] Update libev to 4.33
Changelog: http://cvs.schmorp.de/libev/Changes?pathrev=rel-4_33
Vsevolod Stakhov [Tue, 24 Mar 2020 11:02:13 +0000 (11:02 +0000)]
Merge pull request #3307 from moisseev/patch-1
[WebUI] Fix favicon path
Vsevolod Stakhov [Tue, 24 Mar 2020 10:56:33 +0000 (10:56 +0000)]
[Minor] Add logging
Vsevolod Stakhov [Tue, 24 Mar 2020 10:45:58 +0000 (10:45 +0000)]
[Minor] Add sanity check
Vsevolod Stakhov [Mon, 23 Mar 2020 16:13:45 +0000 (16:13 +0000)]
[Minor] Reduce log noise
Vsevolod Stakhov [Mon, 23 Mar 2020 16:01:28 +0000 (16:01 +0000)]
[Rework] Re cache: Load compiled hyperscan in the main process as well
Vsevolod Stakhov [Mon, 23 Mar 2020 15:34:04 +0000 (15:34 +0000)]
[Rework] Re cache: Load hyperscan early
Vsevolod Stakhov [Mon, 23 Mar 2020 14:50:24 +0000 (14:50 +0000)]
[Rework] URL: Another update for urls extraction logic
URL extraction from HTML parts should look like this:
1. Extract href links
2. Convert HTML to plain text and extract:
a) (http|https|ftp)://foo.bar and www.foo
b) email like strings \bfoo@bar.baz\b .
For all extracted strings check if we have host with a domain from the public suffix.
Vsevolod Stakhov [Mon, 23 Mar 2020 08:29:35 +0000 (08:29 +0000)]
[Minor] Oops, forgot to fill struct field
Alexander Moisseev [Sun, 22 Mar 2020 19:26:17 +0000 (22:26 +0300)]
[WebUI] Fix favicon path
Issue: #3207
Vsevolod Stakhov [Sun, 22 Mar 2020 17:25:32 +0000 (17:25 +0000)]
[Rework] Urls: process query urls in HTML urls correctly
Vsevolod Stakhov [Sun, 22 Mar 2020 13:08:26 +0000 (13:08 +0000)]
[Rework] Urls: Improve query urls handling
Vsevolod Stakhov [Fri, 20 Mar 2020 14:58:21 +0000 (14:58 +0000)]
[Minor] Replace g_abort with abort
Vsevolod Stakhov [Thu, 19 Mar 2020 18:33:16 +0000 (18:33 +0000)]
[Rework] Fix various url extraction issues
Vsevolod Stakhov [Thu, 19 Mar 2020 17:07:33 +0000 (17:07 +0000)]
[Minor] Improve dkim failures logging
Vsevolod Stakhov [Thu, 19 Mar 2020 16:40:51 +0000 (16:40 +0000)]
[Rework] Use multiple search tries for different url extraction types
Vsevolod Stakhov [Thu, 19 Mar 2020 16:06:42 +0000 (16:06 +0000)]
[Rework] Change the way to extract URLs when dealing with alternative parts
Vsevolod Stakhov [Thu, 19 Mar 2020 15:26:45 +0000 (15:26 +0000)]
[Fix] Fix some corner cases in urls parsing, add limits
Vsevolod Stakhov [Thu, 19 Mar 2020 15:26:31 +0000 (15:26 +0000)]
[Minor] Remove UCP from TLD parsing
Vsevolod Stakhov [Thu, 19 Mar 2020 13:37:31 +0000 (13:37 +0000)]
[Minor] Use a more strict pattern for tld lookup
Vsevolod Stakhov [Wed, 18 Mar 2020 15:57:53 +0000 (15:57 +0000)]
[Fix] Fix flags that caused force_actions failure
Issue: #3299
Vsevolod Stakhov [Wed, 18 Mar 2020 10:42:23 +0000 (10:42 +0000)]
[Minor] Fix learning with symbols that have no static scores
Vsevolod Stakhov [Tue, 17 Mar 2020 17:07:31 +0000 (17:07 +0000)]
Merge pull request #3302 from korgoth1/master
[TEST] Force Actions Settings
korgoth1 [Tue, 17 Mar 2020 17:04:47 +0000 (20:04 +0300)]
[TEST] Force Actions Settings
Vsevolod Stakhov [Tue, 17 Mar 2020 15:41:05 +0000 (15:41 +0000)]
[Minor] Implement `hosts` parameter in DNS config
Vsevolod Stakhov [Tue, 17 Mar 2020 15:36:54 +0000 (15:36 +0000)]
[Feature] Implement hosts file processing
Vsevolod Stakhov [Tue, 17 Mar 2020 11:45:57 +0000 (11:45 +0000)]
Merge pull request #3301 from citrin/MISSING_MIME_VERSION
[Minor] Improve MISSING_MIME_VERSION rule
Anton Yuzhaninov [Tue, 17 Mar 2020 11:34:12 +0000 (11:34 +0000)]
[Minor] Improve MISSING_MIME_VERSION rule
Previous condition have a complex condition which prevented adding the
symbol for some MIME messages without MIME-Version header.
Vsevolod Stakhov [Mon, 16 Mar 2020 17:08:07 +0000 (17:08 +0000)]
[Minor] Firther relax href parsing