]>
source.dussan.org Git - rspamd.git/log
Vsevolod Stakhov [Fri, 17 Apr 2020 09:16:36 +0000 (10:16 +0100)]
[Minor] Allow to adjust symbols without score change
Vsevolod Stakhov [Thu, 16 Apr 2020 20:26:16 +0000 (21:26 +0100)]
Merge pull request #3340 from chkpnt/patch-1
[Conf] Fix wrong comment in options.inc
Vsevolod Stakhov [Thu, 16 Apr 2020 19:57:14 +0000 (20:57 +0100)]
[Minor] Selectors: Add ability to use base32 variants
Gregor Dschung [Thu, 16 Apr 2020 19:55:28 +0000 (21:55 +0200)]
[Conf] Fix wrong comment in options.inc
Vsevolod Stakhov [Thu, 16 Apr 2020 16:27:47 +0000 (17:27 +0100)]
[Minor] Clickhouse: Rework schema upload to make it more resilent
Vsevolod Stakhov [Wed, 15 Apr 2020 14:19:52 +0000 (15:19 +0100)]
[Minor] Try to process images before text part heuristic
Vsevolod Stakhov [Wed, 15 Apr 2020 11:56:52 +0000 (12:56 +0100)]
[Minor] Rspamadm: Add urls --full option
Vsevolod Stakhov [Tue, 14 Apr 2020 15:07:37 +0000 (16:07 +0100)]
[Minor] Allow 'default' to be the default result
Vsevolod Stakhov [Tue, 14 Apr 2020 14:49:41 +0000 (15:49 +0100)]
[Minor] Support shadow results in lua task api
Vsevolod Stakhov [Tue, 14 Apr 2020 14:25:58 +0000 (15:25 +0100)]
[Minor] Lua_task: Add table version and multi-results support for set_pre_result
Vsevolod Stakhov [Tue, 14 Apr 2020 14:25:34 +0000 (15:25 +0100)]
[Minor] Add some missing types and docs to rspamd_lua_parse_table_arguments
Vsevolod Stakhov [Tue, 14 Apr 2020 10:35:52 +0000 (11:35 +0100)]
[Project] Rework some more functions to work with shadow results
Vsevolod Stakhov [Tue, 14 Apr 2020 09:49:26 +0000 (10:49 +0100)]
Merge pull request #3332 from cgzones/compiler_new
Resolve various Compiler warnings
Vsevolod Stakhov [Mon, 13 Apr 2020 14:41:28 +0000 (15:41 +0100)]
[Minor] Correct deflate header detection
Vsevolod Stakhov [Mon, 13 Apr 2020 14:16:15 +0000 (15:16 +0100)]
[Minor] Lua_content: Process xref objects and detect encryption there
Vsevolod Stakhov [Mon, 13 Apr 2020 11:20:32 +0000 (12:20 +0100)]
[Minor] Improve log message for inflate/deflate
Vsevolod Stakhov [Sat, 11 Apr 2020 13:32:00 +0000 (14:32 +0100)]
Merge pull request #3331 from moisseev/patch-3
[Minor] Add image/x-ms-bmp CT
Christian Göttsche [Mon, 6 Apr 2020 14:27:45 +0000 (16:27 +0200)]
[Minor] Explicit specify order of binary operations
../contrib/libev/ev.c: In function ‘ev_io_start’:
../contrib/libev/ev.c:4396:34: warning: suggest parentheses around arithmetic in operand of ‘|’ [-Wparentheses]
4396 | fd_change (EV_A_ fd, w->events & EV__IOFDSET | EV_ANFD_REIFY);
| ~~~~~~~~~~^~~~~~~~~~~~~
Christian Göttsche [Mon, 6 Apr 2020 14:27:44 +0000 (16:27 +0200)]
[Minor] Avoid nested opening comment sequences
../contrib/libev/ev.c: At top level:
../contrib/libev/ev.c:5660:27: warning: "/*" within comment [-Wcomment]
5660 | /* EV_STAT 0x00001000 /* stat data changed */
|
../contrib/libev/ev.c:5661:27: warning: "/*" within comment [-Wcomment]
5661 | /* EV_EMBED 0x00010000 /* embedded event loop needs sweep */
|
Christian Göttsche [Mon, 6 Apr 2020 14:27:42 +0000 (16:27 +0200)]
[Minor] enable Wmissing-format-attribute
Christian Göttsche [Mon, 6 Apr 2020 14:27:41 +0000 (16:27 +0200)]
[Minor] silence warnings about unused function results
GCC does not respect `(void) func()`
Christian Göttsche [Mon, 6 Apr 2020 14:27:39 +0000 (16:27 +0200)]
[Minor] Enable missing_noreturn compiler warning
Christian Göttsche [Mon, 6 Apr 2020 14:27:38 +0000 (16:27 +0200)]
[Minor] Remove unused-but-set variables
../src/libserver/url.c: In function ‘rspamd_url_host_set_add’:
../src/libserver/url.c:3808:11: warning: variable ‘k’ set but not used [-Wunused-but-set-variable]
3808 | khiter_t k;
| ^
../src/lua/lua_task.c: In function ‘lua_task_has_urls’:
../src/lua/lua_task.c:2406:11: warning: variable ‘need_emails’ set but not used [-Wunused-but-set-variable]
2406 | gboolean need_emails = FALSE, ret = FALSE;
| ^~~~~~~~~~~
Christian Göttsche [Mon, 6 Apr 2020 14:27:36 +0000 (16:27 +0200)]
[Minor] Print always IPO status
Christian Göttsche [Mon, 6 Apr 2020 14:27:29 +0000 (16:27 +0200)]
[Minor] move static keyword to beginning of function declarations
In file included from ../src/libserver/logger/logger_file.c:23:
../src/libserver/logger/logger_private.h:106:1: warning: ‘static’ is not at beginning of declaration [-Wold-style-declaration]
106 | const static struct rspamd_logger_funcs file_log_funcs = {
| ^~~~~
../src/libserver/logger/logger_private.h:130:1: warning: ‘static’ is not at beginning of declaration [-Wold-style-declaration]
130 | const static struct rspamd_logger_funcs syslog_log_funcs = {
| ^~~~~
../src/libserver/logger/logger_private.h:154:1: warning: ‘static’ is not at beginning of declaration [-Wold-style-declaration]
154 | const static struct rspamd_logger_funcs console_log_funcs = {
| ^~~~~
Alexander Moisseev [Sat, 11 Apr 2020 06:44:05 +0000 (09:44 +0300)]
[Minor] Add image/x-ms-bmp CT
Vsevolod Stakhov [Fri, 10 Apr 2020 11:45:26 +0000 (12:45 +0100)]
[Test] Fix tests
Vsevolod Stakhov [Fri, 10 Apr 2020 10:44:25 +0000 (11:44 +0100)]
[Minor] Add sanity check for base32 decoding
Vsevolod Stakhov [Fri, 10 Apr 2020 10:38:39 +0000 (11:38 +0100)]
[Feature] Allow multiple base32 encodings in Lua API
Vsevolod Stakhov [Fri, 10 Apr 2020 10:27:08 +0000 (11:27 +0100)]
[Minor] Add helper to get base32 type
Vsevolod Stakhov [Fri, 10 Apr 2020 07:28:11 +0000 (08:28 +0100)]
Merge pull request #3329 from moisseev/patch-3
[Minor] Add application/7z CT
Alexander Moisseev [Fri, 10 Apr 2020 07:06:53 +0000 (10:06 +0300)]
[Minor] Add application/7z CT
Vsevolod Stakhov [Thu, 9 Apr 2020 16:46:25 +0000 (17:46 +0100)]
[Feature] Add multiple base32 alphabets for decoding
Vsevolod Stakhov [Thu, 9 Apr 2020 16:15:55 +0000 (17:15 +0100)]
[Minor] Add rfc3548 base32 alphabet
Vsevolod Stakhov [Thu, 9 Apr 2020 16:13:12 +0000 (17:13 +0100)]
[Feature] Support multiple base32 alphabets
Vsevolod Stakhov [Thu, 9 Apr 2020 13:05:48 +0000 (14:05 +0100)]
[Minor] Support gcc static analyzer (from gcc 10)
Vsevolod Stakhov [Wed, 8 Apr 2020 15:23:57 +0000 (16:23 +0100)]
[Minor] Log key id on DKIM failures
Vsevolod Stakhov [Wed, 8 Apr 2020 13:11:55 +0000 (14:11 +0100)]
[Minor] Lua_html: Return empty table if no images are there in html
Vsevolod Stakhov [Wed, 8 Apr 2020 13:09:12 +0000 (14:09 +0100)]
[Project] Process composites separately for each shadow result
Vsevolod Stakhov [Wed, 8 Apr 2020 10:23:30 +0000 (11:23 +0100)]
[Minor] Fix doc string
Vsevolod Stakhov [Wed, 8 Apr 2020 09:12:21 +0000 (10:12 +0100)]
[Minor] Support flatten attribute in rspamd_config:register_re_selector
Vsevolod Stakhov [Wed, 8 Apr 2020 08:14:01 +0000 (09:14 +0100)]
Merge pull request #3327 from moisseev/patch-3
[Minor] Remove whitespaces
Alexander Moisseev [Wed, 8 Apr 2020 06:02:31 +0000 (09:02 +0300)]
[Minor] Remove whitespaces
Vsevolod Stakhov [Tue, 7 Apr 2020 21:50:26 +0000 (22:50 +0100)]
Merge pull request #3326 from membero/patch-1
[Fix] rbl.lua: Helo Check always skipped
Oliver Dick [Tue, 7 Apr 2020 21:05:29 +0000 (23:05 +0200)]
Fix Helo Check
Vsevolod Stakhov [Tue, 7 Apr 2020 20:37:47 +0000 (21:37 +0100)]
[Minor] Add a small helper function
Vsevolod Stakhov [Tue, 7 Apr 2020 20:22:34 +0000 (21:22 +0100)]
[Project] Rework scan result functions to support shadow results
Vsevolod Stakhov [Tue, 7 Apr 2020 10:17:09 +0000 (11:17 +0100)]
[Minor] Clickhouse: Fix extra columns that are arrays
Vsevolod Stakhov [Mon, 6 Apr 2020 16:09:18 +0000 (17:09 +0100)]
[Minor] Allow to add named results via lua API
Vsevolod Stakhov [Mon, 6 Apr 2020 14:17:54 +0000 (15:17 +0100)]
[Project] Implement symbols insertion in multiple results mode
Vsevolod Stakhov [Mon, 6 Apr 2020 13:28:02 +0000 (14:28 +0100)]
[Project] Add routine to call a generic lua function
Vsevolod Stakhov [Sat, 4 Apr 2020 07:44:19 +0000 (08:44 +0100)]
Merge pull request #3320 from heirecka/fix-build-with-gcc10
[Minor] Cherry-pick a fix for replxx to build with gcc10
Heiko Becker [Fri, 3 Apr 2020 22:15:28 +0000 (00:15 +0200)]
[Minor] Cherry-pick a fix for replxx to build with gcc10
723d9c84869511dfb5e63f5c3d3372ac38114713 in replxx's git.
Building rspamd with gcc10 errors out with "'runtime_error' is not a
member of 'std'" otherwise.
Vsevolod Stakhov [Fri, 3 Apr 2020 19:06:43 +0000 (20:06 +0100)]
Merge pull request #3318 from HeinleinSupport/dkim_signing
[Minor] dkim_signing - fix log messages
Carsten Rosenberg [Fri, 3 Apr 2020 18:56:35 +0000 (20:56 +0200)]
[Minor] dkim_signing - fix log messages
Vsevolod Stakhov [Fri, 3 Apr 2020 10:42:37 +0000 (11:42 +0100)]
[Minor] Add missing cast to satisfy gcc understanding of c++
Vsevolod Stakhov [Fri, 3 Apr 2020 10:37:54 +0000 (11:37 +0100)]
[Minor] Remove strange conversion sources from replxx
Issue: #3317
Vsevolod Stakhov [Fri, 3 Apr 2020 10:13:56 +0000 (11:13 +0100)]
[Project] Start results chain implementation
Vsevolod Stakhov [Thu, 2 Apr 2020 12:58:01 +0000 (13:58 +0100)]
[Fix] Fix headers passing in rspamd_proxy
Vsevolod Stakhov [Thu, 2 Apr 2020 12:14:44 +0000 (13:14 +0100)]
[Minor] Improve http in milter mode error reporting
Vsevolod Stakhov [Wed, 1 Apr 2020 13:58:52 +0000 (14:58 +0100)]
[Minor] Update version to 2.6
Vsevolod Stakhov [Wed, 1 Apr 2020 13:57:55 +0000 (14:57 +0100)]
Release 2.5
* [Conf] Mark Rspamd emailbl as ignore whitelist
* [Conf] RBL: Add missing emails = true option
* [Feature] Add support for scripts in fuzzy storage
* [Feature] Arc: Add whitelisted_signers_map option
* [Feature] Implement hosts file processing
* [Feature] Neural: Introduce classes bias that allows non-equal classes learning
* [Feature] Update libev to 4.33
* [Fix] Another brain damage html standard adoptions
* [Fix] Another fix for brain damaged obs-fws state
* [Fix] Fix flags that caused force_actions failure
* [Fix] Fix logging issue
* [Fix] Fix lua symbols scores registration when config does not define scores
* [Fix] Fix opaque maps logic
* [Fix] Fix parsing of the html tags with no spaces after attributes
* [Fix] Fix some corner cases in urls parsing, add limits
* [Fix] Fix tlds extraction if custom composition rules are used
* [Fix] Fix variables replacement in mempool
* [Fix] Improve base64 detection
* [Fix] Normalize dynamic scores in ANN correctly
* [Fix] Plug memory leak introduced by #3153
* [Fix] Stat_redis_backend: Fix memory leak and simplify learn path
* [Fix] Try hard to deal with ghost workers
* [Fix] metadata_exporter default formatter
* [Rework] Change the way to extract URLs when dealing with alternative parts
* [Rework] Fix various url extraction issues
* [Rework] Re cache: Load compiled hyperscan in the main process as well
* [Rework] Re cache: Load hyperscan early
* [Rework] Rework URL structure: adjust tld part
* [Rework] Rework URL structure: host field
* [Rework] Rework URL structure: more structure optimisations
* [Rework] Rework URL structure: user field
* [Rework] URL: Another update for urls extraction logic
* [Rework] Urls: Improve query urls handling
* [Rework] Urls: adopt html related stuff
* [Rework] Urls: more rework of the urls sets
* [Rework] Urls: process query urls in HTML urls correctly
* [Rework] Urls: rework urls hash structure
* [Rework] Urls: update lua libraries
* [Rework] Use multiple search tries for different url extraction types
Signed-off-by: Vsevolod Stakhov <vsevolod@highsecure.ru>
Vsevolod Stakhov [Tue, 31 Mar 2020 13:38:48 +0000 (14:38 +0100)]
[Minor] Use stack for keep-alive pool
Vsevolod Stakhov [Tue, 31 Mar 2020 12:12:35 +0000 (13:12 +0100)]
[Minor] Show count of workers to be killed
Vsevolod Stakhov [Tue, 31 Mar 2020 11:19:59 +0000 (12:19 +0100)]
[Minor] Check socket error when reusing redis pool connections
Vsevolod Stakhov [Tue, 31 Mar 2020 11:09:24 +0000 (12:09 +0100)]
[Minor] Check for socket error before reusing keep-alive connection
Vsevolod Stakhov [Tue, 31 Mar 2020 10:25:27 +0000 (11:25 +0100)]
[Fix] Another fix for brain damaged obs-fws state
Vsevolod Stakhov [Tue, 31 Mar 2020 10:25:16 +0000 (11:25 +0100)]
[Minor] Try to fix OOB reads
Vsevolod Stakhov [Tue, 31 Mar 2020 09:26:11 +0000 (10:26 +0100)]
Merge pull request #3315 from moisseev/patch-2
[Minor] Add missing CT badness values
Alexander Moisseev [Tue, 31 Mar 2020 06:19:45 +0000 (09:19 +0300)]
[Minor] Add missing CT badness values
Vsevolod Stakhov [Mon, 30 Mar 2020 11:18:58 +0000 (12:18 +0100)]
[Minor] Fix another close/ev_modify race
Vsevolod Stakhov [Mon, 30 Mar 2020 11:18:47 +0000 (12:18 +0100)]
[Minor] Add missing function
Vsevolod Stakhov [Mon, 30 Mar 2020 11:18:22 +0000 (12:18 +0100)]
[Minor] Slghtly improve cmake reporting + use -O0 with full debug
Vsevolod Stakhov [Mon, 30 Mar 2020 11:18:09 +0000 (12:18 +0100)]
[Minor] Fix build with leak sanitizer
Vsevolod Stakhov [Sun, 29 Mar 2020 13:19:22 +0000 (14:19 +0100)]
[Minor] Fix order of objects destruction for http keepalive conns
Vsevolod Stakhov [Sun, 29 Mar 2020 12:10:14 +0000 (13:10 +0100)]
[Minor] Fix double close in rspamc
Vsevolod Stakhov [Sat, 28 Mar 2020 16:37:50 +0000 (16:37 +0000)]
[Minor] Try harder to avoid races on child termination
Vsevolod Stakhov [Thu, 26 Mar 2020 17:59:23 +0000 (17:59 +0000)]
[Minor] Do not use signalfd - it is totally broken in libev
Vsevolod Stakhov [Thu, 26 Mar 2020 17:36:53 +0000 (17:36 +0000)]
[Fix] Try hard to deal with ghost workers
Vsevolod Stakhov [Thu, 26 Mar 2020 17:36:34 +0000 (17:36 +0000)]
[Minor] Do not try to set title on osx: it is totally broken
Vsevolod Stakhov [Thu, 26 Mar 2020 17:05:02 +0000 (17:05 +0000)]
[Minor] Fix usage of signalfd and timerfd
Vsevolod Stakhov [Thu, 26 Mar 2020 15:51:27 +0000 (15:51 +0000)]
[Conf] Mark Rspamd emailbl as ignore whitelist
Vsevolod Stakhov [Thu, 26 Mar 2020 15:50:42 +0000 (15:50 +0000)]
Merge pull request #3309 from ricalfieri/patch-1
Update rbl.conf
Vsevolod Stakhov [Thu, 26 Mar 2020 12:36:31 +0000 (12:36 +0000)]
[Minor] Settings: Fix parsing of the settings map
Vsevolod Stakhov [Thu, 26 Mar 2020 09:45:36 +0000 (09:45 +0000)]
[Minor] Fix return values
Vsevolod Stakhov [Wed, 25 Mar 2020 16:43:52 +0000 (16:43 +0000)]
[Conf] RBL: Add missing emails = true option
Vsevolod Stakhov [Wed, 25 Mar 2020 16:40:36 +0000 (16:40 +0000)]
[Feature] Arc: Add whitelisted_signers_map option
Issue: #3308
Vsevolod Stakhov [Wed, 25 Mar 2020 15:36:14 +0000 (15:36 +0000)]
[Minor] Arc: Improve symbols options format
Riccardo Alfieri [Wed, 25 Mar 2020 13:44:20 +0000 (14:44 +0100)]
Update rbl.conf
MSBL list a lot of gmail dropboxes, but these are being excluded from the checks due to gmail.com being whitelisted. Same happens for other freemail providers.
Ignoring the whitelist in this case should be safe enough.
Vsevolod Stakhov [Wed, 25 Mar 2020 10:19:56 +0000 (10:19 +0000)]
[Minor] Slightly improve ev backend selection
Vsevolod Stakhov [Tue, 24 Mar 2020 16:59:07 +0000 (16:59 +0000)]
[Minor] Disable EVBACKEND_IOURING for now as recommended
Vsevolod Stakhov [Tue, 24 Mar 2020 16:36:43 +0000 (16:36 +0000)]
[Feature] Update libev to 4.33
Changelog: http://cvs.schmorp.de/libev/Changes?pathrev=rel-4_33
Vsevolod Stakhov [Tue, 24 Mar 2020 11:02:13 +0000 (11:02 +0000)]
Merge pull request #3307 from moisseev/patch-1
[WebUI] Fix favicon path
Vsevolod Stakhov [Tue, 24 Mar 2020 10:56:33 +0000 (10:56 +0000)]
[Minor] Add logging
Vsevolod Stakhov [Tue, 24 Mar 2020 10:45:58 +0000 (10:45 +0000)]
[Minor] Add sanity check
Vsevolod Stakhov [Mon, 23 Mar 2020 16:13:45 +0000 (16:13 +0000)]
[Minor] Reduce log noise
Vsevolod Stakhov [Mon, 23 Mar 2020 16:01:28 +0000 (16:01 +0000)]
[Rework] Re cache: Load compiled hyperscan in the main process as well
Vsevolod Stakhov [Mon, 23 Mar 2020 15:34:04 +0000 (15:34 +0000)]
[Rework] Re cache: Load hyperscan early
Vsevolod Stakhov [Mon, 23 Mar 2020 14:50:24 +0000 (14:50 +0000)]
[Rework] URL: Another update for urls extraction logic
URL extraction from HTML parts should look like this:
1. Extract href links
2. Convert HTML to plain text and extract:
a) (http|https|ftp)://foo.bar and www.foo
b) email like strings \bfoo@bar.baz\b .
For all extracted strings check if we have host with a domain from the public suffix.
Vsevolod Stakhov [Mon, 23 Mar 2020 08:29:35 +0000 (08:29 +0000)]
[Minor] Oops, forgot to fill struct field