]>
source.dussan.org Git - rspamd.git/log
Vsevolod Stakhov [Tue, 16 Nov 2021 10:08:06 +0000 (10:08 +0000)]
[Minor] Change error to the notice
With this change, Rspamd will no longer emit error codes on learn condition skipping.
Issue: #3956
Vsevolod Stakhov [Mon, 15 Nov 2021 19:05:48 +0000 (19:05 +0000)]
Merge pull request #3980 from cpragadeesh/roc_implementation
[Feature] Add ROC based threshold estimation for neural network plugin
Vsevolod Stakhov [Mon, 15 Nov 2021 08:44:22 +0000 (08:44 +0000)]
[Minor] Update bundled fmt to 8.0.1
Pragadeesh Chandiran [Mon, 8 Nov 2021 05:13:04 +0000 (00:13 -0500)]
[Feature] Add ROC feature to neural network plugin
Vsevolod Stakhov [Sun, 14 Nov 2021 21:10:03 +0000 (21:10 +0000)]
Revert "[Minor] Disable eslint in CI"
This reverts commit
d970e1e7b4271dc6c852ea65a4aabd214ef9ea63 .
Vsevolod Stakhov [Sun, 14 Nov 2021 21:10:16 +0000 (21:10 +0000)]
Merge pull request #3979 from moisseev/stylelint
[Test] Fix Stylelint
moisseev [Sun, 14 Nov 2021 18:18:58 +0000 (21:18 +0300)]
[Test] Pet Stylelint
moisseev [Sun, 14 Nov 2021 17:39:52 +0000 (20:39 +0300)]
[Test] Add PostCSS syntaxes for embedded styles
(required since Stylelint 14.0.0)
Vsevolod Stakhov [Sun, 14 Nov 2021 12:05:18 +0000 (12:05 +0000)]
Merge pull request #3978 from yasuhirokimura/enable_pcre2_by_default
Enable PCRE2 by default.
Yasuhiro Kimura [Sun, 14 Nov 2021 08:18:09 +0000 (17:18 +0900)]
Enable PCRE2 by default.
There are 2 major versions of the PCRE library, PCRE and PCRE2. Rspamd
supports both and current default is the former. But according to the
web page of PCRE library it has reached its end of life. So change the
default to the latter.
Vsevolod Stakhov [Fri, 12 Nov 2021 21:20:03 +0000 (21:20 +0000)]
Merge pull request #3977 from moisseev/surbl
[Conf] Set one_shot for URIBL rules by default
Vsevolod Stakhov [Fri, 12 Nov 2021 21:18:49 +0000 (21:18 +0000)]
[Minor] Allow headers addition if configured
Vsevolod Stakhov [Fri, 12 Nov 2021 15:59:49 +0000 (15:59 +0000)]
[Minor] Add analysis logging
Vsevolod Stakhov [Fri, 12 Nov 2021 12:27:45 +0000 (12:27 +0000)]
[Minor] Allow to get the maximum message size
Vsevolod Stakhov [Fri, 12 Nov 2021 12:27:01 +0000 (12:27 +0000)]
[Minor] Allow to register preloads for external services
moisseev [Fri, 12 Nov 2021 12:01:58 +0000 (15:01 +0300)]
[Conf] Set one_shot for URIBL rules by default
Vsevolod Stakhov [Fri, 12 Nov 2021 11:56:20 +0000 (11:56 +0000)]
[Minor] Add default score for cloudmark
Vsevolod Stakhov [Fri, 12 Nov 2021 11:16:51 +0000 (11:16 +0000)]
Merge pull request #3976 from moisseev/cloudmark
[Feature] Add support of Cloudmark
moisseev [Fri, 12 Nov 2021 10:36:57 +0000 (13:36 +0300)]
[Feature] Add support of Cloudmark
in the external services plugin
Vsevolod Stakhov [Thu, 11 Nov 2021 12:01:01 +0000 (12:01 +0000)]
Merge pull request #3974 from HeinleinSupport/fix/ratelimit
[Fix] ratelimit - symbol per bucket
Vsevolod Stakhov [Thu, 11 Nov 2021 10:58:06 +0000 (10:58 +0000)]
[Fix] Read file maps if they were not pre-read during preload
Vsevolod Stakhov [Thu, 11 Nov 2021 10:22:01 +0000 (10:22 +0000)]
[Minor] Fix signing with `skip_process` flag
Carsten Rosenberg [Wed, 10 Nov 2021 22:32:32 +0000 (23:32 +0100)]
[Fix] ratelimit - symbol per bucket
Vsevolod Stakhov [Wed, 10 Nov 2021 21:06:29 +0000 (21:06 +0000)]
[Minor] Bimi: Add version to the path
Vsevolod Stakhov [Wed, 10 Nov 2021 11:31:02 +0000 (11:31 +0000)]
[Test] Fix automatic training tests
Vsevolod Stakhov [Tue, 9 Nov 2021 17:06:17 +0000 (17:06 +0000)]
Merge pull request #3969 from HeinleinSupport/fix/lua_cfg_transform
[Fix] lua_cfg_transform - silly break breaks actions
Vsevolod Stakhov [Tue, 9 Nov 2021 17:06:01 +0000 (17:06 +0000)]
Merge pull request #3968 from cpragadeesh/avoid_duplicate_neural_rows
[Minor] Prevent duplicate rows from being inserted into neural trainiā¦
Vsevolod Stakhov [Tue, 9 Nov 2021 17:04:00 +0000 (17:04 +0000)]
Merge pull request #3967 from a16bitsysop/386
[Fix] Further fix for i386 compilation
Vsevolod Stakhov [Tue, 9 Nov 2021 13:23:18 +0000 (13:23 +0000)]
[Minor] Rework fuzzy blocking logic
Vsevolod Stakhov [Tue, 9 Nov 2021 12:29:18 +0000 (12:29 +0000)]
[Minor] Add potential workaround for the race condition
Vsevolod Stakhov [Tue, 9 Nov 2021 08:39:38 +0000 (08:39 +0000)]
[Minor] Add IP information
Carsten Rosenberg [Mon, 8 Nov 2021 19:50:44 +0000 (20:50 +0100)]
[Fix] lua_cfg_transform - silly break break actions
Duncan Bellamy [Sun, 7 Nov 2021 16:02:41 +0000 (16:02 +0000)]
[Fix] Further fix for i386 compilation
Vsevolod Stakhov [Mon, 8 Nov 2021 15:48:51 +0000 (15:48 +0000)]
[Minor] Fix flag name
Vsevolod Stakhov [Mon, 8 Nov 2021 08:41:26 +0000 (08:41 +0000)]
[Minor] Limit x86_64 assembly to x86_64
Issue: #3967
Pragadeesh Chandiran [Mon, 8 Nov 2021 06:33:24 +0000 (01:33 -0500)]
[Minor] Prevent duplicate rows from being inserted into neural training set
Vsevolod Stakhov [Sun, 7 Nov 2021 12:53:53 +0000 (12:53 +0000)]
[Project] BIMI: Fix helper integration issues
Vsevolod Stakhov [Sun, 7 Nov 2021 12:49:50 +0000 (12:49 +0000)]
[Minor] Allow to get a port for a specific upstream
Vsevolod Stakhov [Sun, 7 Nov 2021 12:08:28 +0000 (12:08 +0000)]
Merge pull request #3965 from moisseev/wrap
[WebUI] Wrap long IPv6 addresses
Vsevolod Stakhov [Sat, 6 Nov 2021 14:45:05 +0000 (14:45 +0000)]
[Feature] BIMI: Add preliminary version of the BIMI plugin
Issue: #3935
moisseev [Sat, 6 Nov 2021 12:41:53 +0000 (15:41 +0300)]
[WebUI] Wrap long IPv6 addresses
Vsevolod Stakhov [Sat, 6 Nov 2021 12:16:28 +0000 (12:16 +0000)]
[Fix] Restrict x86_64 assembly to x86_64
Issue: #3934
Vsevolod Stakhov [Fri, 5 Nov 2021 20:50:06 +0000 (20:50 +0000)]
[Minor] Avoid null dereference on error path
Vsevolod Stakhov [Fri, 5 Nov 2021 19:55:04 +0000 (19:55 +0000)]
[Minor] Store newlines type
Vsevolod Stakhov [Fri, 5 Nov 2021 19:44:59 +0000 (19:44 +0000)]
Merge pull request #3964 from bradleydoherty59/configurable-s3-uri
[Config] Allow configurable s3 urls
bradleydoherty59 [Fri, 5 Nov 2021 19:01:12 +0000 (14:01 -0500)]
[Config] Allow configurable s3 urls
Vsevolod Stakhov [Fri, 5 Nov 2021 14:59:37 +0000 (14:59 +0000)]
[Minor] Aws: Use enclosing boundary
Vsevolod Stakhov [Fri, 5 Nov 2021 14:59:14 +0000 (14:59 +0000)]
[Minor] Lua_mimepart: Add `get_enclosing_boundary` method
Vsevolod Stakhov [Fri, 5 Nov 2021 14:24:00 +0000 (14:24 +0000)]
[Minor] Add boundary to the structured representation of the parts
Vsevolod Stakhov [Thu, 4 Nov 2021 20:31:38 +0000 (20:31 +0000)]
[Minor] Pet luacheck
Vsevolod Stakhov [Thu, 4 Nov 2021 20:22:36 +0000 (20:22 +0000)]
Merge pull request #3960 from HeinleinSupport/lua_scanners/icap
lua_scanners/icap
Vsevolod Stakhov [Thu, 4 Nov 2021 20:18:47 +0000 (20:18 +0000)]
Merge pull request #3959 from HeinleinSupport/fix/lua_cfg_transform
[Fix] lua_cfg_transform - actions without score (discard)
Vsevolod Stakhov [Thu, 4 Nov 2021 20:18:07 +0000 (20:18 +0000)]
Merge pull request #3958 from HeinleinSupport/lua_scanners/spamassassin
[Minor] external_services - spamassassin - fix result matching
Vsevolod Stakhov [Thu, 4 Nov 2021 20:14:30 +0000 (20:14 +0000)]
[Test] Add tests for DKIM key record parsing
Issue: #3955
Carsten Rosenberg [Thu, 4 Nov 2021 18:28:48 +0000 (19:28 +0100)]
[Fix] lua_cfg_transform - actions without score (discard)
Carsten Rosenberg [Thu, 4 Nov 2021 17:37:27 +0000 (18:37 +0100)]
[Minor] lua_scanners - icap - restart from scratch on requery / stop early on failed header
Carsten Rosenberg [Thu, 4 Nov 2021 08:38:32 +0000 (09:38 +0100)]
[Minor] lua_scanners - icap - follow Connection header directive
- Kaspersky Scan Engine 2.0 (ICAP) support
Vsevolod Stakhov [Wed, 3 Nov 2021 20:13:32 +0000 (20:13 +0000)]
[Minor] Skip modifying headers for skipped tasks
Vsevolod Stakhov [Tue, 2 Nov 2021 21:24:36 +0000 (21:24 +0000)]
[Fix] Allow spaces in DKIM key records
Issue: #3955
Carsten Rosenberg [Tue, 2 Nov 2021 20:15:53 +0000 (21:15 +0100)]
[Minor] lua_scanners - icap - lua linting
Carsten Rosenberg [Tue, 2 Nov 2021 20:15:03 +0000 (21:15 +0100)]
[Minor] lua_scanners - icap - fix result caching
Carsten Rosenberg [Tue, 2 Nov 2021 20:13:07 +0000 (21:13 +0100)]
[Minor] lua_scanners - icap - use Allow 204 again
Carsten Rosenberg [Tue, 2 Nov 2021 19:09:19 +0000 (20:09 +0100)]
[Minor] lua_scanners - icap - update comments
Carsten Rosenberg [Tue, 2 Nov 2021 18:28:45 +0000 (19:28 +0100)]
[Minor] lua_scanners - icap - analyse HTTP return headers
Vsevolod Stakhov [Mon, 1 Nov 2021 20:31:56 +0000 (20:31 +0000)]
[Minor] Rbl: Minor performance improvement when checking URL flags
Suggested by: @citrin
Carsten Rosenberg [Mon, 1 Nov 2021 17:23:55 +0000 (18:23 +0100)]
[Minor] lua_scanners - icap - add SSL support
Carsten Rosenberg [Mon, 1 Nov 2021 16:38:23 +0000 (17:38 +0100)]
[Minor] lua_scanners - icap - add request / http header support (McAfee Web Gateway support)
Vsevolod Stakhov [Mon, 1 Nov 2021 14:34:54 +0000 (14:34 +0000)]
[Minor] Update version to 3.2
Vsevolod Stakhov [Mon, 1 Nov 2021 14:33:30 +0000 (14:33 +0000)]
Release 3.1
* [Feature] Add junk_threshold for autolearn
* [Feature] Add neural test command
* [Feature] Antivirus: Allow to set fake eicar patterns for testing AV engines
* [Feature] Lua_cdb: Add cdb building interface
* [Feature] Ratelimit: Add per bucket configurations
* [Feature] S3: Allow to store structured data in messagepack
* [Fix] Add concept of uncancellable events to prevent use-after-free
* [Fix] Add temporary guard to prevent linked list exploitation
* [Fix] Another rework of the ucl hashing
* [Fix] Another try to fix references safety
* [Fix] Another try to fix rspamd_text passing in the selectors
* [Fix] Avoid copy for received structure as it has raw C pointers
* [Fix] Avoid dangling reference
* [Fix] Correctly check numeric URLs in URL DNS lists
* [Fix] Delete the correct pointer type
* [Fix] Dmarc: Always lowercase domain
* [Fix] Fix compilation of the hyperscan databases with errors
* [Fix] Fix hash table lookup
* [Fix] Fix http message flag shift
* [Fix] Fix parsing of the from_hostname when it is an IP address
* [Fix] Fix parsing of the unquoted attributes in HTML
* [Fix] Fix passing of rspamd_text in selectors pipelines
* [Fix] Fix rubbish QP sequences decoding
* [Fix] Fix some complicated case with the closing tags parsing
* [Fix] Fix the case when l tag is too small
* [Fix] Html: Fix the case where only bgcolor is explicitly set
* [Fix] Libucl: Fix deletion from ucl objects
* [Fix] Namespace and add metadata for OpenMetrics, fix interleaving
* [Fix] Plug memory leak in http settings reload
* [Fix] Preserve SPF top record in the mempool variable
* [Fix] Remove aarch64 GC64 workaround
* [Fix] Remove bogus G_LIKELY
* [Fix] Spf: Do not parse non TXT DNS replies as TXT replies
* [Fix] Try to use on_connect/on_disconnect callbacks to handle internal Redis failures
* [Fix] buffer overflow in rspamc counters
* [Fix] fix static building
* [Fix] lua_scanners - message_min_words logic
* [Fix] src/lua/lua_mimepart.c: fix null dereference
* [Project] Add constant iterators
* [Project] Add helper library to handle mime strings in a more safe matter
* [Project] Add preliminary support of CDB bayes dump
* [Project] Add trim operations
* [Project] Allow mempool allocated mime strings
* [Project] Cdb: Finish backend implementation
* [Project] Cdb: Fix configuration load
* [Project] Cdb: Use shared data between cdb statfiles
* [Project] Cdb: continue statistics backend implementation
* [Project] Finish received headers rework part
* [Project] Move C++ specific declarations to C++ header
* [Project] Rework received headers parsing to C++
* [Project] Start using of the new received structure
* [Project] Start work on cdb backend
* [Rework] Further rework of the redis pool
* [Rework] Redis_pool: fix issues found
* [Rework] Rework learn and add classify condition
* [Rework] Save invisible content to a separate buffer
* [Rework] Start rewriting of the redis pool logic
* [Rules] Improve zero font rule
Signed-off-by: Vsevolod Stakhov <vsevolod@highsecure.ru>
Vsevolod Stakhov [Sat, 30 Oct 2021 20:11:32 +0000 (21:11 +0100)]
[Minor] Use explicit return type
Issue: #3893
Vsevolod Stakhov [Thu, 28 Oct 2021 20:31:34 +0000 (21:31 +0100)]
[Minor] Fix FP with JFIF files
Issue: #3947
Vsevolod Stakhov [Wed, 27 Oct 2021 20:02:38 +0000 (21:02 +0100)]
[Minor] Clickhouse: Try to deal with clock skew in retention logic
Vsevolod Stakhov [Tue, 26 Oct 2021 13:53:33 +0000 (14:53 +0100)]
[Minor] Unify set_pre_result invocations
Vsevolod Stakhov [Mon, 25 Oct 2021 18:48:02 +0000 (19:48 +0100)]
[Minor] Another try...
Vsevolod Stakhov [Mon, 25 Oct 2021 18:44:51 +0000 (19:44 +0100)]
[Minor] Disable eslint in CI
It is broken and I don't know how to fix it.
Vsevolod Stakhov [Mon, 25 Oct 2021 18:43:26 +0000 (19:43 +0100)]
[Minor] Try to fix bloody eslint
Vsevolod Stakhov [Mon, 25 Oct 2021 18:10:20 +0000 (19:10 +0100)]
[Fix] Correctly check numeric URLs in URL DNS lists
Issue: #3948
Vsevolod Stakhov [Sun, 24 Oct 2021 20:16:07 +0000 (21:16 +0100)]
Merge pull request #3943 from cpragadeesh/neuraltest
[Feature] Add neural test command
Vsevolod Stakhov [Sat, 23 Oct 2021 18:36:48 +0000 (19:36 +0100)]
Merge pull request #3936 from dminuoso/add-junk-threshold
[Feature] Add junk_threshold for autolearn
Vsevolod Stakhov [Fri, 22 Oct 2021 18:55:14 +0000 (19:55 +0100)]
Merge pull request #3934 from xtkoba/ArchDep-i386
Support i386 with optimizations
Vsevolod Stakhov [Thu, 21 Oct 2021 14:37:04 +0000 (15:37 +0100)]
[Minor] Agree on types between dump and backend
Vsevolod Stakhov [Thu, 21 Oct 2021 14:17:12 +0000 (15:17 +0100)]
[Minor] Fix several issues found
Vsevolod Stakhov [Thu, 21 Oct 2021 13:55:19 +0000 (14:55 +0100)]
[Minor] Fix log objects for C++
Vsevolod Stakhov [Thu, 21 Oct 2021 13:51:42 +0000 (14:51 +0100)]
[Minor] Support read only backends for stats
Vsevolod Stakhov [Thu, 21 Oct 2021 08:46:10 +0000 (09:46 +0100)]
[Minor] Add explicit cast
Vsevolod Stakhov [Wed, 20 Oct 2021 13:54:01 +0000 (14:54 +0100)]
[Minor] Add a hack to fix termination race condition
Vsevolod Stakhov [Wed, 20 Oct 2021 10:31:16 +0000 (11:31 +0100)]
[Project] Add preliminary support of CDB bayes dump
Vsevolod Stakhov [Wed, 20 Oct 2021 10:08:05 +0000 (11:08 +0100)]
[Minor] Lua_cdb: Allow to use more data types as cdb keys/values
Vsevolod Stakhov [Wed, 20 Oct 2021 09:42:26 +0000 (10:42 +0100)]
[Minor] Save int64 as lua_Integer not lua_Number
Vsevolod Stakhov [Wed, 20 Oct 2021 09:38:55 +0000 (10:38 +0100)]
[Minor] Add helpers to work with boxed int64 numbers
Vsevolod Stakhov [Wed, 20 Oct 2021 09:38:34 +0000 (10:38 +0100)]
[Minor] Add helper to convert a string to a uint64 number
Vsevolod Stakhov [Wed, 20 Oct 2021 09:03:37 +0000 (10:03 +0100)]
[Minor] Release redis pool after Lua state has been destroyed
Vsevolod Stakhov [Tue, 19 Oct 2021 19:51:30 +0000 (20:51 +0100)]
[Minor] Add documentation for lua cdb module
Vsevolod Stakhov [Tue, 19 Oct 2021 16:53:20 +0000 (17:53 +0100)]
[Minor] Lua_cdb: Avoid extra copy on lookup
Vsevolod Stakhov [Tue, 19 Oct 2021 16:49:34 +0000 (17:49 +0100)]
[Feature] Lua_cdb: Add cdb building interface
Vsevolod Stakhov [Tue, 19 Oct 2021 14:54:45 +0000 (15:54 +0100)]
[Minor] Close fd
Vsevolod Stakhov [Tue, 19 Oct 2021 10:54:34 +0000 (11:54 +0100)]
[Project] Cdb: Finish backend implementation
Vsevolod Stakhov [Tue, 19 Oct 2021 10:44:46 +0000 (11:44 +0100)]
[Project] Cdb: Fix configuration load
Vsevolod Stakhov [Tue, 19 Oct 2021 10:39:00 +0000 (11:39 +0100)]
[Project] Cdb: Use shared data between cdb statfiles
Vsevolod Stakhov [Tue, 19 Oct 2021 08:53:33 +0000 (09:53 +0100)]
[Project] Cdb: continue statistics backend implementation