]> source.dussan.org Git - rspamd.git/log
rspamd.git
3 years ago[Minor] Skip bitcoin address check for very long words 3894/head
Anton Yuzhaninov [Fri, 17 Sep 2021 08:46:32 +0000 (09:46 +0100)]
[Minor]  Skip bitcoin address check for very long words

Exclude very long words (which can be extracted e. g. from some text
attachments) from bitcoin address check to avoid excessive resource
usage.

3 years ago[Minor] One more polishing thing
Vsevolod Stakhov [Thu, 16 Sep 2021 12:47:48 +0000 (13:47 +0100)]
[Minor] One more polishing thing

3 years ago[Minor] Fix unregistration of the context and improve logging
Vsevolod Stakhov [Thu, 16 Sep 2021 12:38:35 +0000 (13:38 +0100)]
[Minor] Fix unregistration of the context and improve logging

3 years ago[Minor] Fix list splice
Vsevolod Stakhov [Thu, 16 Sep 2021 09:34:57 +0000 (10:34 +0100)]
[Minor] Fix list splice

3 years agoMerge pull request #3892 from fatalbanana/friendlier_tests
Vsevolod Stakhov [Wed, 15 Sep 2021 13:05:05 +0000 (14:05 +0100)]
Merge pull request #3892 from fatalbanana/friendlier_tests

[Test] Avoid importing user configuration

3 years ago[Test] Avoid importing user configuration 3892/head
Andrew Lewis [Wed, 15 Sep 2021 11:31:44 +0000 (13:31 +0200)]
[Test] Avoid importing user configuration

3 years ago[Minor] Add attribute noreturn to start_hs_helper function
Vsevolod Stakhov [Tue, 14 Sep 2021 20:21:07 +0000 (21:21 +0100)]
[Minor] Add attribute noreturn to start_hs_helper function

Suggested by: @citrin

3 years agoMerge pull request #3891 from fatalbanana/doxydown
Vsevolod Stakhov [Tue, 14 Sep 2021 15:35:15 +0000 (16:35 +0100)]
Merge pull request #3891 from fatalbanana/doxydown

[Minor] Update embedded doxydown

3 years ago[Minor] Update embedded doxydown 3891/head
Andrew Lewis [Tue, 14 Sep 2021 14:17:20 +0000 (16:17 +0200)]
[Minor] Update embedded doxydown

 - To fix nested lists

3 years agoMerge pull request #3890 from fatalbanana/docs
Vsevolod Stakhov [Tue, 14 Sep 2021 13:44:07 +0000 (14:44 +0100)]
Merge pull request #3890 from fatalbanana/docs

[Minor] Updates for API documentation

3 years ago[Minor] Updates for API documentation 3890/head
Andrew Lewis [Tue, 14 Sep 2021 13:33:48 +0000 (15:33 +0200)]
[Minor] Updates for API documentation

 - Put nested lists on the correct level
 - Document more symbol type options
 - Try be clearer about dependencies

3 years ago[Minor] One more try to fix the release order
Vsevolod Stakhov [Mon, 13 Sep 2021 15:53:49 +0000 (16:53 +0100)]
[Minor] One more try to fix the release order

3 years ago[Minor] Do not unref what's not been refed
Vsevolod Stakhov [Mon, 13 Sep 2021 15:28:09 +0000 (16:28 +0100)]
[Minor] Do not unref what's not been refed

3 years ago[Minor] Another try to fight with hiredis...
Vsevolod Stakhov [Mon, 13 Sep 2021 14:07:09 +0000 (15:07 +0100)]
[Minor] Another try to fight with hiredis...

3 years ago[Minor] Add one more check for use-after-free prevention
Vsevolod Stakhov [Mon, 13 Sep 2021 13:49:25 +0000 (14:49 +0100)]
[Minor] Add one more check for use-after-free prevention

3 years ago[Minor] Allow to capture upstream object
Vsevolod Stakhov [Mon, 13 Sep 2021 13:40:06 +0000 (14:40 +0100)]
[Minor] Allow to capture upstream object

3 years ago[Minor] Fix deinit order
Vsevolod Stakhov [Mon, 13 Sep 2021 12:16:31 +0000 (13:16 +0100)]
[Minor] Fix deinit order

3 years ago[Minor] Fix redis termination case not being caught by fuzzy redis
Vsevolod Stakhov [Mon, 13 Sep 2021 10:05:24 +0000 (11:05 +0100)]
[Minor] Fix redis termination case not being caught by fuzzy redis

3 years ago[Minor] Fix C++ logging
Vsevolod Stakhov [Mon, 13 Sep 2021 10:00:12 +0000 (11:00 +0100)]
[Minor] Fix C++ logging

3 years ago[Minor] Fix list splice
Vsevolod Stakhov [Mon, 13 Sep 2021 09:51:45 +0000 (10:51 +0100)]
[Minor] Fix list splice

3 years ago[Minor] Redis_pool: Slightly improve style
Vsevolod Stakhov [Sun, 12 Sep 2021 11:39:57 +0000 (12:39 +0100)]
[Minor] Redis_pool: Slightly improve style

3 years ago[Rework] Redis_pool: fix issues found
Vsevolod Stakhov [Sun, 12 Sep 2021 11:27:47 +0000 (12:27 +0100)]
[Rework] Redis_pool: fix issues found

3 years ago[Rework] Further rework of the redis pool
Vsevolod Stakhov [Sat, 11 Sep 2021 19:53:29 +0000 (20:53 +0100)]
[Rework] Further rework of the redis pool

3 years ago[Rework] Start rewriting of the redis pool logic
Vsevolod Stakhov [Sat, 11 Sep 2021 13:30:56 +0000 (14:30 +0100)]
[Rework] Start rewriting of the redis pool logic

3 years ago[Minor] Try to deal with broken CD headers
Vsevolod Stakhov [Fri, 10 Sep 2021 19:18:44 +0000 (20:18 +0100)]
[Minor] Try to deal with broken CD headers

3 years ago[Minor] Remove unused cfg fields
Vsevolod Stakhov [Fri, 10 Sep 2021 15:53:19 +0000 (16:53 +0100)]
[Minor] Remove unused cfg fields

3 years ago[Minor] Store obfuscated subjects in Redis
Vsevolod Stakhov [Thu, 9 Sep 2021 15:39:48 +0000 (16:39 +0100)]
[Minor] Store obfuscated subjects in Redis

Issue: #3886

3 years agoMerge pull request #3889 from arkamar/dep-info
Vsevolod Stakhov [Thu, 9 Sep 2021 14:56:42 +0000 (15:56 +0100)]
Merge pull request #3889 from arkamar/dep-info

Reflect recent doctest version bump in dependency info table

3 years ago[Minor] Add content type to MIME_BAD_ATTACHMET symbol
Vsevolod Stakhov [Thu, 9 Sep 2021 14:52:25 +0000 (15:52 +0100)]
[Minor] Add content type to MIME_BAD_ATTACHMET symbol

3 years agoReflect recent doctest version bump in dependency info table 3889/head
Petr Vaněk [Thu, 9 Sep 2021 14:45:40 +0000 (16:45 +0200)]
Reflect recent doctest version bump in dependency info table

This just bumps the version number of currently bundled doctest library
in dependency info table.

3 years ago[Minor] Update bundled doctest to the latest version
Vsevolod Stakhov [Thu, 9 Sep 2021 09:41:17 +0000 (10:41 +0100)]
[Minor] Update bundled doctest to the latest version

3 years ago[Fix] Fix some complicated case with the closing tags parsing
Vsevolod Stakhov [Wed, 8 Sep 2021 13:45:33 +0000 (14:45 +0100)]
[Fix] Fix some complicated case with the closing tags parsing

3 years ago[Minor] Cleanup metrics output
Vsevolod Stakhov [Wed, 8 Sep 2021 11:26:19 +0000 (12:26 +0100)]
[Minor] Cleanup metrics output

3 years agoMerge pull request #3883 from pdf/fix_openmetrics
Vsevolod Stakhov [Wed, 8 Sep 2021 11:18:40 +0000 (12:18 +0100)]
Merge pull request #3883 from pdf/fix_openmetrics

[Fix] Namespace and add metadata for OpenMetrics, fix interleaving

3 years ago[Fix] Namespace and add metadata for OpenMetrics, fix interleaving 3883/head
Peter Fern [Tue, 7 Sep 2021 23:37:10 +0000 (09:37 +1000)]
[Fix] Namespace and add metadata for OpenMetrics, fix interleaving

3 years ago[Minor] Allow to get invisible content in `rspamadm mime ex`
Vsevolod Stakhov [Tue, 7 Sep 2021 15:35:02 +0000 (16:35 +0100)]
[Minor] Allow to get invisible content in `rspamadm mime ex`

3 years ago[Minor] Allow to get invisible content from html
Vsevolod Stakhov [Tue, 7 Sep 2021 15:34:49 +0000 (16:34 +0100)]
[Minor] Allow to get invisible content from html

3 years ago[Rules] Improve zero font rule
Vsevolod Stakhov [Tue, 7 Sep 2021 14:00:58 +0000 (15:00 +0100)]
[Rules] Improve zero font rule

3 years ago[Rework] Save invisible content to a separate buffer
Vsevolod Stakhov [Tue, 7 Sep 2021 14:00:38 +0000 (15:00 +0100)]
[Rework] Save invisible content to a separate buffer

3 years agoMerge pull request #3880 from fatalbanana/lua_milterheaders
Vsevolod Stakhov [Mon, 6 Sep 2021 10:12:53 +0000 (11:12 +0100)]
Merge pull request #3880 from fatalbanana/lua_milterheaders

Milter_headers: fix x-spamd-bar for plain lua (#3879)

3 years ago[Minor] Another PUC-Rio Lua compatibility fix 3880/head
Andrew Lewis [Mon, 6 Sep 2021 09:17:28 +0000 (11:17 +0200)]
[Minor] Another PUC-Rio Lua compatibility fix

 - Reported by @mebourne

3 years agoMerge pull request #3875 from arkamar/system-doctest
Vsevolod Stakhov [Fri, 3 Sep 2021 15:51:02 +0000 (16:51 +0100)]
Merge pull request #3875 from arkamar/system-doctest

Add SYSTEM_DOCTEST cmake option

3 years ago[Minor] Dmarc_report: Fix template
Vsevolod Stakhov [Fri, 3 Sep 2021 13:33:36 +0000 (14:33 +0100)]
[Minor] Dmarc_report: Fix template

Issue: #3877

3 years ago[Minor] Another fix of the remaining octets logic
Vsevolod Stakhov [Fri, 3 Sep 2021 12:31:32 +0000 (13:31 +0100)]
[Minor] Another fix of the remaining octets logic

3 years ago[Minor] Fix remaining octets logic
Vsevolod Stakhov [Fri, 3 Sep 2021 12:10:59 +0000 (13:10 +0100)]
[Minor] Fix remaining octets logic

3 years ago[Fix] Fix the case when l tag is too small
Vsevolod Stakhov [Fri, 3 Sep 2021 09:09:40 +0000 (10:09 +0100)]
[Fix] Fix the case when l tag is too small

3 years ago[Minor] Fix misused variable
Vsevolod Stakhov [Thu, 2 Sep 2021 13:07:14 +0000 (14:07 +0100)]
[Minor] Fix misused variable

3 years ago[Fix] Preserve SPF top record in the mempool variable
Vsevolod Stakhov [Thu, 2 Sep 2021 12:56:15 +0000 (13:56 +0100)]
[Fix] Preserve SPF top record in the mempool variable

3 years ago[Minor] Fix stupid memory leak
Vsevolod Stakhov [Thu, 2 Sep 2021 12:32:09 +0000 (13:32 +0100)]
[Minor] Fix stupid memory leak

3 years ago[Fix] Plug memory leak in http settings reload
Vsevolod Stakhov [Thu, 2 Sep 2021 10:28:19 +0000 (11:28 +0100)]
[Fix] Plug memory leak in http settings reload

Reverts: d9180d3ac0fac6d0aa12cd33117cb7efc731e2a2

3 years ago[Minor] Explicitly disallow to set settings on top of other settings
Vsevolod Stakhov [Thu, 2 Sep 2021 09:51:59 +0000 (10:51 +0100)]
[Minor] Explicitly disallow to set settings on top of other settings

3 years agoAdd SYSTEM_DOCTEST cmake option 3875/head
Petr Vaněk [Wed, 1 Sep 2021 11:30:56 +0000 (13:30 +0200)]
Add SYSTEM_DOCTEST cmake option

This gives packagers option to use system version of doctest rather than
bundled one. It is disabled by default. Additionally, there is no need
to link rspamd-test-cxx with doctest as it is is single header library.

Main reason for this change is that currently bundled version of
doctest-2.4.5 can't compile with glibc-2.34 [1]. However, this issue was
already fixed in upstream doctest-2.4.6 [2] in commit [3]. With this,
packagers can just bump doctest to fixed version.

[1] https://github.com/onqtam/doctest/issues/473
[2] https://github.com/onqtam/doctest/blob/master/CHANGELOG.md#246-2021-03-22
[3] https://github.com/onqtam/doctest/commit/099d5414e97244ec44cf46b14cd176b3a3dc52e3

3 years agoMerge pull request #3874 from fatalbanana/rspamd_stats_rescore
Vsevolod Stakhov [Wed, 1 Sep 2021 14:38:55 +0000 (15:38 +0100)]
Merge pull request #3874 from fatalbanana/rspamd_stats_rescore

[Minor] rspamd_stats: support rescoring symbols

3 years ago[Minor] rspamd_stats: support rescoring symbols 3874/head
Andrew Lewis [Wed, 1 Sep 2021 11:56:59 +0000 (13:56 +0200)]
[Minor] rspamd_stats: support rescoring symbols

3 years ago[Minor] Fix number of arguments to invoke a lua function
Vsevolod Stakhov [Wed, 1 Sep 2021 14:14:43 +0000 (15:14 +0100)]
[Minor] Fix number of arguments to invoke a lua function

3 years ago[Minor] Plug dtor memory leak (not important)
Vsevolod Stakhov [Wed, 1 Sep 2021 13:52:57 +0000 (14:52 +0100)]
[Minor] Plug dtor memory leak (not important)

3 years ago[Rework] Rework learn and add classify condition
Vsevolod Stakhov [Wed, 1 Sep 2021 13:26:32 +0000 (14:26 +0100)]
[Rework] Rework learn and add classify condition

3 years ago[Minor] Add function to get a lua_reference from a string returning a function
Vsevolod Stakhov [Wed, 1 Sep 2021 12:35:13 +0000 (13:35 +0100)]
[Minor] Add function to get a lua_reference from a string returning a function

3 years agoMerge pull request #3873 from jendis/fix_fuzzy_crash
Vsevolod Stakhov [Tue, 31 Aug 2021 15:44:49 +0000 (16:44 +0100)]
Merge pull request #3873 from jendis/fix_fuzzy_crash

[Fix] src/lua/lua_mimepart.c: fix null dereference

3 years ago[Fix] Fix http message flag shift
Vsevolod Stakhov [Tue, 31 Aug 2021 13:25:12 +0000 (14:25 +0100)]
[Fix] Fix http message flag shift

Issue: #3872

3 years ago[Fix] src/lua/lua_mimepart.c: fix null dereference 3873/head
Jan Smutny [Tue, 31 Aug 2021 12:25:23 +0000 (14:25 +0200)]
[Fix] src/lua/lua_mimepart.c: fix null dereference

3 years ago[Fix] Another try to fix references safety
Vsevolod Stakhov [Tue, 31 Aug 2021 12:12:00 +0000 (13:12 +0100)]
[Fix] Another try to fix references safety

Issue: #3871

3 years ago[Fix] Avoid dangling reference
Vsevolod Stakhov [Tue, 31 Aug 2021 10:08:09 +0000 (11:08 +0100)]
[Fix] Avoid dangling reference

Issue: #3871

3 years ago[Fix] Delete the correct pointer type
Vsevolod Stakhov [Mon, 30 Aug 2021 09:23:00 +0000 (10:23 +0100)]
[Fix] Delete the correct pointer type

Issue: #3853

3 years ago[Minor] Fix exit codes usage to POSIX portable EXIT_FAILURE
Vsevolod Stakhov [Sun, 29 Aug 2021 18:59:03 +0000 (19:59 +0100)]
[Minor] Fix exit codes usage to POSIX portable EXIT_FAILURE

3 years ago[Minor] Further priorities adjustment
Vsevolod Stakhov [Sat, 28 Aug 2021 10:19:14 +0000 (11:19 +0100)]
[Minor] Further priorities adjustment

3 years ago[Minor] Fix expressions priorities
Vsevolod Stakhov [Fri, 27 Aug 2021 13:47:31 +0000 (14:47 +0100)]
[Minor] Fix expressions priorities

3 years ago[Minor] Mime_types: Allow application/octet-stream for all extensions
Vsevolod Stakhov [Fri, 27 Aug 2021 12:40:44 +0000 (13:40 +0100)]
[Minor] Mime_types: Allow application/octet-stream for all extensions

3 years ago[Minor] Lua_compression: Add support of the compression level for gzip
Vsevolod Stakhov [Thu, 26 Aug 2021 15:08:28 +0000 (16:08 +0100)]
[Minor] Lua_compression: Add support of the compression level for gzip

3 years agoMerge pull request #3866 from HeinleinSupport/lua_scanners/common
Vsevolod Stakhov [Thu, 26 Aug 2021 09:23:10 +0000 (10:23 +0100)]
Merge pull request #3866 from HeinleinSupport/lua_scanners/common

[Fix] lua_scanners - message_min_words logic

3 years ago[Fix] lua_scanners - message_min_words logic 3866/head
Carsten Rosenberg [Wed, 25 Aug 2021 17:14:39 +0000 (19:14 +0200)]
[Fix] lua_scanners - message_min_words logic

3 years ago[Minor] Store multiple base tags (but use only first one as usually)
Vsevolod Stakhov [Wed, 25 Aug 2021 16:37:21 +0000 (17:37 +0100)]
[Minor] Store multiple base tags (but use only first one as usually)

3 years ago[Minor] Fix small href values with a base urls presented
Vsevolod Stakhov [Wed, 25 Aug 2021 16:32:58 +0000 (17:32 +0100)]
[Minor] Fix small href values with a base urls presented

3 years ago[Minor] Fix match_limit in pcre2 code
Vsevolod Stakhov [Wed, 25 Aug 2021 16:12:28 +0000 (17:12 +0100)]
[Minor] Fix match_limit in pcre2 code

3 years ago[Fix] Add concept of uncancellable events to prevent use-after-free
Vsevolod Stakhov [Wed, 25 Aug 2021 15:41:47 +0000 (16:41 +0100)]
[Fix] Add concept of uncancellable events to prevent use-after-free

3 years agoMerge pull request #3863 from CrawX/aarch64-luajit-fixes
Vsevolod Stakhov [Wed, 25 Aug 2021 11:11:58 +0000 (12:11 +0100)]
Merge pull request #3863 from CrawX/aarch64-luajit-fixes

[Fix] Remove aarch64 GC64 workaround

3 years ago[Fix] Remove aarch64 GC64 workaround 3863/head
CruX [Sun, 29 Nov 2020 12:46:22 +0000 (13:46 +0100)]
[Fix] Remove aarch64 GC64 workaround

luajit contains full support for lightuserdata on aarch64 in newest 2.1 versions

3 years ago[Minor] Save 8 bytes in rspamd_regexp_t
Vsevolod Stakhov [Tue, 24 Aug 2021 15:30:34 +0000 (16:30 +0100)]
[Minor] Save 8 bytes in rspamd_regexp_t

3 years ago[Minor] Fix build
Vsevolod Stakhov [Tue, 24 Aug 2021 15:21:23 +0000 (16:21 +0100)]
[Minor] Fix build

3 years ago[Minor] Fix match limit feature in regexps
Vsevolod Stakhov [Tue, 24 Aug 2021 15:19:25 +0000 (16:19 +0100)]
[Minor] Fix match limit feature in regexps

3 years ago[Minor] Rework replxx to make in compatible with Rspamd again
Vsevolod Stakhov [Tue, 24 Aug 2021 14:53:32 +0000 (15:53 +0100)]
[Minor] Rework replxx to make in compatible with Rspamd again

3 years ago[Minor] Update replxx library
Vsevolod Stakhov [Tue, 24 Aug 2021 14:47:07 +0000 (15:47 +0100)]
[Minor] Update replxx library

3 years ago[Minor] Configwizard: Fix usage when the config is wrong
Vsevolod Stakhov [Tue, 24 Aug 2021 14:25:02 +0000 (15:25 +0100)]
[Minor] Configwizard: Fix usage when the config is wrong

3 years ago[Minor] Lua_magic: Add another spammy JS pattern
Vsevolod Stakhov [Tue, 24 Aug 2021 12:24:53 +0000 (13:24 +0100)]
[Minor] Lua_magic: Add another spammy JS pattern

3 years ago[Minor] Pet luacheck
Vsevolod Stakhov [Tue, 24 Aug 2021 09:53:27 +0000 (10:53 +0100)]
[Minor] Pet luacheck

3 years ago[Minor] Detect logger's debug level in lua debug utilities
Vsevolod Stakhov [Tue, 24 Aug 2021 09:45:38 +0000 (10:45 +0100)]
[Minor] Detect logger's debug level in lua debug utilities

3 years ago[Minor] Allow to get logger level
Vsevolod Stakhov [Tue, 24 Aug 2021 09:40:56 +0000 (10:40 +0100)]
[Minor] Allow to get logger level

3 years ago[Fix] Spf: Do not parse non TXT DNS replies as TXT replies
Vsevolod Stakhov [Mon, 23 Aug 2021 13:12:40 +0000 (14:12 +0100)]
[Fix] Spf: Do not parse non TXT DNS replies as TXT replies

3 years ago[Minor] Rdns: One more sanity check added
Vsevolod Stakhov [Mon, 23 Aug 2021 13:10:01 +0000 (14:10 +0100)]
[Minor] Rdns: One more sanity check added

3 years agoMerge pull request #3854 from sebastianlipponer/master
Vsevolod Stakhov [Mon, 23 Aug 2021 09:19:43 +0000 (10:19 +0100)]
Merge pull request #3854 from sebastianlipponer/master

Regexp: Extend UNITEDINTERNET_SPAM upstream spam filter regexp

3 years ago[Fix] Another rework of the ucl hashing
Vsevolod Stakhov [Mon, 23 Aug 2021 09:10:33 +0000 (10:10 +0100)]
[Fix] Another rework of the ucl hashing

3 years ago[Fix] Libucl: Fix deletion from ucl objects
Vsevolod Stakhov [Sun, 22 Aug 2021 17:23:31 +0000 (18:23 +0100)]
[Fix] Libucl: Fix deletion from ucl objects

3 years agoMerge pull request #3855 from arkamar/libfmt
Vsevolod Stakhov [Sat, 21 Aug 2021 10:52:26 +0000 (11:52 +0100)]
Merge pull request #3855 from arkamar/libfmt

Add SYSTEM_FMT cmake option

3 years agoAdd SYSTEM_FMT cmake option 3855/head
Petr Vaněk [Sat, 21 Aug 2021 09:24:35 +0000 (11:24 +0200)]
Add SYSTEM_FMT cmake option

This gives packagers option to use system version of fmt rather than
bundled one. It is disabled by default.

3 years ago[Minor] Regexp: Extend upstream spam filter regexp 3854/head
Sebastian Lipponer [Sat, 21 Aug 2021 09:37:00 +0000 (11:37 +0200)]
[Minor] Regexp: Extend upstream spam filter regexp

3 years ago[Minor] Update version to 3.1
Vsevolod Stakhov [Fri, 20 Aug 2021 17:52:24 +0000 (18:52 +0100)]
[Minor] Update version to 3.1

3 years agoMerge pull request #3852 from tomop-tg/lua54
Vsevolod Stakhov [Fri, 20 Aug 2021 17:52:03 +0000 (18:52 +0100)]
Merge pull request #3852 from tomop-tg/lua54

fix compatibility with lua-5.4

3 years agofix compatibility with lua-5.4 3852/head
Tomohiro "Tomo-p" KATO [Mon, 15 Feb 2021 15:29:59 +0000 (00:29 +0900)]
fix compatibility with lua-5.4

3 years agoRelease 3.0 3.0
Vsevolod Stakhov [Thu, 19 Aug 2021 10:02:46 +0000 (11:02 +0100)]
Release 3.0

* [Conf] Align ARC scores with DKIM scores
* [CritFix] Neural: Fix sorting application
* [Feature] Add a simple dumper for bayes tokens
* [Feature] Add lua_maps.fill_config_maps function
* [Feature] Add preliminary exporter to AWS S3
* [Feature] Add preliminary restore bayes support
* [Feature] Add race condition protection against hs_helper restarts
* [Feature] Add rspamd_utf8_strcmp utility
* [Feature] Add zstd streaming API
* [Feature] Allow to log severity level explicitly
* [Feature] Allow to save and show attachment name when inserting AV scan results
* [Feature] Allow to sort urls for Lua
* [Feature] Allow to specify different timeouts/retransmits for fuzzy rules
* [Feature] Aws_s3: Allow to compress data stored
* [Feature] CMakeLists.txt: Change check and run-test to use rspamd-test-cxx * fixes #3807
* [Feature] Dmarc_report: allow sending reports in batches
* [Feature] Fuzzy_check: Allow to disable subject when making short text hash
* [Feature] Lua_cryptobox: Add keyed ssl hash functions via HMAC
* [Feature] Lua_task: Add get_urls_filtered method
* [Feature] Make monitored checks less frequent
* [Feature] Milter_headers: Add x-rspamd-pre-result header
* [Feature] Neural: Allow to balance FP/FN for the network
* [Feature] Ppopagate monitored errors from rbl module
* [Feature] Pyzor calculate score dynamically Count - WL-Count of default_score in percent
* [Feature] Rbl: Distinguish flattened and non-flattened selectors in RBL requests
* [Feature] Re-add pyzor support
* [Feature] Settings: add ip_map check and rework structure slightly
* [Feature] Spamassassin: Allow to set the default priority for SA scores
* [Feature] Strip smtp comments from message id
* [Feature] add SYSTEM_ZSTD cmake option To use the system zstd instead on the bundled version
* [Feature] external_relay plugin
* [Feature] rspamadm clickhouse neural_train subcommand
* [Fix] #3400 milter_headers: fix inverted logic for extended_headers_rcpt
* [Fix] ASN: fix _FAIL symbol for when main symbol is disabled
* [Fix] Add a special logic for text part with no text extraction
* [Fix] Add diacritics flag for several eu languages
* [Fix] Another FSM fix to accomodate possibility of multiple consequent ?
* [Fix] Avoid curse of dynamic array referencing
* [Fix] Avoid reinitialising neural settings
* [Fix] Check remain before processing TXT records
* [Fix] Enable error multiplier on http errors
* [Fix] Finally rework parsing entities logic
* [Fix] Fix '==' parsing in the content type attributes parser
* [Fix] Fix IPv6 expansion for SPF macros
* [Fix] Fix Mozilla Message-ID detection
* [Fix] Fix an edge case in BITCOIN_ADDR rule
* [Fix] Fix brain-damaged behaviour when http request has a custom Host header
* [Fix] Fix check of limits in email address parsing
* [Fix] Fix copy&paste error and rework
* [Fix] Fix expressions logic for and/or and float values
* [Fix] Fix fuzzy retransmits
* [Fix] Fix http maps with no or invalid expires data
* [Fix] Fix last quote character parsing in the content-type state machine
* [Fix] Fix normalisation flags propagation
* [Fix] Fix overflow when appending many broken tags
* [Fix] Fix parsing of rfc2047 tokens with '?' inside
* [Fix] Fix phishing flag set
* [Fix] Fix rfc2047 embedded into rfc2231 pieces in special headers
* [Fix] Fix round-robin rotation
* [Fix] Fix searching for symbols
* [Fix] Fix storing of the regexps inside variant
* [Fix] Fix tokenization near exceptions
* [Fix] Fix visibility calculations
* [Fix] Html: Attach inline tags to the structure
* [Fix] Html: Do not treat empty tags as block tags
* [Fix] Ical: Do not extract urls from all flags using merely specific ones
* [Fix] Initialise symcache even if it cannot be loaded properly
* [Fix] Lua_fuzzy: Remove text parts check when checking image dimensions
* [Fix] Lua_maps: Fix adjustments for the map type in the complex map definitions
* [Fix] Lua_task: Fix deleted symbols in has_symbol/get_symbol
* [Fix] Move metric and symcache link from validation to the init stage
* [Fix] Oletools: Another try to fix table sorting
* [Fix] One more default behaviour fix
* [Fix] Phishing: Rework urls processing
* [Fix] RBL: was missing some config schema
* [Fix] Replies: Fix 'Reply-To' handling in task:get_reply_sender
* [Fix] Rework metrics handling
* [Fix] Save symcache on exit
* [Fix] Selectors: Filter nil elements in lists
* [Fix] Selectors: Properly fix implicit tostring for nils
* [Fix] Try to fix some broken code in DMARC reporting plugin
* [Fix] Urls: Fix processing of html urls when it comes to the flags
* [Fix] Use proper buffer length
* [Fix] Various visibility fixes
* [Fix]: ASN: dns cb func should also return in case of an error
* [Project] Add a simple css rule definition
* [Project] Add css style skeleton
* [Project] Add css syntax (adopted from ebnf)
* [Project] Add css_selectors
* [Project] Add doctest unit testing library
* [Project] Add expected library
* [Project] Add fmt library for simple string ops
* [Project] Add fu2 library to better functions abstractions
* [Project] Add hashing method
* [Project] Add parsers skeleton
* [Project] Add preliminary support of vcard parser
* [Project] Add process exceptions for invisible text
* [Project] Add some methods for css parser
* [Project] Allow static libstdc++
* [Project] Another whitespace hack
* [Project] CSS: Various fixes in the declarations and values parsing
* [Project] Cpp: Add robin-hood hash map library
* [Project] Css: Add AST debug
* [Project] Css: Add colors conversion functions
* [Project] Css: Add dimensions handling
* [Project] Css: Add display value support
* [Project] Css: Add frozen library from https://github.com/serge-sans-paille/frozen/
* [Project] Css: Add opacity support
* [Project] Css: Add parser helpers to simplify debugging
* [Project] Css: Add preliminary stylesheet support
* [Project] Css: Add rules processing functions and tests
* [Project] Css: Add simple selectors unit tests
* [Project] Css: Add some c++ unit tests
* [Project] Css: Add some debug methods
* [Project] Css: Add some debug statements for the css parser
* [Project] Css: Add some logical skeleton for declarations parser
* [Project] Css: Add url/function tokens
* [Project] Css: Allow at rules parsing
* [Project] Css: Declarations parsing logic skeleton
* [Project] Css: Enable conditional css parsing support from the HTML parser
* [Project] Css: Finish generic lexer cases
* [Project] Css: Fix HSL conversion
* [Project] Css: Fix minus parsing
* [Project] Css: Fix parser consumers nesting
* [Project] Css: Fix parsing of the qualified rules
* [Project] Css: Fix rules merging
* [Project] Css: Further fixes to lexer
* [Project] Css: Further steps to parse css colors + rework
* [Project] Css: Further work on parser's methods
* [Project] Css: Implement backlog of css tokens
* [Project] Css: Implement numbers and ident parsers
* [Project] Css: Implement simple css selectors lookup
* [Project] Css: Implement styles merging
* [Project] Css: Make debug strings json like to simplify tests
* [Project] Css: Minor adjustments
* [Project] Css: More meat to the lexer
* [Project] Css: Move some of the tests to the doctest
* [Project] Css: Projected a parser
* [Project] Css: Properties attachment logic
* [Project] Css: Remove ragel from build targets (maybe keep for reference)
* [Project] Css: Rework css block structure
* [Project] Css: Rework flags of css properties
* [Project] Css: Rework tokens structure
* [Project] Css: Several fixes + tests
* [Project] Css: Simplify checks
* [Project] Css: Simplify debug code
* [Project] Css: Start css selectors parsing logic
* [Project] Css: Start semantic parsing for rules
* [Project] Css: Start stylesheet implementation
* [Project] Css: Tidy up lambdas
* [Project] Css: rework tokeniser
* [Project] Dmarc: Add dmarc report tool (WIP)
* [Project] Dmarc: Add munging configuration
* [Project] Dmarc: Add preliminary munging logic
* [Project] Dmarc: Fix header removal
* [Project] Dmarc: Fix munging logic
* [Project] Dmarc: Use full recipient address instead of a domain map
* [Project] Dmarc: Use zlists for dmarc reports
* [Project] Dmarc_report: Add message generation logic
* [Project] Dmarc_report: Add preliminary sending support
* [Project] Fix lua bindings
* [Project] Fix xml/sgml tags processing
* [Project] Handle new modification
* [Project] Html/CSS: Add transform from a CSS rule to html block
* [Project] Html/CSS: Link html and css styles
* [Project] Html/CSS: Switch styles parsing to css parser
* [Project] Html/Css: Fix some issues found
* [Project] Html/Css: Implement visibility rules for a block
* [Project] Html: Add more tests cases and fix some more corner issues
* [Project] Html: Add rows display type support
* [Project] Html: Allow decode entities function to normalise spaces + unit tests
* [Project] Html: Another rework of the tags structure
* [Project] Html: Another try to fix unbalanced cases
* [Project] Html: Fix crossing spans
* [Project] Html: Fix parent propagation
* [Project] Html: Further rework of the html parsing stuff
* [Project] Html: Implement logic for tags pairing
* [Project] Html: Implement rawtext state machine
* [Project] Html: Insert closing tags as well :(
* [Project] Html: More fixes
* [Project] Html: More fixes
* [Project] Html: More spaces logic fixes
* [Project] Html: One more attempt to write text content
* [Project] Html: Replace \0 in html content
* [Project] Html: Rework img/a tags handling
* [Project] Html: Rework propagation method
* [Project] Html: Rework tags placement
* [Project] Html: Rework transparency logic
* [Project] Html: Support 'hidden' attribute
* [Project] Html: Try another approach to append tags content
* [Project] Html: Try to deal with bad unknown tags properly
* [Project] Lua_aws: Add canonicalisation utility
* [Project] Lua_aws: Add function to produce AWS Authorisation header
* [Project] Lua_aws: Implement request signing
* [Project] Lua_mime: Add lua_mime.modify_headers routine
* [Project] Lua_task: Add modify_header method
* [Project] Lua_task: Allow to extract modified headers
* [Project] Make unescape code public for unit testing
* [Project] More fixes for closed tags
* [Project] More fixes to calculations
* [Project] Rework API for the modified headers
* [Project] Rework html visibility rule
* [Project] Skeleton of the css library
* [Project] Start headers modification API structure
* [Project] Start working on AWS Lua API
* [Project] Use lua_mime to modify headers
* [Project] Use modified headers on dkim signing
* [Project] Use string_view to constexpr variant unpacking
* [Rework] Add composites manager concept
* [Rework] Add tags definitions
* [Rework] Allow C code to be compiled with C++ compiler
* [Rework] Clickhouse: Store url flags
* [Rework] Composites: Rewrite the composites logic
* [Rework] Composites: Start rework of the composites framework
* [Rework] Dmarc: Move check policy function to the common utils
* [Rework] Dmarc: Rework reports keys structure
* [Rework] Further work to make html content private
* [Rework] Html/CSS: Remove css C bindings as they are useless now
* [Rework] Html/CSS: Rework Lua bindings
* [Rework] Html/Css: Start rework of the html blocks
* [Rework] Html: Add images processing logic
* [Rework] Html: Add traverse function
* [Rework] Html: Another steps to get rid of gnode
* [Rework] Html: Convert to variant
* [Rework] Html: Deal with the utf_content part
* [Rework] Html: Final rework part for the html processing code
* [Rework] Html: Fix Lua bindings
* [Rework] Html: Forgot to add the internal include
* [Rework] Html: Further html urls rework
* [Rework] Html: Further rework of the tags content extraction
* [Rework] Html: Make parameters as a vector again
* [Rework] Html: Move blocks part
* [Rework] Html: Move images processing stuff
* [Rework] Html: Rework lua bindings
* [Rework] Html: Start html text extraction rework
* [Rework] Html: Start refactoring of the html tags handling
* [Rework] Html: Start removing of GNode stuff
* [Rework] Html: Start rework of the html content structure
* [Rework] Lua_magic: Try to detect text parts with 8bit characters for non-utf8 encodings
* [Rework] Move HTML url functions and rework them
* [Rework] Move and adopt entities handling logic
* [Rework] Move common and rarely used dmarc code to the library
* [Rework] Move compression routines outside of rspamd_util library
* [Rework] Move entities/tags handling
* [Rework] Phishing: Split from redirectors usage
* [Rework] Redesign html blocks propagation logic
* [Rework] Remove tag name string
* [Rework] Rename phished url to a linked url
* [Rework] Reorganize dmarc plugin and remove unsupported reporting code
* [Rework] Reputation: Use more flexible types in get/set functions
* [Rework] Require proper C++ environment for Rspamd build
* [Rework] Rework extended urls output
* [Rework] Rework tags parsing machine
* [Rework] Slightly improve old regexp API
* [Rework] Start conversion of the redis pool code to c++
* [Rework] Try to resolve failed upstreams more agressively
* [Rework] Use C++ utf8 library with unit tests to trim whitespaces
* [Rework] Use C++ version for unicode normalisation
* [Rework] Use C++ version of the lua threads pool
* [Rules] Add raw addresses to MULTIPLE_FROM options
* [Rules] Another fix to HTTP_TO_HTTPS rule
* [Rules] Do not trigger HTML_SHORT_LINK_IMG on external images
* [Rules] Extend FORGED_X_MAILER
* [Rules] Extend OLD_X_MAILER
* [Rules] Fix CTYPE_MIXED_BOGUS for text attachments
* [Rules] Fix FPs for CTYPE_MIXED_BOGUS
* [Rules] Fix HTTP_TO_HTTPS rule
* [Rules] Fix HTTP_TO_HTTPS rule
* [Rules] Fix zerofont rule (partially)
* [Rules] Micro-optimize X_PHP_EVAL
* [Rules] Reduce default weight for R_MISSING_CHARSET

Signed-off-by: Vsevolod Stakhov <vsevolod@highsecure.ru>
3 years ago[Minor] Revert ignoring of the invisible urls by default
Vsevolod Stakhov [Wed, 18 Aug 2021 20:28:46 +0000 (21:28 +0100)]
[Minor] Revert ignoring of the invisible urls by default