]>
source.dussan.org Git - rspamd.git/log
Stathis Xantinidis [Mon, 3 Jun 2024 17:07:16 +0000 (17:07 +0000)]
Updated broken quickstart url
it was 404ring
Vsevolod Stakhov [Mon, 3 Jun 2024 10:30:16 +0000 (16:30 +0600)]
Merge pull request #4987 from twesterhever/temp-txz
[Minor] Treat *.txz attachments as archives and harmful
Ivan Stakhov [Mon, 3 Jun 2024 10:29:11 +0000 (15:29 +0500)]
Upgraded replies and known senders modules (#4895)
* Made the individual replies_set for senders and their recipients.
Made the global replies_set for verified recipients.
* Made the individual replies_set for senders and their recipients.
Made the global replies_set for verified recipients.
* FIXED. Made the individual replies_set for senders and their recipients.
Made the global replies_set for verified recipients.
* Made the individual replies_set for senders and their recipients.
Made the global replies_set for verified recipients.
* Added pre-test for replies set
* Update functional of replies_set
* Few changes to replies and added check for incoming mail
* Few changes in known_senders in check_known_incoming_mail_callback
* Few changes in known_senders and replies
* An attempt to write test(not tested)
* Clean up
* Clean up
* Clean up
* Added tests for replies and known_senders (all tests failed, debug required)
* Moved replies test to the 001_merged
* Cleared up code
* Few changes to replies
* Small changes in score of CHECK_INC_MAIL symbol
* Small debug in known_senders
* Plugin known_senders is fully working
* Troubleshooting replies module
* Changed symbol for check_known_incoming_mail_callback
* Added test for failed incoming mail check
* Little rework
* Rewritten test for more appropriate
* Rewritten tests for replies module. All test passed(debugging not adding to global set)
* Debugged replies module
* Replies module works and tested(needs performance improvements)
* Cleaned up code
* Improved readability and cleaned up code
* Connected auth back(Tests not working, needs user)
* Added test for incoming mail check in known senders module
* Debugged. Works normally(tested, needs to add user)
* Debug + clean up. Tested. Works. User auth required for tests
* Improved performance
* Small changes
* Changed adding to global replies set logic + improved logs messaging
* Added authenticated user to tests
* Cleaned up
* Made a few changes according to the comments on pull request
* [Rework] Added removal of extra senders and recipients in global and local replies sets
* [Minor] Small cleanup
* [Minor] Cleaned up code
* [Fix] Fixed call of incorrect function when making key
* [Rework] Reworked scripts. Added ZADD redis call for local and global replies set
* [Minor] Cleaned up code
* [Fix] Improved performance and eliminated unnecessary invocations
* [Minor] Reassigned script ids
* [Feature] Made a check for local set
* [Fix] Upgraded tests for known senders
* [Fix] Upgraded tests for known senders
* [Fix] Fixed performance of verification of local replies set
* [Minor] Cleaned up code
* [Feature] Added new test to the known_senders tests
* [Test] Ubuntu test
* [Fix] Fixing local replies test check
* [Fix] Fixed code for local replies set check(was not working in previous versions of redis)
* [Fix] Reorganized code to more convenient style and made better loading for scripts
* [Minor] Code has been rewritten in a more appropriate format
* [Minor] Fixed debug messaging
* [Fix] Reworked expiration of replies sets
* [Minor] Upgrade code style
* [Fix] Small fix
* [Feature] Change LFU logic of global replies set to LRU logic
* Made the individual replies_set for senders and their recipients.
Made the global replies_set for verified recipients.
* Made the individual replies_set for senders and their recipients.
Made the global replies_set for verified recipients.
* FIXED. Made the individual replies_set for senders and their recipients.
Made the global replies_set for verified recipients.
* Made the individual replies_set for senders and their recipients.
Made the global replies_set for verified recipients.
* Added pre-test for replies set
* Update functional of replies_set
* Few changes to replies and added check for incoming mail
* Few changes in known_senders in check_known_incoming_mail_callback
* Few changes in known_senders and replies
* An attempt to write test(not tested)
* Clean up
* Clean up
* Clean up
* Added tests for replies and known_senders (all tests failed, debug required)
* Moved replies test to the 001_merged
* Cleared up code
* Few changes to replies
* Small changes in score of CHECK_INC_MAIL symbol
* Small debug in known_senders
* Plugin known_senders is fully working
* Troubleshooting replies module
* Changed symbol for check_known_incoming_mail_callback
* Added test for failed incoming mail check
* Little rework
* Rewritten test for more appropriate
* Rewritten tests for replies module. All test passed(debugging not adding to global set)
* Debugged replies module
* Replies module works and tested(needs performance improvements)
* Cleaned up code
* Improved readability and cleaned up code
* Connected auth back(Tests not working, needs user)
* Added test for incoming mail check in known senders module
* Debugged. Works normally(tested, needs to add user)
* Debug + clean up. Tested. Works. User auth required for tests
* Improved performance
* Small changes
* Changed adding to global replies set logic + improved logs messaging
* Added authenticated user to tests
* Cleaned up
* Made a few changes according to the comments on pull request
* [Rework] Added removal of extra senders and recipients in global and local replies sets
* [Minor] Small cleanup
* [Minor] Cleaned up code
* [Fix] Fixed call of incorrect function when making key
* [Rework] Reworked scripts. Added ZADD redis call for local and global replies set
* [Minor] Cleaned up code
* [Fix] Improved performance and eliminated unnecessary invocations
* [Minor] Reassigned script ids
* [Feature] Made a check for local set
* [Fix] Upgraded tests for known senders
* [Fix] Upgraded tests for known senders
* [Fix] Fixed performance of verification of local replies set
* [Minor] Cleaned up code
* [Feature] Added new test to the known_senders tests
* [Test] Ubuntu test
* [Fix] Fixing local replies test check
* [Fix] Fixed code for local replies set check(was not working in previous versions of redis)
* [Fix] Reorganized code to more convenient style and made better loading for scripts
* [Minor] Code has been rewritten in a more appropriate format
* [Minor] Fixed debug messaging
* [Fix] Reworked expiration of replies sets
* [Minor] Upgrade code style
* [Fix] Small fix
* [Feature] Change LFU logic of global replies set to LRU logic
* [Fix] Fix test conflict
* [Minor] Revert rename
* [Minor] Clean up code
* [Fix] Fix commit history
Vsevolod Stakhov [Sun, 2 Jun 2024 15:38:40 +0000 (21:38 +0600)]
Merge pull request #4997 from dragoangel/patch-6
Fix hfilter checks_hello_badip
Dmitriy Alekseev [Fri, 31 May 2024 07:00:33 +0000 (09:00 +0200)]
Fix hfilter checks_hello_badip
Vsevolod Stakhov [Thu, 30 May 2024 14:40:46 +0000 (20:40 +0600)]
Merge pull request #4995 from lucasRolff/master
[Minor] Fix typo in Prometheus helper message for rspamd_ham_total
Lucas Rolff [Thu, 30 May 2024 13:52:04 +0000 (15:52 +0200)]
[Minor] Fix typo in Prometheus helper message for rspamd_ham_total
Vsevolod Stakhov [Wed, 29 May 2024 11:49:02 +0000 (17:49 +0600)]
Merge pull request #4992 from PxPert/master
[FIX] call get_words_count method on the textpart in AV Scan
root [Tue, 28 May 2024 13:00:56 +0000 (15:00 +0200)]
Fix get_words_count method to be called on the textpart and not on the mimepart
Vsevolod Stakhov [Mon, 27 May 2024 14:11:25 +0000 (20:11 +0600)]
Merge pull request #4988 from fatalbanana/test4981
[Test] Test multimap regexp_multi map
Andrew Lewis [Mon, 27 May 2024 11:06:25 +0000 (13:06 +0200)]
[Test] Test multimap regexp_multi map
twesterhever [Mon, 27 May 2024 09:24:50 +0000 (09:24 +0000)]
[Minor] Treat *.txz attachments as archives and harmful
Rationale: https://dshield.org/diary/Files%20with%20TXZ%20extension%20used%20as%20malspam%20attachments/30958
Vsevolod Stakhov [Fri, 24 May 2024 14:34:32 +0000 (15:34 +0100)]
[Fix] Unset autolearn flag if we learn explicitly
Vsevolod Stakhov [Tue, 21 May 2024 13:46:35 +0000 (19:46 +0600)]
Merge pull request #4976 from rspamd/vstakhov-fix-multimap-multisym
Fix multimaps with dynamic symbols
Vsevolod Stakhov [Tue, 21 May 2024 11:20:26 +0000 (17:20 +0600)]
Merge pull request #4967 from ishisora/master
[Minor] Exclude User-Agent: Mozilla Thunderbird from XM_UA_NO_VERSION
ishisora [Tue, 21 May 2024 10:56:48 +0000 (19:56 +0900)]
correct headers.lua
Vsevolod Stakhov [Mon, 20 May 2024 17:57:00 +0000 (18:57 +0100)]
[Fix] Fix dynamic_symbols in the multimap plugin
Vsevolod Stakhov [Mon, 20 May 2024 17:56:38 +0000 (18:56 +0100)]
[Test] Properly test symbols registration
Vsevolod Stakhov [Sun, 19 May 2024 21:32:08 +0000 (03:32 +0600)]
Merge pull request #4975 from rspamd/vstakhov-dkim-l-sanity
Verify `l=` tag in DKIM signatures
Vsevolod Stakhov [Sat, 18 May 2024 15:01:29 +0000 (16:01 +0100)]
[Minor] Tweak some checks
Vsevolod Stakhov [Sat, 18 May 2024 14:58:29 +0000 (15:58 +0100)]
[Minor] Grr, fix misprint
Vsevolod Stakhov [Sat, 18 May 2024 14:23:57 +0000 (15:23 +0100)]
[Minor] Oops, fix the build
Vsevolod Stakhov [Sat, 18 May 2024 14:20:47 +0000 (15:20 +0100)]
[Feature] Verify sanity of l= tag in DKIM
Vsevolod Stakhov [Sat, 18 May 2024 12:31:52 +0000 (18:31 +0600)]
Merge pull request #4972 from dragoangel/patch-5
Add bayes_expiry.conf to provide ability to set custom settings
Vsevolod Stakhov [Sat, 18 May 2024 12:16:06 +0000 (13:16 +0100)]
[Minor] Use proper typing and allocation logic in kann
Vsevolod Stakhov [Sat, 18 May 2024 11:56:01 +0000 (12:56 +0100)]
[Fix] Allow autolearn for the controller worker
Dmitriy Alekseev [Fri, 17 May 2024 21:18:09 +0000 (23:18 +0200)]
Merge branch 'master' into patch-5
Vsevolod Stakhov [Fri, 17 May 2024 10:56:45 +0000 (16:56 +0600)]
Merge pull request #4973 from rspamd/vstakhov-fix-dmarc-rua
Fix parsing of DMARC records with spaces
Vsevolod Stakhov [Thu, 16 May 2024 15:12:26 +0000 (16:12 +0100)]
[Minor] Oops, fix `for` loop
Vsevolod Stakhov [Thu, 16 May 2024 15:05:59 +0000 (16:05 +0100)]
[Minor] Relax mailto processing with no TLD
Vsevolod Stakhov [Thu, 16 May 2024 15:05:43 +0000 (16:05 +0100)]
[Minor] Improve string splitting
Vsevolod Stakhov [Thu, 16 May 2024 15:05:10 +0000 (16:05 +0100)]
[Fix] Allow spaces in DMARC records
Issue: #4906
Dmitriy Alekseev [Thu, 16 May 2024 14:34:47 +0000 (16:34 +0200)]
Merge branch 'master' into patch-5
Dmitriy Alekseev [Thu, 16 May 2024 14:34:21 +0000 (17:34 +0300)]
Update bayes_expiry.conf
Vsevolod Stakhov [Thu, 16 May 2024 12:44:06 +0000 (18:44 +0600)]
Merge pull request #4965 from rspamd/vstakhov-check-nconns-shutdown
[Fix] Check nconns when firing the final termination event
Dmitriy Alekseev [Wed, 15 May 2024 23:47:18 +0000 (02:47 +0300)]
Create bayes_expiry.conf
Vsevolod Stakhov [Wed, 15 May 2024 14:16:58 +0000 (20:16 +0600)]
Merge pull request #4963 from fatalbanana/debian_fasttext
Revert "[Minor] debian: enable fasttext"
ishisora [Tue, 14 May 2024 12:25:41 +0000 (21:25 +0900)]
Merge branch 'rspamd:master' into master
gami [Tue, 14 May 2024 12:19:30 +0000 (21:19 +0900)]
[Minor] Exclude User-Agent: Mozilla Thunderbird from XM_UA_NO_VERSION
gami [Tue, 14 May 2024 12:15:34 +0000 (21:15 +0900)]
[Minor] Exclude User-Agent: Mozilla Thunderbird from XM_UA_NO_VERSION
Vsevolod Stakhov [Tue, 14 May 2024 08:15:34 +0000 (14:15 +0600)]
Merge pull request #4966 from moisseev/eslint
[Test] Disable @stylistic/multiline-comment-style
moisseev [Mon, 13 May 2024 18:47:16 +0000 (21:47 +0300)]
[Test] Disable @stylistic/multiline-comment-style
Vsevolod Stakhov [Mon, 13 May 2024 18:29:18 +0000 (19:29 +0100)]
[Minor] Make log message less confusing
Vsevolod Stakhov [Mon, 13 May 2024 18:25:59 +0000 (19:25 +0100)]
[Fix] Check nconns when firing the final termination event
Issue: #4941
Andrew Lewis [Mon, 13 May 2024 14:10:06 +0000 (16:10 +0200)]
Revert "[Minor] debian: enable fasttext"
This reverts commit
afe7a39faf6a414f484ca15ff585e785c3da2e2c .
Vsevolod Stakhov [Mon, 13 May 2024 13:05:07 +0000 (19:05 +0600)]
Merge pull request #4961 from fatalbanana/debian_fasttext
Enable fasttext support on debianalikes
Andrew Lewis [Mon, 13 May 2024 11:00:33 +0000 (13:00 +0200)]
[Minor] debian: enable fasttext
Andrew Lewis [Mon, 13 May 2024 10:57:23 +0000 (12:57 +0200)]
[Minor] debian: add libarchive-dev to Build-Depends
Vsevolod Stakhov [Mon, 6 May 2024 09:26:35 +0000 (15:26 +0600)]
Merge pull request #4955 from twesterhever/temp-dnsbl-mid-fix-selector
[Minor] Properly make use of selectors for checking MID RHSs against DNSBLs
twesterhever [Mon, 6 May 2024 06:44:58 +0000 (06:44 +0000)]
[Minor] Properly make use of selectors for checking MID RHSs against DNSBLs
Related to: https://github.com/rspamd/rspamd/pull/4888
Vsevolod Stakhov [Sat, 4 May 2024 07:04:40 +0000 (13:04 +0600)]
Merge pull request #4953 from ikedas/fix_is_uppercase
[Fix] SUBJ_ALL_CAPS is overkill with some unicase scripts
Vsevolod Stakhov [Fri, 3 May 2024 13:34:19 +0000 (19:34 +0600)]
Merge pull request #4954 from moisseev/webui
[Minor] Remove redundant sub-property
moisseev [Fri, 3 May 2024 06:55:56 +0000 (09:55 +0300)]
[Minor] Remove redundant sub-property
IKEDA Soji [Thu, 2 May 2024 13:34:09 +0000 (22:34 +0900)]
SUBJ_ALL_CAPS is overkill
It should consider characters in unicase scripts as being not uppercase.
Vsevolod Stakhov [Thu, 2 May 2024 13:43:32 +0000 (19:43 +0600)]
Merge pull request #4888 from twesterhever/temp-rbl-mid
Implement DNSBL checks for Message-ID RHS
Vsevolod Stakhov [Wed, 1 May 2024 14:26:56 +0000 (20:26 +0600)]
Merge pull request #4950 from twesterhever/temp-cd-message-body
Add Content-Description header rules
twesterhever [Wed, 1 May 2024 08:10:34 +0000 (08:10 +0000)]
[Minor] Constrain Content-Description regexp
twesterhever [Wed, 1 May 2024 08:09:19 +0000 (08:09 +0000)]
[Minor] Remove superflous "string.format()"
Vsevolod Stakhov [Tue, 30 Apr 2024 14:07:58 +0000 (20:07 +0600)]
Merge pull request #4915 from twesterhever/temp-freemail-mdn
Add detection for freemail and disposable e-mail usage for message delivery notification
Vsevolod Stakhov [Mon, 29 Apr 2024 15:21:56 +0000 (16:21 +0100)]
[Fix] Allow to set 0 as number of rows to disable roll history
Issue: #4947
Closes: #4947
Vsevolod Stakhov [Mon, 29 Apr 2024 13:53:57 +0000 (19:53 +0600)]
Merge pull request #4951 from rspamd/vstakhov-langdet-fix
Apply detection phase if fasttext could not detect language
Vsevolod Stakhov [Mon, 29 Apr 2024 13:29:08 +0000 (14:29 +0100)]
[Fix] Fix another corner case that allows candidates to be freed without init
Vsevolod Stakhov [Sun, 28 Apr 2024 21:15:09 +0000 (22:15 +0100)]
[Fix] Apply detection phase if fasttext could not detect language
Issue: #4929
Vsevolod Stakhov [Sun, 28 Apr 2024 20:34:15 +0000 (02:34 +0600)]
Merge pull request #4949 from twesterhever/temp-archive-content
[Minor] Add bad file types commonly found in archives attached to malspam
twesterhever [Sun, 28 Apr 2024 09:44:07 +0000 (09:44 +0000)]
[Enhancement] Catch "Mail message body" Content-Description
This header frequently surfaces in spam, mostly advance fee fraud.
twesterhever [Sun, 28 Apr 2024 09:43:44 +0000 (09:43 +0000)]
[Minor] Add rule for presence of Content-Description header
twesterhever [Sun, 28 Apr 2024 09:06:17 +0000 (09:06 +0000)]
[Minor] Add bad file types commonly found in archives attached to malspam
twesterhever [Sun, 28 Apr 2024 08:43:32 +0000 (08:43 +0000)]
[Minor] Query MID RHS FQDNs against popular DNSBL using selectors
See https://github.com/rspamd/rspamd/pull/4888 for the related
discussion.
twesterhever [Sun, 28 Apr 2024 08:29:32 +0000 (08:29 +0000)]
Revert "[Enhancement] Check Message-ID RHS against popular DNSBLs by default"
This reverts commit
c78c70c76bb7ae8e714ed773037ccce1012dd20f .
twesterhever [Sun, 28 Apr 2024 08:29:23 +0000 (08:29 +0000)]
Revert "[Enhancement] Implement Message-ID RHS checks against DNSBLs"
This reverts commit
5e84a82f8742ed2bcef65859759c0dd14aa9c4ca .
twesterhever [Sun, 24 Mar 2024 16:29:47 +0000 (16:29 +0000)]
[Enhancement] Check Message-ID RHS against popular DNSBLs by default
twesterhever [Sun, 24 Mar 2024 16:29:22 +0000 (16:29 +0000)]
[Enhancement] Implement Message-ID RHS checks against DNSBLs
Vsevolod Stakhov [Fri, 26 Apr 2024 14:16:08 +0000 (20:16 +0600)]
Merge pull request #4914 from twesterhever/temp-rework-injector-composite
Rework composites for spam injected into compromised accounts
Vsevolod Stakhov [Thu, 25 Apr 2024 14:27:24 +0000 (15:27 +0100)]
[Fix] Backport fixes from libucl
Vsevolod Stakhov [Wed, 24 Apr 2024 14:41:45 +0000 (20:41 +0600)]
Merge pull request #4942 from rspamd/vstakhov-fix-base64
Do not read out-of-boundary when doing base64 encoding
Vsevolod Stakhov [Wed, 24 Apr 2024 13:47:17 +0000 (14:47 +0100)]
[Fix] Do not read out-of-boundary when doing base64 encoding
Vsevolod Stakhov [Wed, 24 Apr 2024 08:49:47 +0000 (14:49 +0600)]
Merge pull request #4939 from rspamd/vstakhov-fuzzy-backpressure
Implement backpressure for fuzzy check
Vsevolod Stakhov [Tue, 23 Apr 2024 14:41:29 +0000 (15:41 +0100)]
[Minor] Further normalization
Vsevolod Stakhov [Tue, 23 Apr 2024 14:40:43 +0000 (15:40 +0100)]
[Minor] Jitter backpressure
Vsevolod Stakhov [Tue, 23 Apr 2024 14:37:18 +0000 (15:37 +0100)]
[Project] Implement fuzzy check retransmits backpressure
Vsevolod Stakhov [Tue, 23 Apr 2024 14:04:05 +0000 (15:04 +0100)]
[Minor] Change log logic in fuzzy_check
Vsevolod Stakhov [Tue, 23 Apr 2024 14:03:25 +0000 (15:03 +0100)]
[Minor] Add function to reschedule events at specific timer
Vsevolod Stakhov [Mon, 22 Apr 2024 18:11:54 +0000 (00:11 +0600)]
Merge pull request #4937 from rspamd/vstakhov-control-fixes
Serialize control commands
Vsevolod Stakhov [Mon, 22 Apr 2024 17:42:08 +0000 (18:42 +0100)]
[Minor] Deal with descriptors in the wait queue
Vsevolod Stakhov [Mon, 22 Apr 2024 17:29:11 +0000 (18:29 +0100)]
[Minor] Do not use pointers to local variables, sigh
Vsevolod Stakhov [Mon, 22 Apr 2024 15:00:01 +0000 (16:00 +0100)]
[Minor] Try to fix mess with refcounts
Vsevolod Stakhov [Mon, 22 Apr 2024 14:49:47 +0000 (15:49 +0100)]
[Rework] Serialize control commands
In fact, we cannot send multiple commands and read them through the pipe. It has
caused multiple weird issues in the past but I can now see clearly how it should
be done. We should send commands and serialize all requests pending to let them
being sent one by one, after reply for the previous command has been received.
Vsevolod Stakhov [Mon, 22 Apr 2024 13:45:10 +0000 (19:45 +0600)]
Merge pull request #4935 from moisseev/webui
[Minor] Update Bootstrap
Vsevolod Stakhov [Mon, 22 Apr 2024 13:24:42 +0000 (19:24 +0600)]
Merge pull request #4934 from dragoangel/patch-5
Fix error in headers_checks.lua
moisseev [Sun, 21 Apr 2024 07:26:47 +0000 (10:26 +0300)]
[Minor] Update Bootstrap
Vsevolod Stakhov [Sat, 20 Apr 2024 14:43:20 +0000 (20:43 +0600)]
Merge pull request #4933 from rspamd/vstakhov-utf8-received
Support UTF8 flag for the received headers
Vsevolod Stakhov [Sat, 20 Apr 2024 14:34:11 +0000 (15:34 +0100)]
[Fix] Backport multiple fixes from libucl
Vsevolod Stakhov [Sat, 20 Apr 2024 11:39:12 +0000 (17:39 +0600)]
Merge pull request #4932 from rspamd/vstakhov-fix-bayes-disable
Fix statfile symbols disabling
Dmitriy Alekseev [Fri, 19 Apr 2024 18:33:44 +0000 (21:33 +0300)]
Fix error in headers_checks.lua
Vsevolod Stakhov [Fri, 19 Apr 2024 13:14:10 +0000 (14:14 +0100)]
[Minor] Support UTF8 in Received flags
Issue: #4919
Vsevolod Stakhov [Fri, 19 Apr 2024 13:06:05 +0000 (14:06 +0100)]
[Fix] If we have one statfile disabled we need to disable all
Vsevolod Stakhov [Thu, 18 Apr 2024 21:15:05 +0000 (03:15 +0600)]
Merge pull request #4930 from aduernberger/bayes_relearn
[Fix] Relearn messages in bayes filter
Vsevolod Stakhov [Thu, 18 Apr 2024 13:27:56 +0000 (19:27 +0600)]
Merge pull request #4926 from lucasRolff/master
[Minor] Add selector to get rspamd_hostname
aduernberger [Thu, 18 Apr 2024 12:44:01 +0000 (14:44 +0200)]
[Fix] Increase/decrease hash_key value for tokens depending on is_unlearn
When relearning a message, this script is called twice:
1. With `is_unlearn` true and the old `is_spam` value
2. With `is_unlearn` false and the new `is_spam` value
If `is_unlearn` is true, the code should not increase the value of the hash_key. Decreasing it ensures that it behaves like a fresh learn with the new is_spam value.
aduernberger [Thu, 18 Apr 2024 12:34:51 +0000 (14:34 +0200)]
[Fix] Update is_spam in learned_ids when relearning