]>
source.dussan.org Git - rspamd.git/log
moisseev [Mon, 29 Jul 2024 17:06:41 +0000 (20:06 +0300)]
Rename unrecognized SenderScore RBL result symbol
moisseev [Mon, 29 Jul 2024 07:32:46 +0000 (10:32 +0300)]
Set SenderScore RPBL scores
moisseev [Sun, 28 Jul 2024 15:26:38 +0000 (18:26 +0300)]
[Conf] Add SenderScore RPBL return codes
Vsevolod Stakhov [Sun, 28 Jul 2024 07:45:26 +0000 (08:45 +0100)]
[Minor] Try to fix ambigious rvalue
Vsevolod Stakhov [Fri, 26 Jul 2024 17:04:27 +0000 (18:04 +0100)]
[Minor] Fix known senders to work with empty mime recipients
Issue: #5070
Vsevolod Stakhov [Thu, 25 Jul 2024 13:10:46 +0000 (19:10 +0600)]
Merge pull request #4960 from JasonStephenson/bugfix/arc-regex-fix
[FIX] Arc regex to no longer match on dmarc=
Jason Stephenson [Thu, 25 Jul 2024 12:52:02 +0000 (13:52 +0100)]
linter fix
Vsevolod Stakhov [Thu, 25 Jul 2024 12:21:44 +0000 (13:21 +0100)]
[Conf] Increase scores for strange things in the archives
Vsevolod Stakhov [Thu, 25 Jul 2024 12:15:12 +0000 (13:15 +0100)]
[Fix] GPT: Fix bug in condition check
Jason Stephenson [Tue, 23 Jul 2024 15:12:28 +0000 (16:12 +0100)]
Use pattern to get all methodspecs + reasonspecs, and return the value of the arc one if present
Vsevolod Stakhov [Tue, 23 Jul 2024 10:39:12 +0000 (11:39 +0100)]
[Minor] Update version to 3.9.2
Vsevolod Stakhov [Tue, 23 Jul 2024 10:37:27 +0000 (11:37 +0100)]
Release 3.9.1
* [Conf] Spf: Add R_SPF_PLUSALL symbol with some score
* [Feature] Spf: Treat SPF +all in a special way
* [Minor] Ensure some safety when checking weights
* [Minor] Fix several issues with flag propagation
* [Minor] Gpt: Improve prompt and add some conversion heursitics
* [Minor] Gpt: Remove top_p reduce temperature to 0
* [Minor] Gpt: Set response_format
* [Minor] Gpt: Use gpt-4o-mini by default
Vsevolod Stakhov [Mon, 22 Jul 2024 14:10:31 +0000 (20:10 +0600)]
Merge pull request #5068 from rspamd/vstakhov-gpt-fixes
Some tunes and fixes for GPT
Vsevolod Stakhov [Mon, 22 Jul 2024 12:34:37 +0000 (13:34 +0100)]
[Minor] Use gpt-4o-mini by default
Vsevolod Stakhov [Mon, 22 Jul 2024 12:33:37 +0000 (13:33 +0100)]
[Minor] Improve prompt and add some conversion heursitics
Vsevolod Stakhov [Mon, 22 Jul 2024 12:25:39 +0000 (13:25 +0100)]
[Minor] Ensure some safety when checking weights
Issue: #5065
Vsevolod Stakhov [Mon, 22 Jul 2024 12:10:02 +0000 (13:10 +0100)]
[Minor] Set response_format
Vsevolod Stakhov [Mon, 22 Jul 2024 12:06:51 +0000 (13:06 +0100)]
[Minor] Remove top_p reduce temperature to 0
Vsevolod Stakhov [Fri, 19 Jul 2024 13:08:40 +0000 (19:08 +0600)]
Merge pull request #5063 from moisseev/eslint
[Test] Migrate ESLint to 9.7.0
moisseev [Thu, 18 Jul 2024 14:30:45 +0000 (17:30 +0300)]
[Test] Migrate ESLint to 9.7.0
Vsevolod Stakhov [Thu, 18 Jul 2024 13:42:22 +0000 (19:42 +0600)]
Merge pull request #5059 from rspamd/vstakhov-spf-plusall
[Feature] Treat SPF +all in a special way
Vsevolod Stakhov [Thu, 18 Jul 2024 13:30:53 +0000 (19:30 +0600)]
Merge branch 'master' into vstakhov-spf-plusall
Vsevolod Stakhov [Thu, 18 Jul 2024 12:27:44 +0000 (13:27 +0100)]
[Conf] Add R_SPF_PLUSALL symbol with some score
Vsevolod Stakhov [Thu, 18 Jul 2024 12:26:26 +0000 (13:26 +0100)]
[Minor] Fix several issues with flag propagation
Vsevolod Stakhov [Thu, 18 Jul 2024 12:13:27 +0000 (13:13 +0100)]
[Test] Add test for SPF +all
Vsevolod Stakhov [Wed, 17 Jul 2024 18:39:42 +0000 (00:39 +0600)]
Merge pull request #5058 from moisseev/setup-node-ci
[Test] Use actions/setup-node
moisseev [Wed, 17 Jul 2024 13:21:40 +0000 (16:21 +0300)]
[Test] Use actions/setup-node
The `npm ci`sets up exact versions of Node.js packages listed in the package-lock.json file,
which is ensuring consistency across different test runs and environments.
Vsevolod Stakhov [Wed, 17 Jul 2024 14:35:18 +0000 (15:35 +0100)]
[Feature] Treat SPF +all in a special way
Issue: #4996
Vsevolod Stakhov [Fri, 12 Jul 2024 11:24:28 +0000 (12:24 +0100)]
[Minor] Update version to 3.9.1
Vsevolod Stakhov [Fri, 12 Jul 2024 11:17:54 +0000 (12:17 +0100)]
Release 3.9.0
* [CritFix] Protect regexp matcher from regexps with empty patterns
* [Feature] Allow adding X-CMAE-Score header
* [Feature] Allow custom milter quarantine and tempfail messages
* [Feature] Allow to specify minimum weight in GPT plugin
* [Feature] Cloudmark: Add scores_symbols setting
* [Feature] Further optimization to the hot path
* [Feature] Make min_resolve_interval configurable
* [Feature] Report slow synchronous rules
* [Feature] Rspamc: add `files-list` option
* [Feature] Support metrics command in normal/proxy workers
* [Feature] Support reply in message pack format
* [Feature] Use msgpack in the client
* [Feature] Verify sanity of l= tag in DKIM
* [Feature] milter_headers: support not removing headers
* [Fix] Allow autolearn for the controller worker
* [Fix] Allow spaces in DMARC records
* [Fix] Allow to set 0 as number of rows to disable roll history
* [Fix] Always set the unlearn flag when relearning
* [Fix] Apply detection phase if fasttext could not detect language
* [Fix] Backport fixes from libucl
* [Fix] Backport multiple fixes from libucl
* [Fix] Change expiration logic for redis_cache
* [Fix] Check nconns when firing the final termination event
* [Fix] Do not apply tableshape for known senders
* [Fix] Do not crash if symbol is missing in the metric
* [Fix] Do not read out-of-boundary when doing base64 encoding
* [Fix] Do not save multipatterns to FS in certain cases
* [Fix] Fix another corner case that allows candidates to be freed without init
* [Fix] Fix documentation nesting
* [Fix] Fix dynamic_symbols in the multimap plugin
* [Fix] Fix inconsistent nesting in mime parts
* [Fix] Fix parsing of maps definitions
* [Fix] Fix shared memory proxying when compression is set
* [Fix] Fuzzy add/delete handlers are badly broken for compression
* [Fix] Honor dynamic thresholds for greylisting module
* [Fix] If we have one statfile disabled we need to disable all
* [Fix] Increase/decrease hash_key value for tokens depending on is_unlearn
* [Fix] Libucl: Fix messagepack autodetection
* [Fix] Resgore the collaterally removed line
* [Fix] Unset autolearn flag if we learn explicitly
* [Fix] Update `nconns` in proxy
* [Fix] Update greylisting threshold as it can be easily dynamic
* [Fix] Update is_spam in learned_ids when relearning
* [Fix] Use explicit timeouts in the metadata exporter
* [Fix] metric_exporter: avoid sending `nil` in metric values
* [Project] Add GPT plugin
* [Project] Add a tool to perform statistical analysis of classifiers
* [Project] Finally fix slow timer behaviour
* [Project] Implement fuzzy check retransmits backpressure
* [Project] Improve stats processing
* [Project] Reduce default window size of OSB tokenizer to 2
* [Project] Rework grow factor
* [Project] Start optimization of userdata hashing
* [Project] Use libarchive for troublesome archives
* [Rework] Allow metrics endpoint to be enabled for each scanner
* [Rework] Allow multiple conditions for dkim signing when using vault/redis
* [Rework] Introduce dynamic_rate_limit for ratelimits
* [Rework] Serialize control commands
* [Rework] Update fmt to version 11
* [Rework] Use direct hashing instead of string hashing
* [Rules] Added rules for detecting likely malware
Vsevolod Stakhov [Fri, 12 Jul 2024 08:40:59 +0000 (14:40 +0600)]
Merge pull request #5053 from moisseev/ratelimit
Update comments in ratelimit.conf example
moisseev [Fri, 12 Jul 2024 06:38:14 +0000 (09:38 +0300)]
Update comments in ratelimit.conf example
Vsevolod Stakhov [Thu, 11 Jul 2024 15:23:33 +0000 (16:23 +0100)]
[Fix] Do not crash if symbol is missing in the metric
Vsevolod Stakhov [Thu, 11 Jul 2024 15:08:00 +0000 (16:08 +0100)]
[Fix] Do not apply tableshape for known senders
Vsevolod Stakhov [Thu, 11 Jul 2024 14:10:13 +0000 (20:10 +0600)]
Merge pull request #5045 from rspamd/vstakhov-ratelimits-disable-dyn
Introduce dynamic_rate_limit for ratelimits plugin
Vsevolod Stakhov [Thu, 11 Jul 2024 13:28:39 +0000 (19:28 +0600)]
Merge branch 'master' into vstakhov-ratelimits-disable-dyn
Vsevolod Stakhov [Thu, 11 Jul 2024 13:28:24 +0000 (19:28 +0600)]
Merge pull request #5051 from fatalbanana/fix_ratelimit_tests
[Test] Fix ratelimit tests
Vsevolod Stakhov [Thu, 11 Jul 2024 13:13:26 +0000 (14:13 +0100)]
[Minor] cmath is a bit more strict
Vsevolod Stakhov [Thu, 11 Jul 2024 13:09:26 +0000 (14:09 +0100)]
[Test] Add missing
Vsevolod Stakhov [Thu, 11 Jul 2024 13:03:40 +0000 (14:03 +0100)]
[Minor] Specify failure reason clearly
Vsevolod Stakhov [Thu, 11 Jul 2024 12:47:05 +0000 (13:47 +0100)]
[Minor] Fix logic
Andrew Lewis [Thu, 11 Jul 2024 13:03:25 +0000 (15:03 +0200)]
[Test] Fix ratelimit tests
Vsevolod Stakhov [Wed, 10 Jul 2024 12:53:30 +0000 (18:53 +0600)]
Merge branch 'master' into vstakhov-ratelimits-disable-dyn
Vsevolod Stakhov [Wed, 10 Jul 2024 12:53:18 +0000 (18:53 +0600)]
Merge pull request #5048 from fatalbanana/ratelimit_tests
[Test] Add tests for ratelimit module
Andrew Lewis [Wed, 10 Jul 2024 12:46:34 +0000 (14:46 +0200)]
[Test] Add tests for ratelimit module
Vsevolod Stakhov [Tue, 9 Jul 2024 15:53:44 +0000 (16:53 +0100)]
[Minor] Mention mode of dynamic limits in the log
Vsevolod Stakhov [Tue, 9 Jul 2024 15:20:48 +0000 (21:20 +0600)]
Merge pull request #5043 from rspamd/vstakhov-gpt-tunes
Improve some functions in the GPT plugin
Vsevolod Stakhov [Tue, 9 Jul 2024 13:22:31 +0000 (14:22 +0100)]
[Project] Enable compatibility with the existing buckets
Vsevolod Stakhov [Mon, 8 Jul 2024 18:22:25 +0000 (19:22 +0100)]
[Rework] Introduce dynamic_rate_limit for ratelimits
Vsevolod Stakhov [Mon, 8 Jul 2024 17:34:16 +0000 (23:34 +0600)]
Merge pull request #5041 from fatalbanana/graphite_nil
[Fix] metric_exporter: avoid sending `nil` in metric values (#5027)
Andrew Lewis [Mon, 8 Jul 2024 14:05:52 +0000 (16:05 +0200)]
[Fix] metric_exporter: avoid sending `nil` in metric values
Vsevolod Stakhov [Mon, 8 Jul 2024 13:52:35 +0000 (19:52 +0600)]
Merge pull request #5042 from fatalbanana/suspicious_images
[Minor] Fix description (#3867)
Andrew Lewis [Mon, 8 Jul 2024 13:49:55 +0000 (15:49 +0200)]
[Minor] Fix description
Vsevolod Stakhov [Mon, 8 Jul 2024 13:49:19 +0000 (14:49 +0100)]
[Feature] Allow to specify minimum weight in GPT plugin
Vsevolod Stakhov [Mon, 8 Jul 2024 13:42:03 +0000 (14:42 +0100)]
[Minor] Push dynamic symbol weight
Vsevolod Stakhov [Mon, 1 Jul 2024 18:27:28 +0000 (00:27 +0600)]
Merge pull request #5035 from rspamd/vstakhov-gpt-experiments
Trying to test various things with GPT
Vsevolod Stakhov [Mon, 1 Jul 2024 18:15:10 +0000 (19:15 +0100)]
[Project] Trying to test various things with GPT
Vsevolod Stakhov [Mon, 1 Jul 2024 14:35:25 +0000 (20:35 +0600)]
Merge pull request #5034 from rspamd/vstakhov-fmt-11
Update embedded fmtlib to 11.0
Vsevolod Stakhov [Mon, 1 Jul 2024 14:20:42 +0000 (15:20 +0100)]
[Minor] Update dependency info
Vsevolod Stakhov [Mon, 1 Jul 2024 14:20:05 +0000 (15:20 +0100)]
[Rework] Update fmt to version 11
Vsevolod Stakhov [Sun, 30 Jun 2024 15:22:41 +0000 (16:22 +0100)]
[Minor] Set mres earlier
Issue: #5028
Vsevolod Stakhov [Sun, 30 Jun 2024 15:19:32 +0000 (21:19 +0600)]
Merge pull request #5032 from rspamd/vstakhov-gpt-plugin
Add GPT plugin
Vsevolod Stakhov [Sun, 30 Jun 2024 15:05:09 +0000 (16:05 +0100)]
[Minor] Log FP and FN
Vsevolod Stakhov [Sat, 29 Jun 2024 12:31:08 +0000 (13:31 +0100)]
[Minor] Add some missing symbols
Vsevolod Stakhov [Sat, 29 Jun 2024 12:27:25 +0000 (13:27 +0100)]
[Minor] Add from and subject to the prompt
Vsevolod Stakhov [Fri, 28 Jun 2024 14:21:23 +0000 (15:21 +0100)]
[Minor] Allow to specify spam/ham symbols in classifier_test
Vsevolod Stakhov [Fri, 28 Jun 2024 14:14:54 +0000 (15:14 +0100)]
[Minor] Allow autolearn
Vsevolod Stakhov [Fri, 28 Jun 2024 14:11:42 +0000 (15:11 +0100)]
[Minor] Apply review suggestion
Vsevolod Stakhov [Fri, 28 Jun 2024 14:09:50 +0000 (15:09 +0100)]
[Minor] Adjust configuration
Vsevolod Stakhov [Fri, 28 Jun 2024 14:06:05 +0000 (15:06 +0100)]
[Minor] Make except symbols configurable
Vsevolod Stakhov [Fri, 28 Jun 2024 14:03:30 +0000 (15:03 +0100)]
Update src/plugins/lua/gpt.lua
Co-authored-by: Andrew Lewis <nerf@judo.za.org>
Vsevolod Stakhov [Fri, 28 Jun 2024 14:00:21 +0000 (15:00 +0100)]
[Minor] Check words count properly
Vsevolod Stakhov [Fri, 28 Jun 2024 10:18:40 +0000 (11:18 +0100)]
[Project] Add checks to decide if we need a GPT check
Vsevolod Stakhov [Fri, 28 Jun 2024 09:54:38 +0000 (10:54 +0100)]
[Minor] Also use gzip compression
Vsevolod Stakhov [Fri, 28 Jun 2024 09:53:10 +0000 (10:53 +0100)]
[Minor] Use keep-alive and upstreams logic
Vsevolod Stakhov [Fri, 28 Jun 2024 09:47:41 +0000 (10:47 +0100)]
[Minor] Disable module by default
Vsevolod Stakhov [Thu, 27 Jun 2024 14:40:03 +0000 (15:40 +0100)]
[Minor] Copy&paste fix
Vsevolod Stakhov [Thu, 27 Jun 2024 14:39:09 +0000 (15:39 +0100)]
[Project] Add GPT plugin
Dmitriy Alekseev [Wed, 26 Jun 2024 14:21:57 +0000 (16:21 +0200)]
Exclude MIME_BAD_UNICODE false positive (#5030)
* Update composites.conf
* Update composites.conf
* Update composites.conf
* Update composites.conf
* Update mime_types_group.conf
* Update mime_types_group.conf
* Update composites.conf
Ivan Stakhov [Tue, 25 Jun 2024 12:49:56 +0000 (17:49 +0500)]
Fixed bug with task:inject() function according to the issue #5010 (#5021)
* [Fix] Fix issue with task:inject_url
* [Minor] Code clean up
* [Minor] Clean up
* [Minor] Small fix
* [Minor] Fix small typo
* [Test] Debug
* [Test] Debug
* [Test] Debug inject_url
* [Test] Debugging
* [Test] Debugging task:inject test
* [Test] Debugging task:inject test
* [Test] Debugging task:inject test
* [Minor] Debug task:inject_url test
* [Minor] Small fix
* [Minor] Debug task:inject_url test
* [Test] Test base task:inject
* [Test] Test updated task:inject
* [Test] Test updated task:inject
* [Test] Test updated task:inject
* [Test] Test updated task:inject
* [Test] Test updated task:inject
* [Test] Test fixed task:inject
* [Test] Test fixed task:inject
* [Test] Testing task:inject
* [Test] Testing task:inject
* [Test] Fix task:inject
* [Test] Fix task:inject
* [Test] Fix task:inject
* [Test] Fix task:inject
* [Test] Fix task:inject
* [Test] Fix task:inject
* [Test] Fix task:inject
* [Test] Fix task:inject
* [Test] Test base task:inject
* [Test] Test base task:inject
* [Test] Test base task:inject
* [Test] Fix task:inject
* [Test] Fix task:inject
* [Test] Fix task:inject
* [Test] Fix task:inject
* [Minor] Clean up code in task:inject
* [Minor] Updated test for task:inject
* [Test] Debug test for task:inject_url
* [Test] Debug test for task:inject_url
* [Test] Fix task:inject_url
* [Test] Fix task:inject_url
* [Test] Fix task:inject_url
* [Test] Fix task:inject_url
* [Test] Fix task:inject_url
* [Test] Fix task:inject_url
* [Test] Fix task:inject_url
* [Test] Fix task:inject_url
* [Test] Fix task:inject_url
* [Test] Fix task:inject_url
* [Test] Fix task:inject_url
* [Test] Fix task:inject_url
* [Test] Fix task:inject_url
* [Test] Fix task:inject_url
* [Test] Fix task:inject_url
* [Test] Check task:inject_url
* [Test] Check task:inject_url
* [Test] Check task:inject_url
* [Test] Check task:inject_url
* [Test] Check task:inject_url
* [Test] Check task:inject_url
* [Minor] Clean up code
* [Minor] Clean up code
* [Minor] Little fix for error messages in url.create function
* [Test] Change way to inject url
* [Test] Fix inject url
* [Test] Fix inject url
* [Test] Fix inject url
* [Test] Fix inject url
* [Test] Fix inject url
* [Minor] Clean up code
* [Test] Without fake mime_part
* [Test] Without fake mime_part
* [Minor] Clean up
* [Test] Mime part of the task
* [Test] Mpart should exist
* [Test] Mpart should exist
* [Test] Mpart should exist
* [Test] Another check for mpart->urls
* [Minor] Clean up
* [Minor] Clean up
* [Fix] Fixing OpenSSL 3.0 compatibility
* [Fix] Reverted
Vsevolod Stakhov [Mon, 24 Jun 2024 14:01:45 +0000 (20:01 +0600)]
Merge pull request #5026 from rspamd/vstakhov-metrics-worker
[Rework] Allow metrics endpoint to be enabled for each scanner
Vsevolod Stakhov [Mon, 24 Jun 2024 13:48:17 +0000 (14:48 +0100)]
[Feature] Support metrics command in normal/proxy workers
Vsevolod Stakhov [Sat, 22 Jun 2024 12:47:28 +0000 (13:47 +0100)]
[Minor] Unify metrics conversion
Vsevolod Stakhov [Fri, 21 Jun 2024 13:43:14 +0000 (14:43 +0100)]
[Rework] Allow metrics endpoint to be enabled for each scanner
Vsevolod Stakhov [Fri, 21 Jun 2024 10:14:56 +0000 (16:14 +0600)]
Merge pull request #5020 from rspamd/vstakhov-slow-timer
[Rework] Rething slow timer
Vsevolod Stakhov [Thu, 20 Jun 2024 15:14:51 +0000 (16:14 +0100)]
[Minor] Further logic tunes
Vsevolod Stakhov [Thu, 20 Jun 2024 15:02:18 +0000 (21:02 +0600)]
Merge pull request #5011 from rspamd/vstakhov-bayes-experiments
Improve bayes performance by setting the default window size to 2
Vsevolod Stakhov [Thu, 20 Jun 2024 14:54:57 +0000 (15:54 +0100)]
[Project] Finally fix slow timer behaviour
Vsevolod Stakhov [Thu, 20 Jun 2024 14:50:09 +0000 (15:50 +0100)]
[Minor] Set pending status where appropriate
Vsevolod Stakhov [Wed, 19 Jun 2024 15:21:31 +0000 (16:21 +0100)]
[Feature] Report slow synchronous rules
Vsevolod Stakhov [Wed, 19 Jun 2024 15:12:10 +0000 (16:12 +0100)]
[Minor] Use internal flags
Vsevolod Stakhov [Wed, 19 Jun 2024 14:56:55 +0000 (15:56 +0100)]
[Conf] Add missing symbol
Vsevolod Stakhov [Wed, 19 Jun 2024 14:41:12 +0000 (15:41 +0100)]
[Rework] Another bunch of changes to the dependencies processing
Vsevolod Stakhov [Tue, 18 Jun 2024 14:40:58 +0000 (15:40 +0100)]
[Minor] Remove bogus message
Vsevolod Stakhov [Tue, 18 Jun 2024 14:35:39 +0000 (15:35 +0100)]
[Minor] Add notice about unknown deps
Vsevolod Stakhov [Tue, 18 Jun 2024 14:19:41 +0000 (15:19 +0100)]
[Rework] Dependencies must be unique...
Vsevolod Stakhov [Tue, 18 Jun 2024 13:48:37 +0000 (14:48 +0100)]
[Rework] Use explicit item status
Vsevolod Stakhov [Mon, 17 Jun 2024 19:28:43 +0000 (01:28 +0600)]
Merge branch 'master' into vstakhov-bayes-experiments
Vsevolod Stakhov [Mon, 17 Jun 2024 14:12:49 +0000 (15:12 +0100)]
[Rework] Rething slow timer
Vsevolod Stakhov [Thu, 13 Jun 2024 13:35:27 +0000 (14:35 +0100)]
[Minor] Use files instead of arguments for rspamc