]>
source.dussan.org Git - rspamd.git/log
Vsevolod Stakhov [Sat, 27 May 2023 11:12:32 +0000 (12:12 +0100)]
Merge pull request #4499 from moisseev/webui
[WebUI] Add ability to compute fuzzy hashes
moisseev [Fri, 26 May 2023 13:12:23 +0000 (16:12 +0300)]
[WebUI] Add ability to compute fuzzy hashes
from sample message source
Vsevolod Stakhov [Thu, 25 May 2023 13:44:00 +0000 (14:44 +0100)]
[Minor] Fix for old hyperscan
Vsevolod Stakhov [Thu, 25 May 2023 13:41:30 +0000 (14:41 +0100)]
[Fix] Fix an old issue with order of destruction race between redis pool and lua
Vsevolod Stakhov [Thu, 25 May 2023 09:02:09 +0000 (10:02 +0100)]
[Fix] Try harder to remove bad hyperscan files
Issue: #4493
Vsevolod Stakhov [Wed, 24 May 2023 13:25:18 +0000 (14:25 +0100)]
[Fix] Fix parsing due to old bug revealed
Vsevolod Stakhov [Sun, 21 May 2023 16:14:47 +0000 (17:14 +0100)]
Merge pull request #4490 from moisseev/webui
[Minor] Fix rows background coloring
moisseev [Sun, 21 May 2023 15:18:43 +0000 (18:18 +0300)]
[Minor] Fix rows background coloring
of the Bayesian statistics table
Vsevolod Stakhov [Sun, 21 May 2023 10:57:09 +0000 (11:57 +0100)]
[Minor] Avoid using registry to store traverse function + cleanup
Vsevolod Stakhov [Sat, 20 May 2023 20:17:43 +0000 (21:17 +0100)]
[Minor] Add maps:foreach method in the Lua API
Vsevolod Stakhov [Sat, 20 May 2023 14:51:39 +0000 (15:51 +0100)]
[Minor] Remove old and broken utilities
Vsevolod Stakhov [Sat, 20 May 2023 14:49:30 +0000 (15:49 +0100)]
[Minor] Avoid using of gio in Rspamd
Vsevolod Stakhov [Sat, 20 May 2023 14:37:30 +0000 (15:37 +0100)]
[Minor] Make read_passphrase utility more universal
Vsevolod Stakhov [Sat, 20 May 2023 14:26:53 +0000 (15:26 +0100)]
[Minor] Fix help output
Issue: #4483
Vsevolod Stakhov [Sat, 20 May 2023 14:22:43 +0000 (15:22 +0100)]
[Feature] Add controller endpoint to get fuzzy hashes from messages
Sample usage:
```
curl -XPOST 'http://localhost:11334/plugins/fuzzy/hashes?flag=1' --data-binary '@-' < file
```
Sample output:
```json
{
"hashes": {
"local": [
"24b6e7de2f489778d828c827079c48bacb086f816d0a7acabbe42e8d0da703b89b913176ad67eefaf5b54fa59f5e0ecfc7015846c4043fcfb0c7a4ed7a235025",
"72789777cbec926f4143de4c08c87acc3fbf3b909b5c39f1edcf82ed12e2d8bc2f56be8d68ee681feccf44ca04e3eca5b8ec039cb84a0d40e22258c370a10cbb"
],
"rspamd.com": [
"24b6e7de2f489778d828c827079c48bacb086f816d0a7acabbe42e8d0da703b89b913176ad67eefaf5b54fa59f5e0ecfc7015846c4043fcfb0c7a4ed7a235025",
"72789777cbec926f4143de4c08c87acc3fbf3b909b5c39f1edcf82ed12e2d8bc2f56be8d68ee681feccf44ca04e3eca5b8ec039cb84a0d40e22258c370a10cbb"
],
},
"success": true
}
```
Issue: #4489
Vsevolod Stakhov [Sat, 20 May 2023 12:19:24 +0000 (13:19 +0100)]
[Feature] Allow to have weak flags in fuzzy storage
Vsevolod Stakhov [Fri, 19 May 2023 20:37:11 +0000 (21:37 +0100)]
[Minor] Remove redundant variable
Vsevolod Stakhov [Thu, 18 May 2023 19:28:21 +0000 (20:28 +0100)]
[Minor] Always report multipattern compile error
Issue: #4487
Vsevolod Stakhov [Tue, 16 May 2023 10:41:53 +0000 (11:41 +0100)]
[Minor] Fix newindex
Vsevolod Stakhov [Tue, 16 May 2023 10:01:24 +0000 (11:01 +0100)]
[Minor] Allow more sane flags and ids syntax when register symbols
For example, flags could be defined as:
```lua
rspamd_config.register_symbol{
flags = ['ignore_passthrough', 'nice']
}
```
instead of (compatibility is still there):
```lua
rspamd_config.register_symbol{
flags = 'ignore_passthrough,nice'
}
```
Vsevolod Stakhov [Mon, 15 May 2023 08:18:45 +0000 (09:18 +0100)]
[Minor] Fix old bug that score was not converted to a number
Vsevolod Stakhov [Mon, 15 May 2023 08:06:45 +0000 (09:06 +0100)]
[Test] Add multimap options test
Vsevolod Stakhov [Sat, 13 May 2023 21:24:16 +0000 (22:24 +0100)]
[Feature] Allow to read options from maps in the multimap plugin
Issue: #4468
Vsevolod Stakhov [Sat, 13 May 2023 14:24:25 +0000 (15:24 +0100)]
[Minor] Show percentages
Vsevolod Stakhov [Sat, 13 May 2023 12:31:23 +0000 (13:31 +0100)]
[Minor] Allow to run without an explicit group name when `-u` is set
Vsevolod Stakhov [Sat, 13 May 2023 12:18:46 +0000 (13:18 +0100)]
[Fix] Fix format string usage
Issue: #4482
Vsevolod Stakhov [Fri, 12 May 2023 11:01:25 +0000 (12:01 +0100)]
[Fix] Set proper counter
Vsevolod Stakhov [Fri, 12 May 2023 10:04:04 +0000 (11:04 +0100)]
[Fix] More fixes to fuzzystat
Vsevolod Stakhov [Fri, 12 May 2023 09:50:14 +0000 (10:50 +0100)]
[Fix] Update stats before encryption...
Vsevolod Stakhov [Fri, 12 May 2023 09:38:20 +0000 (10:38 +0100)]
[Minor] Ignore FUZZY_STAT
Vsevolod Stakhov [Fri, 12 May 2023 08:45:08 +0000 (09:45 +0100)]
[Minor] Fix flags stat
Vsevolod Stakhov [Fri, 12 May 2023 08:23:57 +0000 (09:23 +0100)]
[Minor] Fix fuzzy stats
Vsevolod Stakhov [Tue, 9 May 2023 19:45:07 +0000 (20:45 +0100)]
[Conf] Remove outdated composite rules
Vsevolod Stakhov [Tue, 9 May 2023 05:14:27 +0000 (06:14 +0100)]
[Minor] Print flags stat
Vsevolod Stakhov [Mon, 8 May 2023 18:31:43 +0000 (19:31 +0100)]
[Minor] Output flags stat per key
Vsevolod Stakhov [Mon, 8 May 2023 17:43:36 +0000 (18:43 +0100)]
[Minor] Add utility to iterate over values by pointer and keys
Vsevolod Stakhov [Mon, 8 May 2023 17:26:51 +0000 (18:26 +0100)]
[Feature] Count stats per key per flag
Vsevolod Stakhov [Sun, 7 May 2023 04:01:02 +0000 (05:01 +0100)]
[Minor] More code modernisations
Vsevolod Stakhov [Sun, 7 May 2023 01:24:40 +0000 (02:24 +0100)]
[Minor] Fix some legacy
Vsevolod Stakhov [Sat, 6 May 2023 01:35:55 +0000 (02:35 +0100)]
[Minor] Show the fasttext status in version output
Vsevolod Stakhov [Fri, 5 May 2023 16:35:13 +0000 (17:35 +0100)]
[Minor] Lua_util: Add normalize_utf8 utility
Issue: #4475
Vsevolod Stakhov [Thu, 4 May 2023 06:23:08 +0000 (07:23 +0100)]
[Minor] Fix build on systems with no monotonic clock
Issue: #4478
Vsevolod Stakhov [Thu, 4 May 2023 06:07:47 +0000 (07:07 +0100)]
[Minor] Fix spelling mistake
Vsevolod Stakhov [Wed, 3 May 2023 11:08:01 +0000 (12:08 +0100)]
[Minor] Add some more debug to the fasttext classifier
Vsevolod Stakhov [Tue, 2 May 2023 17:03:49 +0000 (18:03 +0100)]
[Feature] Allow to use other methods when fasttext detection is enabled
Vsevolod Stakhov [Tue, 2 May 2023 16:56:14 +0000 (17:56 +0100)]
[Fix] Feed fasttext language model with the pre-tokenized words
Vsevolod Stakhov [Sun, 30 Apr 2023 19:52:40 +0000 (20:52 +0100)]
[Conf] Add missing attributes for the language detection configuration
Vsevolod Stakhov [Sat, 29 Apr 2023 17:09:17 +0000 (18:09 +0100)]
Merge pull request #4473 from rspamd/vstakhov-fasttext-langdet
[Feature] Add fasttext language detector to Rspamd
Vsevolod Stakhov [Sat, 29 Apr 2023 16:44:16 +0000 (17:44 +0100)]
[Project] Some further fixes
Vsevolod Stakhov [Sat, 29 Apr 2023 15:00:52 +0000 (16:00 +0100)]
[Fix] Ignore non-unique stop words
Vsevolod Stakhov [Sat, 29 Apr 2023 14:47:15 +0000 (15:47 +0100)]
[Project] Implement fasttext language detection
Vsevolod Stakhov [Sat, 29 Apr 2023 13:53:40 +0000 (14:53 +0100)]
[Conf] Add language detection configuration
Vsevolod Stakhov [Sat, 29 Apr 2023 13:46:55 +0000 (14:46 +0100)]
[Project] Show fasttext info
Vsevolod Stakhov [Sat, 29 Apr 2023 13:22:41 +0000 (14:22 +0100)]
[Project] Add preliminary language detector based on fasttext library
Vsevolod Stakhov [Thu, 27 Apr 2023 20:40:59 +0000 (21:40 +0100)]
[Minor] Remove unused macro
Vsevolod Stakhov [Wed, 26 Apr 2023 21:56:53 +0000 (22:56 +0100)]
[Test] Fix unit tests
Vsevolod Stakhov [Wed, 26 Apr 2023 21:54:24 +0000 (22:54 +0100)]
[Feature] Add html parsing limit
Vsevolod Stakhov [Tue, 25 Apr 2023 21:37:06 +0000 (22:37 +0100)]
[Minor] Use utf8 compatible comparison
Vsevolod Stakhov [Sun, 23 Apr 2023 20:03:07 +0000 (21:03 +0100)]
[Conf] Add `one_shot` to some specific multimap rules
Vsevolod Stakhov [Sun, 23 Apr 2023 19:53:39 +0000 (20:53 +0100)]
[Minor] Add build system support for fasttext library
Vsevolod Stakhov [Sat, 22 Apr 2023 12:03:12 +0000 (13:03 +0100)]
[Minor] Improve options
Vsevolod Stakhov [Sat, 22 Apr 2023 11:57:47 +0000 (12:57 +0100)]
[Feature] Add extra symbol when URL redirector reaches nested limit
Issue: #4406
Vsevolod Stakhov [Fri, 21 Apr 2023 20:11:11 +0000 (21:11 +0100)]
[Fix] Include the last character when parsing the last header with no value
Issue: #4388
Vsevolod Stakhov [Mon, 17 Apr 2023 19:41:45 +0000 (20:41 +0100)]
Merge pull request #4422 from a16bitsysop/redirector
[Fix] remove obsolete rspamd-redirector files
Vsevolod Stakhov [Sun, 16 Apr 2023 22:17:38 +0000 (23:17 +0100)]
Merge pull request #4461 from moisseev/webui
[Minor] Fix pagination control border radius
Vsevolod Stakhov [Sat, 15 Apr 2023 06:53:03 +0000 (07:53 +0100)]
Merge pull request #4449 from jendis/fix_arc
[CritFix] Fix arc signing
moisseev [Thu, 13 Apr 2023 13:50:09 +0000 (16:50 +0300)]
[Minor] Remove obsolete CSS rule
moisseev [Thu, 13 Apr 2023 09:40:53 +0000 (12:40 +0300)]
[Minor] Fix pagination control border radius
Vsevolod Stakhov [Sun, 9 Apr 2023 11:42:03 +0000 (12:42 +0100)]
[Minor] Update lua-tableshape to 2.6.0
Issue: #4455
Vsevolod Stakhov [Sat, 8 Apr 2023 21:05:14 +0000 (22:05 +0100)]
[Minor] Fix include/exclude policy
Vsevolod Stakhov [Sat, 8 Apr 2023 20:45:39 +0000 (21:45 +0100)]
[Feature] Add ability to deny specific fuzzy flags by default
Vsevolod Stakhov [Fri, 7 Apr 2023 20:54:58 +0000 (21:54 +0100)]
[Minor] Pet luacheck
Vsevolod Stakhov [Fri, 7 Apr 2023 20:50:14 +0000 (21:50 +0100)]
[Minor] Fix key type in output
Vsevolod Stakhov [Fri, 7 Apr 2023 20:36:45 +0000 (21:36 +0100)]
[Minor] Print more useful information in the `--version` output
Vsevolod Stakhov [Fri, 7 Apr 2023 20:17:44 +0000 (21:17 +0100)]
[Minor] Add `dnskey` type of output
Issue: #4429
Vsevolod Stakhov [Fri, 7 Apr 2023 15:54:37 +0000 (16:54 +0100)]
[Fix] Do not use `rspamadm.dkim_keygen`
Vsevolod Stakhov [Fri, 7 Apr 2023 15:38:50 +0000 (16:38 +0100)]
[Feature] Finish all features of dkim_keygen in Lua
Vsevolod Stakhov [Fri, 7 Apr 2023 15:08:15 +0000 (16:08 +0100)]
[Rework] Write dkim keygen tool in lua
Vsevolod Stakhov [Fri, 7 Apr 2023 14:59:46 +0000 (15:59 +0100)]
[Minor] Allow to save private key in output
Vsevolod Stakhov [Fri, 7 Apr 2023 13:34:34 +0000 (14:34 +0100)]
[Minor] Fix openssl invocation
Vsevolod Stakhov [Fri, 7 Apr 2023 11:06:25 +0000 (12:06 +0100)]
[Test] Add unit testing
Vsevolod Stakhov [Fri, 7 Apr 2023 11:06:07 +0000 (12:06 +0100)]
[Feature] Add some missing functions to `lua_rsa` library
Vsevolod Stakhov [Thu, 6 Apr 2023 21:07:28 +0000 (22:07 +0100)]
Merge pull request #4457 from moisseev/rspamd-stats
[Minor] Use a scalar variable as a dir handle
Alexander Moisseev [Thu, 6 Apr 2023 14:22:52 +0000 (17:22 +0300)]
[Minor] Use a scalar variable as a dir handle
instead of a bareword
Vsevolod Stakhov [Wed, 5 Apr 2023 19:00:04 +0000 (20:00 +0100)]
[Minor] Re-sign drone yaml
Vsevolod Stakhov [Wed, 5 Apr 2023 18:59:44 +0000 (19:59 +0100)]
Merge pull request #4453 from moisseev/webui
[WebUI] Fix "Clean history" button enabling/disabling in the Scan tab
moisseev [Wed, 5 Apr 2023 15:21:18 +0000 (18:21 +0300)]
[Test] Fix Stylelint and npm warnings
moisseev [Wed, 5 Apr 2023 14:07:31 +0000 (17:07 +0300)]
[WebUI] Fix "Clean history" button
enabling/disabling in the Scan tab
Vsevolod Stakhov [Tue, 4 Apr 2023 21:31:13 +0000 (22:31 +0100)]
[Rework] Default max shots must not influence options
Issue: #4450
Vsevolod Stakhov [Mon, 3 Apr 2023 20:24:00 +0000 (21:24 +0100)]
[Minor] Do not propagate broken headers flag for attached messages
Jan Smutny [Fri, 31 Mar 2023 14:21:20 +0000 (16:21 +0200)]
fixup! arc.lua: fix signature of ARC-Seal header
Vsevolod Stakhov [Thu, 30 Mar 2023 16:57:50 +0000 (17:57 +0100)]
Merge pull request #4448 from simbuerg/simbuerg/fix-double-dip-ratelimit
[Fix] Avoid double-dip of nrcpt when calculating ratelimit condition
Jan Smutny [Thu, 30 Mar 2023 09:16:53 +0000 (11:16 +0200)]
arc.lua: fix signature of ARC-Seal header
The ARC Set header field values must be supplied to the hash function in increasing
instance order, starting at 1.
Defined in https://www.rfc-editor.org/rfc/rfc8617.html#section-5.1.1.
Jan Smutny [Mon, 20 Mar 2023 08:48:26 +0000 (09:48 +0100)]
arc.lua: fix usage of ARC-Authentication-Results in arc_sign_seal func
The ARC-Authentication-Results header field was gathered in function arc_sign_seal
directly from headers.
This commit adds the sorted ARC-Authentication-Results header to cache
which is then reused in arc_sign_seal function.
Andreas Simbuerger [Wed, 29 Mar 2023 16:08:57 +0000 (18:08 +0200)]
fix: avoid double-dip of nrcpt when calculating ratelimit condition
Before this commit, rspamd would consider the number of recipients of
the current message twice when calculating the ratelimit condition.
Vsevolod Stakhov [Sun, 26 Mar 2023 12:16:48 +0000 (13:16 +0100)]
[Test] Add unit tests for the compression functions
Vsevolod Stakhov [Sun, 26 Mar 2023 12:16:24 +0000 (13:16 +0100)]
[Minor] Fix some issues with the in-place gzip, add gunzip
Vsevolod Stakhov [Sat, 25 Mar 2023 16:00:14 +0000 (16:00 +0000)]
[Feature] Use in-place deflation for strings
Vsevolod Stakhov [Sat, 25 Mar 2023 15:27:06 +0000 (15:27 +0000)]
Merge pull request #4444 from moisseev/bootstrap-v5
[WebUI] Migrate to Bootstrap v5.2
Vsevolod Stakhov [Sat, 25 Mar 2023 15:26:34 +0000 (15:26 +0000)]
[Minor] Sigh, some more portability for gcc