]>
source.dussan.org Git - rspamd.git/log
kristous [Sun, 6 Mar 2016 07:56:27 +0000 (08:56 +0100)]
Update phishing.md
found a small typo :-)
Vsevolod Stakhov [Sat, 5 Mar 2016 22:20:47 +0000 (22:20 +0000)]
[Minor] Use utf8 length for subject
Vsevolod Stakhov [Sat, 5 Mar 2016 22:16:16 +0000 (22:16 +0000)]
[Feature] Add util.strlen_utf8 lua function
Vsevolod Stakhov [Sat, 5 Mar 2016 22:07:45 +0000 (22:07 +0000)]
Merge pull request #546 from moisseev/patch-2
Add LONG_SUBJ rule
Alexander Moisseev [Sat, 5 Mar 2016 18:59:58 +0000 (21:59 +0300)]
Add LONG_SUBJ rule
Vsevolod Stakhov [Sat, 5 Mar 2016 14:44:08 +0000 (14:44 +0000)]
[Feature] Rework and abstract lua maps API
- Now all maps share the same lua object table.
- Remove bad destructions code since objects are reallocated during maps
operations
- Fix and unify various parts of maps management
- Pass map object to lua callbacks
Vsevolod Stakhov [Sat, 5 Mar 2016 13:36:51 +0000 (13:36 +0000)]
[MajorFeature] Add preliminary version of updates
This plugin is intended to load dynamic updates for rspamd. Now its
functionality is very limited.
Vsevolod Stakhov [Sat, 5 Mar 2016 13:23:29 +0000 (13:23 +0000)]
[Minor] Fix lua_cryptobox registration
Vsevolod Stakhov [Fri, 4 Mar 2016 15:10:37 +0000 (15:10 +0000)]
[Minor] Add guards for NaN values
Vsevolod Stakhov [Fri, 4 Mar 2016 14:56:43 +0000 (14:56 +0000)]
[Feature] Add support for WLBLEval SA plugin
Vsevolod Stakhov [Fri, 4 Mar 2016 14:42:44 +0000 (14:42 +0000)]
[Minor] Fix actions setting
Vsevolod Stakhov [Fri, 4 Mar 2016 13:19:58 +0000 (13:19 +0000)]
[Fix] Properly set priority for rules with negative score
Vsevolod Stakhov [Fri, 4 Mar 2016 11:22:36 +0000 (11:22 +0000)]
[Fix] Fix race condition in lua_tcp module
Vsevolod Stakhov [Thu, 3 Mar 2016 18:05:20 +0000 (18:05 +0000)]
[Feature] Add task:set_metric_action lua API method
rspamd_config:set_metric_symbol({table})
Set the value of a specified symbol in a metric.
This function accepts table with the following elements:
- `name`: name of symbol (string)
- `score`: score for symbol (number)
- `metric`: name of metric (string, optional)
- `description`: description of symbol (string, optional)
- `group`: name of group for symbol (string, optional)
- `one_shot`: turn off multiple hits for a symbol (boolean, optional)
- `flags`: comma separated string of flags:
+ `ignore`: do not strictly check validity of symbol and corresponding rule
+ `one_shot`: turn off multiple hits for a symbol
- `priority`: priority of symbol's definition
Vsevolod Stakhov [Thu, 3 Mar 2016 17:06:04 +0000 (17:06 +0000)]
[Fix] Set 'ignore' flags from symbols coming from SA
Vsevolod Stakhov [Thu, 3 Mar 2016 17:05:49 +0000 (17:05 +0000)]
[Feature] Allow to specify flags for metric symbols
Vsevolod Stakhov [Thu, 3 Mar 2016 16:53:00 +0000 (16:53 +0000)]
[Fix] Add watcher for lua_tcp module
Vsevolod Stakhov [Thu, 3 Mar 2016 15:26:27 +0000 (15:26 +0000)]
[Fix] Lowercase and cache the principal recipient
Issue: #544
Reported by: @sativouf
Vsevolod Stakhov [Thu, 3 Mar 2016 12:19:48 +0000 (12:19 +0000)]
[Feature] Improve tests for siphash
- Add fuzz tests
- Add variable length input tests
- Check sanity of siphash implementation on start
Vsevolod Stakhov [Thu, 3 Mar 2016 11:28:42 +0000 (11:28 +0000)]
[Fix] Don't use _memcpy in assembly
Vsevolod Stakhov [Thu, 3 Mar 2016 10:37:47 +0000 (10:37 +0000)]
[Feature] Add AVX2 version of siphash
This version has been taken from the google code at
https://github.com/google/highwayhash/
The final code is obtained by compiling c++ using clang-3.8 compiler.
Vsevolod Stakhov [Thu, 3 Mar 2016 10:05:28 +0000 (10:05 +0000)]
[Minor] Disable shutdown workaround for HTTP
Vsevolod Stakhov [Thu, 3 Mar 2016 09:19:24 +0000 (09:19 +0000)]
Merge pull request #543 from fatalbanana/master
[Fix] Avoid problematic operation on possibly nil value in once_received
Andrew Lewis [Thu, 3 Mar 2016 08:43:59 +0000 (10:43 +0200)]
[Fix] Avoid problematic operation on possibly nil value in once_received
Vsevolod Stakhov [Wed, 2 Mar 2016 12:58:26 +0000 (12:58 +0000)]
[Fix] Add more guards for IP address
Vsevolod Stakhov [Wed, 2 Mar 2016 12:11:12 +0000 (12:11 +0000)]
[Feature] SA plugin can now set missing scores for rspamd
Vsevolod Stakhov [Wed, 2 Mar 2016 12:10:59 +0000 (12:10 +0000)]
[Minor] Fix spelling in log message
Vsevolod Stakhov [Wed, 2 Mar 2016 11:52:39 +0000 (11:52 +0000)]
[Fix] Handle some bad IP URLs
Vsevolod Stakhov [Tue, 1 Mar 2016 13:04:43 +0000 (13:04 +0000)]
[Feature] Export versions vars to UCL
Vsevolod Stakhov [Tue, 1 Mar 2016 12:27:02 +0000 (12:27 +0000)]
[Feature] Add rspamd_version function to LUA API
Vsevolod Stakhov [Mon, 29 Feb 2016 15:50:22 +0000 (15:50 +0000)]
[Minor] Temporary disable scheduler optimization
It is not very well investigated and might decrease performance in some
cases I care about.
Vsevolod Stakhov [Mon, 29 Feb 2016 15:45:29 +0000 (15:45 +0000)]
[Feature] Improve symbols sorting function
Vsevolod Stakhov [Mon, 29 Feb 2016 15:26:43 +0000 (15:26 +0000)]
[Fix] Fix redis stats to avoid double free
Vsevolod Stakhov [Mon, 29 Feb 2016 15:18:39 +0000 (15:18 +0000)]
[Feature] Add lockless logging
Sometimes, it is needed to turn off logging mutex to avoid recursive
mutex obtaining. It is especially useful to do it within children wait
code in the main processes dispatcher.
Vsevolod Stakhov [Mon, 29 Feb 2016 14:59:41 +0000 (14:59 +0000)]
[Minor] Fix race condition when removing hash
Vsevolod Stakhov [Mon, 29 Feb 2016 14:59:26 +0000 (14:59 +0000)]
[Minor] Fix closing race in fuzzy storage
Vsevolod Stakhov [Mon, 29 Feb 2016 14:53:12 +0000 (14:53 +0000)]
[Fix] Fix sorting order for symbols cache
Vsevolod Stakhov [Mon, 29 Feb 2016 13:54:42 +0000 (13:54 +0000)]
[Fix] Fix `all` in spf redirects
Issue: #542
Reported by: @sativouf
Vsevolod Stakhov [Mon, 29 Feb 2016 12:52:53 +0000 (12:52 +0000)]
[Fix] Fix crash on scan
Vsevolod Stakhov [Mon, 29 Feb 2016 11:14:12 +0000 (11:14 +0000)]
[Minor] Fix reject action parsing
Vsevolod Stakhov [Mon, 29 Feb 2016 11:11:39 +0000 (11:11 +0000)]
[Minor] Hide rdrand checks for non-x86 platforms
Vsevolod Stakhov [Sun, 28 Feb 2016 22:58:20 +0000 (22:58 +0000)]
[Feature] Add priorities for actions
Add dedicated API to modify action limits with priorities from different
configuration place. This follows the logic of symbols' priorities and
will be used for dynamic rules and override definitions.
Vsevolod Stakhov [Sun, 28 Feb 2016 11:58:14 +0000 (11:58 +0000)]
[CritFix] Fix issue with inconsistent resorting
This is a long term issue that was in rspamd for many years. Sometimes,
some rules are not scanned or scanned twice. That happened because of
resorting called during pending tasks exist in the wait queue. In this
case, resorting breaks logic of symbols processing, causing unprocessed
rules to be treated as processed and, vice versa, processed rules as
unprocessed.
This commit introduces refcounted approach for resorting keeping state
for each individual task. This allows to resort independently from the
existing tasks waiting in the queue.
Vsevolod Stakhov [Sun, 28 Feb 2016 11:11:37 +0000 (11:11 +0000)]
[Feature] Rework dynamic symbols for new metrics API
Vsevolod Stakhov [Sat, 27 Feb 2016 14:03:59 +0000 (14:03 +0000)]
[Fix] Fix some cases for RDNS_NONE
Vsevolod Stakhov [Sat, 27 Feb 2016 13:43:41 +0000 (13:43 +0000)]
[Fix] Don't set default values for hostname and helo
Vsevolod Stakhov [Sat, 27 Feb 2016 13:39:26 +0000 (13:39 +0000)]
[Feature] Add ignore_received option
In this mode rspamd ignores data from the first received (it might be
produced by some third party and not our MTA)
Vsevolod Stakhov [Sat, 27 Feb 2016 13:39:14 +0000 (13:39 +0000)]
[Fix] Fix placement of RDNS checks
Vsevolod Stakhov [Sat, 27 Feb 2016 13:31:01 +0000 (13:31 +0000)]
[Feature] Add RDNS_NONE rule
Vsevolod Stakhov [Sat, 27 Feb 2016 13:19:03 +0000 (13:19 +0000)]
[Minor] Implement workaround for legacy clients
Vsevolod Stakhov [Fri, 26 Feb 2016 17:26:33 +0000 (17:26 +0000)]
Steal lua_text ownership to prevent gc
Vsevolod Stakhov [Fri, 26 Feb 2016 14:42:23 +0000 (14:42 +0000)]
Add more reasonable errors for lua_tcp module
Vsevolod Stakhov [Fri, 26 Feb 2016 12:43:45 +0000 (12:43 +0000)]
Add more guards for mutable cache
Vsevolod Stakhov [Fri, 26 Feb 2016 11:55:14 +0000 (11:55 +0000)]
Implement versioning in symbols cache to allow modiifications on fly
Vsevolod Stakhov [Fri, 26 Feb 2016 10:42:13 +0000 (10:42 +0000)]
Allow to set redis db and password in lua_redis
Vsevolod Stakhov [Fri, 26 Feb 2016 09:52:47 +0000 (09:52 +0000)]
Use object priority when adding symbols from ucl
Vsevolod Stakhov [Fri, 26 Feb 2016 09:51:03 +0000 (09:51 +0000)]
Allow overwrite scores with the same priority
Vsevolod Stakhov [Thu, 25 Feb 2016 18:44:17 +0000 (18:44 +0000)]
Cleanup event
Vsevolod Stakhov [Thu, 25 Feb 2016 18:43:59 +0000 (18:43 +0000)]
Destroy session if a client has gone.
Vsevolod Stakhov [Thu, 25 Feb 2016 16:57:52 +0000 (16:57 +0000)]
Add special timeout when spending too much in sync processing
Vsevolod Stakhov [Thu, 25 Feb 2016 16:57:34 +0000 (16:57 +0000)]
Increase stack size after fork
Vsevolod Stakhov [Thu, 25 Feb 2016 16:57:15 +0000 (16:57 +0000)]
Fix non-UTF regexps for pcre2
Vsevolod Stakhov [Thu, 25 Feb 2016 15:13:07 +0000 (15:13 +0000)]
Fix task:has_flag method
Vsevolod Stakhov [Thu, 25 Feb 2016 11:08:24 +0000 (11:08 +0000)]
Some fixes to the previous commit
Vsevolod Stakhov [Thu, 25 Feb 2016 10:35:58 +0000 (10:35 +0000)]
Add auth support and db selection for redis stats
Vsevolod Stakhov [Wed, 24 Feb 2016 23:15:05 +0000 (23:15 +0000)]
Fix a stupid mistake
Vsevolod Stakhov [Wed, 24 Feb 2016 17:54:30 +0000 (17:54 +0000)]
Rework system of symbols registration
It is possible now to use priorities when adding symbols to metrics and
override scores for symbols with lower priority with the scores with
high priority.
Vsevolod Stakhov [Wed, 24 Feb 2016 15:04:33 +0000 (15:04 +0000)]
Rework lua errors reporting
Vsevolod Stakhov [Wed, 24 Feb 2016 14:34:09 +0000 (14:34 +0000)]
Fix DKIM verification for empty DKIM signatures
Vsevolod Stakhov [Wed, 24 Feb 2016 13:19:05 +0000 (13:19 +0000)]
Temporary disable JIT when using valgrind
Vsevolod Stakhov [Tue, 23 Feb 2016 17:47:33 +0000 (17:47 +0000)]
Fix pcre jit fast path (one more time)
Vsevolod Stakhov [Tue, 23 Feb 2016 17:47:17 +0000 (17:47 +0000)]
Fix has_symbol method
Vsevolod Stakhov [Tue, 23 Feb 2016 16:24:07 +0000 (16:24 +0000)]
Try to workaround for double free in redis
Vsevolod Stakhov [Tue, 23 Feb 2016 11:36:47 +0000 (11:36 +0000)]
Add sanity guards for ip_score
Issue: #536
Reported by: @AlexeySa
Vsevolod Stakhov [Mon, 22 Feb 2016 23:39:49 +0000 (23:39 +0000)]
Fix some more issues found by coverity
Vsevolod Stakhov [Mon, 22 Feb 2016 23:25:29 +0000 (23:25 +0000)]
Oops, fix task:get_user
Vsevolod Stakhov [Mon, 22 Feb 2016 17:39:15 +0000 (17:39 +0000)]
Add more strict checks of arguments to lua_task
Vsevolod Stakhov [Mon, 22 Feb 2016 17:16:14 +0000 (17:16 +0000)]
Update from the recent libucl
Vsevolod Stakhov [Mon, 22 Feb 2016 15:05:56 +0000 (15:05 +0000)]
Release 1.1.4
* Print traceback on lua errors in lua config
* Fix leaks in lua error paths
* Improve 'R_EMPTY_IMAGE' rule
* Fix metas memoization in SA plugin
* Properly set `flag` in fuzzy replies
* Fix arguments order
* Fix issue with out-of-boundary reading
* Fix issues found by coverity
* Same result checking error found by coverity
* Fix varargs processing (found by coverity)
* Fix error in printing hex
* Reduce weights for some hfilter patterns
* Add aliases for task:get_from_ip:
- task:get_addr
- task:get_from_addr
- task:get_ip
* Rework once_received module
- Fix priority for `good_hosts`
- If a good host has been found do not add once_received symbols
- Fix priorities for strict once_received
- Add ability to whitelist IP addresses
* Fix `MISSING_MIMEOLE` rule for modern OE
* Treat meta tags as embedded tags (#501)
Signed-off-by: Vsevolod Stakhov <vsevolod@highsecure.ru>
Vsevolod Stakhov [Mon, 22 Feb 2016 14:41:49 +0000 (14:41 +0000)]
Handle srv protocol timeouts in a specific way
Vsevolod Stakhov [Mon, 22 Feb 2016 14:10:36 +0000 (14:10 +0000)]
Add command to sync fuzzy storage
It should be as simple as `rspamadm control fuzzy_sync`
Issue: #533
Reported by: @moisseev
Vsevolod Stakhov [Mon, 22 Feb 2016 13:24:58 +0000 (13:24 +0000)]
More doc fixes
Vsevolod Stakhov [Mon, 22 Feb 2016 13:22:12 +0000 (13:22 +0000)]
Fix doc comments
Vsevolod Stakhov [Mon, 22 Feb 2016 13:12:43 +0000 (13:12 +0000)]
Add hash API for lua_cryptobox
Vsevolod Stakhov [Mon, 22 Feb 2016 11:30:35 +0000 (11:30 +0000)]
Add high level signing API for libcryptobox
Vsevolod Stakhov [Mon, 22 Feb 2016 10:14:02 +0000 (10:14 +0000)]
Add missing features for cryptobox lua api
Vsevolod Stakhov [Sun, 21 Feb 2016 23:04:39 +0000 (23:04 +0000)]
Add some more replacements
Vsevolod Stakhov [Sun, 21 Feb 2016 22:20:13 +0000 (22:20 +0000)]
Better dependencies support between SA and rspamd
Now SA rules can depend on the corresponding rspamd rules applying the
replacement table.
Vsevolod Stakhov [Sun, 21 Feb 2016 18:09:13 +0000 (18:09 +0000)]
Fix interaction with clients with no local Received
Vsevolod Stakhov [Sat, 20 Feb 2016 23:31:23 +0000 (23:31 +0000)]
Continue work on cryptobox API
Vsevolod Stakhov [Sat, 20 Feb 2016 22:22:17 +0000 (22:22 +0000)]
Backport fix from libucl
Vsevolod Stakhov [Sat, 20 Feb 2016 17:25:59 +0000 (17:25 +0000)]
Merge pull request #532 from moisseev/patch-1
Improve html images rules
Alexander Moisseev [Sat, 20 Feb 2016 07:45:22 +0000 (10:45 +0300)]
Don't trigger R_EMPTY_IMAGE on image links
as they covered with `HTML_SHORT_LINK_IMG_1` rule.
It should be safe for legitimate emails with images attached since `R_EMPTY_IMAGE` and `HTML_SHORT_LINK_IMG_1` won't be triggered at the same time any more.
Alexander Moisseev [Sat, 20 Feb 2016 07:34:34 +0000 (10:34 +0300)]
Don't trigger HTML_SHORT_LINK_IMG on small images
It's common for legitimate emails to have small image links (buttons, social networks junk e.t.c.)
Vsevolod Stakhov [Fri, 19 Feb 2016 22:54:08 +0000 (22:54 +0000)]
Add preliminary lua API for libcryptobox
Vsevolod Stakhov [Thu, 18 Feb 2016 18:57:05 +0000 (18:57 +0000)]
Write notes about symbols in rspamd
Vsevolod Stakhov [Thu, 18 Feb 2016 18:18:11 +0000 (18:18 +0000)]
Set is_spam = true for all but 'no action' or 'greylist'
Vsevolod Stakhov [Thu, 18 Feb 2016 16:16:49 +0000 (16:16 +0000)]
In lua, number cannot be used in boolean context
Vsevolod Stakhov [Thu, 18 Feb 2016 11:42:50 +0000 (11:42 +0000)]
Backport fixes from libucl
Vsevolod Stakhov [Thu, 18 Feb 2016 11:11:05 +0000 (11:11 +0000)]
Add workaround for old glib