]> source.dussan.org Git - rspamd.git/log
rspamd.git
8 years ago[Feature] Add lua functions for caseless comparison
Vsevolod Stakhov [Mon, 7 Mar 2016 15:14:01 +0000 (15:14 +0000)]
[Feature] Add lua functions for caseless comparison

8 years ago[Feature] Add map:set_sign_key and map:get_sign_key
Vsevolod Stakhov [Mon, 7 Mar 2016 15:02:56 +0000 (15:02 +0000)]
[Feature] Add map:set_sign_key and map:get_sign_key

8 years ago[Feature] Add map:get_proto lua API method
Vsevolod Stakhov [Mon, 7 Mar 2016 12:54:55 +0000 (12:54 +0000)]
[Feature] Add map:get_proto lua API method

8 years ago[Feature] Add map:is_signed method
Vsevolod Stakhov [Mon, 7 Mar 2016 12:32:03 +0000 (12:32 +0000)]
[Feature] Add map:is_signed method

8 years ago[Fix] Temporary disable ignoring of bad HTML tags
Vsevolod Stakhov [Mon, 7 Mar 2016 10:42:44 +0000 (10:42 +0000)]
[Fix] Temporary disable ignoring of bad HTML tags

8 years agoMerge pull request #547 from kristous/patch-1
Vsevolod Stakhov [Mon, 7 Mar 2016 00:28:51 +0000 (00:28 +0000)]
Merge pull request #547 from kristous/patch-1

Update phishing.md

8 years ago[Rework] Move maps code to a separate lua unit
Vsevolod Stakhov [Sun, 6 Mar 2016 18:12:33 +0000 (18:12 +0000)]
[Rework] Move maps code to a separate lua unit

8 years ago[Feature] Return map object for further actions
Vsevolod Stakhov [Sun, 6 Mar 2016 14:32:08 +0000 (14:32 +0000)]
[Feature] Return map object for further actions

Map object could be used to manage maps, for example, by LUA API.

8 years agoUpdate phishing.md 547/head
kristous [Sun, 6 Mar 2016 07:56:27 +0000 (08:56 +0100)]
Update phishing.md

found a small typo :-)

8 years ago[Minor] Use utf8 length for subject
Vsevolod Stakhov [Sat, 5 Mar 2016 22:20:47 +0000 (22:20 +0000)]
[Minor] Use utf8 length for subject

8 years ago[Feature] Add util.strlen_utf8 lua function
Vsevolod Stakhov [Sat, 5 Mar 2016 22:16:16 +0000 (22:16 +0000)]
[Feature] Add util.strlen_utf8 lua function

8 years agoMerge pull request #546 from moisseev/patch-2
Vsevolod Stakhov [Sat, 5 Mar 2016 22:07:45 +0000 (22:07 +0000)]
Merge pull request #546 from moisseev/patch-2

Add LONG_SUBJ rule

8 years agoAdd LONG_SUBJ rule 546/head
Alexander Moisseev [Sat, 5 Mar 2016 18:59:58 +0000 (21:59 +0300)]
Add LONG_SUBJ rule

8 years ago[Feature] Rework and abstract lua maps API
Vsevolod Stakhov [Sat, 5 Mar 2016 14:44:08 +0000 (14:44 +0000)]
[Feature] Rework and abstract lua maps API

- Now all maps share the same lua object table.
- Remove bad destructions code since objects are reallocated during maps
  operations
- Fix and unify various parts of maps management
- Pass map object to lua callbacks

8 years ago[MajorFeature] Add preliminary version of updates
Vsevolod Stakhov [Sat, 5 Mar 2016 13:36:51 +0000 (13:36 +0000)]
[MajorFeature] Add preliminary version of updates

This plugin is intended to load dynamic updates for rspamd. Now its
functionality is very limited.

8 years ago[Minor] Fix lua_cryptobox registration
Vsevolod Stakhov [Sat, 5 Mar 2016 13:23:29 +0000 (13:23 +0000)]
[Minor] Fix lua_cryptobox registration

8 years ago[Minor] Add guards for NaN values
Vsevolod Stakhov [Fri, 4 Mar 2016 15:10:37 +0000 (15:10 +0000)]
[Minor] Add guards for NaN values

8 years ago[Feature] Add support for WLBLEval SA plugin
Vsevolod Stakhov [Fri, 4 Mar 2016 14:56:43 +0000 (14:56 +0000)]
[Feature] Add support for WLBLEval SA plugin

8 years ago[Minor] Fix actions setting
Vsevolod Stakhov [Fri, 4 Mar 2016 14:42:44 +0000 (14:42 +0000)]
[Minor] Fix actions setting

8 years ago[Fix] Properly set priority for rules with negative score
Vsevolod Stakhov [Fri, 4 Mar 2016 13:19:58 +0000 (13:19 +0000)]
[Fix] Properly set priority for rules with negative score

8 years ago[Fix] Fix race condition in lua_tcp module
Vsevolod Stakhov [Fri, 4 Mar 2016 11:22:36 +0000 (11:22 +0000)]
[Fix] Fix race condition in lua_tcp module

8 years ago[Feature] Add task:set_metric_action lua API method
Vsevolod Stakhov [Thu, 3 Mar 2016 18:05:20 +0000 (18:05 +0000)]
[Feature] Add task:set_metric_action lua API method

rspamd_config:set_metric_symbol({table})

Set the value of a specified symbol in a metric.
This function accepts table with the following elements:

- `name`: name of symbol (string)
- `score`: score for symbol (number)
- `metric`: name of metric (string, optional)
- `description`: description of symbol (string, optional)
- `group`: name of group for symbol (string, optional)
- `one_shot`: turn off multiple hits for a symbol (boolean, optional)
- `flags`: comma separated string of flags:
   + `ignore`: do not strictly check validity of symbol and corresponding rule
   + `one_shot`: turn off multiple hits for a symbol
- `priority`: priority of symbol's definition

8 years ago[Fix] Set 'ignore' flags from symbols coming from SA
Vsevolod Stakhov [Thu, 3 Mar 2016 17:06:04 +0000 (17:06 +0000)]
[Fix] Set 'ignore' flags from symbols coming from SA

8 years ago[Feature] Allow to specify flags for metric symbols
Vsevolod Stakhov [Thu, 3 Mar 2016 17:05:49 +0000 (17:05 +0000)]
[Feature] Allow to specify flags for metric symbols

8 years ago[Fix] Add watcher for lua_tcp module
Vsevolod Stakhov [Thu, 3 Mar 2016 16:53:00 +0000 (16:53 +0000)]
[Fix] Add watcher for lua_tcp module

8 years ago[Fix] Lowercase and cache the principal recipient
Vsevolod Stakhov [Thu, 3 Mar 2016 15:26:27 +0000 (15:26 +0000)]
[Fix] Lowercase and cache the principal recipient

Issue: #544
Reported by: @sativouf

8 years ago[Feature] Improve tests for siphash
Vsevolod Stakhov [Thu, 3 Mar 2016 12:19:48 +0000 (12:19 +0000)]
[Feature] Improve tests for siphash

- Add fuzz tests
- Add variable length input tests
- Check sanity of siphash implementation on start

8 years ago[Fix] Don't use _memcpy in assembly
Vsevolod Stakhov [Thu, 3 Mar 2016 11:28:42 +0000 (11:28 +0000)]
[Fix] Don't use _memcpy in assembly

8 years ago[Feature] Add AVX2 version of siphash
Vsevolod Stakhov [Thu, 3 Mar 2016 10:37:47 +0000 (10:37 +0000)]
[Feature] Add AVX2 version of siphash

This version has been taken from the google code at
https://github.com/google/highwayhash/

The final code is obtained by compiling c++ using clang-3.8 compiler.

8 years ago[Minor] Disable shutdown workaround for HTTP
Vsevolod Stakhov [Thu, 3 Mar 2016 10:05:28 +0000 (10:05 +0000)]
[Minor] Disable shutdown workaround for HTTP

8 years agoMerge pull request #543 from fatalbanana/master
Vsevolod Stakhov [Thu, 3 Mar 2016 09:19:24 +0000 (09:19 +0000)]
Merge pull request #543 from fatalbanana/master

[Fix] Avoid problematic operation on possibly nil value in once_received

8 years ago[Fix] Avoid problematic operation on possibly nil value in once_received 543/head
Andrew Lewis [Thu, 3 Mar 2016 08:43:59 +0000 (10:43 +0200)]
[Fix] Avoid problematic operation on possibly nil value in once_received

8 years ago[Fix] Add more guards for IP address
Vsevolod Stakhov [Wed, 2 Mar 2016 12:58:26 +0000 (12:58 +0000)]
[Fix] Add more guards for IP address

8 years ago[Feature] SA plugin can now set missing scores for rspamd
Vsevolod Stakhov [Wed, 2 Mar 2016 12:11:12 +0000 (12:11 +0000)]
[Feature] SA plugin can now set missing scores for rspamd

8 years ago[Minor] Fix spelling in log message
Vsevolod Stakhov [Wed, 2 Mar 2016 12:10:59 +0000 (12:10 +0000)]
[Minor] Fix spelling in log message

8 years ago[Fix] Handle some bad IP URLs
Vsevolod Stakhov [Wed, 2 Mar 2016 11:52:39 +0000 (11:52 +0000)]
[Fix] Handle some bad IP URLs

8 years ago[Feature] Export versions vars to UCL
Vsevolod Stakhov [Tue, 1 Mar 2016 13:04:43 +0000 (13:04 +0000)]
[Feature] Export versions vars to UCL

8 years ago[Feature] Add rspamd_version function to LUA API
Vsevolod Stakhov [Tue, 1 Mar 2016 12:27:02 +0000 (12:27 +0000)]
[Feature] Add rspamd_version function to LUA API

8 years ago[Minor] Temporary disable scheduler optimization
Vsevolod Stakhov [Mon, 29 Feb 2016 15:50:22 +0000 (15:50 +0000)]
[Minor] Temporary disable scheduler optimization

It is not very well investigated and might decrease performance in some
cases I care about.

8 years ago[Feature] Improve symbols sorting function
Vsevolod Stakhov [Mon, 29 Feb 2016 15:45:29 +0000 (15:45 +0000)]
[Feature] Improve symbols sorting function

8 years ago[Fix] Fix redis stats to avoid double free
Vsevolod Stakhov [Mon, 29 Feb 2016 15:26:43 +0000 (15:26 +0000)]
[Fix] Fix redis stats to avoid double free

8 years ago[Feature] Add lockless logging
Vsevolod Stakhov [Mon, 29 Feb 2016 15:18:39 +0000 (15:18 +0000)]
[Feature] Add lockless logging

Sometimes, it is needed to turn off logging mutex to avoid recursive
mutex obtaining. It is especially useful to do it within children wait
code in the main processes dispatcher.

8 years ago[Minor] Fix race condition when removing hash
Vsevolod Stakhov [Mon, 29 Feb 2016 14:59:41 +0000 (14:59 +0000)]
[Minor] Fix race condition when removing hash

8 years ago[Minor] Fix closing race in fuzzy storage
Vsevolod Stakhov [Mon, 29 Feb 2016 14:59:26 +0000 (14:59 +0000)]
[Minor] Fix closing race in fuzzy storage

8 years ago[Fix] Fix sorting order for symbols cache
Vsevolod Stakhov [Mon, 29 Feb 2016 14:53:12 +0000 (14:53 +0000)]
[Fix] Fix sorting order for symbols cache

8 years ago[Fix] Fix `all` in spf redirects
Vsevolod Stakhov [Mon, 29 Feb 2016 13:54:42 +0000 (13:54 +0000)]
[Fix] Fix `all` in spf redirects

Issue: #542
Reported by: @sativouf

8 years ago[Fix] Fix crash on scan
Vsevolod Stakhov [Mon, 29 Feb 2016 12:52:53 +0000 (12:52 +0000)]
[Fix] Fix crash on scan

8 years ago[Minor] Fix reject action parsing
Vsevolod Stakhov [Mon, 29 Feb 2016 11:14:12 +0000 (11:14 +0000)]
[Minor] Fix reject action parsing

8 years ago[Minor] Hide rdrand checks for non-x86 platforms
Vsevolod Stakhov [Mon, 29 Feb 2016 11:11:39 +0000 (11:11 +0000)]
[Minor] Hide rdrand checks for non-x86 platforms

8 years ago[Feature] Add priorities for actions
Vsevolod Stakhov [Sun, 28 Feb 2016 22:58:20 +0000 (22:58 +0000)]
[Feature] Add priorities for actions

Add dedicated API to modify action limits with priorities from different
configuration place. This follows the logic of symbols' priorities and
will be used for dynamic rules and override definitions.

8 years ago[CritFix] Fix issue with inconsistent resorting
Vsevolod Stakhov [Sun, 28 Feb 2016 11:58:14 +0000 (11:58 +0000)]
[CritFix] Fix issue with inconsistent resorting

This is a long term issue that was in rspamd for many years. Sometimes,
some rules are not scanned or scanned twice. That happened because of
resorting called during pending tasks exist in the wait queue. In this
case, resorting breaks logic of symbols processing, causing unprocessed
rules to be treated as processed and, vice versa, processed rules as
unprocessed.

This commit introduces refcounted approach for resorting keeping state
for each individual task. This allows to resort independently from the
existing tasks waiting in the queue.

8 years ago[Feature] Rework dynamic symbols for new metrics API
Vsevolod Stakhov [Sun, 28 Feb 2016 11:11:37 +0000 (11:11 +0000)]
[Feature] Rework dynamic symbols for new metrics API

8 years ago[Fix] Fix some cases for RDNS_NONE
Vsevolod Stakhov [Sat, 27 Feb 2016 14:03:59 +0000 (14:03 +0000)]
[Fix] Fix some cases for RDNS_NONE

8 years ago[Fix] Don't set default values for hostname and helo
Vsevolod Stakhov [Sat, 27 Feb 2016 13:43:41 +0000 (13:43 +0000)]
[Fix] Don't set default values for hostname and helo

8 years ago[Feature] Add ignore_received option
Vsevolod Stakhov [Sat, 27 Feb 2016 13:39:26 +0000 (13:39 +0000)]
[Feature] Add ignore_received option

In this mode rspamd ignores data from the first received (it might be
produced by some third party and not our MTA)

8 years ago[Fix] Fix placement of RDNS checks
Vsevolod Stakhov [Sat, 27 Feb 2016 13:39:14 +0000 (13:39 +0000)]
[Fix] Fix placement of RDNS checks

8 years ago[Feature] Add RDNS_NONE rule
Vsevolod Stakhov [Sat, 27 Feb 2016 13:31:01 +0000 (13:31 +0000)]
[Feature] Add RDNS_NONE rule

8 years ago[Minor] Implement workaround for legacy clients
Vsevolod Stakhov [Sat, 27 Feb 2016 13:19:03 +0000 (13:19 +0000)]
[Minor] Implement workaround for legacy clients

8 years agoSteal lua_text ownership to prevent gc
Vsevolod Stakhov [Fri, 26 Feb 2016 17:26:33 +0000 (17:26 +0000)]
Steal lua_text ownership to prevent gc

8 years agoAdd more reasonable errors for lua_tcp module
Vsevolod Stakhov [Fri, 26 Feb 2016 14:42:23 +0000 (14:42 +0000)]
Add more reasonable errors for lua_tcp module

8 years agoAdd more guards for mutable cache
Vsevolod Stakhov [Fri, 26 Feb 2016 12:43:45 +0000 (12:43 +0000)]
Add more guards for mutable cache

8 years agoImplement versioning in symbols cache to allow modiifications on fly
Vsevolod Stakhov [Fri, 26 Feb 2016 11:55:14 +0000 (11:55 +0000)]
Implement versioning in symbols cache to allow modiifications on fly

8 years agoAllow to set redis db and password in lua_redis
Vsevolod Stakhov [Fri, 26 Feb 2016 10:42:13 +0000 (10:42 +0000)]
Allow to set redis db and password in lua_redis

8 years agoUse object priority when adding symbols from ucl
Vsevolod Stakhov [Fri, 26 Feb 2016 09:52:47 +0000 (09:52 +0000)]
Use object priority when adding symbols from ucl

8 years agoAllow overwrite scores with the same priority
Vsevolod Stakhov [Fri, 26 Feb 2016 09:51:03 +0000 (09:51 +0000)]
Allow overwrite scores with the same priority

8 years agoCleanup event
Vsevolod Stakhov [Thu, 25 Feb 2016 18:44:17 +0000 (18:44 +0000)]
Cleanup event

8 years agoDestroy session if a client has gone.
Vsevolod Stakhov [Thu, 25 Feb 2016 18:43:59 +0000 (18:43 +0000)]
Destroy session if a client has gone.

8 years agoAdd special timeout when spending too much in sync processing
Vsevolod Stakhov [Thu, 25 Feb 2016 16:57:52 +0000 (16:57 +0000)]
Add special timeout when spending too much in sync processing

8 years agoIncrease stack size after fork
Vsevolod Stakhov [Thu, 25 Feb 2016 16:57:34 +0000 (16:57 +0000)]
Increase stack size after fork

8 years agoFix non-UTF regexps for pcre2
Vsevolod Stakhov [Thu, 25 Feb 2016 16:57:15 +0000 (16:57 +0000)]
Fix non-UTF regexps for pcre2

8 years agoFix task:has_flag method
Vsevolod Stakhov [Thu, 25 Feb 2016 15:13:07 +0000 (15:13 +0000)]
Fix task:has_flag method

8 years agoSome fixes to the previous commit
Vsevolod Stakhov [Thu, 25 Feb 2016 11:08:24 +0000 (11:08 +0000)]
Some fixes to the previous commit

8 years agoAdd auth support and db selection for redis stats
Vsevolod Stakhov [Thu, 25 Feb 2016 10:35:58 +0000 (10:35 +0000)]
Add auth support and db selection for redis stats

8 years agoFix a stupid mistake
Vsevolod Stakhov [Wed, 24 Feb 2016 23:15:05 +0000 (23:15 +0000)]
Fix a stupid mistake

8 years agoRework system of symbols registration
Vsevolod Stakhov [Wed, 24 Feb 2016 17:54:30 +0000 (17:54 +0000)]
Rework system of symbols registration

It is possible now to use priorities when adding symbols to metrics and
override scores for symbols with lower priority with the scores with
high priority.

8 years agoRework lua errors reporting
Vsevolod Stakhov [Wed, 24 Feb 2016 15:04:33 +0000 (15:04 +0000)]
Rework lua errors reporting

8 years agoFix DKIM verification for empty DKIM signatures
Vsevolod Stakhov [Wed, 24 Feb 2016 14:34:09 +0000 (14:34 +0000)]
Fix DKIM verification for empty DKIM signatures

8 years agoTemporary disable JIT when using valgrind
Vsevolod Stakhov [Wed, 24 Feb 2016 13:19:05 +0000 (13:19 +0000)]
Temporary disable JIT when using valgrind

8 years agoFix pcre jit fast path (one more time)
Vsevolod Stakhov [Tue, 23 Feb 2016 17:47:33 +0000 (17:47 +0000)]
Fix pcre jit fast path (one more time)

8 years agoFix has_symbol method
Vsevolod Stakhov [Tue, 23 Feb 2016 17:47:17 +0000 (17:47 +0000)]
Fix has_symbol method

8 years agoTry to workaround for double free in redis
Vsevolod Stakhov [Tue, 23 Feb 2016 16:24:07 +0000 (16:24 +0000)]
Try to workaround for double free in redis

8 years agoAdd sanity guards for ip_score
Vsevolod Stakhov [Tue, 23 Feb 2016 11:36:47 +0000 (11:36 +0000)]
Add sanity guards for ip_score

Issue: #536
Reported by: @AlexeySa

8 years agoFix some more issues found by coverity
Vsevolod Stakhov [Mon, 22 Feb 2016 23:39:49 +0000 (23:39 +0000)]
Fix some more issues found by coverity

8 years agoOops, fix task:get_user
Vsevolod Stakhov [Mon, 22 Feb 2016 23:25:29 +0000 (23:25 +0000)]
Oops, fix task:get_user

8 years agoAdd more strict checks of arguments to lua_task
Vsevolod Stakhov [Mon, 22 Feb 2016 17:39:15 +0000 (17:39 +0000)]
Add more strict checks of arguments to lua_task

8 years agoUpdate from the recent libucl
Vsevolod Stakhov [Mon, 22 Feb 2016 17:16:14 +0000 (17:16 +0000)]
Update from the recent libucl

8 years agoRelease 1.1.4
Vsevolod Stakhov [Mon, 22 Feb 2016 15:05:56 +0000 (15:05 +0000)]
Release 1.1.4

* Print traceback on lua errors in lua config
* Fix leaks in lua error paths
* Improve 'R_EMPTY_IMAGE' rule
* Fix metas memoization in SA plugin
* Properly set `flag` in fuzzy replies
* Fix arguments order
* Fix issue with out-of-boundary reading
* Fix issues found by coverity
* Same result checking error found by coverity
* Fix varargs processing (found by coverity)
* Fix error in printing hex
* Reduce weights for some hfilter patterns
* Add aliases for task:get_from_ip:
- task:get_addr
- task:get_from_addr
- task:get_ip
*  Rework once_received module
- Fix priority for `good_hosts`
- If a good host has been found do not add once_received symbols
- Fix priorities for strict once_received
- Add ability to whitelist IP addresses
* Fix `MISSING_MIMEOLE` rule for modern OE
* Treat meta tags as embedded tags (#501)

Signed-off-by: Vsevolod Stakhov <vsevolod@highsecure.ru>
8 years agoHandle srv protocol timeouts in a specific way
Vsevolod Stakhov [Mon, 22 Feb 2016 14:41:49 +0000 (14:41 +0000)]
Handle srv protocol timeouts in a specific way

8 years agoAdd command to sync fuzzy storage
Vsevolod Stakhov [Mon, 22 Feb 2016 14:10:36 +0000 (14:10 +0000)]
Add command to sync fuzzy storage

It should be as simple as `rspamadm control fuzzy_sync`

Issue: #533
Reported by: @moisseev

8 years agoMore doc fixes
Vsevolod Stakhov [Mon, 22 Feb 2016 13:24:58 +0000 (13:24 +0000)]
More doc fixes

8 years agoFix doc comments
Vsevolod Stakhov [Mon, 22 Feb 2016 13:22:12 +0000 (13:22 +0000)]
Fix doc comments

8 years agoAdd hash API for lua_cryptobox
Vsevolod Stakhov [Mon, 22 Feb 2016 13:12:43 +0000 (13:12 +0000)]
Add hash API for lua_cryptobox

8 years agoAdd high level signing API for libcryptobox
Vsevolod Stakhov [Mon, 22 Feb 2016 11:30:35 +0000 (11:30 +0000)]
Add high level signing API for libcryptobox

8 years agoAdd missing features for cryptobox lua api
Vsevolod Stakhov [Mon, 22 Feb 2016 10:14:02 +0000 (10:14 +0000)]
Add missing features for cryptobox lua api

8 years agoAdd some more replacements
Vsevolod Stakhov [Sun, 21 Feb 2016 23:04:39 +0000 (23:04 +0000)]
Add some more replacements

8 years agoBetter dependencies support between SA and rspamd
Vsevolod Stakhov [Sun, 21 Feb 2016 22:20:13 +0000 (22:20 +0000)]
Better dependencies support between SA and rspamd

Now SA rules can depend on the corresponding rspamd rules applying the
replacement table.

8 years agoFix interaction with clients with no local Received
Vsevolod Stakhov [Sun, 21 Feb 2016 18:09:13 +0000 (18:09 +0000)]
Fix interaction with clients with no local Received

8 years agoContinue work on cryptobox API
Vsevolod Stakhov [Sat, 20 Feb 2016 23:31:23 +0000 (23:31 +0000)]
Continue work on cryptobox API

8 years agoBackport fix from libucl
Vsevolod Stakhov [Sat, 20 Feb 2016 22:22:17 +0000 (22:22 +0000)]
Backport fix from libucl

8 years agoMerge pull request #532 from moisseev/patch-1
Vsevolod Stakhov [Sat, 20 Feb 2016 17:25:59 +0000 (17:25 +0000)]
Merge pull request #532 from moisseev/patch-1

Improve html images rules