]>
source.dussan.org Git - rspamd.git/log
Vsevolod Stakhov [Mon, 21 Mar 2016 13:43:32 +0000 (13:43 +0000)]
Release 1.2.0
* New dynamic updates plugin
* Regular expressions map support
* Faster radix trie algorithm
* Faster siphash for AVX2 supporing CPUs (used in fuzzy hashes)
* PCRE2 support
* Allow quoted and slashed keys in map
* Add proper support of DNS resolvers balancing (#552)
* Rework includes and configuration system for better local changes support
* New keypairs framework for signing and encryption
* Added support for dynamic modules and workers
* Allow to dump configuration with help comments
* Rework once_received module
- Fix priority for `good_hosts`
- If a good host has been found do not add once_received symbols
- Fix priorities for strict once_received
- Add ability to whitelist IP addresses
* Implement support of signed maps for HTTP and file maps
* Add command to sync fuzzy storage (#533)
* Rework system of symbols and actions registration
It is possible now to use priorities when adding symbols to metrics and
override scores for symbols with lower priority with the scores with
high priority.
* Add auth support and db selection for redis stats
* Improve composite rules application
* Add ignore_received option
* Fix critical issue with inconsistent resorting
* Fix `all` in spf redirects
* Add punycoded versions for IDN domains (#554)
* Improve sorting order for symbols cache
* Add lockless logging for processes management
* Allow to specify flags for metric symbols
* Load images height and width from style attribute (#538)
* Override DNS requests limits for SPF and DKIM
* Fix resetting symbols to their default values in WebUI
* Improve configuration agility for redis stats
* Allow to set db and password for redis in stat_convert
* Import the latest libucl
* LUA API changes:
- Add rspamd_version function to LUA API
- Add lua_cryptobox module
- Add lua_map module
- Add task:set_metric_action lua API method
- Fix race condition in lua_tcp module
- Fix a lot of issues in lua_redis module
- Rework and abstract lua maps API
- Add util.strlen_utf8 lua function
- Add lua functions for caseless comparison
- Allow optional symbols registration
- Add config:add_map table form method, add regexp maps
- Add task:has_urls method
- Add task:has_flag method
- Add html tags methods to lua_html
- Add task:get_dns_req
* Plugins changes:
- Add support for WLBLEval SA plugin
- Use caseless comparison in SA and DMARC plugins
- Allow SA plugin to set scores for rspamd symbols
- Add regexp maps support to multimap
- Allow filenames match in multimap
- Add more filters for the existing map types
- Fix html images rules to reduce FP rates
* New rules:
- LONG_SUBJ - too long subject
- MIME_BAD_ATTACHMENT - bad attachement type
- RDNS_NONE - no reverse DNS record for sender's IP
- Fix MISSING_MIMEOLE rule for modern OE
* Many other bugfixes, memory leaks plugs thanks to:
- Coverity scan
- New gcc-6 warnings
- valgrind manual iterations
* Documentation improvements:
- FAQ list: https://rspamd.com/doc/faq.html
- Reworked quick start guide
- Added documentation for all active modules
* Other changes:
- Dropped Ubuntu Vivid support
- Added Ubuntu Xenial support
- Rework build system for rspamd and rmilter
Signed-off-by: Vsevolod Stakhov <vsevolod@highsecure.ru>
Vsevolod Stakhov [Mon, 21 Mar 2016 12:40:03 +0000 (12:40 +0000)]
[Doc] Add mime_types documentation
Vsevolod Stakhov [Mon, 21 Mar 2016 10:15:45 +0000 (10:15 +0000)]
[Doc] Add some documentation for rspamd update
Vsevolod Stakhov [Mon, 21 Mar 2016 09:18:36 +0000 (09:18 +0000)]
[Feature] Allow base32 keys in maps
Vsevolod Stakhov [Sat, 19 Mar 2016 14:36:13 +0000 (14:36 +0000)]
[Minor] Add some more info about systemd failures
Vsevolod Stakhov [Sat, 19 Mar 2016 11:22:36 +0000 (11:22 +0000)]
[Doc] Use UCL highlighter instead of nginx
Vsevolod Stakhov [Sat, 19 Mar 2016 11:22:17 +0000 (11:22 +0000)]
[Doc] Update redis backend documentation
Vsevolod Stakhov [Fri, 18 Mar 2016 13:39:25 +0000 (13:39 +0000)]
[Fix] Lowercase keys in SA lists
Vsevolod Stakhov [Fri, 18 Mar 2016 10:54:51 +0000 (10:54 +0000)]
[Fix] Fix resetting symbols to their default values in WebUI
Vsevolod Stakhov [Fri, 18 Mar 2016 10:43:00 +0000 (10:43 +0000)]
[Fix] Fix a bug in MIME_BAD_ATTACHMENT rule
Issue: #561
Reported by: @moisseev
Vsevolod Stakhov [Fri, 18 Mar 2016 09:55:14 +0000 (09:55 +0000)]
[Minor] Add `trusted_ips` alias
Vsevolod Stakhov [Thu, 17 Mar 2016 16:36:05 +0000 (16:36 +0000)]
[Doc] Add chartable documentation
Vsevolod Stakhov [Thu, 17 Mar 2016 16:35:46 +0000 (16:35 +0000)]
[Doc] Document new map types and features
Vsevolod Stakhov [Thu, 17 Mar 2016 14:14:04 +0000 (14:14 +0000)]
[Feature] Rework composite rules application
First of all exclude all elements with any parent that is negation:
`!A || B` -> here we can have both !A and B matched, but we do *NOT*
want to remove symbol in that case.
We apply the following logic subsequently:
- if no composites would like to save score then we remove score
- if no composites would like to save symbol then we remove symbol
Vsevolod Stakhov [Thu, 17 Mar 2016 14:13:45 +0000 (14:13 +0000)]
[Feature] Save operation node for expressions atoms
Vsevolod Stakhov [Thu, 17 Mar 2016 13:14:45 +0000 (13:14 +0000)]
[Minor] Place default extensions map to the config
Vsevolod Stakhov [Thu, 17 Mar 2016 13:14:21 +0000 (13:14 +0000)]
[Minor] Add HS_FLAG_SINGLEMATCH for re maps
Vsevolod Stakhov [Thu, 17 Mar 2016 12:45:39 +0000 (12:45 +0000)]
[Feature] Add filename multimap type
Vsevolod Stakhov [Thu, 17 Mar 2016 12:15:44 +0000 (12:15 +0000)]
[Feature] Allow regexp maps for mime types
Vsevolod Stakhov [Thu, 17 Mar 2016 12:15:18 +0000 (12:15 +0000)]
[Feature] Add MIME_BAD_ATTACHMENT rule for bad attachment types
Vsevolod Stakhov [Thu, 17 Mar 2016 11:06:39 +0000 (11:06 +0000)]
[Feature] Add punycoded versions for IDN domains
Issue: #554
Reported by: @moisseev
Vsevolod Stakhov [Thu, 17 Mar 2016 10:38:39 +0000 (10:38 +0000)]
Merge pull request #559 from moisseev/patch-2
[Minor] Raise `LONG_SUBJ` threshold
Vsevolod Stakhov [Thu, 17 Mar 2016 10:15:08 +0000 (10:15 +0000)]
[Feature] Add regexp maps support to multimap module
Vsevolod Stakhov [Thu, 17 Mar 2016 10:14:48 +0000 (10:14 +0000)]
[Minor] Fix loading of regexp maps
Vsevolod Stakhov [Thu, 17 Mar 2016 10:14:30 +0000 (10:14 +0000)]
[Fix] Allocate ids array in case of hyperscan
Vsevolod Stakhov [Thu, 17 Mar 2016 10:08:10 +0000 (10:08 +0000)]
[Minor] Fix description of rspamd_lua_parse_table_arguments
Vsevolod Stakhov [Thu, 17 Mar 2016 09:57:40 +0000 (09:57 +0000)]
[Feature] Add config:add_map table form method, add regexp maps
Alexander Moisseev [Thu, 17 Mar 2016 06:59:55 +0000 (09:59 +0300)]
[Minor] Raise `LONG_SUBJ` threshold
Vsevolod Stakhov [Wed, 16 Mar 2016 17:55:07 +0000 (17:55 +0000)]
[Feature] Allow to extract functions from lua tables
Vsevolod Stakhov [Wed, 16 Mar 2016 17:50:14 +0000 (17:50 +0000)]
[Feature] Add method to check regexp maps
Vsevolod Stakhov [Wed, 16 Mar 2016 16:42:43 +0000 (16:42 +0000)]
[Feature] Allow to set db and password for redis in stat_convert
Vsevolod Stakhov [Wed, 16 Mar 2016 16:42:23 +0000 (16:42 +0000)]
[Fix] Fix couple of issues with arguments in lua_redis
Vsevolod Stakhov [Wed, 16 Mar 2016 16:42:06 +0000 (16:42 +0000)]
[Fix] Fix parsing of address:port
Vsevolod Stakhov [Wed, 16 Mar 2016 14:01:16 +0000 (14:01 +0000)]
[Feature] More sane configuration for redis statistics
Vsevolod Stakhov [Wed, 16 Mar 2016 09:03:02 +0000 (09:03 +0000)]
[Fix] Improve diagnostic for url misdetection
Vsevolod Stakhov [Tue, 15 Mar 2016 17:40:39 +0000 (17:40 +0000)]
[Feature] Add support for regexp maps
Vsevolod Stakhov [Tue, 15 Mar 2016 17:04:25 +0000 (17:04 +0000)]
[Fix] Do not check empty html components
Vsevolod Stakhov [Tue, 15 Mar 2016 15:06:07 +0000 (15:06 +0000)]
[Fix] Restore described behaviour for some lua functions
Vsevolod Stakhov [Tue, 15 Mar 2016 14:58:43 +0000 (14:58 +0000)]
[Feature] Rework rspamd DNS to use the ordinary upstreams rotation
Issue: #552
Reported by: @Freeaqingme
Vsevolod Stakhov [Tue, 15 Mar 2016 14:57:38 +0000 (14:57 +0000)]
[Minor] Nameservers are now raw ucl object
Vsevolod Stakhov [Tue, 15 Mar 2016 14:57:04 +0000 (14:57 +0000)]
[Feature] Add workaround for master-slave definitions
Vsevolod Stakhov [Tue, 15 Mar 2016 14:56:41 +0000 (14:56 +0000)]
[Feature] Allow forced and non-forced upstreams selection
Vsevolod Stakhov [Tue, 15 Mar 2016 14:56:25 +0000 (14:56 +0000)]
[Fix] Fix parsing upstreams from UCL
Vsevolod Stakhov [Tue, 15 Mar 2016 14:55:51 +0000 (14:55 +0000)]
[Feature] Allow raw ucl options in the config
Vsevolod Stakhov [Tue, 15 Mar 2016 13:45:53 +0000 (13:45 +0000)]
[Feature] Allow iterating over upstreams
Vsevolod Stakhov [Tue, 15 Mar 2016 13:26:52 +0000 (13:26 +0000)]
[Feature] Add flags and opaque data to upstreams
Vsevolod Stakhov [Tue, 15 Mar 2016 12:55:03 +0000 (12:55 +0000)]
[Feature] Rework librdns to interact with external upstreams
Vsevolod Stakhov [Tue, 15 Mar 2016 12:05:18 +0000 (12:05 +0000)]
[Minor] Add EV_CLOSED support for guard event
Vsevolod Stakhov [Tue, 15 Mar 2016 11:53:00 +0000 (11:53 +0000)]
[Minor] Fix some errno handling
Vsevolod Stakhov [Tue, 15 Mar 2016 11:50:00 +0000 (11:50 +0000)]
[Minor] Ensure that socket received is non-blocking
Vsevolod Stakhov [Tue, 15 Mar 2016 09:27:31 +0000 (09:27 +0000)]
[Minor] Fix map callback type
Vsevolod Stakhov [Tue, 15 Mar 2016 09:22:07 +0000 (09:22 +0000)]
[Feature] Allways clear maps on exit
Vsevolod Stakhov [Mon, 14 Mar 2016 23:58:28 +0000 (23:58 +0000)]
[Fix] Fix memory leak in HTTP request code
Vsevolod Stakhov [Mon, 14 Mar 2016 19:13:44 +0000 (19:13 +0000)]
[Feature] Allow quoted and slashed keys in maps
Vsevolod Stakhov [Mon, 14 Mar 2016 18:47:23 +0000 (18:47 +0000)]
[Feature] Restore locking logic for HTTP maps
Vsevolod Stakhov [Mon, 14 Mar 2016 18:45:06 +0000 (18:45 +0000)]
[Fix] More fixes to maps resources management
Vsevolod Stakhov [Mon, 14 Mar 2016 17:21:31 +0000 (17:21 +0000)]
[Fix] Rework map reading state machine
Vsevolod Stakhov [Mon, 14 Mar 2016 16:05:32 +0000 (16:05 +0000)]
[Fix] Switch to refcounts to avoid more races
Issue: #550
Reported by: @moisseev
Vsevolod Stakhov [Mon, 14 Mar 2016 11:50:31 +0000 (11:50 +0000)]
[Fix] Fix another memory issue with lua maps
Issue: #550
Reported by: @moisseev
Vsevolod Stakhov [Mon, 14 Mar 2016 11:50:15 +0000 (11:50 +0000)]
[Fix] Fix memory allocation in fstring
Vsevolod Stakhov [Mon, 14 Mar 2016 09:32:22 +0000 (09:32 +0000)]
[Fix] Fix potential HTTP connection structure corruption
Issue: #550
Reported by: @moisseev
Vsevolod Stakhov [Sun, 13 Mar 2016 22:21:19 +0000 (22:21 +0000)]
[Fix] Use CAS for atomic maps lock
Vsevolod Stakhov [Sun, 13 Mar 2016 21:14:42 +0000 (21:14 +0000)]
[Feature] Allow data for all maps types
Vsevolod Stakhov [Sun, 13 Mar 2016 17:54:07 +0000 (17:54 +0000)]
[Minor] Add flag for embedded maps
Vsevolod Stakhov [Sat, 12 Mar 2016 14:44:49 +0000 (14:44 +0000)]
[Feature] Print map id when using it in lua logger
Vsevolod Stakhov [Sat, 12 Mar 2016 14:37:58 +0000 (14:37 +0000)]
[Feature] Add map:get_uri method
Vsevolod Stakhov [Sat, 12 Mar 2016 13:21:48 +0000 (13:21 +0000)]
[Fetaure] Be more clever about map timeouts
Vsevolod Stakhov [Sat, 12 Mar 2016 13:12:34 +0000 (13:12 +0000)]
[Fix] Fix case when DNS resolver is not initialized
Vsevolod Stakhov [Fri, 11 Mar 2016 17:20:17 +0000 (17:20 +0000)]
[Feature] Add task:get_dns_req method
Vsevolod Stakhov [Fri, 11 Mar 2016 16:44:06 +0000 (16:44 +0000)]
[Feature] Override DNS requests limits for SPF and DKIM
Vsevolod Stakhov [Fri, 11 Mar 2016 15:38:53 +0000 (15:38 +0000)]
[Minor] Revert disabling of fast path
Vsevolod Stakhov [Fri, 11 Mar 2016 13:12:17 +0000 (13:12 +0000)]
[Minor] Disable pcre jit fast
Vsevolod Stakhov [Fri, 11 Mar 2016 13:10:26 +0000 (13:10 +0000)]
[Feature] Add more information about regexps
Vsevolod Stakhov [Fri, 11 Mar 2016 09:45:37 +0000 (09:45 +0000)]
[Feature] Load images height and width from style attribute
Issue: #538
Submitted by: @moisseev
Vsevolod Stakhov [Fri, 11 Mar 2016 09:19:34 +0000 (09:19 +0000)]
[Fix] Always try to use height and width for images
Vsevolod Stakhov [Fri, 11 Mar 2016 09:19:08 +0000 (09:19 +0000)]
[Minor] Set value even if a string cannot be converted to a number
Vsevolod Stakhov [Thu, 10 Mar 2016 19:16:01 +0000 (19:16 +0000)]
[Doc] Add comments about configuration
Vsevolod Stakhov [Thu, 10 Mar 2016 19:03:51 +0000 (19:03 +0000)]
[Feature] Rework includes system in the configuration
Vsevolod Stakhov [Thu, 10 Mar 2016 17:35:49 +0000 (17:35 +0000)]
[Feature] Add LOCAL_CONFDIR option
Vsevolod Stakhov [Thu, 10 Mar 2016 17:29:24 +0000 (17:29 +0000)]
[Doc] Describe new way to redefine symbols
Vsevolod Stakhov [Thu, 10 Mar 2016 17:04:48 +0000 (17:04 +0000)]
[Feature] Rework includes and configuration system
Vsevolod Stakhov [Thu, 10 Mar 2016 16:55:52 +0000 (16:55 +0000)]
[Feature] Allow priorities in dynamic updates
Vsevolod Stakhov [Thu, 10 Mar 2016 14:59:38 +0000 (14:59 +0000)]
[Feature] Add default dynamic updates configuration
Vsevolod Stakhov [Thu, 10 Mar 2016 14:19:45 +0000 (14:19 +0000)]
[Fix] Fix HTTP maps updates
Vsevolod Stakhov [Thu, 10 Mar 2016 14:18:45 +0000 (14:18 +0000)]
[Feature] Add function to *properly* print HTTP date
strftime is badly broken and polluted by brain-damaged people that
think that locales in libc is a good idea. It isn't.
Vsevolod Stakhov [Thu, 10 Mar 2016 14:03:29 +0000 (14:03 +0000)]
[Feature] Use Last-Modified header
Vsevolod Stakhov [Thu, 10 Mar 2016 13:34:30 +0000 (13:34 +0000)]
[Fix] Fix multiple issues with http maps
Vsevolod Stakhov [Thu, 10 Mar 2016 11:46:57 +0000 (11:46 +0000)]
[Fix] Fix parsing of HTTP maps
Vsevolod Stakhov [Thu, 10 Mar 2016 11:00:31 +0000 (11:00 +0000)]
[Minor] Add restart to systemd service
Issue: #91
Reported by: @damned-trooper
Vsevolod Stakhov [Wed, 9 Mar 2016 15:56:34 +0000 (15:56 +0000)]
[Fix] Add guard when searching for email urls
Vsevolod Stakhov [Wed, 9 Mar 2016 15:56:17 +0000 (15:56 +0000)]
[Fix] Do not allow empty IP addresses to be parsed
Vsevolod Stakhov [Wed, 9 Mar 2016 15:55:52 +0000 (15:55 +0000)]
[Fix] Skip invalid addresses when parsing IP lists
Vsevolod Stakhov [Wed, 9 Mar 2016 15:55:35 +0000 (15:55 +0000)]
[Minor] Zero new nodes in btrie
Vsevolod Stakhov [Wed, 9 Mar 2016 14:27:38 +0000 (14:27 +0000)]
[Fix] Plug memory leak in lua_fann
Vsevolod Stakhov [Tue, 8 Mar 2016 17:33:39 +0000 (17:33 +0000)]
[Minor] Explicitly set ENABLE_LUAJIT in debian rules
Vsevolod Stakhov [Tue, 8 Mar 2016 16:01:15 +0000 (16:01 +0000)]
[Fix] Fix versions comparison
Vsevolod Stakhov [Tue, 8 Mar 2016 15:49:41 +0000 (15:49 +0000)]
[Feature] Allow optional symbols registration
Vsevolod Stakhov [Tue, 8 Mar 2016 15:00:56 +0000 (15:00 +0000)]
[Feature] Add more features to dynamic updates
Vsevolod Stakhov [Tue, 8 Mar 2016 15:00:38 +0000 (15:00 +0000)]
[Fix] Resort symbols cache if it has been changed
Vsevolod Stakhov [Tue, 8 Mar 2016 14:40:00 +0000 (14:40 +0000)]
[Fix] Fix calling of lua map callbacks