]> source.dussan.org Git - rspamd.git/log
rspamd.git
9 years agoAdd no_stat flag.
Vsevolod Stakhov [Fri, 25 Sep 2015 14:07:04 +0000 (15:07 +0100)]
Add no_stat flag.

Issue: #382

9 years agoShow learned counter.
Vsevolod Stakhov [Fri, 25 Sep 2015 12:47:56 +0000 (13:47 +0100)]
Show learned counter.

Issue: #383

9 years agoSave learned messages count.
Vsevolod Stakhov [Fri, 25 Sep 2015 12:46:42 +0000 (13:46 +0100)]
Save learned messages count.

9 years agoAdd strict mode for configtest.
Vsevolod Stakhov [Fri, 25 Sep 2015 12:26:13 +0000 (13:26 +0100)]
Add strict mode for configtest.

9 years agoAdd logger counters.
Vsevolod Stakhov [Fri, 25 Sep 2015 12:17:55 +0000 (13:17 +0100)]
Add logger counters.

9 years agoSlightly improve help messages.
Vsevolod Stakhov [Fri, 25 Sep 2015 00:26:29 +0000 (01:26 +0100)]
Slightly improve help messages.

9 years agoAdd configtest command.
Vsevolod Stakhov [Fri, 25 Sep 2015 00:16:02 +0000 (01:16 +0100)]
Add configtest command.

9 years agoImplement generating keypairs via rspamadm.
Vsevolod Stakhov [Thu, 24 Sep 2015 23:43:34 +0000 (00:43 +0100)]
Implement generating keypairs via rspamadm.

9 years agoAllow metric registration for composite expressions.
Vsevolod Stakhov [Thu, 24 Sep 2015 17:39:46 +0000 (18:39 +0100)]
Allow metric registration for composite expressions.

9 years agoAdd encrypted length guard.
Vsevolod Stakhov [Thu, 24 Sep 2015 17:33:48 +0000 (18:33 +0100)]
Add encrypted length guard.

9 years agoAdd `pw` utility to manage rspamd passwords.
Vsevolod Stakhov [Thu, 24 Sep 2015 17:19:58 +0000 (18:19 +0100)]
Add `pw` utility to manage rspamd passwords.

9 years agoMove constant_memcmp to libutil code.
Vsevolod Stakhov [Thu, 24 Sep 2015 16:59:40 +0000 (17:59 +0100)]
Move constant_memcmp to libutil code.

9 years agoImprove passing of arguments to commands.
Vsevolod Stakhov [Thu, 24 Sep 2015 16:37:45 +0000 (17:37 +0100)]
Improve passing of arguments to commands.

9 years agoAdd rspamadm routine.
Vsevolod Stakhov [Thu, 24 Sep 2015 16:09:35 +0000 (17:09 +0100)]
Add rspamadm routine.

9 years agoSet C locale for numeric values.
Vsevolod Stakhov [Thu, 24 Sep 2015 14:35:39 +0000 (15:35 +0100)]
Set C locale for numeric values.

9 years agoAdd more verbosity to parsing of values.
Vsevolod Stakhov [Thu, 24 Sep 2015 14:35:16 +0000 (15:35 +0100)]
Add more verbosity to parsing of values.

9 years agoCorrectly set locale before start.
Vsevolod Stakhov [Thu, 24 Sep 2015 14:30:04 +0000 (15:30 +0100)]
Correctly set locale before start.

9 years agoTry to fix crashes when GString is reallocated.
Vsevolod Stakhov [Thu, 24 Sep 2015 14:21:35 +0000 (15:21 +0100)]
Try to fix crashes when GString is reallocated.

Issue: #381

9 years agoFix piechart clean slice.
Vsevolod Stakhov [Wed, 23 Sep 2015 18:31:11 +0000 (19:31 +0100)]
Fix piechart clean slice.

Issue: #380

9 years agoUpdate version to 1.0.3
Vsevolod Stakhov [Wed, 23 Sep 2015 16:39:57 +0000 (17:39 +0100)]
Update version to 1.0.3

9 years agoRelease 1.0.2 1.0.2
Vsevolod Stakhov [Wed, 23 Sep 2015 16:26:52 +0000 (17:26 +0100)]
Release 1.0.2

* Fix critical bug in webui that prevents password from being sent
* Rework webui view:
- Switch to d3.js for graphs
- Improve piechart look
- Rework colors for piechart
- Fix layout for symbols
- Fix refresh button
* Add descriptions for whitelist maps
* Fix build on arm (#379)
* Fix issue with the last element in the radix trie
* Add more tests for radix trie algorithm
* Allow to extract URLs from query strings of other URLs (#361)
* Initialize rrd fields before writing to file
* Fix double free if no password has been specified

Signed-off-by: Vsevolod Stakhov <vsevolod@highsecure.ru>
9 years agoSearch for urls in query parts of html urls as well.
Vsevolod Stakhov [Wed, 23 Sep 2015 16:08:32 +0000 (17:08 +0100)]
Search for urls in query parts of html urls as well.

9 years agoFix double free if no password has been specified.
Vsevolod Stakhov [Wed, 23 Sep 2015 15:53:30 +0000 (16:53 +0100)]
Fix double free if no password has been specified.

Reported by: Golub Mikhail

9 years agoInitialize rrd fields before writing to file.
Vsevolod Stakhov [Wed, 23 Sep 2015 15:52:04 +0000 (16:52 +0100)]
Initialize rrd fields before writing to file.

9 years agoAllow to extract URLs from query strings of other URLs.
Vsevolod Stakhov [Wed, 23 Sep 2015 15:37:04 +0000 (16:37 +0100)]
Allow to extract URLs from query strings of other URLs.

Issue: #361
Reported by: @socksrambler

9 years agoAdd tests for the problematic case in radix trie.
Vsevolod Stakhov [Wed, 23 Sep 2015 15:13:23 +0000 (16:13 +0100)]
Add tests for the problematic case in radix trie.

9 years agoFix issue with the last element in the radix trie.
Vsevolod Stakhov [Wed, 23 Sep 2015 15:12:54 +0000 (16:12 +0100)]
Fix issue with the last element in the radix trie.

9 years agoUpdate webui.
Vsevolod Stakhov [Wed, 23 Sep 2015 13:16:32 +0000 (14:16 +0100)]
Update webui.

9 years agoReiterate on colors one more time.
Vsevolod Stakhov [Wed, 23 Sep 2015 13:15:49 +0000 (14:15 +0100)]
Reiterate on colors one more time.

9 years agoFix issue with va_list passing.
Vsevolod Stakhov [Wed, 23 Sep 2015 12:43:59 +0000 (13:43 +0100)]
Fix issue with va_list passing.

Issue: #379
Reported by: @Gottox

9 years agoImprove pie colors.
Vsevolod Stakhov [Wed, 23 Sep 2015 12:35:42 +0000 (13:35 +0100)]
Improve pie colors.

9 years agoAdd descriptions for whitelist maps.
Vsevolod Stakhov [Wed, 23 Sep 2015 11:34:57 +0000 (12:34 +0100)]
Add descriptions for whitelist maps.

9 years agoRename main.h and main.c to `rspamd.X`
Vsevolod Stakhov [Tue, 22 Sep 2015 17:17:24 +0000 (18:17 +0100)]
Rename main.h and main.c to `rspamd.X`

9 years agoUpdate version number to 1.0.2.
Vsevolod Stakhov [Tue, 22 Sep 2015 16:24:41 +0000 (17:24 +0100)]
Update version number to 1.0.2.

9 years agoRelease 1.0.1 1.0.1
Vsevolod Stakhov [Tue, 22 Sep 2015 15:53:20 +0000 (16:53 +0100)]
Release 1.0.1

* Add writing to rrd from the controller
* Fixed lots of bugs in rrd code
* Adopt new DNS API in hfilter plugin (by @AlexeySa)
* Allow only one controller process to manage rrd file
* Set event base for fuzzy calls
* Improve fuzzy IO errors logging
* Add rra extraction function to rrd library
* Add graph handler to the controller
* Cache correct passwords to avoid too high CPU usage when working with webui
* Controller sockets are owned by router do not export them to task
* Optimize logging by skipping hash table search if it's empty
* Fix loading issue whith broken statfiles
* Print assertions from glib to rspamd logger
* Load legacy `lua/rspamd.local.lua`
* Update webui with some fixes to learning and scanning

Signed-off-by: Vsevolod Stakhov <vsevolod@highsecure.ru>
9 years agoUpdate webui.
Vsevolod Stakhov [Tue, 22 Sep 2015 15:37:02 +0000 (16:37 +0100)]
Update webui.

9 years agoLoad legacy `lua/rspamd.local.lua`
Vsevolod Stakhov [Tue, 22 Sep 2015 15:36:31 +0000 (16:36 +0100)]
Load legacy `lua/rspamd.local.lua`

9 years agoFix issue when there is no reject score for any metric.
Vsevolod Stakhov [Tue, 22 Sep 2015 15:34:09 +0000 (16:34 +0100)]
Fix issue when there is no reject score for any metric.

9 years agoPrint assertions from glib to rspamd logger.
Vsevolod Stakhov [Tue, 22 Sep 2015 15:08:44 +0000 (16:08 +0100)]
Print assertions from glib to rspamd logger.

9 years agoFix issue whith broken statfiles.
Vsevolod Stakhov [Tue, 22 Sep 2015 12:49:46 +0000 (13:49 +0100)]
Fix issue whith broken statfiles.

9 years agoFix time for /graph.
Vsevolod Stakhov [Tue, 22 Sep 2015 10:58:15 +0000 (11:58 +0100)]
Fix time for /graph.

9 years agoOptimize logging by skipping hash table search if it's empty.
Vsevolod Stakhov [Tue, 22 Sep 2015 10:33:00 +0000 (11:33 +0100)]
Optimize logging by skipping hash table search if it's empty.

9 years agoController sockets are owned by router do not export them to task.
Vsevolod Stakhov [Tue, 22 Sep 2015 08:52:24 +0000 (09:52 +0100)]
Controller sockets are owned by router do not export them to task.

9 years agoCache correct passwords to avoid too high CPU usage.
Vsevolod Stakhov [Tue, 22 Sep 2015 08:25:14 +0000 (09:25 +0100)]
Cache correct passwords to avoid too high CPU usage.

9 years agoAdd graph handler to the controller.
Vsevolod Stakhov [Mon, 21 Sep 2015 18:14:24 +0000 (19:14 +0100)]
Add graph handler to the controller.

9 years agoAdd rra extraction function.
Vsevolod Stakhov [Mon, 21 Sep 2015 16:33:26 +0000 (17:33 +0100)]
Add rra extraction function.

9 years agoFix assignment order.
Vsevolod Stakhov [Mon, 21 Sep 2015 15:28:26 +0000 (16:28 +0100)]
Fix assignment order.

9 years agoImprove fuzzy IO errors logging.
Vsevolod Stakhov [Mon, 21 Sep 2015 15:03:52 +0000 (16:03 +0100)]
Improve fuzzy IO errors logging.

9 years agoSet event base for fuzzy calls.
Vsevolod Stakhov [Mon, 21 Sep 2015 14:49:48 +0000 (15:49 +0100)]
Set event base for fuzzy calls.

9 years agoPerform some rrd file check.
Vsevolod Stakhov [Mon, 21 Sep 2015 13:53:35 +0000 (14:53 +0100)]
Perform some rrd file check.

9 years agoAdjust rrd intervals.
Vsevolod Stakhov [Mon, 21 Sep 2015 08:03:25 +0000 (09:03 +0100)]
Adjust rrd intervals.

9 years agoPreserve worker's index when restaring workers.
Vsevolod Stakhov [Sat, 19 Sep 2015 20:43:51 +0000 (21:43 +0100)]
Preserve worker's index when restaring workers.

9 years agoAllow only one controller process to manage rrd file.
Vsevolod Stakhov [Sat, 19 Sep 2015 20:40:07 +0000 (21:40 +0100)]
Allow only one controller process to manage rrd file.

9 years agoMerge pull request #373 from AlexeySa/patch-6
Vsevolod Stakhov [Sun, 20 Sep 2015 19:45:37 +0000 (20:45 +0100)]
Merge pull request #373 from AlexeySa/patch-6

Fix Hfilter plugin with the new DNS API

9 years agoFix Hfilter plugins with the new DNS API 373/head
Alexey AL [Sun, 20 Sep 2015 10:11:28 +0000 (13:11 +0300)]
Fix Hfilter plugins with the new DNS API

9 years agoFix a stupid bug in rrd event initialization.
Vsevolod Stakhov [Sat, 19 Sep 2015 20:31:52 +0000 (21:31 +0100)]
Fix a stupid bug in rrd event initialization.

9 years agoImprove rrd tests.
Vsevolod Stakhov [Sat, 19 Sep 2015 20:31:34 +0000 (21:31 +0100)]
Improve rrd tests.

9 years agoAdd writing to rrd from the controller.
Vsevolod Stakhov [Fri, 18 Sep 2015 16:15:18 +0000 (17:15 +0100)]
Add writing to rrd from the controller.

9 years agoUpdate version to 1.0.1
Vsevolod Stakhov [Fri, 18 Sep 2015 13:40:20 +0000 (14:40 +0100)]
Update version to 1.0.1

9 years agoUpdate `add header` action in the settings.
Vsevolod Stakhov [Fri, 18 Sep 2015 00:29:20 +0000 (01:29 +0100)]
Update `add header` action in the settings.

9 years agoUpdate statistics documentation.
Vsevolod Stakhov [Thu, 17 Sep 2015 23:44:48 +0000 (00:44 +0100)]
Update statistics documentation.

9 years agoMerge pull request #371 from fatalbanana/master
Vsevolod Stakhov [Thu, 17 Sep 2015 19:29:14 +0000 (20:29 +0100)]
Merge pull request #371 from fatalbanana/master

Merge changes from OBS (except for EL6 stuff)

9 years agoMerge changes from OBS (except for EL6 stuff) 371/head
Andrew Lewis [Thu, 17 Sep 2015 17:57:54 +0000 (19:57 +0200)]
Merge changes from OBS (except for EL6 stuff)

9 years agoAdd migration notes.
Vsevolod Stakhov [Thu, 17 Sep 2015 17:59:38 +0000 (18:59 +0100)]
Add migration notes.

9 years agoRelease 1.0.0 1.0.0
Vsevolod Stakhov [Thu, 17 Sep 2015 15:22:41 +0000 (16:22 +0100)]
Release 1.0.0

* Rework symbols processing:
- Improve sorting logic for symbols
- Organize processing into multiple stages
- Added asynchronous watchers for symbols
- Added ability to organize dependencies between symbols
* Fixed URL redirector:
- Use optimized POE loop
- Organize dependencies
- Fix startup
* New sqlite3 backend:
- Allow to have per-languages and per-user statistics
- Allow sqlite3 to be used as statistics backend
* Store tokenizer configuration within statfiles
* Improve bayes statistics:
- Use headers and images metainformation in bayes
- Suggest using of pre-processed tokens for statistics
- Fix tokens normalization for OSB algorithm
* Rewrite url parsing:
- Fix numerous issues with url extraction and normalization
- Fix mailto urls
* Fix settings plugin to allow custom actions scores
* Improve rbl plugin
* Allow capturing patterns in rspamd lua regexp library
* Add GTUBE support
* Fix spamc legacy support
* Add DKIM support to RBL module
* Fix issues with multiple DKIM signatures
* Fix issue if rspamd cannot create statfiles (#331)
* Rework parts and task structure:
- Now text_parts, parts and received are arrays
- Pre-allocate arrays with some reasonable defaults
- Use arrays instead of lists in plugins and checks
- Remove unused fields from task structure
- Rework mime_foreach callback function
- Remove deprecated scan_milliseconds field
* Add ip_score plugin support (not enabled by default):
- Can check for asn/country and network using DNS lookups
- Can store and load reputation from redis server
* Improve PARTS_DIFFER rule to count merely different words
* New HTML parser:
- Parses HTML parts using a set of state machines
- Extracts useful data and exports it to lua functions:
+ Styles
+ Images
+ URLs
+ Colors
+ Structure elements
- Added HTML rules for some checks
* New version of LUA DNS API
* Table versions of many functions in LUA API
* Improve rspamc client:
- Print execution time
- Allow executing of external commands and passing output to them
- Allow mime output mode when rspamc alters message according to rspamd
checks and send it to an external command or stdout
* Allow scanning of local files using HTTP requests
* Rework configuration system:
- Rules are now moved from the $CONFDIR to $RULESDIR to avoid ambiguity
- All modules configurations are now split in $CONFDIR/modules.d/* to
simplify upgrades
- Move hfilter to plugins
- Allow plugins and rules to define default scores to simplify metrics
setup
- Include overrides for all modules to honor local/automatic parameters
- Tune scores for many modules
* Rework and enable DMARC plugin
* Add whitelist plugin for SPF/DKIM/DMARC based whitelisting
* Add some common domains to whitelists shipped with rspamd
* Rework logging:
- Now each log entry supports module name and a `tag`. Tag is used to
identify unique objects (such as tasks) when checking log files
- It is possible to turn on debugging for the specific modules
- Systemd logging is fixed
* Improve spamassassin plugin.
- Now headers are matched more like SA
- Improve support of Message-ID
- Add support of ToCc header type
- Fix :addr and :name in headers regexps
* Resurrect rrd support code
* Save controller stats between restarts
* Fixed tonns of bugs
* Added tonns of minor improvements and features
* Added more unit tests
* Create functional tests framework
* Added documentation for missing modules
* Added rpm/deb repositories and scripts
* Updated WebUI and libucl externals

Signed-off-by: Vsevolod Stakhov <vsevolod@highsecure.ru>
9 years agoAdd 0.9.10 changelog entry.
Vsevolod Stakhov [Thu, 17 Sep 2015 15:15:45 +0000 (16:15 +0100)]
Add 0.9.10 changelog entry.

9 years agoMerge pull request #370 from fatalbanana/master
Vsevolod Stakhov [Thu, 17 Sep 2015 15:11:27 +0000 (16:11 +0100)]
Merge pull request #370 from fatalbanana/master

Fix DKIM RBL

9 years agoFix DKIM RBL 370/head
Andrew Lewis [Thu, 17 Sep 2015 15:08:17 +0000 (17:08 +0200)]
Fix DKIM RBL

9 years agoUpdate linux build specs.
Vsevolod Stakhov [Thu, 17 Sep 2015 14:23:26 +0000 (15:23 +0100)]
Update linux build specs.

9 years agoSet one shot mode for dkim.
Vsevolod Stakhov [Thu, 17 Sep 2015 14:23:14 +0000 (15:23 +0100)]
Set one shot mode for dkim.

9 years agoFurther reduce hfilter weights.
Vsevolod Stakhov [Thu, 17 Sep 2015 14:22:16 +0000 (15:22 +0100)]
Further reduce hfilter weights.

9 years agoCheck DKIM domain when whitelisting by DKIM signature.
Vsevolod Stakhov [Thu, 17 Sep 2015 14:09:37 +0000 (15:09 +0100)]
Check DKIM domain when whitelisting by DKIM signature.

9 years agoImprove dkim domains validation for DMARC
Vsevolod Stakhov [Thu, 17 Sep 2015 14:09:18 +0000 (15:09 +0100)]
Improve dkim domains validation for DMARC

9 years agoIndexes start from 1 in lua!!!!
Vsevolod Stakhov [Thu, 17 Sep 2015 14:09:03 +0000 (15:09 +0100)]
Indexes start from 1 in lua!!!!

9 years agoSanitize spaces in headers' start.
Vsevolod Stakhov [Thu, 17 Sep 2015 13:41:49 +0000 (14:41 +0100)]
Sanitize spaces in headers' start.

9 years agoEnable systemd logging in systemd configuration.
Vsevolod Stakhov [Thu, 17 Sep 2015 13:27:48 +0000 (14:27 +0100)]
Enable systemd logging in systemd configuration.

9 years agoAdd special knob for systemd logging.
Vsevolod Stakhov [Thu, 17 Sep 2015 13:27:06 +0000 (14:27 +0100)]
Add special knob for systemd logging.

9 years agoAdd facebookmail.com to dmarc whitelist.
Vsevolod Stakhov [Wed, 16 Sep 2015 17:24:07 +0000 (18:24 +0100)]
Add facebookmail.com to dmarc whitelist.

9 years agoAdjust scores for whitelists slightly.
Vsevolod Stakhov [Wed, 16 Sep 2015 17:08:18 +0000 (18:08 +0100)]
Adjust scores for whitelists slightly.

9 years agoUse tld for whitelisting.
Vsevolod Stakhov [Wed, 16 Sep 2015 17:05:54 +0000 (18:05 +0100)]
Use tld for whitelisting.

9 years agoFix wrongly placed g_string_free.
Vsevolod Stakhov [Wed, 16 Sep 2015 17:03:08 +0000 (18:03 +0100)]
Fix wrongly placed g_string_free.

9 years agoAllow optional multiplier for whitelists.
Vsevolod Stakhov [Wed, 16 Sep 2015 16:55:49 +0000 (17:55 +0100)]
Allow optional multiplier for whitelists.

9 years agoFix logging in DNS.
Vsevolod Stakhov [Wed, 16 Sep 2015 15:47:36 +0000 (16:47 +0100)]
Fix logging in DNS.

9 years agoPrint IP address in logs.
Vsevolod Stakhov [Wed, 16 Sep 2015 15:28:23 +0000 (16:28 +0100)]
Print IP address in logs.

9 years agoAdd whitelist configuration.
Vsevolod Stakhov [Wed, 16 Sep 2015 15:25:14 +0000 (16:25 +0100)]
Add whitelist configuration.

9 years agoUse new statistics format in the default config.
Vsevolod Stakhov [Wed, 16 Sep 2015 14:15:52 +0000 (15:15 +0100)]
Use new statistics format in the default config.

9 years agoMatch domain name for simple dkim signatures.
Vsevolod Stakhov [Wed, 16 Sep 2015 14:14:09 +0000 (15:14 +0100)]
Match domain name for simple dkim signatures.

9 years agoAdd Karp-Rabin algorithm for substrings search.
Vsevolod Stakhov [Wed, 16 Sep 2015 14:04:24 +0000 (15:04 +0100)]
Add Karp-Rabin algorithm for substrings search.

9 years agoFix multiple DKIM signatures for relaxed method.
Vsevolod Stakhov [Wed, 16 Sep 2015 13:30:45 +0000 (14:30 +0100)]
Fix multiple DKIM signatures for relaxed method.

9 years agoFix a stupid mistake in module name.
Vsevolod Stakhov [Tue, 15 Sep 2015 22:20:40 +0000 (23:20 +0100)]
Fix a stupid mistake in module name.

9 years agoAnother issue with nested depends.
Vsevolod Stakhov [Tue, 15 Sep 2015 17:40:01 +0000 (18:40 +0100)]
Another issue with nested depends.

9 years agoImprove url log output.
Vsevolod Stakhov [Tue, 15 Sep 2015 17:36:56 +0000 (18:36 +0100)]
Improve url log output.

9 years agoPrint 'from: ' in logs if a task has no `user` specified
Vsevolod Stakhov [Tue, 15 Sep 2015 17:29:25 +0000 (18:29 +0100)]
Print 'from: ' in logs if a task has no `user` specified

9 years agoAdd default dmarc configuration.
Vsevolod Stakhov [Tue, 15 Sep 2015 17:10:23 +0000 (18:10 +0100)]
Add default dmarc configuration.

9 years agoStop logging of encrypted passwords.
Vsevolod Stakhov [Tue, 15 Sep 2015 17:01:27 +0000 (18:01 +0100)]
Stop logging of encrypted passwords.

9 years agoSave controller statistics between restarts.
Vsevolod Stakhov [Tue, 15 Sep 2015 16:34:36 +0000 (17:34 +0100)]
Save controller statistics between restarts.

9 years agoFix rrd tests.
Vsevolod Stakhov [Tue, 15 Sep 2015 16:01:27 +0000 (17:01 +0100)]
Fix rrd tests.

9 years agoFix rra updates.
Vsevolod Stakhov [Tue, 15 Sep 2015 16:00:05 +0000 (17:00 +0100)]
Fix rra updates.

9 years agoFix bugs in pdp calculations.
Vsevolod Stakhov [Tue, 15 Sep 2015 15:11:44 +0000 (16:11 +0100)]
Fix bugs in pdp calculations.

9 years agoAdd debugging to rrd code.
Vsevolod Stakhov [Tue, 15 Sep 2015 14:35:59 +0000 (15:35 +0100)]
Add debugging to rrd code.