]> source.dussan.org Git - rspamd.git/log
rspamd.git
9 years agoUpdate webui.
Vsevolod Stakhov [Tue, 22 Sep 2015 15:37:02 +0000 (16:37 +0100)]
Update webui.

9 years agoLoad legacy `lua/rspamd.local.lua`
Vsevolod Stakhov [Tue, 22 Sep 2015 15:36:31 +0000 (16:36 +0100)]
Load legacy `lua/rspamd.local.lua`

9 years agoFix issue when there is no reject score for any metric.
Vsevolod Stakhov [Tue, 22 Sep 2015 15:34:09 +0000 (16:34 +0100)]
Fix issue when there is no reject score for any metric.

9 years agoPrint assertions from glib to rspamd logger.
Vsevolod Stakhov [Tue, 22 Sep 2015 15:08:44 +0000 (16:08 +0100)]
Print assertions from glib to rspamd logger.

9 years agoFix issue whith broken statfiles.
Vsevolod Stakhov [Tue, 22 Sep 2015 12:49:46 +0000 (13:49 +0100)]
Fix issue whith broken statfiles.

9 years agoFix time for /graph.
Vsevolod Stakhov [Tue, 22 Sep 2015 10:58:15 +0000 (11:58 +0100)]
Fix time for /graph.

9 years agoOptimize logging by skipping hash table search if it's empty.
Vsevolod Stakhov [Tue, 22 Sep 2015 10:33:00 +0000 (11:33 +0100)]
Optimize logging by skipping hash table search if it's empty.

9 years agoController sockets are owned by router do not export them to task.
Vsevolod Stakhov [Tue, 22 Sep 2015 08:52:24 +0000 (09:52 +0100)]
Controller sockets are owned by router do not export them to task.

9 years agoCache correct passwords to avoid too high CPU usage.
Vsevolod Stakhov [Tue, 22 Sep 2015 08:25:14 +0000 (09:25 +0100)]
Cache correct passwords to avoid too high CPU usage.

9 years agoAdd graph handler to the controller.
Vsevolod Stakhov [Mon, 21 Sep 2015 18:14:24 +0000 (19:14 +0100)]
Add graph handler to the controller.

9 years agoAdd rra extraction function.
Vsevolod Stakhov [Mon, 21 Sep 2015 16:33:26 +0000 (17:33 +0100)]
Add rra extraction function.

9 years agoFix assignment order.
Vsevolod Stakhov [Mon, 21 Sep 2015 15:28:26 +0000 (16:28 +0100)]
Fix assignment order.

9 years agoImprove fuzzy IO errors logging.
Vsevolod Stakhov [Mon, 21 Sep 2015 15:03:52 +0000 (16:03 +0100)]
Improve fuzzy IO errors logging.

9 years agoSet event base for fuzzy calls.
Vsevolod Stakhov [Mon, 21 Sep 2015 14:49:48 +0000 (15:49 +0100)]
Set event base for fuzzy calls.

9 years agoPerform some rrd file check.
Vsevolod Stakhov [Mon, 21 Sep 2015 13:53:35 +0000 (14:53 +0100)]
Perform some rrd file check.

9 years agoAdjust rrd intervals.
Vsevolod Stakhov [Mon, 21 Sep 2015 08:03:25 +0000 (09:03 +0100)]
Adjust rrd intervals.

9 years agoPreserve worker's index when restaring workers.
Vsevolod Stakhov [Sat, 19 Sep 2015 20:43:51 +0000 (21:43 +0100)]
Preserve worker's index when restaring workers.

9 years agoAllow only one controller process to manage rrd file.
Vsevolod Stakhov [Sat, 19 Sep 2015 20:40:07 +0000 (21:40 +0100)]
Allow only one controller process to manage rrd file.

9 years agoMerge pull request #373 from AlexeySa/patch-6
Vsevolod Stakhov [Sun, 20 Sep 2015 19:45:37 +0000 (20:45 +0100)]
Merge pull request #373 from AlexeySa/patch-6

Fix Hfilter plugin with the new DNS API

9 years agoFix Hfilter plugins with the new DNS API 373/head
Alexey AL [Sun, 20 Sep 2015 10:11:28 +0000 (13:11 +0300)]
Fix Hfilter plugins with the new DNS API

9 years agoFix a stupid bug in rrd event initialization.
Vsevolod Stakhov [Sat, 19 Sep 2015 20:31:52 +0000 (21:31 +0100)]
Fix a stupid bug in rrd event initialization.

9 years agoImprove rrd tests.
Vsevolod Stakhov [Sat, 19 Sep 2015 20:31:34 +0000 (21:31 +0100)]
Improve rrd tests.

9 years agoAdd writing to rrd from the controller.
Vsevolod Stakhov [Fri, 18 Sep 2015 16:15:18 +0000 (17:15 +0100)]
Add writing to rrd from the controller.

9 years agoUpdate version to 1.0.1
Vsevolod Stakhov [Fri, 18 Sep 2015 13:40:20 +0000 (14:40 +0100)]
Update version to 1.0.1

9 years agoUpdate `add header` action in the settings.
Vsevolod Stakhov [Fri, 18 Sep 2015 00:29:20 +0000 (01:29 +0100)]
Update `add header` action in the settings.

9 years agoUpdate statistics documentation.
Vsevolod Stakhov [Thu, 17 Sep 2015 23:44:48 +0000 (00:44 +0100)]
Update statistics documentation.

9 years agoMerge pull request #371 from fatalbanana/master
Vsevolod Stakhov [Thu, 17 Sep 2015 19:29:14 +0000 (20:29 +0100)]
Merge pull request #371 from fatalbanana/master

Merge changes from OBS (except for EL6 stuff)

9 years agoMerge changes from OBS (except for EL6 stuff) 371/head
Andrew Lewis [Thu, 17 Sep 2015 17:57:54 +0000 (19:57 +0200)]
Merge changes from OBS (except for EL6 stuff)

9 years agoAdd migration notes.
Vsevolod Stakhov [Thu, 17 Sep 2015 17:59:38 +0000 (18:59 +0100)]
Add migration notes.

9 years agoRelease 1.0.0 1.0.0
Vsevolod Stakhov [Thu, 17 Sep 2015 15:22:41 +0000 (16:22 +0100)]
Release 1.0.0

* Rework symbols processing:
- Improve sorting logic for symbols
- Organize processing into multiple stages
- Added asynchronous watchers for symbols
- Added ability to organize dependencies between symbols
* Fixed URL redirector:
- Use optimized POE loop
- Organize dependencies
- Fix startup
* New sqlite3 backend:
- Allow to have per-languages and per-user statistics
- Allow sqlite3 to be used as statistics backend
* Store tokenizer configuration within statfiles
* Improve bayes statistics:
- Use headers and images metainformation in bayes
- Suggest using of pre-processed tokens for statistics
- Fix tokens normalization for OSB algorithm
* Rewrite url parsing:
- Fix numerous issues with url extraction and normalization
- Fix mailto urls
* Fix settings plugin to allow custom actions scores
* Improve rbl plugin
* Allow capturing patterns in rspamd lua regexp library
* Add GTUBE support
* Fix spamc legacy support
* Add DKIM support to RBL module
* Fix issues with multiple DKIM signatures
* Fix issue if rspamd cannot create statfiles (#331)
* Rework parts and task structure:
- Now text_parts, parts and received are arrays
- Pre-allocate arrays with some reasonable defaults
- Use arrays instead of lists in plugins and checks
- Remove unused fields from task structure
- Rework mime_foreach callback function
- Remove deprecated scan_milliseconds field
* Add ip_score plugin support (not enabled by default):
- Can check for asn/country and network using DNS lookups
- Can store and load reputation from redis server
* Improve PARTS_DIFFER rule to count merely different words
* New HTML parser:
- Parses HTML parts using a set of state machines
- Extracts useful data and exports it to lua functions:
+ Styles
+ Images
+ URLs
+ Colors
+ Structure elements
- Added HTML rules for some checks
* New version of LUA DNS API
* Table versions of many functions in LUA API
* Improve rspamc client:
- Print execution time
- Allow executing of external commands and passing output to them
- Allow mime output mode when rspamc alters message according to rspamd
checks and send it to an external command or stdout
* Allow scanning of local files using HTTP requests
* Rework configuration system:
- Rules are now moved from the $CONFDIR to $RULESDIR to avoid ambiguity
- All modules configurations are now split in $CONFDIR/modules.d/* to
simplify upgrades
- Move hfilter to plugins
- Allow plugins and rules to define default scores to simplify metrics
setup
- Include overrides for all modules to honor local/automatic parameters
- Tune scores for many modules
* Rework and enable DMARC plugin
* Add whitelist plugin for SPF/DKIM/DMARC based whitelisting
* Add some common domains to whitelists shipped with rspamd
* Rework logging:
- Now each log entry supports module name and a `tag`. Tag is used to
identify unique objects (such as tasks) when checking log files
- It is possible to turn on debugging for the specific modules
- Systemd logging is fixed
* Improve spamassassin plugin.
- Now headers are matched more like SA
- Improve support of Message-ID
- Add support of ToCc header type
- Fix :addr and :name in headers regexps
* Resurrect rrd support code
* Save controller stats between restarts
* Fixed tonns of bugs
* Added tonns of minor improvements and features
* Added more unit tests
* Create functional tests framework
* Added documentation for missing modules
* Added rpm/deb repositories and scripts
* Updated WebUI and libucl externals

Signed-off-by: Vsevolod Stakhov <vsevolod@highsecure.ru>
9 years agoAdd 0.9.10 changelog entry.
Vsevolod Stakhov [Thu, 17 Sep 2015 15:15:45 +0000 (16:15 +0100)]
Add 0.9.10 changelog entry.

9 years agoMerge pull request #370 from fatalbanana/master
Vsevolod Stakhov [Thu, 17 Sep 2015 15:11:27 +0000 (16:11 +0100)]
Merge pull request #370 from fatalbanana/master

Fix DKIM RBL

9 years agoFix DKIM RBL 370/head
Andrew Lewis [Thu, 17 Sep 2015 15:08:17 +0000 (17:08 +0200)]
Fix DKIM RBL

9 years agoUpdate linux build specs.
Vsevolod Stakhov [Thu, 17 Sep 2015 14:23:26 +0000 (15:23 +0100)]
Update linux build specs.

9 years agoSet one shot mode for dkim.
Vsevolod Stakhov [Thu, 17 Sep 2015 14:23:14 +0000 (15:23 +0100)]
Set one shot mode for dkim.

9 years agoFurther reduce hfilter weights.
Vsevolod Stakhov [Thu, 17 Sep 2015 14:22:16 +0000 (15:22 +0100)]
Further reduce hfilter weights.

9 years agoCheck DKIM domain when whitelisting by DKIM signature.
Vsevolod Stakhov [Thu, 17 Sep 2015 14:09:37 +0000 (15:09 +0100)]
Check DKIM domain when whitelisting by DKIM signature.

9 years agoImprove dkim domains validation for DMARC
Vsevolod Stakhov [Thu, 17 Sep 2015 14:09:18 +0000 (15:09 +0100)]
Improve dkim domains validation for DMARC

9 years agoIndexes start from 1 in lua!!!!
Vsevolod Stakhov [Thu, 17 Sep 2015 14:09:03 +0000 (15:09 +0100)]
Indexes start from 1 in lua!!!!

9 years agoSanitize spaces in headers' start.
Vsevolod Stakhov [Thu, 17 Sep 2015 13:41:49 +0000 (14:41 +0100)]
Sanitize spaces in headers' start.

9 years agoEnable systemd logging in systemd configuration.
Vsevolod Stakhov [Thu, 17 Sep 2015 13:27:48 +0000 (14:27 +0100)]
Enable systemd logging in systemd configuration.

9 years agoAdd special knob for systemd logging.
Vsevolod Stakhov [Thu, 17 Sep 2015 13:27:06 +0000 (14:27 +0100)]
Add special knob for systemd logging.

9 years agoAdd facebookmail.com to dmarc whitelist.
Vsevolod Stakhov [Wed, 16 Sep 2015 17:24:07 +0000 (18:24 +0100)]
Add facebookmail.com to dmarc whitelist.

9 years agoAdjust scores for whitelists slightly.
Vsevolod Stakhov [Wed, 16 Sep 2015 17:08:18 +0000 (18:08 +0100)]
Adjust scores for whitelists slightly.

9 years agoUse tld for whitelisting.
Vsevolod Stakhov [Wed, 16 Sep 2015 17:05:54 +0000 (18:05 +0100)]
Use tld for whitelisting.

9 years agoFix wrongly placed g_string_free.
Vsevolod Stakhov [Wed, 16 Sep 2015 17:03:08 +0000 (18:03 +0100)]
Fix wrongly placed g_string_free.

9 years agoAllow optional multiplier for whitelists.
Vsevolod Stakhov [Wed, 16 Sep 2015 16:55:49 +0000 (17:55 +0100)]
Allow optional multiplier for whitelists.

9 years agoFix logging in DNS.
Vsevolod Stakhov [Wed, 16 Sep 2015 15:47:36 +0000 (16:47 +0100)]
Fix logging in DNS.

9 years agoPrint IP address in logs.
Vsevolod Stakhov [Wed, 16 Sep 2015 15:28:23 +0000 (16:28 +0100)]
Print IP address in logs.

9 years agoAdd whitelist configuration.
Vsevolod Stakhov [Wed, 16 Sep 2015 15:25:14 +0000 (16:25 +0100)]
Add whitelist configuration.

9 years agoUse new statistics format in the default config.
Vsevolod Stakhov [Wed, 16 Sep 2015 14:15:52 +0000 (15:15 +0100)]
Use new statistics format in the default config.

9 years agoMatch domain name for simple dkim signatures.
Vsevolod Stakhov [Wed, 16 Sep 2015 14:14:09 +0000 (15:14 +0100)]
Match domain name for simple dkim signatures.

9 years agoAdd Karp-Rabin algorithm for substrings search.
Vsevolod Stakhov [Wed, 16 Sep 2015 14:04:24 +0000 (15:04 +0100)]
Add Karp-Rabin algorithm for substrings search.

9 years agoFix multiple DKIM signatures for relaxed method.
Vsevolod Stakhov [Wed, 16 Sep 2015 13:30:45 +0000 (14:30 +0100)]
Fix multiple DKIM signatures for relaxed method.

9 years agoFix a stupid mistake in module name.
Vsevolod Stakhov [Tue, 15 Sep 2015 22:20:40 +0000 (23:20 +0100)]
Fix a stupid mistake in module name.

9 years agoAnother issue with nested depends.
Vsevolod Stakhov [Tue, 15 Sep 2015 17:40:01 +0000 (18:40 +0100)]
Another issue with nested depends.

9 years agoImprove url log output.
Vsevolod Stakhov [Tue, 15 Sep 2015 17:36:56 +0000 (18:36 +0100)]
Improve url log output.

9 years agoPrint 'from: ' in logs if a task has no `user` specified
Vsevolod Stakhov [Tue, 15 Sep 2015 17:29:25 +0000 (18:29 +0100)]
Print 'from: ' in logs if a task has no `user` specified

9 years agoAdd default dmarc configuration.
Vsevolod Stakhov [Tue, 15 Sep 2015 17:10:23 +0000 (18:10 +0100)]
Add default dmarc configuration.

9 years agoStop logging of encrypted passwords.
Vsevolod Stakhov [Tue, 15 Sep 2015 17:01:27 +0000 (18:01 +0100)]
Stop logging of encrypted passwords.

9 years agoSave controller statistics between restarts.
Vsevolod Stakhov [Tue, 15 Sep 2015 16:34:36 +0000 (17:34 +0100)]
Save controller statistics between restarts.

9 years agoFix rrd tests.
Vsevolod Stakhov [Tue, 15 Sep 2015 16:01:27 +0000 (17:01 +0100)]
Fix rrd tests.

9 years agoFix rra updates.
Vsevolod Stakhov [Tue, 15 Sep 2015 16:00:05 +0000 (17:00 +0100)]
Fix rra updates.

9 years agoFix bugs in pdp calculations.
Vsevolod Stakhov [Tue, 15 Sep 2015 15:11:44 +0000 (16:11 +0100)]
Fix bugs in pdp calculations.

9 years agoAdd debugging to rrd code.
Vsevolod Stakhov [Tue, 15 Sep 2015 14:35:59 +0000 (15:35 +0100)]
Add debugging to rrd code.

9 years agoUpdate rrd code.
Vsevolod Stakhov [Tue, 15 Sep 2015 12:38:47 +0000 (13:38 +0100)]
Update rrd code.

9 years agoUpdate rrd test.
Vsevolod Stakhov [Tue, 15 Sep 2015 12:38:39 +0000 (13:38 +0100)]
Update rrd test.

9 years agoAdd utility to get calendar ticks.
Vsevolod Stakhov [Tue, 15 Sep 2015 12:38:30 +0000 (13:38 +0100)]
Add utility to get calendar ticks.

9 years agoFix dependencies nesting.
Vsevolod Stakhov [Tue, 15 Sep 2015 10:20:26 +0000 (11:20 +0100)]
Fix dependencies nesting.

9 years agoAdd whitelist documentation.
Vsevolod Stakhov [Tue, 15 Sep 2015 08:34:41 +0000 (09:34 +0100)]
Add whitelist documentation.

9 years agoFix scanning via controller.
Vsevolod Stakhov [Tue, 15 Sep 2015 08:09:07 +0000 (09:09 +0100)]
Fix scanning via controller.

9 years agoUpdate interface.
Vsevolod Stakhov [Mon, 14 Sep 2015 23:10:48 +0000 (00:10 +0100)]
Update interface.

9 years agoAdd initial version of the whitelist plugin.
Vsevolod Stakhov [Mon, 14 Sep 2015 21:12:04 +0000 (22:12 +0100)]
Add initial version of the whitelist plugin.

9 years agoFix parsing of lua tables.
Vsevolod Stakhov [Mon, 14 Sep 2015 21:11:43 +0000 (22:11 +0100)]
Fix parsing of lua tables.

9 years agoImprove error handler for lua_pcall.
Vsevolod Stakhov [Mon, 14 Sep 2015 20:56:30 +0000 (21:56 +0100)]
Improve error handler for lua_pcall.

9 years agoPrint stack trace on lua errors.
Vsevolod Stakhov [Mon, 14 Sep 2015 20:37:34 +0000 (21:37 +0100)]
Print stack trace on lua errors.

9 years agoUnbreak logging in the settings module.
Vsevolod Stakhov [Mon, 14 Sep 2015 17:47:45 +0000 (18:47 +0100)]
Unbreak logging in the settings module.

9 years agoFix variable name.
Vsevolod Stakhov [Mon, 14 Sep 2015 17:11:19 +0000 (18:11 +0100)]
Fix variable name.

9 years agoRework dmarc to the dependencies system.
Vsevolod Stakhov [Mon, 14 Sep 2015 15:44:00 +0000 (16:44 +0100)]
Rework dmarc to the dependencies system.

9 years agoUse rspamd.com instead of highsecure.ru
Vsevolod Stakhov [Mon, 14 Sep 2015 15:05:36 +0000 (16:05 +0100)]
Use rspamd.com instead of highsecure.ru

9 years agoDo not trigger hfilter for rspamc scans.
Vsevolod Stakhov [Mon, 14 Sep 2015 13:35:28 +0000 (14:35 +0100)]
Do not trigger hfilter for rspamc scans.

9 years agoAdd workaround for libevent 1.4.
Vsevolod Stakhov [Fri, 11 Sep 2015 14:14:39 +0000 (15:14 +0100)]
Add workaround for libevent 1.4.

9 years agoReduce verbosity of resort messages.
Vsevolod Stakhov [Fri, 11 Sep 2015 14:07:37 +0000 (15:07 +0100)]
Reduce verbosity of resort messages.

9 years agoCorrectly handle arrays when reading mime_types.
Vsevolod Stakhov [Fri, 11 Sep 2015 12:05:58 +0000 (13:05 +0100)]
Correctly handle arrays when reading mime_types.

9 years agoFix index calculation.
Vsevolod Stakhov [Thu, 10 Sep 2015 15:01:51 +0000 (16:01 +0100)]
Fix index calculation.

9 years agoShow scan time in rspamc client.
Vsevolod Stakhov [Thu, 10 Sep 2015 14:38:24 +0000 (15:38 +0100)]
Show scan time in rspamc client.

9 years agoClear url parser to avoid invalid offsets when parsing urls.
Vsevolod Stakhov [Thu, 10 Sep 2015 14:09:36 +0000 (15:09 +0100)]
Clear url parser to avoid invalid offsets when parsing urls.

9 years agoBe more carefull about newlines in html.
Vsevolod Stakhov [Thu, 10 Sep 2015 12:47:28 +0000 (13:47 +0100)]
Be more carefull about newlines in html.

9 years agoFix pragma usage.
Vsevolod Stakhov [Thu, 10 Sep 2015 11:45:19 +0000 (12:45 +0100)]
Fix pragma usage.

9 years agoRelax synchronization mode in sqlite3.
Vsevolod Stakhov [Thu, 10 Sep 2015 10:15:05 +0000 (11:15 +0100)]
Relax synchronization mode in sqlite3.

9 years agoChange separators to commas to avoid issues with ipv6.
Vsevolod Stakhov [Thu, 10 Sep 2015 09:55:28 +0000 (10:55 +0100)]
Change separators to commas to avoid issues with ipv6.

9 years agoAllow to change fold_max variable.
Vsevolod Stakhov [Wed, 9 Sep 2015 15:03:06 +0000 (16:03 +0100)]
Allow to change fold_max variable.

9 years agoMore fixes to emails parsing.
Vsevolod Stakhov [Wed, 9 Sep 2015 14:37:14 +0000 (15:37 +0100)]
More fixes to emails parsing.

9 years agoTurn on folding for now as gmime breaks everything.
Vsevolod Stakhov [Wed, 9 Sep 2015 13:36:53 +0000 (14:36 +0100)]
Turn on folding for now as gmime breaks everything.

9 years agoMore fixes on per-languages and per-user stats.
Vsevolod Stakhov [Tue, 8 Sep 2015 20:11:22 +0000 (21:11 +0100)]
More fixes on per-languages and per-user stats.

9 years agoFix creating languages on learning.
Vsevolod Stakhov [Tue, 8 Sep 2015 18:09:14 +0000 (19:09 +0100)]
Fix creating languages on learning.

9 years agoFix stupid cast issue.
Vsevolod Stakhov [Tue, 8 Sep 2015 15:34:53 +0000 (16:34 +0100)]
Fix stupid cast issue.

9 years agoRework symbols classes in url parser.
Vsevolod Stakhov [Tue, 8 Sep 2015 13:44:40 +0000 (14:44 +0100)]
Rework symbols classes in url parser.

9 years agoMore fixes to url parser.
Vsevolod Stakhov [Tue, 8 Sep 2015 13:12:45 +0000 (14:12 +0100)]
More fixes to url parser.

9 years agoUse folding for symbols header.
Vsevolod Stakhov [Tue, 8 Sep 2015 12:44:18 +0000 (13:44 +0100)]
Use folding for symbols header.