]> source.dussan.org Git - rspamd.git/log
rspamd.git
9 years agoRelease 1.0.4 1.0.4
Vsevolod Stakhov [Mon, 5 Oct 2015 14:10:52 +0000 (15:10 +0100)]
Release 1.0.4

* Add configdump routine to rspamadm
* Implement retransmits for fuzzy_check plugin
* Fix events processing for learning anf checking fuzzy hashes
* Avoid dependency on unneeded and uncompatible glib include
* Add `historyreset` command to the controller
* Fix loading of tokenizer config from dump (#389)
* Add sorting hints for the history
* Allow custom lua scripts for users/languages extraction (#388)
* Do not add FORGED_RECIPIENTS when 'To' is missing (#387)
* Do not add R_UNDISC_RCPT when 'To' is missing (#387)
* Add encryption to fuzzy check plugin
* Add encryption for fuzzy storage
* Add new epoch for encrypted fuzzy request
* Add encryption for `rspamd.com` storage
* Remove gmime processing for LDA mode as it is deadly broken
* Add routine to find end of headers position in mime messages
* Fix LDA headers folding
* Init libraries in rspamc client as well to avoid locale issues
* Avoid collision with locally installed includes
* Allocate and free memory with the same allocator in rspamadm (#385)
* Preserve expired fuzzy hashes counter
* Improvements in webui:
- Add favicon.ico
- Rework history table
- Fix sorting for the history
- Migrate to bootstrap 3 and jquery 2
- Fix css bugs
- Add glyphicons
- Add reset history
- Improve history buttons
- Redraw graph to avoid display issues
- Webui is now MIT licensed to match licensing policy of rspamd

Signed-off-by: Vsevolod Stakhov <vsevolod@highsecure.ru>
9 years agoUpdate copyright notices.
Vsevolod Stakhov [Mon, 5 Oct 2015 13:52:59 +0000 (14:52 +0100)]
Update copyright notices.

9 years agoCatch up interface changes.
Vsevolod Stakhov [Mon, 5 Oct 2015 13:17:21 +0000 (14:17 +0100)]
Catch up interface changes.

9 years agoTry to fix fuzzy learning states (not fully completed).
Vsevolod Stakhov [Mon, 5 Oct 2015 12:50:51 +0000 (13:50 +0100)]
Try to fix fuzzy learning states (not fully completed).

9 years agoUpdate manpage.
Vsevolod Stakhov [Mon, 5 Oct 2015 11:40:12 +0000 (12:40 +0100)]
Update manpage.

9 years agoAdd configdump routine.
Vsevolod Stakhov [Mon, 5 Oct 2015 11:38:44 +0000 (12:38 +0100)]
Add configdump routine.

9 years agoImplement retransmits for fuzzy_check plugin.
Vsevolod Stakhov [Mon, 5 Oct 2015 11:08:32 +0000 (12:08 +0100)]
Implement retransmits for fuzzy_check plugin.

9 years agoUpdate webui.
Vsevolod Stakhov [Sun, 4 Oct 2015 19:55:34 +0000 (20:55 +0100)]
Update webui.

9 years agoFix dirent include.
Vsevolod Stakhov [Sat, 3 Oct 2015 15:09:58 +0000 (16:09 +0100)]
Fix dirent include.

9 years agoAvoid dependency on unneeded and uncompatible glib include.
Vsevolod Stakhov [Sat, 3 Oct 2015 15:03:12 +0000 (16:03 +0100)]
Avoid dependency on unneeded and uncompatible glib include.

9 years agoUpdate interface.
Vsevolod Stakhov [Sat, 3 Oct 2015 13:21:49 +0000 (14:21 +0100)]
Update interface.

9 years agoAdd '/historyreset' command.
Vsevolod Stakhov [Sat, 3 Oct 2015 13:20:55 +0000 (14:20 +0100)]
Add '/historyreset' command.

9 years agoFix loading of tokenizer config from dump.
Vsevolod Stakhov [Sat, 3 Oct 2015 13:05:27 +0000 (14:05 +0100)]
Fix loading of tokenizer config from dump.

Issue: #389

9 years agoUpdate webui.
Vsevolod Stakhov [Fri, 2 Oct 2015 15:54:02 +0000 (16:54 +0100)]
Update webui.

9 years agoAdd sorting hints for the history.
Vsevolod Stakhov [Fri, 2 Oct 2015 13:42:40 +0000 (14:42 +0100)]
Add sorting hints for the history.

9 years agoAllow custom lua scripts for users/languages extraction.
Vsevolod Stakhov [Fri, 2 Oct 2015 12:23:03 +0000 (13:23 +0100)]
Allow custom lua scripts for users/languages extraction.

Issue: #388

9 years agoDo not use relative path for linkage.
Vsevolod Stakhov [Fri, 2 Oct 2015 11:30:39 +0000 (12:30 +0100)]
Do not use relative path for linkage.

Issue: #386

9 years agoDo not add FORGED_RECIPIENTS when 'To' is missing.
Vsevolod Stakhov [Thu, 1 Oct 2015 21:20:15 +0000 (22:20 +0100)]
Do not add FORGED_RECIPIENTS when 'To' is missing.

Issue: #387

9 years agoDo not add R_UNDISC_RCPT when 'To' is missing.
Vsevolod Stakhov [Thu, 1 Oct 2015 21:19:10 +0000 (22:19 +0100)]
Do not add R_UNDISC_RCPT when 'To' is missing.

Issue: #387

9 years agoAdd key for rspamd.com fuzzy storage.
Vsevolod Stakhov [Thu, 1 Oct 2015 13:23:15 +0000 (14:23 +0100)]
Add key for rspamd.com fuzzy storage.

9 years agoDo not try to decrypt when no local key defined.
Vsevolod Stakhov [Thu, 1 Oct 2015 12:56:30 +0000 (13:56 +0100)]
Do not try to decrypt when no local key defined.

9 years agoSet the correct epoch for encrypted requests.
Vsevolod Stakhov [Wed, 30 Sep 2015 17:39:48 +0000 (18:39 +0100)]
Set the correct epoch for encrypted requests.

9 years agoFix events calculations.
Vsevolod Stakhov [Wed, 30 Sep 2015 17:13:23 +0000 (18:13 +0100)]
Fix events calculations.

9 years agoAdd encryption to fuzzy check plugin.
Vsevolod Stakhov [Wed, 30 Sep 2015 16:47:29 +0000 (17:47 +0100)]
Add encryption to fuzzy check plugin.

9 years agoRemove gmime processing for LDA mode as it is deadly broken.
Vsevolod Stakhov [Wed, 30 Sep 2015 14:58:02 +0000 (15:58 +0100)]
Remove gmime processing for LDA mode as it is deadly broken.

9 years agoAdd routine to find end of headers position in mime messages.
Vsevolod Stakhov [Wed, 30 Sep 2015 14:57:58 +0000 (15:57 +0100)]
Add routine to find end of headers position in mime messages.

9 years agoInit libraries in rspamc client as well.
Vsevolod Stakhov [Wed, 30 Sep 2015 13:41:08 +0000 (14:41 +0100)]
Init libraries in rspamc client as well.

9 years agoAdd configuration knobs for encryption in fuzzy_check plugin
Vsevolod Stakhov [Tue, 29 Sep 2015 17:28:22 +0000 (18:28 +0100)]
Add configuration knobs for encryption in fuzzy_check plugin

9 years agoAdd encryption to fuzzy storage.
Vsevolod Stakhov [Tue, 29 Sep 2015 16:29:24 +0000 (17:29 +0100)]
Add encryption to fuzzy storage.

9 years agoDo not copy nm to local key as it seems to be useless.
Vsevolod Stakhov [Tue, 29 Sep 2015 16:07:29 +0000 (17:07 +0100)]
Do not copy nm to local key as it seems to be useless.

9 years agoTry to avoid collision with locally installed includes.
Vsevolod Stakhov [Tue, 29 Sep 2015 12:32:47 +0000 (13:32 +0100)]
Try to avoid collision with locally installed includes.

9 years agoAllocate and free memory with the same allocator.
Vsevolod Stakhov [Tue, 29 Sep 2015 11:38:35 +0000 (12:38 +0100)]
Allocate and free memory with the same allocator.

Issue: #385

9 years agoPreserve expired fuzzy hashes counter.
Vsevolod Stakhov [Mon, 28 Sep 2015 17:41:22 +0000 (18:41 +0100)]
Preserve expired fuzzy hashes counter.

9 years agoUpdate version to 1.0.4
Vsevolod Stakhov [Mon, 28 Sep 2015 17:23:34 +0000 (18:23 +0100)]
Update version to 1.0.4

9 years agoRelease 1.0.3 1.0.3
Vsevolod Stakhov [Mon, 28 Sep 2015 16:19:11 +0000 (17:19 +0100)]
Release 1.0.3

* Fix piechart clean slice (#380)
* Fix controller crashes when GString is reallocated (#381)
* Correctly set locale before start
* Set C locale for numeric values
* Add rspamadm routine:
- add `pw` command to manage passwords
- add `help` command for displaying help
- add `configtest` command to check configuration files
- add `keypair` command for generating encryption keys
- add `fuzzy_merge` routine to merge fuzzy sqlite databases
- add a simple manual page for rspamadm
* Allow metric registration for composite expressions
* Add strict mode for configtest
* Add logger counters
* Save and show learned messages count (#383)
* Add `no_stat` flag
* Add `task:set_flag` and `task:get_flags` (#382)
* Enable foreign keys in sqlite3
* Remove orphaned shingles from fuzzy storage
* Optimize synchronization steps for fuzzy storage
* Allow delayed conditions registration
* Add lua API for conditions registering

Signed-off-by: Vsevolod Stakhov <vsevolod@highsecure.ru>
9 years agoAdd missing entries to spec.
Vsevolod Stakhov [Mon, 28 Sep 2015 15:45:44 +0000 (16:45 +0100)]
Add missing entries to spec.

9 years agoAdd preliminary documentation for rspamadm.
Vsevolod Stakhov [Mon, 28 Sep 2015 15:45:01 +0000 (16:45 +0100)]
Add preliminary documentation for rspamadm.

9 years agoAdd lua API for conditions registering.
Vsevolod Stakhov [Mon, 28 Sep 2015 14:53:20 +0000 (15:53 +0100)]
Add lua API for conditions registering.

9 years agoAllow delayed conditions registration.
Vsevolod Stakhov [Mon, 28 Sep 2015 14:53:06 +0000 (15:53 +0100)]
Allow delayed conditions registration.

9 years agoPrint merge stats.
Vsevolod Stakhov [Mon, 28 Sep 2015 13:15:46 +0000 (14:15 +0100)]
Print merge stats.

9 years agoOptimize performance of expiration.
Vsevolod Stakhov [Mon, 28 Sep 2015 12:09:45 +0000 (13:09 +0100)]
Optimize performance of expiration.

9 years agoMore sync optimizations.
Vsevolod Stakhov [Mon, 28 Sep 2015 11:35:49 +0000 (12:35 +0100)]
More sync optimizations.

9 years agoFirst attempt to clean orphaned elements.
Vsevolod Stakhov [Mon, 28 Sep 2015 10:24:34 +0000 (11:24 +0100)]
First attempt to clean orphaned elements.

9 years agoEnable foreign keys in sqlite3.
Vsevolod Stakhov [Mon, 28 Sep 2015 09:40:43 +0000 (10:40 +0100)]
Enable foreign keys in sqlite3.

9 years agoFix shingles merging.
Vsevolod Stakhov [Mon, 28 Sep 2015 09:04:48 +0000 (10:04 +0100)]
Fix shingles merging.

9 years agoFix duplicate cases in merge operation.
Vsevolod Stakhov [Mon, 28 Sep 2015 08:35:47 +0000 (09:35 +0100)]
Fix duplicate cases in merge operation.

9 years agoImprove logging for merging.
Vsevolod Stakhov [Mon, 28 Sep 2015 08:03:21 +0000 (09:03 +0100)]
Improve logging for merging.

9 years agoAdd merge logic.
Vsevolod Stakhov [Sat, 26 Sep 2015 13:37:00 +0000 (14:37 +0100)]
Add merge logic.

9 years agoStart fuzzy_merge command.
Vsevolod Stakhov [Fri, 25 Sep 2015 15:57:50 +0000 (16:57 +0100)]
Start fuzzy_merge command.

9 years agoAdd functional test for task flags API.
Vsevolod Stakhov [Fri, 25 Sep 2015 14:59:56 +0000 (15:59 +0100)]
Add functional test for task flags API.

9 years agoAdd task:set_flag and task:get_flags.
Vsevolod Stakhov [Fri, 25 Sep 2015 14:45:23 +0000 (15:45 +0100)]
Add task:set_flag and task:get_flags.

Issue: #382

9 years agoAdd no_stat flag.
Vsevolod Stakhov [Fri, 25 Sep 2015 14:07:04 +0000 (15:07 +0100)]
Add no_stat flag.

Issue: #382

9 years agoShow learned counter.
Vsevolod Stakhov [Fri, 25 Sep 2015 12:47:56 +0000 (13:47 +0100)]
Show learned counter.

Issue: #383

9 years agoSave learned messages count.
Vsevolod Stakhov [Fri, 25 Sep 2015 12:46:42 +0000 (13:46 +0100)]
Save learned messages count.

9 years agoAdd strict mode for configtest.
Vsevolod Stakhov [Fri, 25 Sep 2015 12:26:13 +0000 (13:26 +0100)]
Add strict mode for configtest.

9 years agoAdd logger counters.
Vsevolod Stakhov [Fri, 25 Sep 2015 12:17:55 +0000 (13:17 +0100)]
Add logger counters.

9 years agoSlightly improve help messages.
Vsevolod Stakhov [Fri, 25 Sep 2015 00:26:29 +0000 (01:26 +0100)]
Slightly improve help messages.

9 years agoAdd configtest command.
Vsevolod Stakhov [Fri, 25 Sep 2015 00:16:02 +0000 (01:16 +0100)]
Add configtest command.

9 years agoImplement generating keypairs via rspamadm.
Vsevolod Stakhov [Thu, 24 Sep 2015 23:43:34 +0000 (00:43 +0100)]
Implement generating keypairs via rspamadm.

9 years agoAllow metric registration for composite expressions.
Vsevolod Stakhov [Thu, 24 Sep 2015 17:39:46 +0000 (18:39 +0100)]
Allow metric registration for composite expressions.

9 years agoAdd encrypted length guard.
Vsevolod Stakhov [Thu, 24 Sep 2015 17:33:48 +0000 (18:33 +0100)]
Add encrypted length guard.

9 years agoAdd `pw` utility to manage rspamd passwords.
Vsevolod Stakhov [Thu, 24 Sep 2015 17:19:58 +0000 (18:19 +0100)]
Add `pw` utility to manage rspamd passwords.

9 years agoMove constant_memcmp to libutil code.
Vsevolod Stakhov [Thu, 24 Sep 2015 16:59:40 +0000 (17:59 +0100)]
Move constant_memcmp to libutil code.

9 years agoImprove passing of arguments to commands.
Vsevolod Stakhov [Thu, 24 Sep 2015 16:37:45 +0000 (17:37 +0100)]
Improve passing of arguments to commands.

9 years agoAdd rspamadm routine.
Vsevolod Stakhov [Thu, 24 Sep 2015 16:09:35 +0000 (17:09 +0100)]
Add rspamadm routine.

9 years agoSet C locale for numeric values.
Vsevolod Stakhov [Thu, 24 Sep 2015 14:35:39 +0000 (15:35 +0100)]
Set C locale for numeric values.

9 years agoAdd more verbosity to parsing of values.
Vsevolod Stakhov [Thu, 24 Sep 2015 14:35:16 +0000 (15:35 +0100)]
Add more verbosity to parsing of values.

9 years agoCorrectly set locale before start.
Vsevolod Stakhov [Thu, 24 Sep 2015 14:30:04 +0000 (15:30 +0100)]
Correctly set locale before start.

9 years agoTry to fix crashes when GString is reallocated.
Vsevolod Stakhov [Thu, 24 Sep 2015 14:21:35 +0000 (15:21 +0100)]
Try to fix crashes when GString is reallocated.

Issue: #381

9 years agoFix piechart clean slice.
Vsevolod Stakhov [Wed, 23 Sep 2015 18:31:11 +0000 (19:31 +0100)]
Fix piechart clean slice.

Issue: #380

9 years agoUpdate version to 1.0.3
Vsevolod Stakhov [Wed, 23 Sep 2015 16:39:57 +0000 (17:39 +0100)]
Update version to 1.0.3

9 years agoRelease 1.0.2 1.0.2
Vsevolod Stakhov [Wed, 23 Sep 2015 16:26:52 +0000 (17:26 +0100)]
Release 1.0.2

* Fix critical bug in webui that prevents password from being sent
* Rework webui view:
- Switch to d3.js for graphs
- Improve piechart look
- Rework colors for piechart
- Fix layout for symbols
- Fix refresh button
* Add descriptions for whitelist maps
* Fix build on arm (#379)
* Fix issue with the last element in the radix trie
* Add more tests for radix trie algorithm
* Allow to extract URLs from query strings of other URLs (#361)
* Initialize rrd fields before writing to file
* Fix double free if no password has been specified

Signed-off-by: Vsevolod Stakhov <vsevolod@highsecure.ru>
9 years agoSearch for urls in query parts of html urls as well.
Vsevolod Stakhov [Wed, 23 Sep 2015 16:08:32 +0000 (17:08 +0100)]
Search for urls in query parts of html urls as well.

9 years agoFix double free if no password has been specified.
Vsevolod Stakhov [Wed, 23 Sep 2015 15:53:30 +0000 (16:53 +0100)]
Fix double free if no password has been specified.

Reported by: Golub Mikhail

9 years agoInitialize rrd fields before writing to file.
Vsevolod Stakhov [Wed, 23 Sep 2015 15:52:04 +0000 (16:52 +0100)]
Initialize rrd fields before writing to file.

9 years agoAllow to extract URLs from query strings of other URLs.
Vsevolod Stakhov [Wed, 23 Sep 2015 15:37:04 +0000 (16:37 +0100)]
Allow to extract URLs from query strings of other URLs.

Issue: #361
Reported by: @socksrambler

9 years agoAdd tests for the problematic case in radix trie.
Vsevolod Stakhov [Wed, 23 Sep 2015 15:13:23 +0000 (16:13 +0100)]
Add tests for the problematic case in radix trie.

9 years agoFix issue with the last element in the radix trie.
Vsevolod Stakhov [Wed, 23 Sep 2015 15:12:54 +0000 (16:12 +0100)]
Fix issue with the last element in the radix trie.

9 years agoUpdate webui.
Vsevolod Stakhov [Wed, 23 Sep 2015 13:16:32 +0000 (14:16 +0100)]
Update webui.

9 years agoReiterate on colors one more time.
Vsevolod Stakhov [Wed, 23 Sep 2015 13:15:49 +0000 (14:15 +0100)]
Reiterate on colors one more time.

9 years agoFix issue with va_list passing.
Vsevolod Stakhov [Wed, 23 Sep 2015 12:43:59 +0000 (13:43 +0100)]
Fix issue with va_list passing.

Issue: #379
Reported by: @Gottox

9 years agoImprove pie colors.
Vsevolod Stakhov [Wed, 23 Sep 2015 12:35:42 +0000 (13:35 +0100)]
Improve pie colors.

9 years agoAdd descriptions for whitelist maps.
Vsevolod Stakhov [Wed, 23 Sep 2015 11:34:57 +0000 (12:34 +0100)]
Add descriptions for whitelist maps.

9 years agoRename main.h and main.c to `rspamd.X`
Vsevolod Stakhov [Tue, 22 Sep 2015 17:17:24 +0000 (18:17 +0100)]
Rename main.h and main.c to `rspamd.X`

9 years agoUpdate version number to 1.0.2.
Vsevolod Stakhov [Tue, 22 Sep 2015 16:24:41 +0000 (17:24 +0100)]
Update version number to 1.0.2.

9 years agoRelease 1.0.1 1.0.1
Vsevolod Stakhov [Tue, 22 Sep 2015 15:53:20 +0000 (16:53 +0100)]
Release 1.0.1

* Add writing to rrd from the controller
* Fixed lots of bugs in rrd code
* Adopt new DNS API in hfilter plugin (by @AlexeySa)
* Allow only one controller process to manage rrd file
* Set event base for fuzzy calls
* Improve fuzzy IO errors logging
* Add rra extraction function to rrd library
* Add graph handler to the controller
* Cache correct passwords to avoid too high CPU usage when working with webui
* Controller sockets are owned by router do not export them to task
* Optimize logging by skipping hash table search if it's empty
* Fix loading issue whith broken statfiles
* Print assertions from glib to rspamd logger
* Load legacy `lua/rspamd.local.lua`
* Update webui with some fixes to learning and scanning

Signed-off-by: Vsevolod Stakhov <vsevolod@highsecure.ru>
9 years agoUpdate webui.
Vsevolod Stakhov [Tue, 22 Sep 2015 15:37:02 +0000 (16:37 +0100)]
Update webui.

9 years agoLoad legacy `lua/rspamd.local.lua`
Vsevolod Stakhov [Tue, 22 Sep 2015 15:36:31 +0000 (16:36 +0100)]
Load legacy `lua/rspamd.local.lua`

9 years agoFix issue when there is no reject score for any metric.
Vsevolod Stakhov [Tue, 22 Sep 2015 15:34:09 +0000 (16:34 +0100)]
Fix issue when there is no reject score for any metric.

9 years agoPrint assertions from glib to rspamd logger.
Vsevolod Stakhov [Tue, 22 Sep 2015 15:08:44 +0000 (16:08 +0100)]
Print assertions from glib to rspamd logger.

9 years agoFix issue whith broken statfiles.
Vsevolod Stakhov [Tue, 22 Sep 2015 12:49:46 +0000 (13:49 +0100)]
Fix issue whith broken statfiles.

9 years agoFix time for /graph.
Vsevolod Stakhov [Tue, 22 Sep 2015 10:58:15 +0000 (11:58 +0100)]
Fix time for /graph.

9 years agoOptimize logging by skipping hash table search if it's empty.
Vsevolod Stakhov [Tue, 22 Sep 2015 10:33:00 +0000 (11:33 +0100)]
Optimize logging by skipping hash table search if it's empty.

9 years agoController sockets are owned by router do not export them to task.
Vsevolod Stakhov [Tue, 22 Sep 2015 08:52:24 +0000 (09:52 +0100)]
Controller sockets are owned by router do not export them to task.

9 years agoCache correct passwords to avoid too high CPU usage.
Vsevolod Stakhov [Tue, 22 Sep 2015 08:25:14 +0000 (09:25 +0100)]
Cache correct passwords to avoid too high CPU usage.

9 years agoAdd graph handler to the controller.
Vsevolod Stakhov [Mon, 21 Sep 2015 18:14:24 +0000 (19:14 +0100)]
Add graph handler to the controller.

9 years agoAdd rra extraction function.
Vsevolod Stakhov [Mon, 21 Sep 2015 16:33:26 +0000 (17:33 +0100)]
Add rra extraction function.

9 years agoFix assignment order.
Vsevolod Stakhov [Mon, 21 Sep 2015 15:28:26 +0000 (16:28 +0100)]
Fix assignment order.

9 years agoImprove fuzzy IO errors logging.
Vsevolod Stakhov [Mon, 21 Sep 2015 15:03:52 +0000 (16:03 +0100)]
Improve fuzzy IO errors logging.

9 years agoSet event base for fuzzy calls.
Vsevolod Stakhov [Mon, 21 Sep 2015 14:49:48 +0000 (15:49 +0100)]
Set event base for fuzzy calls.