]> source.dussan.org Git - rspamd.git/log
rspamd.git
13 years agoZero memory of pool allocator statistic.
Vsevolod Stakhov [Mon, 25 Jul 2011 13:43:30 +0000 (17:43 +0400)]
Zero memory of pool allocator statistic.

13 years agoFix coredumps when learning message with one empty part.
Vsevolod Stakhov [Mon, 25 Jul 2011 11:45:10 +0000 (15:45 +0400)]
Fix coredumps when learning message with one empty part.

13 years agoAdded tag 0.4.0 for changeset f04885bd268e
Vsevolod Stakhov [Fri, 22 Jul 2011 12:00:51 +0000 (16:00 +0400)]
Added tag 0.4.0 for changeset f04885bd268e

13 years agoFix for libevent. 0.4.0
Vsevolod Stakhov [Fri, 22 Jul 2011 11:58:47 +0000 (15:58 +0400)]
Fix for libevent.

13 years agoWrite error about too few tokens during learning.
Vsevolod Stakhov [Fri, 22 Jul 2011 11:51:31 +0000 (15:51 +0400)]
Write error about too few tokens during learning.

13 years agoIncrease buffer for output.
Vsevolod Stakhov [Fri, 22 Jul 2011 11:50:09 +0000 (15:50 +0400)]
Increase buffer for output.

13 years agoAdded tag 0.4.0 for changeset c52f190b0592
Vsevolod Stakhov [Fri, 22 Jul 2011 11:30:08 +0000 (15:30 +0400)]
Added tag 0.4.0 for changeset c52f190b0592

13 years agoAdd workaround for clang under linux.
Vsevolod Stakhov [Thu, 21 Jul 2011 13:35:29 +0000 (17:35 +0400)]
Add workaround for clang under linux.
Fix problems found by static analyzing.

13 years agoAnother fix to avoid race with settings - add reference counter.
Vsevolod Stakhov [Thu, 21 Jul 2011 12:09:27 +0000 (16:09 +0400)]
Another fix to avoid race with settings - add reference counter.

13 years ago* Add start script for red hat compatible systems
Vsevolod Stakhov [Wed, 20 Jul 2011 15:35:07 +0000 (19:35 +0400)]
* Add start script for red hat compatible systems
Add descriptions for some rspamd API functions (no functional changes).

--HG--
rename : linux/rspamd => linux/rspamd_debian.in

13 years agoRework http chunked encoding parsing.
Vsevolod Stakhov [Wed, 20 Jul 2011 12:07:06 +0000 (16:07 +0400)]
Rework http chunked encoding parsing.

13 years agoDo not try to use information about dispatcher after callback fails (found by valgrind).
Vsevolod Stakhov [Tue, 19 Jul 2011 16:09:18 +0000 (20:09 +0400)]
Do not try to use information about dispatcher after callback fails (found by valgrind).

13 years ago* Add classifiers pre-selection script
Vsevolod Stakhov [Tue, 19 Jul 2011 13:51:28 +0000 (17:51 +0400)]
* Add classifiers pre-selection script

13 years agoFix coredumps on some specific messages with specific urls.
Vsevolod Stakhov [Tue, 19 Jul 2011 13:01:17 +0000 (17:01 +0400)]
Fix coredumps on some specific messages with specific urls.
Fix coredumps while closing log file.
Fix parsing of chunked HTTP replies.

13 years agoRef hash table at settings loading.
Vsevolod Stakhov [Mon, 18 Jul 2011 14:37:12 +0000 (18:37 +0400)]
Ref hash table at settings loading.

13 years agoFix statfiles class determination euristic.
Vsevolod Stakhov [Mon, 18 Jul 2011 13:55:27 +0000 (17:55 +0400)]
Fix statfiles class determination euristic.
Fix call of classifier pre-callback.

13 years agoFix textpart:get_language lua function.
Vsevolod Stakhov [Mon, 18 Jul 2011 13:23:27 +0000 (17:23 +0400)]
Fix textpart:get_language lua function.

13 years agoCreate statfiles using learn_spam function for bayes classifier.
Vsevolod Stakhov [Mon, 18 Jul 2011 13:15:33 +0000 (17:15 +0400)]
Create statfiles using learn_spam function for bayes classifier.
Fix call of pre callbacks for a classifier.

13 years agoUse event_set correctly after event_del.
Vsevolod Stakhov [Mon, 18 Jul 2011 12:54:48 +0000 (16:54 +0400)]
Use event_set correctly after event_del.

13 years agoFix bug with data corruption during settings application.
Vsevolod Stakhov [Mon, 18 Jul 2011 11:32:39 +0000 (15:32 +0400)]
Fix bug with data corruption during settings application.

13 years agoBegin to write normal and updated default configuration.
Vsevolod Stakhov [Fri, 15 Jul 2011 14:56:47 +0000 (18:56 +0400)]
Begin to write normal and updated default configuration.

--HG--
rename : rspamd.xml.sample => conf/rspamd-basic.xml.in

13 years agoAnother fix for comparing parts without content - two empty parts are equal.
Vsevolod Stakhov [Thu, 14 Jul 2011 15:58:05 +0000 (19:58 +0400)]
Another fix for comparing parts without content - two empty parts are equal.

13 years agoFix coredump on messages with one url only.
Vsevolod Stakhov [Thu, 14 Jul 2011 15:47:56 +0000 (19:47 +0400)]
Fix coredump on messages with one url only.

13 years agoFix core dumps when no symbols are found in a message.
Vsevolod Stakhov [Thu, 14 Jul 2011 14:01:09 +0000 (18:01 +0400)]
Fix core dumps when no symbols are found in a message.

13 years ago* Add learn_spam/learn_ham interface to librspamdclient and to rspamc
Vsevolod Stakhov [Thu, 14 Jul 2011 13:48:51 +0000 (17:48 +0400)]
* Add learn_spam/learn_ham interface to librspamdclient and to rspamc
* Improve logic of io dispatcher restoration
Remove correction factor from bayes as it leads to classify errors.

13 years agoAdjust interval.
Vsevolod Stakhov [Thu, 14 Jul 2011 11:10:23 +0000 (15:10 +0400)]
Adjust interval.

13 years ago* Remove completion logic from controller: it is hardly used but breaks new commands...
Vsevolod Stakhov [Thu, 14 Jul 2011 07:31:09 +0000 (11:31 +0400)]
* Remove completion logic from controller: it is hardly used but breaks new commands logic

13 years agoFix multiply compare_parts_distance calls.
Vsevolod Stakhov [Thu, 14 Jul 2011 07:17:34 +0000 (11:17 +0400)]
Fix multiply compare_parts_distance calls.

13 years agoIgnore arguments order in compare_parts_distance function.
Vsevolod Stakhov [Thu, 14 Jul 2011 06:24:15 +0000 (10:24 +0400)]
Ignore arguments order in compare_parts_distance function.

13 years agoChange logic of params inside compare parts distance.
Vsevolod Stakhov [Thu, 14 Jul 2011 06:02:54 +0000 (10:02 +0400)]
Change logic of params inside compare parts distance.
During learning and classifying compare parts using new algorithm.
Raise similarity factor.

13 years ago* Add new algorithm based on diff algorithm to compare relatively short text parts
Vsevolod Stakhov [Wed, 13 Jul 2011 15:39:37 +0000 (19:39 +0400)]
* Add new algorithm based on diff algorithm to compare relatively short text parts

13 years agoAdd validity detector for statfiles inside classifier.
Vsevolod Stakhov [Wed, 13 Jul 2011 09:07:45 +0000 (13:07 +0400)]
Add validity detector for statfiles inside classifier.
Add euristic to detect spam/ham classes based on statfile symbol.

13 years ago* Add second argument to compare_parts_distance function so it can be used as interva...
Vsevolod Stakhov [Wed, 13 Jul 2011 07:04:06 +0000 (11:04 +0400)]
* Add second argument to compare_parts_distance function so it can be used as interval: arg2 <= distance <= arg1

13 years ago* Add ability to get difference between two parts from lua code
Vsevolod Stakhov [Tue, 12 Jul 2011 17:13:10 +0000 (21:13 +0400)]
* Add ability to get difference between two parts from lua code

13 years ago* First commit to implement multi-statfile filter system with new learning mechanizm...
Vsevolod Stakhov [Tue, 12 Jul 2011 16:46:55 +0000 (20:46 +0400)]
* First commit to implement multi-statfile filter system with new learning mechanizm (untested yet)

13 years agoCache data of parts distance function to speed up multiply rules with such function.
Vsevolod Stakhov [Tue, 12 Jul 2011 14:35:47 +0000 (18:35 +0400)]
Cache data of parts distance function to speed up multiply rules with such function.

13 years ago* Make fuzzy hashes utf8 compatible.
Vsevolod Stakhov [Tue, 12 Jul 2011 14:20:21 +0000 (18:20 +0400)]
* Make fuzzy hashes utf8 compatible.

13 years ago* Add a simple logic of language detection for text parts (unicode script based)
Vsevolod Stakhov [Mon, 11 Jul 2011 16:38:47 +0000 (20:38 +0400)]
* Add a simple logic of language detection for text parts (unicode script based)

13 years agoFix phishing detection with img flag.
Vsevolod Stakhov [Mon, 11 Jul 2011 14:42:13 +0000 (18:42 +0400)]
Fix phishing detection with img flag.
Handle unclosed HTML tags properly.
Remove warnings for types on 32 bit archs.
Do not touch grow factor many times when one shot mode is turned on.

13 years ago* Improve performance of settings lookup
Vsevolod Stakhov [Thu, 30 Jun 2011 14:32:11 +0000 (18:32 +0400)]
* Improve performance of settings lookup

13 years ago* Add correcting factor to statistics.
Vsevolod Stakhov [Tue, 28 Jun 2011 15:07:26 +0000 (19:07 +0400)]
* Add correcting factor to statistics.
Now learning increments version of a statfile.
Avoid learning and classifying of similar text parts if a message has 2 text parts.
Several fixes to statistics.

13 years ago* Add ability to specify noip option for uribl suffix to avoid checking urls with...
Vsevolod Stakhov [Tue, 28 Jun 2011 11:53:33 +0000 (15:53 +0400)]
* Add ability to specify noip option for uribl suffix to avoid checking urls with ip addresses on such lists.

13 years agoFix statshow utility.
Vsevolod Stakhov [Mon, 27 Jun 2011 16:26:21 +0000 (20:26 +0400)]
Fix statshow utility.

13 years agoRemove debug.
Vsevolod Stakhov [Mon, 27 Jun 2011 14:52:30 +0000 (18:52 +0400)]
Remove debug.

13 years agoFix incorrect calculating of token length.
Vsevolod Stakhov [Mon, 27 Jun 2011 14:50:29 +0000 (18:50 +0400)]
Fix incorrect calculating of token length.

13 years ago* Welcome 0.4.0
Vsevolod Stakhov [Fri, 24 Jun 2011 16:25:54 +0000 (20:25 +0400)]
* Welcome 0.4.0

Uncompatible changes:
- Statistics is uncompatible in utf8 mode

Major changes:
- Improved utf8 mode
- Convert all characters to lowercase in statistics
- Skip URL's in statistics
- Improve speed of bayes classifier by using integer arithmetics
- Fixed statfiles synchronization that was broken for a long time
- Synchronization is now configurable

Minor changes:
- Bugfixes
- Removed some of legacy code
- Types polishing

13 years agoOops, remove debug.
Vsevolod Stakhov [Thu, 23 Jun 2011 15:10:30 +0000 (19:10 +0400)]
Oops, remove debug.

13 years ago* Fixes to fuzzy hashing logic, skip urls while estimating fuzzy hash
Vsevolod Stakhov [Thu, 23 Jun 2011 15:05:58 +0000 (19:05 +0400)]
* Fixes to fuzzy hashing logic, skip urls while estimating fuzzy hash
Fix tags stripping.
Fix phishing checks (ignore img tags).

13 years agoAnother fix with reload command.
Vsevolod Stakhov [Mon, 20 Jun 2011 13:26:13 +0000 (17:26 +0400)]
Another fix with reload command.

13 years agoFix reload command.
Vsevolod Stakhov [Mon, 20 Jun 2011 13:10:12 +0000 (17:10 +0400)]
Fix reload command.

13 years agoHandle files with zero lenght properly.
Vsevolod Stakhov [Fri, 17 Jun 2011 13:24:55 +0000 (17:24 +0400)]
Handle files with zero lenght properly.

Reported by: Andrej Zverev

13 years agoFix rspamc client to handle multiply files properly.
Vsevolod Stakhov [Fri, 17 Jun 2011 12:16:55 +0000 (16:16 +0400)]
Fix rspamc client to handle multiply files properly.

13 years agoActually all times are in GMT already, so avoid conversion to prevent dst loosing.
Vsevolod Stakhov [Wed, 15 Jun 2011 12:55:28 +0000 (16:55 +0400)]
Actually all times are in GMT already, so avoid conversion to prevent dst loosing.

13 years agoAdd condition to fix inconsistent records in LRU cache.
Vsevolod Stakhov [Tue, 14 Jun 2011 11:53:17 +0000 (15:53 +0400)]
Add condition to fix inconsistent records in LRU cache.

13 years agoAdded tag 0.3.14 for changeset e8e79f27ad01
Vsevolod Stakhov [Fri, 10 Jun 2011 15:46:22 +0000 (19:46 +0400)]
Added tag 0.3.14 for changeset e8e79f27ad01

13 years agoWrite logbuf safely. 0.3.14
Vsevolod Stakhov [Fri, 10 Jun 2011 15:23:55 +0000 (19:23 +0400)]
Write logbuf safely.

13 years agoFix trie text search.
Vsevolod Stakhov [Fri, 10 Jun 2011 14:54:26 +0000 (18:54 +0400)]
Fix trie text search.

13 years agoFix memory issues.
Vsevolod Stakhov [Fri, 10 Jun 2011 14:47:08 +0000 (18:47 +0400)]
Fix memory issues.

13 years agoImprove performance of trie search.
Vsevolod Stakhov [Fri, 10 Jun 2011 14:34:05 +0000 (18:34 +0400)]
Improve performance of trie search.

13 years agoFix connecting to xmlrpc server.
Vsevolod Stakhov [Fri, 10 Jun 2011 13:50:24 +0000 (17:50 +0400)]
Fix connecting to xmlrpc server.

13 years agoFixes from previous commit.
Vsevolod Stakhov [Fri, 10 Jun 2011 13:43:29 +0000 (17:43 +0400)]
Fixes from previous commit.

13 years ago* Add LRU caching structure
Vsevolod Stakhov [Fri, 10 Jun 2011 13:28:19 +0000 (17:28 +0400)]
* Add LRU caching structure
* Add SPF records cache
* Add ability to parse doubles to xmlrpc
Several fixes to dns interface.
Trie plugin now checks urls as well.

13 years agoUp lua version.
Vsevolod Stakhov [Thu, 9 Jun 2011 16:53:50 +0000 (20:53 +0400)]
Up lua version.

13 years ago* Add lua http support that makes it easy to send GET and POST request to HTTP server...
Vsevolod Stakhov [Thu, 9 Jun 2011 16:47:35 +0000 (20:47 +0400)]
* Add lua http support that makes it easy to send GET and POST request to HTTP servers from lua code

13 years ago* Add api for creating XML-rpc calls
Vsevolod Stakhov [Thu, 9 Jun 2011 13:33:07 +0000 (17:33 +0400)]
* Add api for creating XML-rpc calls

13 years ago* Add lua interface for parsing xmlrpc replies
Vsevolod Stakhov [Wed, 8 Jun 2011 17:08:39 +0000 (21:08 +0400)]
* Add lua interface for parsing xmlrpc replies

13 years ago* Add more convinient operations into expressions ('and', 'or', 'not')
Vsevolod Stakhov [Mon, 6 Jun 2011 11:51:52 +0000 (15:51 +0400)]
* Add more convinient operations into expressions ('and', 'or', 'not')

13 years ago* Skip short utf words in statistics
Vsevolod Stakhov [Fri, 3 Jun 2011 16:23:13 +0000 (20:23 +0400)]
* Skip short utf words in statistics

13 years agoMisprint.
Vsevolod Stakhov [Fri, 3 Jun 2011 14:03:19 +0000 (18:03 +0400)]
Misprint.

13 years agoAdded tag 0.3.13 for changeset e20e33df7a46
Vsevolod Stakhov [Fri, 3 Jun 2011 13:52:19 +0000 (17:52 +0400)]
Added tag 0.3.13 for changeset e20e33df7a46

13 years agoParse urls with '_' sign in domain name 0.3.13
Vsevolod Stakhov [Fri, 3 Jun 2011 12:58:22 +0000 (16:58 +0400)]
Parse urls with '_' sign in domain name

13 years agoMerge.
Vsevolod Stakhov [Thu, 2 Jun 2011 16:56:33 +0000 (20:56 +0400)]
Merge.

13 years agoFix bug in librsapmdclient with uninitialized struct field.
Vsevolod Stakhov [Thu, 2 Jun 2011 16:55:19 +0000 (20:55 +0400)]
Fix bug in librsapmdclient with uninitialized struct field.
Fix bug in DNS parser that caused invalid parsing of CNAME fields.

13 years ago* Add new key-value map
Vsevolod Stakhov [Wed, 25 May 2011 14:04:10 +0000 (18:04 +0400)]
* Add new key-value map
* Add lua api support for key-value map
* Fix problem in lua configuration initialization to allow `rspamd_config' global work properly

13 years ago* Fix error in raw headers parsing
Vsevolod Stakhov [Tue, 24 May 2011 14:07:28 +0000 (18:07 +0400)]
* Fix error in raw headers parsing
* Improve speed of raw headers access

13 years agoAdd more options to rspamc client.
Vsevolod Stakhov [Fri, 13 May 2011 16:02:17 +0000 (20:02 +0400)]
Add more options to rspamc client.
Remove unused scores.

13 years agoIgnore empty from in settings.
Vsevolod Stakhov [Fri, 13 May 2011 15:44:59 +0000 (19:44 +0400)]
Ignore empty from in settings.

13 years ago* Strip email addresses from braces
Vsevolod Stakhov [Fri, 13 May 2011 15:22:09 +0000 (19:22 +0400)]
* Strip email addresses from braces
Ignore empty domains in settings

13 years agoAdd log message about action from settings
Vsevolod Stakhov [Fri, 13 May 2011 14:05:04 +0000 (18:05 +0400)]
Add log message about action from settings

13 years ago* Add blacklist to json settings
Vsevolod Stakhov [Fri, 13 May 2011 12:32:02 +0000 (16:32 +0400)]
* Add blacklist to json settings

13 years ago* Improve maillist plugin to detect majordomo, cgp and google groups
Vsevolod Stakhov [Wed, 11 May 2011 18:08:35 +0000 (22:08 +0400)]
* Improve maillist plugin to detect majordomo, cgp and google groups

13 years agoFix settings using.
Vsevolod Stakhov [Wed, 11 May 2011 16:55:02 +0000 (20:55 +0400)]
Fix settings using.
Revert genmodules logic.

13 years agoAdd this shit again.
Vsevolod Stakhov [Wed, 11 May 2011 16:17:13 +0000 (20:17 +0400)]
Add this shit again.

13 years agoForgot to save.
Vsevolod Stakhov [Wed, 11 May 2011 16:12:24 +0000 (20:12 +0400)]
Forgot to save.

13 years agoFix dependencies in cmake.
Vsevolod Stakhov [Wed, 11 May 2011 15:11:05 +0000 (19:11 +0400)]
Fix dependencies in cmake.

13 years ago* Add Subject header that indicate how Subject must be rewritten in case of 'rewrite...
Vsevolod Stakhov [Tue, 10 May 2011 18:52:01 +0000 (22:52 +0400)]
* Add Subject header that indicate how Subject must be rewritten in case of 'rewrite subject' action
Fix initialization order of json settings.

13 years agoFix initialization order.
Vsevolod Stakhov [Tue, 10 May 2011 17:24:02 +0000 (21:24 +0400)]
Fix initialization order.

13 years ago* Rework build process:
Vsevolod Stakhov [Tue, 10 May 2011 15:15:03 +0000 (19:15 +0400)]
* Rework build process:
 - add librspamdserver
 - link this library to all daemons and utils of rspamd
 - use subdirectories more often
* Rework global variables logic - move them to the main process
* Fix logging to handle utf-8 correctly
* Add statshow utility and make it working
* Move printf functions to separate source file

13 years ago* Major cleanup of cmake build system
Vsevolod Stakhov [Fri, 6 May 2011 15:18:40 +0000 (19:18 +0400)]
* Major cleanup of cmake build system
* Add initial version of statshow utility for statfiles debugging
* Add debugging for statistics
* Remove unused utilities

13 years ago* Whitelist settings now affects on metric's action
Vsevolod Stakhov [Tue, 3 May 2011 14:46:33 +0000 (18:46 +0400)]
* Whitelist settings now affects on metric's action

13 years agoAdded tag 0.3.12 for changeset 391960a4b518
Vsevolod Stakhov [Mon, 25 Apr 2011 15:35:54 +0000 (19:35 +0400)]
Added tag 0.3.12 for changeset 391960a4b518

13 years agoUpdate to 0.3.12. 0.3.12
Vsevolod Stakhov [Mon, 25 Apr 2011 15:35:49 +0000 (19:35 +0400)]
Update to 0.3.12.

13 years ago* Add rules for message's date
Vsevolod Stakhov [Mon, 25 Apr 2011 15:34:38 +0000 (19:34 +0400)]
* Add rules for message's date

13 years ago* Add functions to lua API to detect message and task date (in GMT)
Vsevolod Stakhov [Fri, 22 Apr 2011 14:57:52 +0000 (18:57 +0400)]
* Add functions to lua API to detect message and task date (in GMT)

13 years ago* Fix phishing detector to find phished urls with tags inside
Vsevolod Stakhov [Tue, 19 Apr 2011 12:48:35 +0000 (16:48 +0400)]
* Fix phishing detector to find phished urls with tags inside

13 years ago* Add ability to specify dns nameservers in a config
Vsevolod Stakhov [Wed, 6 Apr 2011 15:26:25 +0000 (19:26 +0400)]
* Add ability to specify dns nameservers in a config
* Add ability to select between round-robin and master-slave algorithms for dns servers

13 years agoAdded tag 0.3.11 for changeset efd81f6e3ad6
Vsevolod Stakhov [Mon, 4 Apr 2011 13:14:37 +0000 (17:14 +0400)]
Added tag 0.3.11 for changeset efd81f6e3ad6

13 years ago* Add ability to learn rspamd via worker (without password) 0.3.11
Vsevolod Stakhov [Thu, 31 Mar 2011 16:06:25 +0000 (20:06 +0400)]
* Add ability to learn rspamd via worker (without password)

13 years agoUpdate version to 0.3.11
Vsevolod Stakhov [Thu, 31 Mar 2011 13:38:14 +0000 (17:38 +0400)]
Update version to 0.3.11

13 years ago* Preload statfiles at the early beginning in the main process
Vsevolod Stakhov [Thu, 31 Mar 2011 13:35:35 +0000 (17:35 +0400)]
* Preload statfiles at the early beginning in the main process
* Add JSON output for rspamd worker
* Add HTTP protocol support for rspamd worker