Commit Graph

557 Commits

Author SHA1 Message Date
Vsevolod Stakhov
f0799a8a58 Fix Message-Id rules. 2014-09-06 12:18:35 -07:00
Vsevolod Stakhov
a94c617673 More fixes to classifiers selector. 2014-09-05 16:45:46 +01:00
Vsevolod Stakhov
dabc471756 Add FORGED_SENDER_MAILLIST composite. 2014-09-05 13:49:19 +01:00
Vsevolod Stakhov
dddcecd51d Fix for lua 5.2. 2014-09-05 13:43:33 +01:00
Vsevolod Stakhov
f4bd2d6708 Fix stupid mistake in configurarion. 2014-09-05 12:36:31 +01:00
Vsevolod Stakhov
3f78f1f721 Fix DATE_IN_PAST and DATE_IN_FUTURE 2014-09-04 14:16:42 +01:00
Vsevolod Stakhov
b5e51581d4 Fix configuration. 2014-09-03 18:45:24 +01:00
Vsevolod Stakhov
0fc615b3c3 Simplify cached regexp creation. 2014-08-26 12:02:50 +01:00
Vsevolod Stakhov
d224a23261 Adopt config. 2014-08-25 14:00:29 +01:00
Vsevolod Stakhov
244a9efad6 Fix plugins. 2014-08-18 15:56:33 +01:00
Vsevolod Stakhov
7c5fd966bf Update default configs. 2014-08-17 13:48:01 -07:00
Vsevolod Stakhov
bd4ce0b809 Add configuration option unknown_weight for metrics.
If this option is specified, then all filters add symbols to this metric
with the specified weight even if they are not specified in symbols list
explicitly.
2014-08-17 15:57:51 +01:00
Vsevolod Stakhov
38dd269e95 Update configuration. 2014-07-24 17:48:53 -07:00
Vsevolod Stakhov
e3329afcef Merge pull request #77 from fatalbanana/master
Avoid redefining hardcoded defaults in RBL plugin
2014-05-24 04:40:02 -04:00
Vsevolod Stakhov
093117ff38 Merge pull request #76 from AlexeySa/master
Some adding for RBL and SURBL
2014-05-24 04:39:43 -04:00
Andrew Lewis
d8d43e85eb Avoid redefining hardcoded defaults in RBL plugin 2014-05-23 21:33:26 +02:00
Alexey
79af37b653 Add TOP200 domains to surbl (from spamassassin) 2014-05-23 02:38:25 -07:00
Alexey
f5071c21e6 Update modules.conf 2014-05-23 02:33:26 -07:00
Alexey
8248859d2c Update metrics.conf 2014-05-22 17:35:57 -07:00
Alexey
9a215108d2 Update metrics.conf 2014-05-22 17:34:21 -07:00
Alexey
26dca87ae7 Update metrics.conf 2014-05-22 17:29:57 -07:00
Alexey
7f542f9ca6 Update metric for Spamhaus WL 2014-05-22 17:28:17 -07:00
Alexey
0e82e96aa9 Add Spamhaus WL 2014-05-22 17:26:35 -07:00
Alexey
70950e2b91 Update modules.conf 2014-05-22 17:20:50 -07:00
Alexey
8af560539d Update metric for DNSWL 2014-05-22 17:20:26 -07:00
Alexey
6af6bed5b8 Add symbol for DNSWL 2014-05-22 17:19:14 -07:00
Alexey
58fa426a06 Update metrics for mailspike 2014-05-22 17:17:00 -07:00
Alexey
b3ac6c0530 Upgrage Mailspake rbl 2014-05-22 17:15:12 -07:00
Alexey
6c6083f74e Update modules.conf 2014-05-22 15:25:30 -07:00
Alexey
a6e807668e Add IPv6 support for Spameatingmonkey 2014-05-22 15:22:46 -07:00
Alexey
c4096a1ea4 Add metric for Spameatingmonkey rbl 2014-05-22 15:19:59 -07:00
Alexey
ec54defff2 Remove duplicate rbl rule 2014-05-22 11:04:27 -07:00
Alexey
d6abbeb75e Add rules for Abuseat and Nszones rbl 2014-05-21 12:05:07 -07:00
Alexey
eeda38c31b Add netrics for Abuseat and Nszones rbl 2014-05-21 12:04:50 -07:00
Alexey
02bbbb5264 Add metrics for Abuse.ch and Uceprotect rbl 2014-05-21 11:51:34 -07:00
Alexey
b70551f59c Add rules for Abuse.ch and Uceprotect rbl 2014-05-21 11:51:21 -07:00
Alexey
91a146941f Update metrics.conf 2014-05-21 11:31:58 -07:00
Alexey
1511ab920e Fix: Change rbl logic 2014-05-21 11:31:29 -07:00
Alexey
7942c887e2 Very small fix for DNSWL rule 2014-05-21 10:51:03 -07:00
Vsevolod Stakhov
a84b51ada1 Merge pull request #70 from eneq123/master
DNSWL support (via RBL) added
2014-05-21 13:39:34 -04:00
Alexey
3ca562b763 Hfilter: Add new metrics 2014-05-17 02:49:17 -07:00
Alexey
fd6f0f7957 Hfilter: Update and fix
- Added checks for message-id host
- small fixes
2014-05-17 02:47:57 -07:00
eneq123
444b45d955 * use the "User:" rspamc proto param for ratelimit
* fix rspamd_actions typo
* rspamd_logger added for 'Ratelimit exceeded' case
2014-05-07 16:31:04 +04:00
eneq123
6ec0f7ee2a DNSWL support (via RBL) added 2014-05-07 15:43:43 +04:00
Vsevolod Stakhov
01e1758608 Webui is now controller.
Old controller is kept in legacy_controller.c.
2014-04-30 17:23:58 +01:00
Vsevolod Stakhov
e713036bd3 Add WWWDIR macro to rspamd configuration. 2014-04-24 18:15:33 +01:00
Vsevolod Stakhov
466fbba695 Use updated outlook version. 2014-04-10 15:24:08 -07:00
Alexey
3dfd703101 Hfilter: small fixes 2014-04-05 01:33:13 -07:00
Vsevolod Stakhov
142d36fbc6 Fix hfilter. 2014-03-29 16:18:54 -07:00
Alexey
eba9e34f73 Hfilter: Fix for IPv6 support 2014-03-28 01:56:05 -07:00
Vsevolod Stakhov
650a45cf07 Implement secure IPs for webui. 2014-02-28 17:46:31 +00:00
Vsevolod Stakhov
3f20ce1228 Merge pull request #46 from AlexeySa/master
Added Spameatingmonkey RBL, URIBL and fresh URIBL
2014-02-13 13:11:26 +00:00
Alexey
75c80c6f6e Fix setting for Spameatingmonkey RBL
Remove ipv6 support for RBL
2014-02-12 08:47:15 -08:00
Alexey
99ece568a6 Add metric for Spameatingmonkey RBL and SURBL 2014-02-12 08:41:17 -08:00
Alexey
f40af67101 Add Spameatingmonkey RBL and SURBL 2014-02-12 08:29:56 -08:00
Andrew Lewis
fa8e1dc94f Tweak default RBL module config for brevity 2014-02-07 12:03:58 +02:00
Alexey
8ba82df4bb Fix rule MISSING_MIMEOLE for IPB forum
Add exception for Invision Power Board forum
2014-02-05 09:54:36 -08:00
Alexey
dd6a81c697 Fix Hfilter for null text part
Fix HFILTER_URL_ONELINE for null text part
2014-02-05 00:32:06 -08:00
Alexey
7bd58d6795 Update metrics.conf 2014-02-03 10:16:31 -08:00
Alexey
8d1408000e Rename symbol HFILTER_HOSTNAME_NOPTR 2014-02-03 10:13:53 -08:00
Alexey
a9c26ed598 Rename symbol in Hfilter
Rename symbol HFILTER_HOSTNAME_NOPTR to HFILTER_HOSTNAME_UNKNOWN
2014-02-03 10:09:49 -08:00
Vsevolod Stakhov
174ae21647 Increase default reject treshold. 2014-02-03 16:24:13 +00:00
Andrej Zverev
7f53014465 - Fix typo 2014-02-03 15:38:04 +04:00
Andrej Zverev
a0fd753345 Allow override system predefined settings without touching .conf files
from distribution.
2014-02-01 18:50:38 +04:00
Alexey
2330c14b92 Optimize Hfilter 2014-01-31 09:49:50 -08:00
Alexey
8a78b0de5e Tune metric for hfilter 2014-01-28 10:08:18 -08:00
Vsevolod Stakhov
48fdd5aea9 Rework HFILTER_URL_ONELINE. 2014-01-25 19:42:58 +00:00
Alexey
71d592cb60 Fix hfilter 2014-01-24 12:09:30 -08:00
Vsevolod Stakhov
744d3ff5e5 Remove HFILTER_URL_ONELINE rule.
- Added functions:
 `rspamd_textpart:get_length` - get a full length of text part
 `rspamd_url:get_length` - get a full length of an URL object

- Removed `HFILTER_URL_ONELINE` as it is broken by nature
- Reworked hfilter to improve performance
2014-01-24 16:44:47 +00:00
Vsevolod Stakhov
d667c6b4ac Use more permissive value for parts_differ. 2014-01-24 16:44:10 +00:00
Vsevolod Stakhov
199b32be13 Improve hostname processing. 2014-01-22 14:23:02 +00:00
Alexandre Perrin
2c47cda1c4 workers.conf: controller listen to localhost instead of 127.0.0.1
the rspamc controller default host is "localhost" and using by default 127.0.0.1 for rspamd controller is an issue on hosts using IPv6 as "localhost".
2014-01-17 11:07:23 +01:00
Alexey
9aadec0288 Update Hfilter
- Optimize and fixes for hostname check
- Some fixes for helo check
2014-01-06 13:27:45 -08:00
Vsevolod Stakhov
3c1866666f Several fixes to hfilter module. 2013-12-27 13:54:00 +00:00
Vsevolod Stakhov
dbf377ae0b Merge pull request #19 from AlexeySa/master
Rework checks for Message-id in Hfilter
2013-12-27 02:36:20 -08:00
Alexey
3dc20fa79e Update metric for Hfilter 2013-12-27 01:00:09 -08:00
Alexey
4b0c87faf2 Rework checks for Message-id
Del resolve host rules in Message-Id header
2013-12-27 00:57:45 -08:00
Alexey
655661ca0d Reduce metric for FORGED_SENDER
Many false positives from mail scripts and maillists.
2013-12-27 00:15:11 -08:00
Alexey
fcb7a16572 Update symbols for Hfilter 2013-12-26 13:47:11 -08:00
Alexey
5cb90bb33e Hfilter update
- add "MAIL FROM" host check. Postfix option "reject_unknown_recipient_domain" better to switch off;
- add host check from header "Message-id:";
- rework resolve functions
- Fix symbols
2013-12-26 13:45:20 -08:00
Vsevolod Stakhov
9c477a80e8 Fix escape symbols in hfilter. 2013-12-26 15:26:45 +00:00
Vsevolod Stakhov
928d072cec Remove HELO_NOT_FQDN as it exists in hfilter.
Submitted by: AL
2013-12-24 18:55:47 +00:00
Vsevolod Stakhov
08caf16449 Add hfilter - an advanced set of helo and hostname checks.
Submitted by: AL
2013-12-24 18:24:54 +00:00
Vsevolod Stakhov
4b0f1587bb Improve spamhaus RBL support.
Submitted by: AL
2013-12-24 17:07:12 +00:00
Alexey
35a4f68f3c Add rule for HELO host FQDN check 2013-12-24 06:59:05 -08:00
Alexey
3de23ef38c Add metric for HELO_NOT_FQDN 2013-12-24 06:58:03 -08:00
Vsevolod Stakhov
7bc189b9a9 Adjust weights for uribl lists. 2013-12-23 14:49:53 +00:00
Vsevolod Stakhov
26d4832651 Reduce weight of FORGED_RECIPIENTS rule. 2013-12-23 14:48:36 +00:00
Vsevolod Stakhov
c0902fb952 Fix symbol names. 2013-12-23 12:23:11 +00:00
Vsevolod Stakhov
8080d057db Reflect option in the default config. 2013-12-20 15:55:42 +00:00
Vsevolod Stakhov
5733cc904c Fix misprint in the configuration. 2013-12-18 14:34:21 +00:00
AlexeySa
bb8475620e Update modules.conf
Added Sorbs RBL
2013-12-12 13:08:16 -08:00
AlexeySa
3eff054913 Update metrics.conf
Added Sorbs RBL metrics
2013-12-12 13:03:49 -08:00
AlexeySa
3d0ff53cdb Update 2tld.inc
All SLD's zones for correct surbl works.
2013-12-12 12:36:45 -08:00
Vsevolod Stakhov
21b1eec1aa Always use one_shot mode for fuzzy_check. 2013-12-06 12:19:36 +00:00
Vsevolod Stakhov
4123f20760 Tune default settings. 2013-12-05 15:57:04 +00:00
Vsevolod Stakhov
c52921bf52 Allow to skip unknown flags in fuzzy_check module. 2013-12-05 12:03:47 +00:00
Vsevolod Stakhov
54c67e13ae Set highsecure.ru as readonly fuzzy server. 2013-12-04 16:45:35 +00:00
Vsevolod Stakhov
703fb40d6e Rework fuzzy check module.
- Now all checks are organized to rules.
- Allow to specify read_only rules to avoid problems on learning.
- Use better normalizer for fuzzy module and it now returns values
  from 0 to 1.0 (like bayes does).
- Update configuration accordingly.
- Drop legacy configuration support.
- Detect tanh as well and provide some reasonable (linear) fallback.
2013-12-04 13:41:26 +00:00
Vsevolod Stakhov
8d0e298836 Some copyright fixes. 2013-12-02 13:36:19 +00:00
Vsevolod Stakhov
c9e996fd5b Fix debian spec.
Submitted by: fatalbanana
2013-11-30 22:07:11 +00:00
Vsevolod Stakhov
7dbaf3ce09 Add missing symbols. 2013-11-30 00:35:43 +00:00
Vsevolod Stakhov
7e08afed0e Fix fuzzy check configuration. 2013-11-30 00:21:04 +00:00
Vsevolod Stakhov
31b4474a2f Fix formatting and variables usage. 2013-11-26 15:52:26 +00:00
Vsevolod Stakhov
6ddf5c01fe Add uribl.com to configuration. 2013-11-26 14:53:15 +00:00
Vsevolod Stakhov
1481a248b4 Add symbol for DBL. 2013-11-25 16:42:55 +00:00
Vsevolod Stakhov
cfbcd61e07 Misprint. 2013-11-24 22:11:34 +00:00
Vsevolod Stakhov
ac675792e2 Add basics of the new configuration. 2013-11-21 16:20:45 +00:00
Vsevolod Stakhov
3f74b21cf6 Expand path for logging. 2013-11-21 15:25:48 +00:00
Vsevolod Stakhov
a83d8b4f51 Add allow_update example usage. 2013-06-04 15:08:31 +01:00
Vsevolod Stakhov
3afb1a6d1a Use specific fuzzy database. 2013-06-03 15:55:45 +01:00
Vsevolod Stakhov
a658ca6e8b Increase default limit, as unloading logic is broken. 2013-05-28 15:33:15 +01:00
Vsevolod Stakhov
9fb28304cd Final update for 0.5.4. 2013-02-02 23:27:55 +04:00
Vsevolod Stakhov
3789849b7b * Add meta-classification example.
Many changes to advanced statistic and meta-classification logic.
Add example of complex meta-classification.
2012-10-04 22:14:10 +04:00
Vsevolod Stakhov
0a9d9f994e * Add map_watch_interval configurable.
Support floating point values for time intervals.
2012-09-19 20:42:30 +04:00
Vsevolod Stakhov
ea68f17ec2 Another debian license fix.
Add apache license for regexp that were delivered from SpamAssassin project.
Fix debian/copyright for src/dns.c.
2012-09-10 17:20:57 +04:00
Vsevolod Stakhov
dfa3d03dc0 Fix misprint in the default configuration. 2012-08-16 17:35:29 +04:00
Vsevolod Stakhov
abd0676c12 Fix thunderbird message id for the modern thunderbird versions. 2012-08-14 16:27:23 +04:00
Vsevolod Stakhov
98495cb4ce Update debian rules and changelog.
Update sample config file.
2012-06-09 16:35:00 +04:00
Vsevolod Stakhov
da6966d272 Check received for not more than 5 recipients.
Install lua configuration by default (as user's one should be in rspamd.local.lua).
2012-05-28 17:33:54 +04:00
Vsevolod Stakhov
00c7c62977 * Avoid DoS while sending a message with a lot of recipients in 'To' header.
Fix possible deadlock in lua_redis.
Version is now 0.4.8 as there are enough changes.
2012-05-28 17:26:38 +04:00
Vsevolod Stakhov
f5949d261a Add LOCALSTATES_PREFIX variable for setting where should be runtime files for rspamd.
Suggested by: Vasiliy G. Tolstov
2011-08-08 17:20:34 +04:00
Vsevolod Stakhov
6bb0dd1d22 Update a sample config file.
Set version to 0.4.1.
2011-07-26 17:59:16 +04:00
Vsevolod Stakhov
4335e5a8ce * Add classifiers pre-selection script 2011-07-19 17:51:28 +04:00
Vsevolod Stakhov
08b350777c Begin to write normal and updated default configuration.
--HG--
rename : rspamd.xml.sample => conf/rspamd-basic.xml.in
2011-07-15 18:56:47 +04:00
Vsevolod Stakhov
1bda9f428a * Add rules for message's date 2011-04-25 19:34:38 +04:00
Vsevolod Stakhov
6f122c26db Update rules.
Submitted by: Victor Ustugov
2011-02-24 20:53:20 +03:00
Vsevolod Stakhov
db668597a1 Add rules.
Submitted by: Victor Ustugov
2011-02-24 19:56:27 +03:00
Vsevolod Stakhov
5492467747 Rules update.
Submitted by: Victor Ustugov
2011-02-22 15:55:44 +03:00
Vsevolod Stakhov
a2c2074326 New rules.
Submitted by: Victor Ustugov
2011-02-21 16:38:14 +03:00
Vsevolod Stakhov
8a3eadfc9b Reduce weight of NO_SPACE_IN_FROM.
Change default pid file location.
Change MISSING_TO rule not to work when header exists but empty.
Add rules for bad bondaries and message ids.

Suggested by: Victor Ustugov.
2011-02-19 23:10:39 +03:00
Vsevolod Stakhov
e0593fbd3b * Add ability to save symbols that are inside composites with '-' flag.
Remove warnings from rspamc.
Add new rules [1]

Submitted by: Victor Ustugov [1]
2011-02-19 16:24:17 +03:00
Vsevolod Stakhov
fe1ab59efe Add composites for outlook.
Submitted by: Victor Ustugov
2011-02-19 02:40:01 +03:00
Vsevolod Stakhov
bbc68360a1 * Improve forged_recipients plugin [1]
Add loading of local rules to rspamd.lua [1]

[1] Suggested by Victor Ustugov
2011-02-16 17:00:13 +03:00
Vsevolod Stakhov
b3928c8e33 Remove some legacy from source tree. 2011-02-15 15:50:25 +03:00
Vsevolod Stakhov
8f97c6a684 Polish sample config. 2011-02-09 19:42:23 +03:00
Vsevolod Stakhov
b8211fbcc8 * Introduce new system of configuration checks:
- now symbols inside metrics definition must be inside rules as well
 - symbols may be virtual (e.g. when module can insert several symbols inside callback)
 - symbols may be pure callbacks (when symbol's name is unknown and depends on conditions)
* Module 'emails' is removed as it is not used in the current rspamd
MANY fixes to sample config files
2010-12-20 22:09:16 +03:00
Vsevolod Stakhov
2a8b8ce671 * Write symbols weights to rspamc output
* Improve logic of selecting rspamc version
* Do not try to parse broken DNS replies
* Add 'raw' flag to FROM_EXCESS_BASE64 rule (requested by citrin)
2010-07-31 18:59:40 +04:00
Vsevolod Stakhov
be555f381e * Fix lua representing of invalid ip (nil, not 255.255.255.255)
* Fix R_TO_SEEMS_AUTO rule (by citrin)
* Add multimap lua plugin
2010-07-27 19:09:41 +04:00
Vsevolod Stakhov
34ae83f015 * Add rspamd_log variable to lua plugins to access logging functions
* Each part in rspamd task now can have parent part
* Check for parts distance only for multipart/alternative subparts
* Do not check attachements even if they are text (but attached as file)
* Do not die if write (2) returned ENOSPACE while doing logging, turn on throttling mode instead (1 write try in a second)
* Add ability to turn on debug for specific symbols
* Add ability to configure dns timeouts and dns retransmits in config file
2010-07-25 16:58:11 +04:00
Vsevolod Stakhov
b6f24d4ec8 * Adopt foreach for cmake 2.6 2010-07-19 17:12:09 +04:00
Vsevolod Stakhov
3d1c40c972 * Make DNS resolver working
* Many improvements to rspamd test suite: now it CAN be used for testing rspamd functionality
* Write DNS resolver tests
* Fix issues with memory_pool mutexes and with creating of statfiles
2010-07-08 20:07:07 +04:00
Vsevolod Stakhov
9b5d1aa954 * Fix awfull bug in classifying when first statfile has twice weight than second...
* Fix undisclosed recipients detection
2010-05-14 17:12:55 +04:00
Vsevolod Stakhov
2d8eebcf7a * Bugfixes:
- handle '\' characters in lua strings correctly
  - fix lua initialization
  - avoid of using global lua state (global L)
  - fix listen sockets hash to allow multiply workers of same type but on different listen sockets
  - fix modules options inserting to allow multiply options of the same name
  - fix parsing of lua options
  - fix lua rules
2010-04-20 16:32:23 +04:00
Vsevolod Stakhov
d4b35de431 * Add lua config for most common rules
* Reset lua state while reloading
2010-04-13 19:37:29 +04:00
cebka@lenovo-laptop
21dc91eac1 * Fix another spf core dump while parsing 'include' items 2010-03-15 20:54:39 +03:00
Vsevolod Stakhov
f3b338f158 * Fix build with LUA_ENABLED = on and WITH_LUA = no (when lua is not found) 2009-09-16 15:43:47 +04:00
Vsevolod Stakhov
6b57031f55 * Add lua plugin for checking received headers
* Some tunes to lua API
* Fix bug with http maps
* Optimize installation and make custom prefix for configs
2009-09-15 18:42:05 +04:00
Vsevolod Stakhov
95e1c49982 * Feed BSD lex 2009-09-14 19:20:52 +04:00
Vsevolod Stakhov
a0f41f7c57 * New system of classifiers interface and statfiles processing
* Fix sample config
* Fix compile warnings
* Fix building without lua support
* Fix bugs with nrcpt header parsing and symbols cache loading (by Anton Nekhoroshikh)
2009-09-14 19:11:19 +04:00
Vsevolod Stakhov
8b8b79dd4f * Add implementation of counting bloom filter to rspamd 2009-08-19 20:08:16 +04:00
Vsevolod Stakhov
da847ef3d5 * Add voweling rules
* Add sample config to repository
2009-08-19 18:29:30 +04:00
Vsevolod Stakhov
6c710e4afe * Fix rule 2009-08-12 17:17:02 +04:00
Vsevolod Stakhov
ab9bba4afc * Fix error with statfiles sorting function 2009-07-23 17:16:36 +04:00
Vsevolod Stakhov
19baadf6a0 * Fix distance calculation for common recipients 2009-07-08 19:01:57 +04:00
Vsevolod Stakhov
b1709c2aef * Fix rules 2009-07-08 18:40:18 +04:00
Vsevolod Stakhov
a99a4bf8d2 * Rework structure of sample configs
* Fix rspamc
* Add english readme
2009-06-24 17:09:57 +04:00