Commit Graph

173 Commits

Author SHA1 Message Date
Vsevolod Stakhov
7bf934ec68 [Rework] Finally remove gmime dependency from Rspamd 2016-12-22 23:58:51 +00:00
Vsevolod Stakhov
7ba8cf9d19 [Rework|Minor] Fix utils 2016-12-16 17:59:15 +00:00
Vsevolod Stakhov
07a9ccc127 [Feature] Add gmime parser to mime_tool 2016-12-15 16:08:18 +00:00
Vsevolod Stakhov
dab2e6f4be [Minor] Add some timing for mime parsing tool 2016-12-15 15:14:33 +00:00
Vsevolod Stakhov
d7f3f254ff [Minor] Fix display for message parts 2016-12-14 14:11:27 +00:00
Vsevolod Stakhov
747f2839b0 [Feature] Add mime tool to explore messages 2016-12-14 13:42:48 +00:00
Vsevolod Stakhov
58e9918083 [Minor] Add utility to benchmark base64 2016-12-13 17:39:38 +00:00
Vsevolod Stakhov
4aa1048ffd [Rollback] Remove ssse3 and avx2 versions: no real profit 2016-12-13 17:30:59 +00:00
Vsevolod Stakhov
43b88f6f44 [Feature] Add boundaries parsing in content type 2016-12-12 16:36:32 +00:00
Vsevolod Stakhov
1bf7a98c8f [Minor] Improve tests for content type 2016-12-12 15:43:35 +00:00
Vsevolod Stakhov
0a4f8e4121 [Feature] Add a simple benchmark for content type parsing 2016-12-12 15:43:35 +00:00
Alexander Moisseev
069c958e71 [Minor] rspamd_stats: add time selectors
The parser should exit from the `while` loop when `--end`is reached instead of skipping lines, but I have no idea how to close the file handle properly in that case.
2016-12-09 12:59:07 +03:00
Alexander Moisseev
d4cc6100ae [Minor] rspamd_stats: fix parsing of the last symbol in log entry 2016-12-08 19:20:33 +03:00
Alexander Moisseev
5d7b51b19d [Minor] rspamd_stats: add actions percentage to summary 2016-12-08 17:59:37 +03:00
Alexander Moisseev
44b94e247d [Minor] rspamd_stats: add actions totals 2016-12-07 19:44:12 +03:00
Alexander Moisseev
e53908532a [Minor] rspamd_stats: fix parsing of lines with NaN score 2016-12-07 19:40:53 +03:00
Alexander Moisseev
bbd555dd9c [Minor] rspamd_stats: fix parsing when options are logged
There are symbols with _comma_ separated options like `DMARC_POLICY_SOFTFAIL(0.10){yandex.ru : SPF not aligned (relaxed), DKIM not aligned (relaxed);}`
2016-12-07 18:32:07 +03:00
Vsevolod Stakhov
8eacee21da [Fix] Relax requirements for Received as gmail cannot RFC 2016-11-25 15:27:22 +00:00
Alexander Moisseev
9d187be27d [Minor] rspamd_stats: add basic summary 2016-11-14 17:28:34 +03:00
Vsevolod Stakhov
d7bf70c610 [Fix] Fix issues with CGP helper 2016-10-12 19:38:21 +01:00
Vsevolod Stakhov
196fc45d6b [Minor] Reformat cgp helper 2016-10-11 16:26:14 +01:00
Vsevolod Stakhov
54717ec247 [Feature] Add max-size and timeout options to CGP helper 2016-10-11 16:26:14 +01:00
Vsevolod Stakhov
80688502dd [Minor] Small fixes about fn/fp ambiguity 2016-10-11 14:30:49 +01:00
Vsevolod Stakhov
77fd2c94d9 [Feature] Allow to compare other systems with Rspamd 2016-10-11 13:22:40 +01:00
Vsevolod Stakhov
aeeefccd43 [Minor] Unify learn/classify functions 2016-10-11 10:41:33 +01:00
Vsevolod Stakhov
26f0b37daa [Feature] Add utility to perform classifier tests 2016-10-10 20:38:01 +01:00
Vsevolod Stakhov
aeec766ec9 [Fix] Multiple fixes to asn script, add IPv6 support 2016-10-03 16:07:07 +01:00
Vsevolod Stakhov
32a4e9d755 [Minor] Fix download 2016-10-03 14:40:05 +01:00
Vsevolod Stakhov
09b039623c [Feature] Add ASN -> rbldnsd script for asn.rspamd.com 2016-10-03 13:57:58 +01:00
Vsevolod Stakhov
987e1afced [Minor] Use more portable archivers 2016-08-11 09:48:48 +01:00
Alexander Moisseev
7d3b279aa3 [Feature] rspamd_stats: support log directory reading
rspamd_stats will read (and decompress) multiple log files in the specified directory.
2016-08-11 10:11:10 +03:00
Alexander Moisseev
68fc43a8f0 [Minor] rspamd_stats: fix typo
Reported by: @dehnli via IRC
2016-08-11 09:39:13 +03:00
Alexander Moisseev
e50e7ed487 [Minor] rspamd_stats: place parser code in a subroutine 2016-08-11 09:31:25 +03:00
Vsevolod Stakhov
a1e147e37c [Feature] Add --search-pattern option to rspamd_stats 2016-08-09 10:29:56 +01:00
Vsevolod Stakhov
5e0eeba029 [Minor] Remove unnecessary dependency 2016-08-05 17:27:17 +01:00
Vsevolod Stakhov
feef962567 [Feature] Add correlations report in fuzzy stats 2016-08-04 15:39:16 +01:00
Vsevolod Stakhov
af7255bac4 [Fix] Parse CGP envelope data 2016-08-04 10:42:33 +01:00
Vsevolod Stakhov
9fd26f1ff7 [Fix] Fix buffering in CGP integration 2016-08-03 18:10:57 +01:00
Alexander Moisseev
bfa74659e9 [Fix] rspamd_stats: remove deprecated defined(@array) 2016-08-02 17:13:33 +03:00
Vsevolod Stakhov
ddca96c2b8 [Feature] Add experimental CGP integration 2016-08-02 14:14:25 +01:00
Alexander Moisseev
8caf7d493f [Minor] rspamd_stats: check all symbols by default 2016-07-31 21:05:51 +03:00
Alexander Moisseev
8b0f49de2e Attempt to make rspamd_stats output readable 2016-07-26 10:58:49 +03:00
Vsevolod Stakhov
9e7c70034a [Fix] Fix stats script 2016-07-15 16:29:30 +01:00
Vsevolod Stakhov
00c670b849 [Fix] Fix scores detection 2016-07-08 17:42:40 +01:00
Vsevolod Stakhov
5b7e8f3bb6 [Doc] Add help and man for rspamd_stats utility 2016-07-08 17:05:34 +01:00
Vsevolod Stakhov
270a4930f1 [Feature] Allow to read logs without symbols scores 2016-07-08 17:05:19 +01:00
Vsevolod Stakhov
616595e13e [Feature] Improve statistics script 2016-07-08 15:36:15 +01:00
Vsevolod Stakhov
03ff229b47 [Feature] Further relax parser 2016-06-15 17:08:43 +01:00
Vsevolod Stakhov
e386655418 [Fix] Fix parser 2016-06-15 09:26:38 +01:00
Vsevolod Stakhov
b4b74e7d05 [Minor] Add some more stats 2016-06-14 23:09:24 +01:00
Vsevolod Stakhov
eb1eaf0f10 [Minor] Fix memory allocation 2016-06-14 23:05:07 +01:00
Vsevolod Stakhov
1c356c51a9 [Minor] Add a simple received parser benchmark routine 2016-06-14 22:40:31 +01:00
Vsevolod Stakhov
bc6a03a108 [Feature] Implement SSL support in http client 2016-06-13 17:31:29 +01:00
Vsevolod Stakhov
5bbd698d96 [Rework] Finish rework for the rest of places that use HTTP 2016-06-10 16:38:29 +01:00
Vsevolod Stakhov
0988e1b1b1 [Feature] Add protection against open files limit and accepting sockets 2016-06-09 16:35:31 +01:00
Vsevolod Stakhov
1cf6562bcc [Feature] Add a simple script to evaluate rspamd rules in the logs 2016-05-11 14:23:36 +01:00
Vsevolod Stakhov
cddd684078 [Feature] Add support for regexp maps 2016-03-15 17:40:39 +00:00
Vsevolod Stakhov
4394fa14de Fix some more issues found by coverity 2016-02-22 23:39:49 +00:00
Vsevolod Stakhov
81e728813b Fix benchmarks 2016-02-06 13:22:42 +00:00
Vsevolod Stakhov
0ca1ac02f4 Temporary disable benchmarks 2016-02-06 01:58:12 +00:00
Vsevolod Stakhov
8766fba694 Switch the rest to apache 2 2016-02-04 09:37:21 +00:00
Vsevolod Stakhov
a0902bd2ac Add a simple script to learn fann from rspamd logs 2015-12-22 00:17:59 +00:00
Vsevolod Stakhov
84a964398c Fix csv issues. 2015-10-21 14:16:58 +01:00
Vsevolod Stakhov
0f01129985 Add CSV output for http-bench 2015-10-21 13:55:43 +01:00
Vsevolod Stakhov
8c8f20b0e6 Allow static key for a server 2015-10-21 13:42:41 +01:00
Vsevolod Stakhov
c784381ff5 Fix multiple sigchld processing 2015-10-20 23:31:28 +01:00
Vsevolod Stakhov
1027e57ab8 Rework test framework to use timeout instead of tests number 2015-10-20 19:10:19 +01:00
Vsevolod Stakhov
ef10b62427 Allow writing latencies to a separate file 2015-10-20 17:32:02 +01:00
Vsevolod Stakhov
7ffc61d7ef Fix variable in command line options 2015-10-20 16:55:10 +01:00
Vsevolod Stakhov
b146b1cc7c Rework benchmark to processes from threads 2015-10-20 16:30:14 +01:00
Vsevolod Stakhov
e4336fe612 Implement batch accept in server. 2015-10-20 15:24:51 +01:00
Vsevolod Stakhov
afc786bb1c Implement benchmark. 2015-10-20 15:04:53 +01:00
Vsevolod Stakhov
13678bed5f Fix benchmarking server 2015-10-20 11:47:41 +01:00
Vsevolod Stakhov
c0864168aa Add a simple http server for benchmarks 2015-10-20 10:10:35 +01:00
Vsevolod Stakhov
5efd0c7fe5 Sort dependencies. 2015-06-16 19:13:53 +01:00
Vsevolod Stakhov
5ad7492c72 Store partial results in memcached. 2015-06-16 19:09:36 +01:00
Vsevolod Stakhov
72cd49153a Fix loops in POE. 2015-06-16 19:09:27 +01:00
Vsevolod Stakhov
b5f194d795 Reformat redirector code (no functional changes). 2015-06-16 18:24:20 +01:00
Vsevolod Stakhov
90d1e9ebe5 Fix numerous issues with redirector startup. 2015-06-16 18:20:30 +01:00
Vsevolod Stakhov
52c2a6746e Fix shebang. 2015-06-16 16:31:39 +01:00
Vsevolod Stakhov
7a62e828f7 Update->add 2015-06-16 16:18:31 +01:00
Vsevolod Stakhov
fcfe6de1da Fix digest invocation. 2015-06-16 16:18:31 +01:00
Vsevolod Stakhov
f2334aeb87 Fix variable name. 2015-06-16 16:18:31 +01:00
Vsevolod Stakhov
d8e4c70241 Fix issues with redirector HTTP response. 2015-06-16 16:18:31 +01:00
Vsevolod Stakhov
ea6b0baf7a Do not store redirects to the same url. 2015-04-21 16:48:32 +01:00
Vsevolod Stakhov
ee49822dc4 Cleanup. 2014-01-29 17:35:18 +00:00
Vsevolod Stakhov
cfd88fa9ea Remove dependency on deprecated Digest::SHA256. 2011-12-06 18:39:58 +03:00
Vsevolod Stakhov
e284ad4bdf Fix statshow utility. 2011-06-27 20:26:21 +04:00
Vsevolod Stakhov
92de380c2c * Skip short utf words in statistics 2011-06-03 20:23:13 +04:00
Vsevolod Stakhov
f7595acb30 Fix dependencies in cmake. 2011-05-11 19:11:05 +04:00
Vsevolod Stakhov
1fd435e5d4 * Rework build process:
- add librspamdserver
 - link this library to all daemons and utils of rspamd
 - use subdirectories more often
* Rework global variables logic - move them to the main process
* Fix logging to handle utf-8 correctly
* Add statshow utility and make it working
* Move printf functions to separate source file
2011-05-10 19:15:03 +04:00
Vsevolod Stakhov
683b90f4c6 * Major cleanup of cmake build system
* Add initial version of statshow utility for statfiles debugging
* Add debugging for statistics
* Remove unused utilities
2011-05-06 19:18:40 +04:00
Vsevolod Stakhov
dbc8bb8dbc Implement checking options for modules
Implement checking for classifier options
Fix redirector to handle timeouts and invalid replies properly
Fix surbl module not to check each url
2010-12-13 20:54:22 +03:00
Vsevolod Stakhov
8d0053734f * Use syslog for logging
* Reworking logging logic
* Fixes some tabulation
2010-10-06 17:26:35 +04:00
Vsevolod Stakhov
dc42a41c5e * Improve definitions of redirector domains
* Add support of regexp to check only specific urls for each domains
* Check redirector in trie and not extract specific domains parts
* Add POE errors handling for redirector
2010-10-01 21:13:32 +04:00
Vsevolod Stakhov
a62ddb9677 * Call has_forked method to inform POE about fork 2010-07-13 16:14:47 +04:00
Vsevolod Stakhov
44c8c04604 * Some improvements to redirector 2010-07-13 15:38:15 +04:00
Vsevolod Stakhov
e413f4ee9c * Introduce new logging system:
- independent and customizeable buffering
  - line buffering
  - errors handling support
  - custom (ip based) debug
  - append function name automaticaly (based on __FUNCTION__)
  - add some logic to logs system
2009-12-22 01:32:18 +03:00
Vsevolod Stakhov
a0f41f7c57 * New system of classifiers interface and statfiles processing
* Fix sample config
* Fix compile warnings
* Fix building without lua support
* Fix bugs with nrcpt header parsing and symbols cache loading (by Anton Nekhoroshikh)
2009-09-14 19:11:19 +04:00
Vsevolod Stakhov
188018fe88 * One more fix to default redirector's settings 2009-07-28 15:38:34 +04:00