aboutsummaryrefslogtreecommitdiffstats
Commit message (Collapse)AuthorAgeFilesLines
* [Minor] More fixes to pluginVsevolod Stakhov2019-10-171-28/+33
|
* [Minor] Another try to workaround the clang bugVsevolod Stakhov2019-10-171-6/+17
|
* [Minor] Do not use floating point when extending buffersVsevolod Stakhov2019-10-176-9/+9
|
* [Minor] Try to fix CI error due to clang bugVsevolod Stakhov2019-10-171-2/+4
|
* [Fix] Do not treat archives as textVsevolod Stakhov2019-10-171-1/+3
|
* Merge pull request #3093 from whataboutpereira/maillist-typoVsevolod Stakhov2019-10-161-1/+1
|\ | | | | List-Unsubscribe debug message typo fix.
| * List-Unsubscribe debug message typo fix.Reio Remma2019-10-161-1/+1
| |
* | Merge pull request #3094 from whataboutpereira/maillist-scoreVsevolod Stakhov2019-10-161-1/+3
|\ \ | |/ |/| [Minor] Fix maillist checks to catch Google Groups.
| * Fix maillist checks to catch Google Groups which don't have List-Subscribe ↵Reio Remma2019-10-161-1/+3
|/ | | | header.
* Merge pull request #3091 from realbugi/reputation_plugin_calc_fixVsevolod Stakhov2019-10-161-2/+2
|\ | | | | [Fix] Correct EMA time calculations
| * [Fix] Correct EMA time calculationsBuGi2019-10-161-2/+2
| |
* | [Fix] Fix size calculations when converting from utf16Vsevolod Stakhov2019-10-161-2/+4
| |
* | [Fix] Fix zip files check to relax requirementsVsevolod Stakhov2019-10-161-9/+21
|/
* [Fix] Add workaround for ragel 7 in hyperscan related maps codeVsevolod Stakhov2019-10-151-5/+26
|
* [Rework] Require CMake 3.9 to work, remove manual lto crapVsevolod Stakhov2019-10-152-25/+13
|
* [Fix] Add configurable number of threads for OpenBLASVsevolod Stakhov2019-10-147-17/+47
| | | | Issue: #3082
* [Feature] Lua_scanners: Use lua magic for inclusion/exclusion logicVsevolod Stakhov2019-10-142-9/+45
|
* Merge pull request #3084 from citrin/drone-1.xVsevolod Stakhov2019-10-142-13/+10
|\ | | | | [Minor] Update enviroment variable after Drone upgrade
| * Update enviroment variable after Drone upgradeAnton Yuzhaninov2019-10-142-13/+10
| | | | | | | | Drone 0.8 and Drone 1.x are not fully compatible.
* | [Feature] Multimap: Do not check files in office archivesVsevolod Stakhov2019-10-142-1/+19
|/
* Revert "[Fix] Fix empty prefilters that require mime structures"Vsevolod Stakhov2019-10-144-32/+9
| | | | This reverts commit c3c8d4d13302095c558e74f233269a3277de91c3.
* [Fix] Fix empty prefilters that require mime structuresVsevolod Stakhov2019-10-134-9/+32
|
* Merge pull request #3081 from klausenbusk/arc-docVsevolod Stakhov2019-10-121-1/+1
|\ | | | | [Minor] ARC signing instead of DKIM signing.
| * ARC signing instead of DKIM signing.Kristian Klausen2019-10-121-1/+1
|/ | | | | | | The original commit: 198dca66a ARC signing instead of DKIM signing. was unintended "reverted" in: 3288513eb [Config] Reasonable default settings for ARC
* [Minor] Skip double message processingVsevolod Stakhov2019-10-121-1/+9
|
* [Minor] Oops, fix another case of dtorsVsevolod Stakhov2019-10-121-1/+3
|
* [Minor] Set processed stage when called from LuaVsevolod Stakhov2019-10-121-2/+8
|
* [Fix] Fix crash due to constructors init orderVsevolod Stakhov2019-10-122-7/+8
| | | | Issue: #3079
* [Minor] Update version to 2.1Vsevolod Stakhov2019-10-111-1/+1
|
* Release 2.02.0Vsevolod Stakhov2019-10-111-0/+244
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * [Conf] Add BROKEN_HEADERS_MAILLIST composite * [Conf] Add path to greylist-whitelist-domains.inc * [Conf] Clarify documentation in the config files * [Conf] Introduce maps.d directories * [Conf] Log settings id by default * [Conf] Make LEAKED_PASSWORD_SCAM a composite rule again * [Conf] Move all surbl/emails rules to rbl * [Conf] Register new Spamhaus codes * [Conf] Remove configs for deleted modules * [Conf] Remove surbl parts, fix hash_format attribute * [Conf] Show autolearn sample * [Conf] Slashing: Change default stats backend to Redis * [Conf] Surbl: Utilise new `check_emails` option * [Conf] Update header * [Conf] Use multi-prefixes RBLs in the default config * [CritFix] Deal with case-sensivity in Content-Disposition parser * [CritFix] Eliminate old endpoint * [CritFix] Fix case sensivity when parsing Content-Type * [CritFix] Fix loading of DKIM public keys * [CritFix] Fix procesing of urls * [CritFix] Fix whitelisting when both spf and dkim are required to be valid * [CritFix] Langdet: Fix language detection where no stop words found * [Feature] Add description to the groups * [Feature] Add limit for number of URLs in Lua * [Feature] Add logging of groups to the log_format * [Feature] Add lua_smtp library * [Feature] Add maps cache and type refinement * [Feature] Add p0f scanner * [Feature] Adopt emails module to use lua_maps * [Feature] Allow options matching in composites * [Feature] Allow selectors in rbl module * [Feature] Allow to output group results * [Feature] Asn: Allow to use bgpdump when NET::MRT is broken * [Feature] Calculate tokens occurrences distribution * [Feature] Clickhouse: Add authenticated user and settings id columns * [Feature] Clickhouse: Store groups data * [Feature] Clickhouse: Utilise LowCardinality feature * [Feature] Implement Redis prefixes registration logic * [Feature] Implement settings id propagation between deps * [Feature] Improve AV results caching * [Feature] Improve autolearning * [Feature] Improve logging locking logic (remove it actually) * [Feature] Improve settings processing * [Feature] Langdet: Limit number of stop words to be checked * [Feature] Libucl: Allow to sort keys in ucl objects * [Feature] Lua_config: Extend get symbols method * [Feature] Lua_maps: Allow static maps for key-value pairs * [Feature] Lua_mimepart: Add function filter_words * [Feature] Lua_selectors: Add `words` selector * [Feature] Lua_selectors: Add sort and uniq transform functions * [Feature] Lua_selectors: Allow table arguments for selectors * [Feature] Lua_tcp: Add preliminary support of SSL connections * [Feature] Lua_trie: More flexible API * [Feature] Lua_util: Add filter_specific_url function * [Feature] Lua_util: table_digest can now recursively traverse tables * [Feature] Maillist: Improve detection * [Feature] Maps: Allow caching for complex maps * [Feature] Monitored: Support random lookups * [Feature] Multimap: Add combined maps prototype * [Feature] Multimap: Add dependend maps via redis keys selectors * [Feature] Multimap: Allow multiple email addresses matches * [Feature] Multimap: Also check detected charset when do filename checks * [Feature] Output number of messages processed to proctitle * [Feature] Perform clean SSL shutdown * [Feature] Performance: Do not use base64 SIMD version for bad inputs * [Feature] RBL: Support bit results in replies * [Feature] RBL: Support type specific prefixes * [Feature] Ratelimit: Consider number of SMTP recipients * [Feature] Rbl: Add ability to check urls * [Feature] Rbl: Add resolve_ip based RBLs * [Feature] Rbl: Make config checks much more strict * [Feature] Rbl: Support per-rule whitelists * [Feature] Rbl: Support process script * [Feature] Rbl: Support replyto addresses * [Feature] SURBL: Allow to check email domains * [Feature] Selectors: Add `list` generator * [Feature] Selectors: Add `specific_urls` extractor * [Feature] Selectors: Add flatten function * [Feature] Selectors: Support filter_map and apply_map functions * [Feature] Store Clickhouse data outside of lua alloc * [Feature] Support caching for encrypted files and macros * [Feature] Support images when extracting urls * [Feature] Support more hyperscan flags * [Feature] Support protocol flags * [Feature] URL: Apply stringprep to hostnames to filter garbage * [Feature] Upstreams: Add lazy resolving logic to all upstreams * [Feature] Upstreams: Set noresolve flag on numeric upstreams * [Feature] Use `scores` in apply section * [Feature] Use maps logic from lua_maps for multimap * [Feature] Use random monitored in rbl module * [Feature] lua_scanners - add Razor support * [Fix] Add another safe-guard in urls processing * [Fix] Add debug to ssl, fixed write hangs * [Fix] Add missing groups to C callback symbols * [Fix] Add more checks for ghosts symbols * [Fix] Allow to enable or add new actions via settings * [Fix] Allow to set 0 size for spf/dkim caches * [Fix] Another bunch of fixes towards protocol mess * [Fix] Another fix to deal with bad URLs * [Fix] Arc: Another bunch of fixes for arc signing * [Fix] Arc: More arc signing fixes * [Fix] Avoid another overflow in fpconv * [Fix] Clickhouse: Fix quoting * [Fix] Clickhouse: Fix retention query quoting * [Fix] Distinguish empty and non-empty prefilters * [Fix] Distinguish remote and local addrs parsing * [Fix] Do not assert if length of sig is bad, just fail verification * [Fix] Do not assert if we have broken mime boundary in the headers * [Fix] Do not call implicit strlen to avoid issues * [Fix] Do not count images urls when checking url regexps for compatibility * [Fix] Do not output rbl suffix in symbol option * [Fix] Do not use config pool to avoid issues with double reload * [Fix] Do not use ephemeral string * [Fix] Do not use lightuserdata for traceback * [Fix] Do not use priority in metric registration * [Fix] Emails: Check email sanity before testing on BL * [Fix] Emails: Fix misprint in key name * [Fix] Escape utf in regexp to dodge ragel/hyperscan issue * [Fix] Extend task_timeout to postfilters stage * [Fix] Fix ARC signing after fixing another bug in it... * [Fix] Fix AV scan logic * [Fix] Fix DMARC_NA behaviour in case of no valid policies * [Fix] Fix LRU hash iteration logic * [Fix] Fix alignment mess * [Fix] Fix configuring symbols without scores * [Fix] Fix disabling of the actions * [Fix] Fix dkim signing exceptions * [Fix] Fix embedded images linking logic * [Fix] Fix events leak * [Fix] Fix eviction corner case * [Fix] Fix fuzzy image score calculation #2962 * [Fix] Fix hang in fuzzy_learn when explicit rotation is set * [Fix] Fix headers propagation logic * [Fix] Fix hearbeats restart issue * [Fix] Fix history reset * [Fix] Fix log parameter * [Fix] Fix lua_ip_equal logic * [Fix] Fix more issues with nested messages + tests * [Fix] Fix normalization of non-alphabet based languages * [Fix] Fix offsets when parsing message/rfc822 in multipart * [Fix] Fix options in rbl symbols * [Fix] Fix out of bound access in lua logger * [Fix] Fix out-of-bound read in qp decode * [Fix] Fix parent CTE propagation * [Fix] Fix parsing of the received headers with empty part * [Fix] Fix pending checks for events * [Fix] Fix printing of NULL pointer with fixed length * [Fix] Fix race condition in watcher handler * [Fix] Fix read-after-end in quoted printable decoding * [Fix] Fix redis sentinel support * [Fix] Fix registry leak in case of DNS errors * [Fix] Fix reload logic * [Fix] Fix sending of large entries via HTTPS * [Fix] Fix settings reload * [Fix] Fix some more corner cases for fpconv * [Fix] Fix trie code when there are regexps and Hyperscan is absent * [Fix] Further fixes to printing of the FP numbers * [Fix] Fuzzy_check: Fix timeouts * [Fix] Grrr, fix empty ip case * [Fix] Html: Fix processing of fjlig entity * [Fix] Lang_det: Try better to distinguish Chinese and Japanese * [Fix] Lua_mime: Fix reversed extensions map * [Fix] Lua_task: Fix message-less API * [Fix] Lua_tcp: Report connection failures * [Fix] Lua_tcp: Various fixes and debugging improvements * [Fix] Metadata_exporter: This plugin is idempotent not a postfilter * [Fix] More fixes to extract_specific_urls * [Fix] More stages fixes * [Fix] Neural: Another bunch of fixes * [Fix] Neural: use version in ANN key profile * [Fix] Postpone lua state destruction to allow lua dtors to be used * [Fix] Prefer surbl/emails rule on rbl to preserve compatibility * [Fix] RBL: Fix behaviour of emails_domainonly * [Fix] Ratelimit: Fix dynamic score * [Fix] Rbl: Fix emailbl functions * [Fix] Really fix hyperscan workaround * [Fix] Set sanity limits for pcre2 * [Fix] Settings: Fix settings check flags * [Fix] Sort keys when getting data from Lua when filling rules * [Fix] Statistics: Do not query Redis tokens when there are no learns * [Fix] Stop IO event on write finished in http connection * [Fix] Use heuristically detected text parts data * [Fix] Various fixes to QP encoding algorithm * [Fix] Various fixes to SSL state machine handler * [Fix] Various fixes to asn module * [Fix] Workaround for empty charset in rfc2231 encoding * [Project] Switch from torch to KANN * [Project] Add heartbeat events * [Project] Add preliminary support of the Kaspersky Scan Engine * [Project] Add preliminary version of maps expressions * [Project] Add preprocessed settings to the config structure * [Project] Add simple forward propagation function * [Project] Add small helpers for migration simplifications * [Project] Allow to replace body in milter * [Project] Bundle libev * [Project] First refactoring step libevent->libev * [Project] Implement syntax highlighting for Lua * [Project] Lua_magic: Adopt lua_magic stuff in mime_types * [Project] Remove libfann, gd and other unsupported stuff * [Project] Remove torch * [Project] Rework upstreams * [Rework] Allow execution of async events when hs compiles regexps * [Rework] Bayes expiry: eliminate `default` expiration mode * [Rework] Dkim: Remove signing code * [Rework] Dkim_signing: Move sign condition to dkim_signing * [Rework] Do not lowercase all data send to ClickHouse * [Rework] Drop url tags * [Rework] Eliminate lua_squeeze as it has shown no improvements * [Rework] Eliminate virtual scan time as it is useless * [Rework] Lua core: Use lightuserdata to index classes * [Rework] Lua_util: Another rework for extract_specific_urls * [Rework] Migrate from ip_score to reputation * [Rework] Move mime modification functions to lua_mime library * [Rework] Rbl: Major whitelisting logic rework * [Rework] Remove deprecated plugins * [Rework] Remove log helper worker * [Rework] Remove rspamd.classifiers.lua * [Rework] Rename filter.h to a more sane name * [Rework] Reorganise selectors implementation * [Rework] Replace linenoise with replxx * [Rework] Reputation: Remove ipnet from the ip reputation * [Rework] Reputation: Slashing - change name of symbols * [Rework] Rework children operations * [Rework] Rework config reload * [Rework] Rework expression API * [Rework] Rework image urls processing * [Rework] Rework initialisation to reduce static leaks count * [Rework] Rework request headers processing * [Rework] Slashing: Change versioning schema - move to 2.0 * [Rework] Slashing: Turn off postfilters when passthrough result is set * [Rework] Start moving to replxx * [Rework] Stop support of signed HTTP maps to simplify code * [Rework] Store ASN as UInt32 in ClickHouse * [Rework] Url_redirector: Rewrite plugin * [Rework] Use a dedicated library for autolearn * [Rework] Use libsodium instead of hand crafted crypto implementations * [Rework] Use opaque structure to store a table of mime headers * [Rules] Add dedicated bitcoin addresses filter rule * [Rules] Add more detection to LEAKED_PASSWORD_SCAM * [Rules] Catch LTC addresses * [Rules] Reduce weight of RSPAMD_EMAILBL * [Rules] Rework LEAKED_PASSWORD_SCAM rule one more time Signed-off-by: Vsevolod Stakhov <vsevolod@highsecure.ru>
* [Minor] Update ev_now after logging is doneVsevolod Stakhov2019-10-111-3/+3
|
* [Minor] Add some default optionsVsevolod Stakhov2019-10-112-1/+6
|
* [Minor] Avoid double replyVsevolod Stakhov2019-10-111-1/+3
|
* [Minor] Add missing docVsevolod Stakhov2019-10-111-1/+4
|
* [Minor] Remove deleted codeVsevolod Stakhov2019-10-111-4/+0
|
* [Feature] Add limit for number of URLs in LuaVsevolod Stakhov2019-10-116-8/+62
|
* [Minor] Add default limit for rbl requestsVsevolod Stakhov2019-10-112-0/+28
|
* [Fix] Grrr, fix empty ip caseVsevolod Stakhov2019-10-111-2/+2
|
* [Fix] Fix LRU hash iteration logicVsevolod Stakhov2019-10-111-1/+1
|
* [Fix] Fix parent CTE propagationVsevolod Stakhov2019-10-111-0/+7
|
* [Minor] Fix some corner cases in HTML parsingVsevolod Stakhov2019-10-111-2/+5
|
* [Rules] Catch LTC addressesVsevolod Stakhov2019-10-111-2/+11
|
* [Minor] Distinguish absent IP address in a more sane wayVsevolod Stakhov2019-10-114-5/+15
|
* [Conf] Clarify documentation in the config filesVsevolod Stakhov2019-10-1114-93/+185
|
* [Conf] Register new Spamhaus codesVsevolod Stakhov2019-10-113-0/+35
| | | | | Issue: #3074 Closes: #3074
* [Minor] External_services: Fix fail symbol registrationVsevolod Stakhov2019-10-111-15/+11
|
* [Minor] Fix modules loading logicVsevolod Stakhov2019-10-101-12/+23
|
* [Minor] Fix compile warningsVsevolod Stakhov2019-10-1022-77/+47
|
* [Minor] Add safe-guardsVsevolod Stakhov2019-10-101-14/+19
|
* [Minor] Lua_scanners: Fix some misprintsVsevolod Stakhov2019-10-102-2/+0
|