aboutsummaryrefslogtreecommitdiffstats
Commit message (Collapse)AuthorAgeFilesLines
* [Minor] Fix exit codes usage to POSIX portable EXIT_FAILUREVsevolod Stakhov2021-08-2917-111/+111
|
* [Minor] Further priorities adjustmentVsevolod Stakhov2021-08-281-3/+3
|
* [Minor] Fix expressions prioritiesVsevolod Stakhov2021-08-271-5/+11
|
* [Minor] Mime_types: Allow application/octet-stream for all extensionsVsevolod Stakhov2021-08-271-2/+2
|
* [Minor] Lua_compression: Add support of the compression level for gzipVsevolod Stakhov2021-08-262-3/+12
|
* Merge pull request #3866 from HeinleinSupport/lua_scanners/commonVsevolod Stakhov2021-08-261-7/+10
|\ | | | | [Fix] lua_scanners - message_min_words logic
| * [Fix] lua_scanners - message_min_words logicCarsten Rosenberg2021-08-251-7/+10
|/
* [Minor] Store multiple base tags (but use only first one as usually)Vsevolod Stakhov2021-08-251-7/+11
|
* [Minor] Fix small href values with a base urls presentedVsevolod Stakhov2021-08-251-2/+2
|
* [Minor] Fix match_limit in pcre2 codeVsevolod Stakhov2021-08-251-0/+4
|
* [Fix] Add concept of uncancellable events to prevent use-after-freeVsevolod Stakhov2021-08-251-5/+15
|
* Merge pull request #3863 from CrawX/aarch64-luajit-fixesVsevolod Stakhov2021-08-253-144/+0
|\ | | | | [Fix] Remove aarch64 GC64 workaround
| * [Fix] Remove aarch64 GC64 workaroundCruX2021-08-243-144/+0
|/ | | | luajit contains full support for lightuserdata on aarch64 in newest 2.1 versions
* [Minor] Save 8 bytes in rspamd_regexp_tVsevolod Stakhov2021-08-242-39/+0
|
* [Minor] Fix buildVsevolod Stakhov2021-08-242-2/+8
|
* [Minor] Fix match limit feature in regexpsVsevolod Stakhov2021-08-244-20/+37
|
* [Minor] Rework replxx to make in compatible with Rspamd againVsevolod Stakhov2021-08-245-103/+211
|
* [Minor] Update replxx libraryVsevolod Stakhov2021-08-2419-640/+1692
|
* [Minor] Configwizard: Fix usage when the config is wrongVsevolod Stakhov2021-08-242-8/+14
|
* [Minor] Lua_magic: Add another spammy JS patternVsevolod Stakhov2021-08-241-0/+1
|
* [Minor] Pet luacheckVsevolod Stakhov2021-08-241-2/+0
|
* [Minor] Detect logger's debug level in lua debug utilitiesVsevolod Stakhov2021-08-243-13/+32
|
* [Minor] Allow to get logger levelVsevolod Stakhov2021-08-242-2/+13
|
* [Fix] Spf: Do not parse non TXT DNS replies as TXT repliesVsevolod Stakhov2021-08-231-14/+22
|
* [Minor] Rdns: One more sanity check addedVsevolod Stakhov2021-08-231-1/+11
|
* Merge pull request #3854 from sebastianlipponer/masterVsevolod Stakhov2021-08-231-1/+3
|\ | | | | Regexp: Extend UNITEDINTERNET_SPAM upstream spam filter regexp
| * [Minor] Regexp: Extend upstream spam filter regexpSebastian Lipponer2021-08-211-1/+3
| |
* | [Fix] Another rework of the ucl hashingVsevolod Stakhov2021-08-231-19/+38
| |
* | [Fix] Libucl: Fix deletion from ucl objectsVsevolod Stakhov2021-08-231-61/+35
| |
* | Merge pull request #3855 from arkamar/libfmtVsevolod Stakhov2021-08-211-2/+7
|\ \ | |/ |/| Add SYSTEM_FMT cmake option
| * Add SYSTEM_FMT cmake optionPetr Vaněk2021-08-211-2/+7
|/ | | | | This gives packagers option to use system version of fmt rather than bundled one. It is disabled by default.
* [Minor] Update version to 3.1Vsevolod Stakhov2021-08-201-1/+1
|
* Merge pull request #3852 from tomop-tg/lua54Vsevolod Stakhov2021-08-206-4/+16
|\ | | | | fix compatibility with lua-5.4
| * fix compatibility with lua-5.4Tomohiro "Tomo-p" KATO2021-08-206-4/+16
|/
* Release 3.03.0Vsevolod Stakhov2021-08-191-0/+273
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | * [Conf] Align ARC scores with DKIM scores * [CritFix] Neural: Fix sorting application * [Feature] Add a simple dumper for bayes tokens * [Feature] Add lua_maps.fill_config_maps function * [Feature] Add preliminary exporter to AWS S3 * [Feature] Add preliminary restore bayes support * [Feature] Add race condition protection against hs_helper restarts * [Feature] Add rspamd_utf8_strcmp utility * [Feature] Add zstd streaming API * [Feature] Allow to log severity level explicitly * [Feature] Allow to save and show attachment name when inserting AV scan results * [Feature] Allow to sort urls for Lua * [Feature] Allow to specify different timeouts/retransmits for fuzzy rules * [Feature] Aws_s3: Allow to compress data stored * [Feature] CMakeLists.txt: Change check and run-test to use rspamd-test-cxx * fixes #3807 * [Feature] Dmarc_report: allow sending reports in batches * [Feature] Fuzzy_check: Allow to disable subject when making short text hash * [Feature] Lua_cryptobox: Add keyed ssl hash functions via HMAC * [Feature] Lua_task: Add get_urls_filtered method * [Feature] Make monitored checks less frequent * [Feature] Milter_headers: Add x-rspamd-pre-result header * [Feature] Neural: Allow to balance FP/FN for the network * [Feature] Ppopagate monitored errors from rbl module * [Feature] Pyzor calculate score dynamically Count - WL-Count of default_score in percent * [Feature] Rbl: Distinguish flattened and non-flattened selectors in RBL requests * [Feature] Re-add pyzor support * [Feature] Settings: add ip_map check and rework structure slightly * [Feature] Spamassassin: Allow to set the default priority for SA scores * [Feature] Strip smtp comments from message id * [Feature] add SYSTEM_ZSTD cmake option To use the system zstd instead on the bundled version * [Feature] external_relay plugin * [Feature] rspamadm clickhouse neural_train subcommand * [Fix] #3400 milter_headers: fix inverted logic for extended_headers_rcpt * [Fix] ASN: fix _FAIL symbol for when main symbol is disabled * [Fix] Add a special logic for text part with no text extraction * [Fix] Add diacritics flag for several eu languages * [Fix] Another FSM fix to accomodate possibility of multiple consequent ? * [Fix] Avoid curse of dynamic array referencing * [Fix] Avoid reinitialising neural settings * [Fix] Check remain before processing TXT records * [Fix] Enable error multiplier on http errors * [Fix] Finally rework parsing entities logic * [Fix] Fix '==' parsing in the content type attributes parser * [Fix] Fix IPv6 expansion for SPF macros * [Fix] Fix Mozilla Message-ID detection * [Fix] Fix an edge case in BITCOIN_ADDR rule * [Fix] Fix brain-damaged behaviour when http request has a custom Host header * [Fix] Fix check of limits in email address parsing * [Fix] Fix copy&paste error and rework * [Fix] Fix expressions logic for and/or and float values * [Fix] Fix fuzzy retransmits * [Fix] Fix http maps with no or invalid expires data * [Fix] Fix last quote character parsing in the content-type state machine * [Fix] Fix normalisation flags propagation * [Fix] Fix overflow when appending many broken tags * [Fix] Fix parsing of rfc2047 tokens with '?' inside * [Fix] Fix phishing flag set * [Fix] Fix rfc2047 embedded into rfc2231 pieces in special headers * [Fix] Fix round-robin rotation * [Fix] Fix searching for symbols * [Fix] Fix storing of the regexps inside variant * [Fix] Fix tokenization near exceptions * [Fix] Fix visibility calculations * [Fix] Html: Attach inline tags to the structure * [Fix] Html: Do not treat empty tags as block tags * [Fix] Ical: Do not extract urls from all flags using merely specific ones * [Fix] Initialise symcache even if it cannot be loaded properly * [Fix] Lua_fuzzy: Remove text parts check when checking image dimensions * [Fix] Lua_maps: Fix adjustments for the map type in the complex map definitions * [Fix] Lua_task: Fix deleted symbols in has_symbol/get_symbol * [Fix] Move metric and symcache link from validation to the init stage * [Fix] Oletools: Another try to fix table sorting * [Fix] One more default behaviour fix * [Fix] Phishing: Rework urls processing * [Fix] RBL: was missing some config schema * [Fix] Replies: Fix 'Reply-To' handling in task:get_reply_sender * [Fix] Rework metrics handling * [Fix] Save symcache on exit * [Fix] Selectors: Filter nil elements in lists * [Fix] Selectors: Properly fix implicit tostring for nils * [Fix] Try to fix some broken code in DMARC reporting plugin * [Fix] Urls: Fix processing of html urls when it comes to the flags * [Fix] Use proper buffer length * [Fix] Various visibility fixes * [Fix]: ASN: dns cb func should also return in case of an error * [Project] Add a simple css rule definition * [Project] Add css style skeleton * [Project] Add css syntax (adopted from ebnf) * [Project] Add css_selectors * [Project] Add doctest unit testing library * [Project] Add expected library * [Project] Add fmt library for simple string ops * [Project] Add fu2 library to better functions abstractions * [Project] Add hashing method * [Project] Add parsers skeleton * [Project] Add preliminary support of vcard parser * [Project] Add process exceptions for invisible text * [Project] Add some methods for css parser * [Project] Allow static libstdc++ * [Project] Another whitespace hack * [Project] CSS: Various fixes in the declarations and values parsing * [Project] Cpp: Add robin-hood hash map library * [Project] Css: Add AST debug * [Project] Css: Add colors conversion functions * [Project] Css: Add dimensions handling * [Project] Css: Add display value support * [Project] Css: Add frozen library from https://github.com/serge-sans-paille/frozen/ * [Project] Css: Add opacity support * [Project] Css: Add parser helpers to simplify debugging * [Project] Css: Add preliminary stylesheet support * [Project] Css: Add rules processing functions and tests * [Project] Css: Add simple selectors unit tests * [Project] Css: Add some c++ unit tests * [Project] Css: Add some debug methods * [Project] Css: Add some debug statements for the css parser * [Project] Css: Add some logical skeleton for declarations parser * [Project] Css: Add url/function tokens * [Project] Css: Allow at rules parsing * [Project] Css: Declarations parsing logic skeleton * [Project] Css: Enable conditional css parsing support from the HTML parser * [Project] Css: Finish generic lexer cases * [Project] Css: Fix HSL conversion * [Project] Css: Fix minus parsing * [Project] Css: Fix parser consumers nesting * [Project] Css: Fix parsing of the qualified rules * [Project] Css: Fix rules merging * [Project] Css: Further fixes to lexer * [Project] Css: Further steps to parse css colors + rework * [Project] Css: Further work on parser's methods * [Project] Css: Implement backlog of css tokens * [Project] Css: Implement numbers and ident parsers * [Project] Css: Implement simple css selectors lookup * [Project] Css: Implement styles merging * [Project] Css: Make debug strings json like to simplify tests * [Project] Css: Minor adjustments * [Project] Css: More meat to the lexer * [Project] Css: Move some of the tests to the doctest * [Project] Css: Projected a parser * [Project] Css: Properties attachment logic * [Project] Css: Remove ragel from build targets (maybe keep for reference) * [Project] Css: Rework css block structure * [Project] Css: Rework flags of css properties * [Project] Css: Rework tokens structure * [Project] Css: Several fixes + tests * [Project] Css: Simplify checks * [Project] Css: Simplify debug code * [Project] Css: Start css selectors parsing logic * [Project] Css: Start semantic parsing for rules * [Project] Css: Start stylesheet implementation * [Project] Css: Tidy up lambdas * [Project] Css: rework tokeniser * [Project] Dmarc: Add dmarc report tool (WIP) * [Project] Dmarc: Add munging configuration * [Project] Dmarc: Add preliminary munging logic * [Project] Dmarc: Fix header removal * [Project] Dmarc: Fix munging logic * [Project] Dmarc: Use full recipient address instead of a domain map * [Project] Dmarc: Use zlists for dmarc reports * [Project] Dmarc_report: Add message generation logic * [Project] Dmarc_report: Add preliminary sending support * [Project] Fix lua bindings * [Project] Fix xml/sgml tags processing * [Project] Handle new modification * [Project] Html/CSS: Add transform from a CSS rule to html block * [Project] Html/CSS: Link html and css styles * [Project] Html/CSS: Switch styles parsing to css parser * [Project] Html/Css: Fix some issues found * [Project] Html/Css: Implement visibility rules for a block * [Project] Html: Add more tests cases and fix some more corner issues * [Project] Html: Add rows display type support * [Project] Html: Allow decode entities function to normalise spaces + unit tests * [Project] Html: Another rework of the tags structure * [Project] Html: Another try to fix unbalanced cases * [Project] Html: Fix crossing spans * [Project] Html: Fix parent propagation * [Project] Html: Further rework of the html parsing stuff * [Project] Html: Implement logic for tags pairing * [Project] Html: Implement rawtext state machine * [Project] Html: Insert closing tags as well :( * [Project] Html: More fixes * [Project] Html: More fixes * [Project] Html: More spaces logic fixes * [Project] Html: One more attempt to write text content * [Project] Html: Replace \0 in html content * [Project] Html: Rework img/a tags handling * [Project] Html: Rework propagation method * [Project] Html: Rework tags placement * [Project] Html: Rework transparency logic * [Project] Html: Support 'hidden' attribute * [Project] Html: Try another approach to append tags content * [Project] Html: Try to deal with bad unknown tags properly * [Project] Lua_aws: Add canonicalisation utility * [Project] Lua_aws: Add function to produce AWS Authorisation header * [Project] Lua_aws: Implement request signing * [Project] Lua_mime: Add lua_mime.modify_headers routine * [Project] Lua_task: Add modify_header method * [Project] Lua_task: Allow to extract modified headers * [Project] Make unescape code public for unit testing * [Project] More fixes for closed tags * [Project] More fixes to calculations * [Project] Rework API for the modified headers * [Project] Rework html visibility rule * [Project] Skeleton of the css library * [Project] Start headers modification API structure * [Project] Start working on AWS Lua API * [Project] Use lua_mime to modify headers * [Project] Use modified headers on dkim signing * [Project] Use string_view to constexpr variant unpacking * [Rework] Add composites manager concept * [Rework] Add tags definitions * [Rework] Allow C code to be compiled with C++ compiler * [Rework] Clickhouse: Store url flags * [Rework] Composites: Rewrite the composites logic * [Rework] Composites: Start rework of the composites framework * [Rework] Dmarc: Move check policy function to the common utils * [Rework] Dmarc: Rework reports keys structure * [Rework] Further work to make html content private * [Rework] Html/CSS: Remove css C bindings as they are useless now * [Rework] Html/CSS: Rework Lua bindings * [Rework] Html/Css: Start rework of the html blocks * [Rework] Html: Add images processing logic * [Rework] Html: Add traverse function * [Rework] Html: Another steps to get rid of gnode * [Rework] Html: Convert to variant * [Rework] Html: Deal with the utf_content part * [Rework] Html: Final rework part for the html processing code * [Rework] Html: Fix Lua bindings * [Rework] Html: Forgot to add the internal include * [Rework] Html: Further html urls rework * [Rework] Html: Further rework of the tags content extraction * [Rework] Html: Make parameters as a vector again * [Rework] Html: Move blocks part * [Rework] Html: Move images processing stuff * [Rework] Html: Rework lua bindings * [Rework] Html: Start html text extraction rework * [Rework] Html: Start refactoring of the html tags handling * [Rework] Html: Start removing of GNode stuff * [Rework] Html: Start rework of the html content structure * [Rework] Lua_magic: Try to detect text parts with 8bit characters for non-utf8 encodings * [Rework] Move HTML url functions and rework them * [Rework] Move and adopt entities handling logic * [Rework] Move common and rarely used dmarc code to the library * [Rework] Move compression routines outside of rspamd_util library * [Rework] Move entities/tags handling * [Rework] Phishing: Split from redirectors usage * [Rework] Redesign html blocks propagation logic * [Rework] Remove tag name string * [Rework] Rename phished url to a linked url * [Rework] Reorganize dmarc plugin and remove unsupported reporting code * [Rework] Reputation: Use more flexible types in get/set functions * [Rework] Require proper C++ environment for Rspamd build * [Rework] Rework extended urls output * [Rework] Rework tags parsing machine * [Rework] Slightly improve old regexp API * [Rework] Start conversion of the redis pool code to c++ * [Rework] Try to resolve failed upstreams more agressively * [Rework] Use C++ utf8 library with unit tests to trim whitespaces * [Rework] Use C++ version for unicode normalisation * [Rework] Use C++ version of the lua threads pool * [Rules] Add raw addresses to MULTIPLE_FROM options * [Rules] Another fix to HTTP_TO_HTTPS rule * [Rules] Do not trigger HTML_SHORT_LINK_IMG on external images * [Rules] Extend FORGED_X_MAILER * [Rules] Extend OLD_X_MAILER * [Rules] Fix CTYPE_MIXED_BOGUS for text attachments * [Rules] Fix FPs for CTYPE_MIXED_BOGUS * [Rules] Fix HTTP_TO_HTTPS rule * [Rules] Fix HTTP_TO_HTTPS rule * [Rules] Fix zerofont rule (partially) * [Rules] Micro-optimize X_PHP_EVAL * [Rules] Reduce default weight for R_MISSING_CHARSET Signed-off-by: Vsevolod Stakhov <vsevolod@highsecure.ru>
* [Minor] Revert ignoring of the invisible urls by defaultVsevolod Stakhov2021-08-182-3/+3
|
* [Minor] Set invisible flag on invisible urlsVsevolod Stakhov2021-08-171-0/+14
|
* [Minor] Add `invisible` flag to url structureVsevolod Stakhov2021-08-174-3/+8
|
* [Minor] Minor improvementsVsevolod Stakhov2021-08-162-2/+3
|
* [Fix] Add a special logic for text part with no text extractionVsevolod Stakhov2021-08-163-4/+23
|
* [Minor] Lua_magic: Fix detection for the parts with file namesVsevolod Stakhov2021-08-161-4/+8
|
* [Minor] Mime: Print mime part stuff for text partsVsevolod Stakhov2021-08-161-4/+15
|
* [Minor] Dmarc_report: Improve dates detectionVsevolod Stakhov2021-08-161-2/+7
|
* Merge pull request #3846 from yoshimo/AugustVsevolod Stakhov2021-08-141-0/+5
|\ | | | | [Minor] Add bz2, egg, alz,xz and lz as additional archive extensions
| * - add bz2, egg, alz,xz and lz as additional archive extensionsYoshimo2021-08-131-0/+5
| |
* | [Minor] Lua_magic: Slight re tuneVsevolod Stakhov2021-08-131-1/+1
| |
* | [Minor] Lua_magic: Fix xml detectionVsevolod Stakhov2021-08-132-9/+16
| |
* | [Minor] Lua_magic: Do not treat xml as htmlVsevolod Stakhov2021-08-131-1/+0
| | | | | | | | Suggested by: @citrin
* | [Feature] Aws_s3: Allow to compress data storedVsevolod Stakhov2021-08-131-4/+18
|/
* [Minor] Fix formattingVsevolod Stakhov2021-08-121-1/+1
|