Nelze vybrat více než 25 témat Téma musí začínat písmenem nebo číslem, může obsahovat pomlčky („-“) a může být dlouhé až 35 znaků.

1234567891011121314151617181920212223242526272829303132333435363738394041424344454647484950515253545556575859606162636465666768697071727374757677787980818283848586878889909192939495969798991001011021031041051061071081091101111121131141151161171181191201211221231241251261271281291301311321331341351361371381391401411421431441451461471481491501511521531541551561571581591601611621631641651661671681691701711721731741751761771781791801811821831841851861871881891901911921931941951961971981992002012022032042052062072082092102112122132142152162172182192202212222232242252262272282292302312322332342352362372382392402412422432442452462472482492502512522532542552562572582592602612622632642652662672682692702712722732742752762772782792802812822832842852862872882892902912922932942952962972982993003013023033043053063073083093103113123133143153163173183193203213223233243253263273283293303313323333343353363373383393403413423433443453463473483493503513523533543553563573583593603613623633643653663673683693703713723733743753763773783793803813823833843853863873883893903913923933943953963973983994004014024034044054064074084094104114124134144154164174184194204214224234244254264274284294304314324334344354364374384394404414424434444454464474484494504514524534544554564574584594604614624634644654664674684694704714724734744754764774784794804814824834844854864874884894904914924934944954964974984995005015025035045055065075085095105115125135145155165175185195205215225235245255265275285295305315325335345355365375385395405415425435445455465475485495505515525535545555565575585595605615625635645655665675685695705715725735745755765775785795805815825835845855865875885895905915925935945955965975985996006016026036046056066076086096106116126136146156166176186196206216226236246256266276286296306316326336346356366376386396406416426436446456466476486496506516526536546556566576586596606616626636646656666676686696706716726736746756766776786796806816826836846856866876886896906916926936946956966976986997007017027037047057067077087097107117127137147157167177187197207217227237247257267277287297307317327337347357367377387397407417427437447457467477487497507517527537547557567577587597607617627637647657667677687697707717727737747757767777787797807817827837847857867877887897907917927937947957967977987998008018028038048058068078088098108118128138148158168178188198208218228238248258268278288298308318328338348358368378388398408418428438448458468478488498508518528538548558568578588598608618628638648658668678688698708718728738748758768778788798808818828838848858868878888898908918928938948958968978988999009019029039049059069079089099109119129139149159169179189199209219229239249259269279289299309319329339349359369379389399409419429439449459469479489499509519529539549559569579589599609619629639649659669679689699709719729739749759769779789799809819829839849859869879889899909919929939949959969979989991000100110021003100410051006100710081009101010111012101310141015101610171018101910201021102210231024102510261027102810291030103110321033103410351036103710381039104010411042104310441045104610471048104910501051105210531054105510561057105810591060106110621063106410651066106710681069107010711072107310741075107610771078107910801081108210831084108510861087108810891090109110921093109410951096109710981099110011011102110311041105110611071108110911101111111211131114111511161117111811191120112111221123112411251126112711281129113011311132113311341135113611371138113911401141114211431144114511461147114811491150115111521153115411551156115711581159116011611162116311641165116611671168116911701171117211731174117511761177117811791180118111821183118411851186118711881189119011911192119311941195119611971198119912001201120212031204120512061207120812091210121112121213121412151216121712181219122012211222122312241225122612271228122912301231123212331234123512361237123812391240124112421243124412451246124712481249125012511252125312541255125612571258125912601261126212631264126512661267126812691270127112721273127412751276127712781279128012811282128312841285128612871288128912901291129212931294129512961297129812991300130113021303130413051306130713081309131013111312131313141315131613171318131913201321132213231324132513261327132813291330133113321333133413351336133713381339134013411342134313441345134613471348134913501351135213531354135513561357135813591360136113621363136413651366136713681369137013711372137313741375137613771378137913801381138213831384138513861387138813891390139113921393139413951396139713981399140014011402140314041405140614071408140914101411141214131414141514161417
  1. 1.1.4:
  2. * Print traceback on lua errors in lua config
  3. * Fix leaks in lua error paths
  4. * Improve 'R_EMPTY_IMAGE' rule
  5. * Fix metas memoization in SA plugin
  6. * Properly set `flag` in fuzzy replies
  7. * Fix arguments order
  8. * Fix issue with out-of-boundary reading
  9. * Fix issues found by coverity
  10. * Same result checking error found by coverity
  11. * Fix varargs processing (found by coverity)
  12. * Fix error in printing hex
  13. * Reduce weights for some hfilter patterns
  14. * Add aliases for task:get_from_ip:
  15. - task:get_addr
  16. - task:get_from_addr
  17. - task:get_ip
  18. * Rework once_received module
  19. - Fix priority for `good_hosts`
  20. - If a good host has been found do not add once_received symbols
  21. - Fix priorities for strict once_received
  22. - Add ability to whitelist IP addresses
  23. * Fix `MISSING_MIMEOLE` rule for modern OE
  24. * Treat meta tags as embedded tags (#501)
  25. 1.1.3:
  26. * Fix DSN rules when SMTP from is unavailable
  27. * Fix statconvert routine to avoid lua module usage
  28. * Set a sane quark for configtest to avoid NULL to be printed in logs
  29. * Support c11 if available
  30. * Fix parsing of ip:port strings
  31. * Add more diagnostic for lua subr errors
  32. * Fix task:set_from_ip lua method
  33. * Add basic routines for digital signatures
  34. * Add tool for digital signatures
  35. * Add plain open file API method for atomic open
  36. * Fix parsing nested braces inside logger vars
  37. * Pre filters now actually skip processing
  38. * Add pre-filter mode for multimap
  39. * Switch to apache 2 license
  40. 1.1.2:
  41. * Fix stat_cache closing
  42. * Add checkpoints to sqlite3 learn cache
  43. * Do not recompile lua generated headers all the time
  44. * Increase number of messages learned
  45. * Fix issues with dual stack and hfilter
  46. * Disable MID checks for hfilter by default
  47. * Fix cache definitions in multiple classifier and no type
  48. * Don't crash if learn cache failed to initialize
  49. * Fix googlegroups support in maillist plugin
  50. * Rework flags LUA API:
  51. - Allow to check for a specific flag
  52. - Add `learn_spam`, `learn_ham` and `broken_headers` flags
  53. - Unify internal functions
  54. * Add `BROKEN_HEADERS` rule
  55. * Add support for forged confirmation headers (by @AdUser)
  56. * Allow `any`, `mime` and `smtp` for get_from/get_recipients
  57. * Add mime types checking plugin
  58. * Add rule to detect spammers attempts to cheat mime parsing
  59. * Rework parsing of IP addresses in configuration (better IPv6 support)
  60. * Add `util.parse_mail_address` function to LUA API
  61. * Add lua sqlite3 module
  62. * Implement synchronous redis call
  63. * Ratelimit: avoid possible indexing of nil value (Fixes #498) (by @fatalbanana)
  64. * Add stat_convert command to convert stats tokens from sqlite3 to redis
  65. * Implement redis advanced lua api with pipelining
  66. * Fix memory leak on redis stat (#500)
  67. * Fix user/language learn count in sqlite statistics (#496) (by @fatalbanana)
  68. * Fix build with custom pcre
  69. * Fix fuzzy relearning (#498)
  70. * Improve planning of asynchronous tasks
  71. * Show slow rules in log
  72. * Add warning for slow regexps
  73. * Add base32 decode/encode routines to lua util
  74. * Allow converting of learn cache from sqlite to redis
  75. * Add methods to check if a messages has from/rcpts
  76. * Improve and fix multimap plugin:
  77. - Restore 'header' maps
  78. - Add filters for headers
  79. - Add 'email:addr', 'email:user', 'email:domain' and 'email:name' filters
  80. - Add generic regexp filters
  81. * Disable reload command in rc scripts
  82. * Improve runtime CPU dispatcher for libcryptobox
  83. * Add preliminary support of digital signatures via ed25519
  84. * Add detection for RDRAND support
  85. * Print configuration of crypto on start
  86. * A in SPF presumes AAAA lookup as well
  87. 1.1.1:
  88. * Fix duplicated XBL symbol
  89. * Reduce log severity for ratelimit missing servers
  90. * Fix XBL composite to avoid duplicate symbols
  91. * Reduce weight of URL_ONLY rule due to FP rate
  92. * Disable fuzzy hashes from the metadata for now
  93. * Fix processing of empty messages (#486)
  94. * Always treat DNS timeouts as temporary fail for SPF
  95. * Fix issue with SPF double IP stack (#483)
  96. * Use X-Forwarded-For when checking secure_ip (#488)
  97. * Fix hash calculation for sqlite stats
  98. * Fix memory corruption on punycode
  99. * Fix strings allocation in punycode
  100. * Fix error message (#491)
  101. 1.1.0:
  102. * Incompatible change: sqlite3 and per_user behaviour:
  103. Now both redis and sqlite3 follows the common principles for per-user
  104. statistics:
  105. 1) If per-user statistics is enabled check per-user tokens ONLY
  106. 2) If per-user statistics is not enabled then check common tokens ONLY
  107. If you need old behaviour, then you'd need to use separate classifier
  108. for per-user statistics.
  109. * Implement redis statistics backend and cache
  110. * Implement autolearning for statistics
  111. * Reworked statistics architecture from scratch
  112. * Add hyperscan (https://github.com/01org/hyperscan) engine for regular
  113. expressions:
  114. - add lazy loader for hyperscan databases
  115. - rework regexp cache to have joint pcre/hyperscan scanning
  116. - implement hyperscan pre-filter support
  117. - add compilation guards for bad expressions
  118. - implement `rspamadm control recompile` command
  119. - implement hyperscan cache monitoring
  120. - slides: <https://highsecure.ru/rspamd-hyperscan.pdf>
  121. * Implement flexible task logging
  122. * Rework fuzzy worker:
  123. - it is now possible to run multiple fuzzy workers;
  124. - implement lazy writing as sqlite3 is bad at concurrent writing;
  125. - add retries for simple sql commands in fuzzy backend;
  126. - use fine-grained transactions for fuzzy;
  127. - implement new multi-pubkeys mode;
  128. - allow encrypted only storages;
  129. - rework statistics for fuzzy;
  130. - add `rspamadm control fuzzystat` command for extended statistics;
  131. - implement human readable output for the previous command;
  132. - add condition script for learning fuzzy storage;
  133. * Various fixes to SPF:
  134. - fix `redirect` records;
  135. - fix domains when parsing mx/ptr/a records in includes/redirects;
  136. - fix issues with multiple addresses in SPF records;
  137. - ignore SPF results in case of DNS failure;
  138. - adjust TTL of records when resolving subelements of SPF records;
  139. - always select `v=spf1` line if it is available
  140. - do not cache records with DNS failure in subrequests;
  141. - ignore records with temporary fails during subrequests resolving;
  142. - fix `RDNS_RC_NOREC` support;
  143. * Add clang plugin for static analysis:
  144. - implement static checks for `rspamd_printf` format strings;
  145. * Add 'allow_raw_input' option for non-mime messages
  146. * Recognize types using libmagic
  147. * Fix parsing of IPv6 received headers
  148. * Add new interface of communication between workers in rspamd
  149. * Add support for named socketpairs
  150. * Don't write URLs by default as it is too verbose
  151. * Set status for HTTP replies
  152. * Try load `rspamd.conf.override`
  153. * Implement words decaying for text parts to limit many checks
  154. * Improve support of SA rules and plugins:
  155. - add check_for_shifted_date and check_for_missing_to_header eval rules;
  156. - add 'check_relays_unparseable' support;
  157. - add `check_for_mime('mime_attachement')` function;
  158. - use new re_cache interface for all SA rules;
  159. - add support for `Mail::SpamAssassin::Plugin::MIMEHeader`;
  160. - add support of 'special' SA headers to `exists` function;
  161. - fix issue when SA metas contain other metas;
  162. - fix freemail rules;
  163. * Many fixes to the URL parser
  164. * Match any newline character in regexps
  165. * Fix resolving of upstreams and detection of poor IPv6 configurations
  166. * Parse upstreams selection algorithm from the configuration line
  167. * Add `reresolve` command to the control interface
  168. * Generate fuzzy hashes from task metadata (URLs and headers)
  169. * Add method to check if IP is local and `local_addrs` option
  170. * Implement forced timeout for delayed filters
  171. * Disable fast path of pcre-jit as it seems to be broken
  172. * Bayes fixes:
  173. - new normalizer function;
  174. - really use weights of tokens from the OSB algorithm;
  175. - restore multiple classifiers support;
  176. * Rules changes:
  177. - add `R_SUSPICIOUS_URL` rule that detects obfuscated URL's;
  178. - improve empty image rule;
  179. - rework `FORGED_RECIPIENTS` rule;
  180. - reduce weight of `SUSPICIOUS_RECIPS`;
  181. - fix `*_NORESOLVE_MX` symbols in hfilter;
  182. - add `SUBJ_ALL_CAPS` rule with support of UTF8
  183. - add spamhaus SBL to uribl
  184. - fix `SUSPICIOUS_RECIPS` and `SORTED_RECIPS` rules
  185. - remove `R_TO_SEEMS_AUTO` as it generates a lot of FP;
  186. - add new Message-ID regexp for Thunderbird (by @moisseev);
  187. * Plugins changes:
  188. - allow ratelimit plugin to set symbol instead of pre-result
  189. - support IP DNS black lists for URIBL (e.g spamhaus SBL);
  190. - drop deprecated SURBL bits (by @fatalbanana)
  191. - rename `JP_SURBL_MULTI` to `ABUSE_SURBL` (by @fatalbanana)
  192. - add `SURBL_BLOCKED` (by @fatalbanana)
  193. - add `CR_SURBL`
  194. - SURBL: allow fallthrough to default symbol (by @fatalbanana)
  195. - Settings: fix IP match (by @fatalbanana)
  196. - SURBL: add missing symbols to metric (by @fatalbanana)
  197. - allow processing images urls for SURBL
  198. - unconditionally disable SPF for authenticated users and local networks
  199. * Rework ratelimit plugin
  200. - switch to `rates` instead of old and stupid strings to setup;
  201. - check if a bucket is zero and disable the corresponding limits'
  202. - turn off all buckets by default;
  203. - check either `rcpt` or `user` buckets, not all together'
  204. - document new `rates` and `symbol` options;
  205. - inform user about what buckets are used in the configuration;
  206. * Add neural network **experimental** plugin
  207. * Add a sample script to learn neural network from rspamd logs
  208. * Add documentation strings support to rspamd:
  209. - add strings for the main configuration options;
  210. - document workers options;
  211. - add internal plugin options;
  212. - create `rspamadm confighelp` routine;
  213. - implement human readable output for the previous command;
  214. - add subtree search support;
  215. - add keyword search support;
  216. * Documentation improvements, tutorials section, statistics description
  217. * Many other minor and major bugfixes not noted here
  218. 1.0.11:
  219. * Fix spf redirects
  220. * Fix domains when parsing mx/ptr/a records in includes/redirects
  221. * Fix unfolded base64 encoding
  222. * Fix GError use-after-free
  223. * Do not rewrite the original url when using redirector
  224. * Fix parsing of fragment in urls
  225. * Fix processing of HTML tags
  226. * Improve empty image rule
  227. * Avoid long double type
  228. * Fix tokens weights in OSB algorithm
  229. * Improve debugging for bayes
  230. 1.0.10:
  231. * Fix settings application (#416)
  232. * Fix another issue with fixed strings
  233. * Fix hash function invocation
  234. * Use the proper string for make_dns_request in lua_http
  235. * Fix scan time output
  236. * Update webui:
  237. - fix labels for greylisting
  238. - fix dimension of scan time
  239. 1.0.9:
  240. * Emergency fix in keyed blake2 to fix fuzzy hashes and encrypted password
  241. * Support passwords longer than 64 symbols
  242. 1.0.8:
  243. * Add function to traverse AST atoms
  244. * Allow dependencies on rspamd symbols for SA metas
  245. * Fix memory corruption when timeout is removed in fuzzy check
  246. * Fix encrypted fuzzy add processing
  247. * Avoid use-after-free in controller session destructor
  248. * Use session pool instead of task pool in fuzzy check
  249. * Fix assembly in i386 mode (#413, #412)
  250. 1.0.7:
  251. * Plugged memory leaks in internet address object & html parser
  252. * Fixed static build
  253. * Fixed multiple sigchld processing
  254. * Fixed deletion of signal events after event processing loop
  255. * Fixed build on ARM (#404 - reported by @Gottox)
  256. * Fixed setting the default mask for SPF.
  257. * Fixed sanitisation of HTTP query values
  258. * Fixed parsing of the last header in encrypted HTTP messages
  259. * Additions and fixes for test suite & benchmarks
  260. * Added openssl aes-256-gcm support to libcryptobox & HTTP server
  261. * Implemented support for starting multiple HTTP servers
  262. * Implemented batch accept in HTTP server
  263. * Added module to get data from HTTP headers (#285 - reported by @msimerson)
  264. * Added `rspamadm control` command
  265. * Added ability to sort counters output.
  266. * Added ability to specify custom headers for rspamc client
  267. * Fix architecture detection
  268. * Converted history storage to the UCL format
  269. * Allow flexible number of rows in history
  270. * Fix action badges in WebUI
  271. * Add universal cryptobox hash API
  272. * Migrated to the optimized blake2b implementation adopted from Andrew Moon
  273. * Allow explicit loading of specific modules
  274. * Always load settings module
  275. * Allow to add symbols from settings
  276. * Fix double free in the controller fuzzy learn command
  277. * Avoid endless loop when cannot open sqlite db
  278. * Updated libucl
  279. 1.0.6:
  280. * Fix build on i386
  281. * Update CentOS7 service file patch (by @fatalbanana)
  282. * Fix path to rspamadm in Debian init script (by @fatalbanana)
  283. * Fix broken '_SC_GETPW_R_SIZE_MAX' on FreeBSD
  284. * Fix portability issues
  285. * Use cryptobox chacha for libottery
  286. * Better support of 32 bit builds
  287. * Fix header name tokens setup
  288. * Fix levenstein distance method for words
  289. * Add workaround for old libevent (#400)
  290. * Fix microseconds in termination timer
  291. * Fix some more issues with fixed strings
  292. * Explicitly test CPU instructions even after CPUID call
  293. * Do not check out of boundary memory
  294. * Do not output broken emails
  295. * Fix unknown symbols registration
  296. * Handle SIGILL using longjmp
  297. * Block signals when exiting event loop
  298. * Fix incorrect allocation size
  299. * Slightly optimize alignment
  300. * Restore rspamd -t for compatibility
  301. * Add more sanity checks for emails
  302. 1.0.5:
  303. * Add rspamd control interface:
  304. - support `stat` command to get runtime stats of rspamd workers
  305. - support `reload` command to reload runtime elements (e.g. sqlite3 databases)
  306. * Rework curve25519 library for modular design:
  307. - add Sandy2x implementation by Tung Chou
  308. - fix CPU detection for variables loading assembly
  309. - add testing for curve25519 ECDH
  310. * New fixed strings library
  311. * Add `R_SUSPICIOUS_IMAGES` rule
  312. * Enable mmap in sqlite3
  313. * Use new strings in the HTTP code
  314. * Improve google perftools invocation
  315. * Improve performance profiling in http test
  316. * Reorganize includes to reduce namespace pollution
  317. * Allow specific sections printing in configdump command
  318. * Rework workers signals handlers to be chained if needed
  319. * Update socketpair utility function
  320. * Add control_path option for rspamd control protocol
  321. * Fix ownership when listening on UNIX sockets
  322. * Rework signals processing in main
  323. * Remove extra tools from rspamd (they live in rspamadm now)
  324. * Remove global rspamd_main
  325. * Add global timeout for the overall task processing (8 seconds by default)
  326. * Sanitize NULL values for fuzzy backend
  327. * Store NM between encrypt/decrypt
  328. * Add textpart:get_words_count method
  329. * Fix generic DNS request in lua
  330. * Tune hfilter weights
  331. * Add support of IPv6 in hfilter
  332. * Fix parsing of HTTP headers with IP addresses
  333. * Sync with the recent libucl
  334. * Various minor bugfixes
  335. 1.0.4:
  336. * Add configdump routine to rspamadm
  337. * Implement retransmits for fuzzy_check plugin
  338. * Fix events processing for learning anf checking fuzzy hashes
  339. * Avoid dependency on unneeded and uncompatible glib include
  340. * Add `historyreset` command to the controller
  341. * Fix loading of tokenizer config from dump (#389)
  342. * Add sorting hints for the history
  343. * Allow custom lua scripts for users/languages extraction (#388)
  344. * Do not add FORGED_RECIPIENTS when 'To' is missing (#387)
  345. * Do not add R_UNDISC_RCPT when 'To' is missing (#387)
  346. * Add encryption to fuzzy check plugin
  347. * Add encryption for fuzzy storage
  348. * Add new epoch for encrypted fuzzy request
  349. * Add encryption for `rspamd.com` storage
  350. * Remove gmime processing for LDA mode as it is deadly broken
  351. * Add routine to find end of headers position in mime messages
  352. * Fix LDA headers folding
  353. * Init libraries in rspamc client as well to avoid locale issues
  354. * Avoid collision with locally installed includes
  355. * Allocate and free memory with the same allocator in rspamadm (#385)
  356. * Preserve expired fuzzy hashes counter
  357. * Improvements in webui:
  358. - Add favicon.ico
  359. - Rework history table
  360. - Fix sorting for the history
  361. - Migrate to bootstrap 3 and jquery 2
  362. - Fix css bugs
  363. - Add glyphicons
  364. - Add reset history
  365. - Improve history buttons
  366. - Redraw graph to avoid display issues
  367. - Webui is now MIT licensed to match licensing policy of rspamd
  368. 1.0.3:
  369. * Fix piechart clean slice (#380)
  370. * Fix controller crashes when GString is reallocated (#381)
  371. * Correctly set locale before start
  372. * Set C locale for numeric values
  373. * Add rspamadm routine:
  374. - add `pw` command to manage passwords
  375. - add `help` command for displaying help
  376. - add `configtest` command to check configuration files
  377. - add `keypair` command for generating encryption keys
  378. - add `fuzzy_merge` routine to merge fuzzy sqlite databases
  379. - add a simple manual page for rspamadm
  380. * Allow metric registration for composite expressions
  381. * Add strict mode for configtest
  382. * Add logger counters
  383. * Save and show learned messages count (#383)
  384. * Add `no_stat` flag
  385. * Add `task:set_flag` and `task:get_flags` (#382)
  386. * Enable foreign keys in sqlite3
  387. * Remove orphaned shingles from fuzzy storage
  388. * Optimize synchronization steps for fuzzy storage
  389. * Allow delayed conditions registration
  390. * Add lua API for conditions registering
  391. 1.0.2:
  392. * Fix critical bug in webui that prevents password from being sent
  393. * Rework webui view:
  394. - Switch to d3.js for graphs
  395. - Improve piechart look
  396. - Rework colors for piechart
  397. - Fix layout for symbols
  398. - Fix refresh button
  399. * Add descriptions for whitelist maps
  400. * Fix build on arm (#379)
  401. * Fix issue with the last element in the radix trie
  402. * Add more tests for radix trie algorithm
  403. * Allow to extract URLs from query strings of other URLs (#361)
  404. * Initialize rrd fields before writing to file
  405. * Fix double free if no password has been specified
  406. 1.0.1:
  407. * Add writing to rrd from the controller
  408. * Fixed lots of bugs in rrd code
  409. * Adopt new DNS API in hfilter plugin (by @AlexeySa)
  410. * Allow only one controller process to manage rrd file
  411. * Set event base for fuzzy calls
  412. * Improve fuzzy IO errors logging
  413. * Add rra extraction function to rrd library
  414. * Add graph handler to the controller
  415. * Cache correct passwords to avoid too high CPU usage when working with webui
  416. * Controller sockets are owned by router do not export them to task
  417. * Optimize logging by skipping hash table search if it's empty
  418. * Fix loading issue whith broken statfiles
  419. * Print assertions from glib to rspamd logger
  420. * Load legacy `lua/rspamd.local.lua`
  421. * Update webui with some fixes to learning and scanning
  422. 1.0.0:
  423. * Rework symbols processing:
  424. - Improve sorting logic for symbols
  425. - Organize processing into multiple stages
  426. - Added asynchronous watchers for symbols
  427. - Added ability to organize dependencies between symbols
  428. * Fixed URL redirector:
  429. - Use optimized POE loop
  430. - Organize dependencies
  431. - Fix startup
  432. * New sqlite3 backend:
  433. - Allow to have per-languages and per-user statistics
  434. - Allow sqlite3 to be used as statistics backend
  435. * Store tokenizer configuration within statfiles
  436. * Improve bayes statistics:
  437. - Use headers and images metainformation in bayes
  438. - Suggest using of pre-processed tokens for statistics
  439. - Fix tokens normalization for OSB algorithm
  440. * Rewrite url parsing:
  441. - Fix numerous issues with url extraction and normalization
  442. - Fix mailto urls
  443. * Fix settings plugin to allow custom actions scores
  444. * Improve rbl plugin
  445. * Allow capturing patterns in rspamd lua regexp library
  446. * Add GTUBE support
  447. * Fix spamc legacy support
  448. * Add DKIM support to RBL module
  449. * Fix issues with multiple DKIM signatures
  450. * Fix issue if rspamd cannot create statfiles (#331)
  451. * Rework parts and task structure:
  452. - Now text_parts, parts and received are arrays
  453. - Pre-allocate arrays with some reasonable defaults
  454. - Use arrays instead of lists in plugins and checks
  455. - Remove unused fields from task structure
  456. - Rework mime_foreach callback function
  457. - Remove deprecated scan_milliseconds field
  458. * Add ip_score plugin support (not enabled by default):
  459. - Can check for asn/country and network using DNS lookups
  460. - Can store and load reputation from redis server
  461. * Improve PARTS_DIFFER rule to count merely different words
  462. * New HTML parser:
  463. - Parses HTML parts using a set of state machines
  464. - Extracts useful data and exports it to lua functions:
  465. + Styles
  466. + Images
  467. + URLs
  468. + Colors
  469. + Structure elements
  470. - Added HTML rules for some checks
  471. * New version of LUA DNS API
  472. * Table versions of many functions in LUA API
  473. * Improve rspamc client:
  474. - Print execution time
  475. - Allow executing of external commands and passing output to them
  476. - Allow mime output mode when rspamc alters message according to rspamd
  477. checks and send it to an external command or stdout
  478. * Allow scanning of local files using HTTP requests
  479. * Rework configuration system:
  480. - Rules are now moved from the $CONFDIR to $RULESDIR to avoid ambiguity
  481. - All modules configurations are now split in $CONFDIR/modules.d/* to
  482. simplify upgrades
  483. - Move hfilter to plugins
  484. - Allow plugins and rules to define default scores to simplify metrics
  485. setup
  486. - Include overrides for all modules to honor local/automatic parameters
  487. - Tune scores for many modules
  488. * Rework and enable DMARC plugin
  489. * Add whitelist plugin for SPF/DKIM/DMARC based whitelisting
  490. * Add some common domains to whitelists shipped with rspamd
  491. * Rework logging:
  492. - Now each log entry supports module name and a `tag`. Tag is used to
  493. identify unique objects (such as tasks) when checking log files
  494. - It is possible to turn on debugging for the specific modules
  495. - Systemd logging is fixed
  496. * Improve spamassassin plugin.
  497. - Now headers are matched more like SA
  498. - Improve support of Message-ID
  499. - Add support of ToCc header type
  500. - Fix :addr and :name in headers regexps
  501. * Resurrect rrd support code
  502. * Save controller stats between restarts
  503. * Fixed tonns of bugs
  504. * Added tonns of minor improvements and features
  505. * Added more unit tests
  506. * Create functional tests framework
  507. * Added documentation for missing modules
  508. * Added rpm/deb repositories and scripts
  509. * Updated WebUI and libucl externals
  510. 0.9.10:
  511. * Do not dereference null pointer on learning.
  512. * Fix some extreme cases in BAYES.
  513. * Add a workaround to avoid bad HTML messages breaking.
  514. * Build with -O2 flags by default.
  515. * Add constraints to limit DNS requests count per task.
  516. * Add workaround for SURBL DNS flood.
  517. * Set error if rspamd cannot learn anything.
  518. 0.9.9:
  519. * Don't use RWL_SPAMHAUS_WL (unknown result) for whitelisting (by @fatalbanana)
  520. * Import updated public suffix list (by @fatalbanana)
  521. * Remove debug message
  522. * Fix settings (by @fatalbanana)
  523. * Remove duplicated symbol registration
  524. * Use WAL for fuzzy storage
  525. * RBL fixes (by @fatalbanana):
  526. - silence errors;
  527. - yield unknown results from RBLs;
  528. - fix scoring for DNSWL;
  529. - fix use of RBL name as symbol;
  530. - ignore RBL names that would not be yielded;
  531. * Support captures in regular expressions
  532. * Add captures support to lua_regexp
  533. * Support dist on FreeBSD and Darwin
  534. * Add RCVD_IN_DNSWL_NONE as whitelisting exclusion (by @fatalbanana)
  535. * Multiple fixes to URL detection:
  536. - support port definition;
  537. - fix query and path recognition;
  538. - fix parsing of multiple slashes in URL;
  539. - fix parsing query just after port;
  540. - fix path field in `url:to_table` method;
  541. - improve support of IP based URLs.
  542. * Set ignore_whitelists = true for RECEIVED_SPAMHAUS_XBL (by @fatalbanana)
  543. * Add GTUBE support
  544. * Ignore User header in SA mode
  545. 0.9.8:
  546. * Fix critical bug in bayes classifier (#305)
  547. * Fix critical bug in RBL module (by @fatalbanana)
  548. * Fix and rework settings plugin.
  549. * Fix get_all_opts for a case of non-iterable options.
  550. * Use tld for redirector's matching.
  551. 0.9.7:
  552. * Add whitelist_exception setting to RBL module (by @fatalbanana)
  553. * Don't use RWL_MAILSPIKE_POSSIBLE or DNSWL_BLOCKED for whitelisting (by
  554. @fatalbanana)
  555. * Fix extreme cases in bayes classifier.
  556. * Fix parsing of urls with '?' at the end of hostname.
  557. * Update interface.
  558. * Fix number of issues with webui interaction.
  559. * Fix saving maps.
  560. * Allow user@ and @domain matches in multimap.
  561. * Fix issues with bounces From processing.
  562. * Fix abs/fabs misuse.
  563. * Fix builds on suse and arch linux distributions.
  564. 0.9.6:
  565. * Fix memory leak if mime cannot be parsed.
  566. * Fix dkim cache expiration.
  567. * Fix issues with redirector HTTP response.
  568. * Fix abnormal connection closing with certains messages with a high score
  569. (issue #296)
  570. * Fix redirector installation.
  571. * Use specific POE loop for some systems.
  572. * Fix number of issues in URL redirector.
  573. * Fix selecting URLs for sending to redirector.
  574. 0.9.5:
  575. * Avoid double free when extending HTTP message.
  576. * Fix double free if multiple classifiers are defined.
  577. * Fix misprint in spamassassin plugin.
  578. * Fix cpuid invocation on i386.
  579. * Fix ownership issues for zero-copy decode.
  580. * Allow __len metamethod on rspamd{text}.
  581. * Add base64 decoding lua utility.
  582. * Fix build on FreeBSD
  583. * Skip spaces at the beginning of mime messages.
  584. * DBL_ABUSE_REDIR should not have significant weight.
  585. * Allow to split by lua_regexp rspamd{text} objects.
  586. * Allow to specify custom stop pattern for lua_tcp.
  587. 0.9.4:
  588. * Fix critical bugs in tokenization algorithm
  589. * Write unit tests for tokenization
  590. * Add documentation for lua_tcp
  591. * Switch off legacy tokenization by default.
  592. * Fix critical bugs in words normalization
  593. * Add lua bindings to tokenizer.
  594. * Implement storing of HTTP headers inside task
  595. * Add lua API to accerss HTTP headers data
  596. * Implemented base64 encoding suitable for MIME
  597. * Use caseless hash and equal functions for HTTP request headers.
  598. * Improve debian architectures support (by @dottedmag)
  599. 0.9.3:
  600. * Revert incorrect regexp change that broke the default rules
  601. * Fix lua_tcp module
  602. 0.9.2:
  603. * Fix error on spawning unique workers.
  604. * Add preliminary version of generic LUA TCP requests API.
  605. * Use lua 5.1 if luajit is not available (Arm64, PowerPC, s390x etc)
  606. * Fix fuzzy mime strings with only type.
  607. * Improve thunderbird sanity checks.
  608. * Fix critical bug on matching regular expressions.
  609. * Make hiredis optional dependency.
  610. * Fix multiple bugs in daemon reloading
  611. 0.9.1:
  612. * Restore utf8 validation for regular expressions to avoid crashes
  613. * Fix symbols displaying in the interface
  614. * Add symbol groups to the interface
  615. * Fix maps ID parsing in the controller
  616. * Add multimap and regexp modules documentation
  617. * Backport fixes from libucl
  618. * Fix debian package (by @dottedmag)
  619. * Rework XXH32 invocations
  620. 0.9.0:
  621. * Add support of the fast and secure protocol level encryption:
  622. - curve25519 is used for key exchange;
  623. - chacha20/poly1305 cryptobox construction for bulk encryption;
  624. - zero latency overhead;
  625. - encrypting and balancing HTTP proxy worker
  626. * Rework expressions and create new expressions library:
  627. - aggressive optimizations based on the abstract syntax tree;
  628. - abstract expressions support (regular expressions, functions, lua modules
  629. composites and so on)
  630. - New comparision and '+' operators support
  631. - New greedy algorithm to minimize execution time of expressions and
  632. all symbols
  633. - Dynamic expressions benchmark and reoptimizations
  634. * Many improvements to the LUA API:
  635. - reworked logger module allowing to do pretty print of the most of lua
  636. types (including tables and userdata classes)
  637. - reworked lua redis and lua HTTP to support more features
  638. - added opaque type for passing large text chunks without copying
  639. - new regexp module with many auxiliary functions (e.g. `re:split`)
  640. * LuaJIT is now the default requirement for rspamd allowing to speed up lua
  641. execution by a large margin (however, plain lua is still supported)
  642. * New plugins:
  643. - spamassassin rules plugin that allows to load and re-use the most of
  644. SA rules natively
  645. - DMARC plugin that evaluates SPF and DKIM policies to the domain policies
  646. - many old plugins has been reworked to implement new features and improve
  647. stability
  648. * New aho-corasic trie implementation from @mischasan that allows to load and
  649. use hundreds of thousands of patterns with no influence on load
  650. * Support of PCRE JIT and PCRE JIT fast path modes that significantly improves
  651. the performance of regular expressions if supported by PCRE
  652. * New URLs parser and extractor:
  653. - removed legacy code that was useless for url finding
  654. - reworked algorithms of URL parsing for more precise and accurate results
  655. - added top-level-domains tree from http://publicsuffix.org
  656. - improved emails parsing
  657. - removed many phishing false positives due to TLD tree check
  658. * New statistics infrastructure:
  659. - created a separate layer of statistic library
  660. - improved OSB-Bayes by re-weighting tokens according to the original
  661. academic paper and `crm114` implementation, which reduced false positives
  662. rate significantly
  663. - created learn cache to avoid double learning of statistics and providing
  664. an efficient way to re-learn class for a message
  665. - created abstract layers for different statistics backends
  666. - implemented new tokenization algorithms with fast or secure (siphash)
  667. hashes to generate statistics features
  668. * Reworked utf8 tokenization that previously corrupted all UTF8 words (minor
  669. incompatibility with old fuzzy hashes with utf-8 symbols)
  670. * SPF module has been completely rewritten to support complex cases of
  671. `include` and `redirect` within SPF records
  672. * DKIM module now supports multiple signatures
  673. * Controller passwords can now be stored encrypted by `PBKDF2-HMAC` in the
  674. configuration file
  675. * Many hand-written HTTP clients has been replaced with the common rspamd
  676. http module
  677. * New test framework:
  678. - import lua `telescope` test framework
  679. - add unit tests for many rspamd modules and routines
  680. - create a unit test for each possible bug found
  681. - use luajit ffi for testing C code
  682. - added preliminary support of functional testing by creating tasks from lua
  683. * Randomize hash seed to avoid certain hash tables vulnerabilities
  684. * Documentation improvements:
  685. - added documentation for the vast majority of rspamd modules
  686. - added documentation for rspamd protocol
  687. - added documentation for the most of rspamd LUA extensions
  688. * Fixed tonns of bugs and memory leaks
  689. * Added tonns of minor features
  690. 0.8.3:
  691. * Various critical fixes in distribution (by @dottedmag and @fatalbanana)
  692. * Fixed bugs in url detector to parse certain patterns
  693. * Add default host and helo for a client
  694. * Some sanity checks for tokenizer and classifier
  695. * Reiterate on systemd support
  696. * Fix missing symbol registration
  697. * Add support of spamc compatible output
  698. * Filter double-dots in rbl.lua validate_dns (by @fatalbanana)
  699. * Update ucl submodule due to critical bugfix
  700. 0.8.2:
  701. * Create fuzzy db if it does not exist
  702. * Fix: Centos init script: configtest() (by @AlexeySa)
  703. * Enable one_shot for RECEIVED_SPAMHAUS_XBL - Fixes #102 (by @fatalbanana)
  704. * Update Exim patch (by @fatalbanana)
  705. * Fix processing of unix sockets.
  706. * Allow applying settings to authenticated users (by @fatalbanana)
  707. * Make settings priorities work as documented (by @fatalbanana)
  708. * Fix race condition in symbols planner
  709. * Add DNSWL_BLOCKED symbol (by @fatalbanana)
  710. * Make Exim pass usernames to rspamd (by @fatalbanana)
  711. * Update RBL module (by @fatalbanana):
  712. - fix indentation;
  713. - collapse loops;
  714. - avoid calling for un-needed information;
  715. - allow disabling RBLs for authenticated users
  716. * once_received.lua: Fix indentation & add exclusion for authenticated users (by @fatalbanana)
  717. * hfilter.lua: Add exclusion for authenticated users (by @AlexeySa)
  718. * Updates to hfilter rules (by @AlexeySa)
  719. * Set empty <> user or addr for msgs without FROM (by @eneq123)
  720. * Fix: attempt to index field '?' (a nil value) (by @eneq123)
  721. * Fix: if not exist Date-header (by @AlexeySa)
  722. * Add task:get_content() method.
  723. * rbl.lua: Ignore private IP space (by @fatalbanana)
  724. * Allow to check radix maps from lua by rspamd{ip}
  725. * Make local exclusions configurable per-RBL (by @fatalbanana)
  726. * Add rspamd_config:radix_from_config() (by @fatalbanana)
  727. * Support emails dnsbl in rbl (by @fatalbanana)
  728. * Complete rework of url extraction logic
  729. * Allow customizations for unix sockets. (fixes #182)
  730. * Set lua path according to rspamd settings.
  731. * Import lua-functional for plugins stuff.
  732. * Completely rewrite multimap plugin in functional style.
  733. * Fix FORGED_MUA_THUNDERBIRD_MSGID (fixes #186)
  734. * Check IPv6 addresses at dnswl.org and Spamhaus whitelist (by @fatalbanana)
  735. * Add lowercase utility for utf8 strings.
  736. * Various fixes to build system
  737. * Updated debian configuration infrastructure (by @dottedmag)
  738. 0.8.1:
  739. * Add sqlite and perl as dependencies for RPM/Debian packages (by @fatalbanana)
  740. * Remove whitelist.lua from RPM file list (by @fatalbanana)
  741. * Make Exim pass hostnames to rspamd (by @fatalbanana)
  742. * Fix building on Fedora (by @fatalbanana)
  743. * Add toggle for disabling installation of systemd units on Linux (by @fatalbanana)
  744. * Fix double format rounding that caused output corruption (reported by @fatalbanana)
  745. * Revert broken change for destructors ordering that led to memory corruption
  746. * Do not reset symbols case of settings if parsed from lua (reported by @andrejzverev)
  747. * Fix build on SunOS (by @wiedi)
  748. * Fix multiple crashes on broken DKIM DNS records
  749. * Fix critical issue with composites weights removing
  750. * Fix memory corruption in composites processing code
  751. * Ignore non-SPF TXT records when parsing SPF includes
  752. 0.8.0:
  753. * New fuzzy check logic:
  754. - use shingles algorithm for fuzzy matching
  755. - use blake2 instead of md5 for larger output space
  756. - combine fuzzy and strict matching
  757. - allow to organize private storages by means of keys
  758. - preserve compatibility with previous versions
  759. * New fuzzy storage:
  760. - use sqlite instead of own memory based hash tables
  761. - rework commands interface
  762. - add conversion from the old format
  763. - add fuzzy match by shignles
  764. - support old rspamd versions
  765. * Add lemmatizing for words used in fuzzy hashes that allows to improve match
  766. quality by using of the first forms of all words
  767. * Rework language detection
  768. * Fix several critical bugs, memory leaks and deadlocks:
  769. - memory leak in HTML nodes parsing
  770. - deadlock in logger code
  771. - deadlock in signals processing
  772. - crashes in fuzzy_storage
  773. - crashes in tokenizers if the input was empty
  774. * Import new libucl with several bugfixes and improvements
  775. * Support listening on ipv6 addresses only
  776. * Fix macro expansion in SPF module
  777. * Several bugfixes in DKIM module
  778. * Add load headers support for mime parts to the lua API
  779. * Add documentation for:
  780. - workers in general
  781. - fuzzy_storage worker
  782. - fuzzy_check plugin
  783. - mimepart and textpart lua API modules
  784. 0.7.6:
  785. * Apply boundary fix for dkim simple canonization
  786. * Fix ping command
  787. * Return nil if header was not found in lua_task
  788. * Fix hang in upstreams revive logic
  789. * Decode entitles when normalizing HTML parts
  790. * Fix logic of finding URLs in HTML parts
  791. * Do not include \0 into length of text when performing conversion to utf8
  792. * Fix raw vs parsed reperesentations
  793. Raw parts are now:
  794. - decoded b64/qp, but *NOT* converted to utf-8
  795. Processed parts are now:
  796. - converted to UTF-8
  797. - normalized if needed (e.g. HTML tags are stripped)
  798. * Rework DKIM canonization to line based
  799. * Fix fuzzy hashes addding
  800. * Use more specific hash function for fuzzy
  801. * Fix leaking of iconv descriptors
  802. * Fix PTR resolving in lua resolver
  803. * Rework spf module.
  804. - Copy data to memory pool as cached record might be destroyed causing
  805. freed memory being passed to the protocol output (use after free)
  806. - Allow SPF_NEUTRAL policy to be handled separately
  807. - Add R_SPF_NEUTRAL to the default config
  808. * Rework `register_symbols` function
  809. * Allow to disable components of hfilter
  810. 0.7.5:
  811. * Fix owner when creating folder /run/rspamd (by @sfirmery)
  812. * Fix IP validity checks
  813. * Decode URLs obtained from HTML tags
  814. * Fix crash with unweighted upstreams
  815. * Stop processing headers in parts
  816. * Set sockaddr.sa_family properly when connectig to upstreams
  817. * Fix reload issues in surbl and fuzzy_check (reported by @citrin)
  818. * Fix timeouts in redirector
  819. * Improve lua errors reporting
  820. * Fix lua closures processing in libucl
  821. * Rework calling of lua functions from regexp module
  822. * Choose raw regexp for raw headers
  823. * Rework conversion to utf since glib one is broken
  824. * Ignore SGML style tags in html
  825. * Fix old bug with non-capturing https urls
  826. * Fix memory corruption on fuzzy reload (reported by @citrin)
  827. * Fix percents display in rspamc
  828. * Fix buffer update for DKIM
  829. * Do not validate utf for raw headers
  830. 0.7.4:
  831. * Fix build under *BSD
  832. * Detect HAN unicode script
  833. * Implement language detection heuristic for text parts
  834. * Fix time output in history
  835. * Improve piechart coloring
  836. * Fix \r\n conversion in DKIM module (reported by @citrin)
  837. * Try to detect systems with no IPv6 support
  838. * Fix multiple/single values in use settings (reported by @citrin)
  839. * Rework IP addresses in upstreams:
  840. - Select ipv4/unix addresses if they exist and use ipv6 for ipv6 only
  841. upstreams (since the support of ipv6 is poor in many OSes and
  842. environments)
  843. - Free IP list on upstream destruction
  844. - Add test cases for addresses selection
  845. - Allow adding of free form IP addresses to upstreams
  846. * Fix endiannes in lua_radix search (reported by @citrin)
  847. * Soft shutdown should also set wanna_die flag (reported by @citrin)
  848. * Stop use-after-free in event loop termination
  849. * Fix processing of very short messages in DKIM (reported by @citrin)
  850. * Detect systems without shared mutexes
  851. * Fix issues with PTR and MX elements in SPF parser (reported by @citrin)
  852. 0.7.3:
  853. * New upstreams code:
  854. - simplify upstreams API;
  855. - unify strings parsing in upstreams definition;
  856. - add configuration options for the upstreams;
  857. - for failed upstreams re-resolve their addresses;
  858. - use all resolved addresses for an upstream (round-robin);
  859. - implement stable hashing and use it by default for upstreams;
  860. - add unit test for upstreams module.
  861. * Rework signals processing in all rspamd workers:
  862. - signals are now processed in the event loop;
  863. - implement the most common signal handlers for all workers;
  864. - add callbacks for workers specific signal handlers
  865. * Fix critical issue with fuzzy storage:
  866. Fuzzy stroage could not save any hashes on termination due to bugged
  867. signals handling
  868. * Fix roll history IP storage
  869. * Rework ipv4/ipv6 handling in parsing addresses:
  870. - turn off support of IPV6_V6ONLY socket option;
  871. - create ipv6 socket prior to ipv4 one to handle systems with v6/v4
  872. sockets enabled (Linux)
  873. * Remove CBL as it's wholly included in Spamhaus XBL (by @fatalbanana)
  874. * Remove nszones.com fake RBL (by @citrin)
  875. * Fix upstreams interaction for fuzzy_check
  876. * Verify spf PTR records (reported by @citrin)
  877. * Fix spf MX records parsing
  878. * Add compatibility for old libevent (by @yellowman)
  879. * Sync bugfixes from libucl
  880. 0.7.2:
  881. * Convert all maps to the compressed radix trie
  882. * Allow IPv6 addresses in IP maps
  883. * Remove dynamic items support from symbols cache
  884. * Allow hex encoded output of strings
  885. * Fix bug with control connections count
  886. * Process fuzzy weight correctly (reported by @fatalbanana)
  887. * Remove extra reference retain of http connection on error
  888. * Remove deprecated options from the default config
  889. * Add `one_shot` attr to metric's symbols
  890. * Doc: add documentation for metrics
  891. * Add Upstart job to debian packaging (by @CameronNemo)
  892. * Config: improve SURBL symbols descriptions (by @citrin)
  893. * Config: reflect SURBL changes (by @citrin):
  894. - Outblaze removed, malware moved to separate list:
  895. http://www.surbl.org/news/internal/MW-malware-sublist-added-to-multi
  896. * Fix C modules initialization on restart
  897. * Treat single IP as a single IP in radix lists (reported by @citrin)
  898. * Do not touch file and core limits if not asked explicitly (reported by @citrin)
  899. * Improve logging for fuzzy errors
  900. * Block SIGPIPE for HTTP writing
  901. * Doc: update manual pages
  902. * Fix HTTP connection termination
  903. * Reduce default number of parallel requests to 8
  904. * Sync with libucl include features
  905. 0.7.1:
  906. * Fix typo in stat output.
  907. * Fix issues with includes crossing with the system includes
  908. * Restore testing framework
  909. * Add radix trie test suite
  910. * Implement new path-compressed radix trie.
  911. - The performance benefit over the old algorithm is about 1.5 times.
  912. - Memory usage is significantly lower as well.
  913. - Now radix trie can accept any IPv4/IPv6 values
  914. * Various improvements to the memory pools code
  915. * Fix writing reply to a client when no filters are defined
  916. * Write base32 encoded fuzzy
  917. * Fix 'soft reject' action
  918. * Fix rspamd reload and modules reconfiguration
  919. * Fix subject rewriting for the default subject
  920. * Fix states for processing task and pre-filters
  921. * Fix issues with connection closing
  922. * Fix crashes in rdns
  923. * Fix ratelimit pre-filter
  924. * Update exim patch.
  925. - Update to the recent exim version
  926. - Strip extra leading src/ from the patch
  927. - Remove sendfile since it was broken
  928. - Fix rspamd spam report for exim
  929. * Improve documentation
  930. 0.7.0:
  931. * Use HTTP protocol for all operatiosn
  932. * Webui worker is now removed and controller works as webui
  933. * Allow to serve static files via controller by option `static_dir`
  934. * Rspamd interface is now a part of rspamd
  935. * Rspamc client has been rewritten to use HTTP and non-blocking mode
  936. allowing to start multiple operations simultaneously (see `-n` option)
  937. * Lua API was completely reworked to satisfy modern standards of LUA:
  938. * Module `lua-message` was removed
  939. * Reduced number of superglobals registered by rspamd
  940. * Many functions has been redesigned
  941. * Symbols registration is now more convenient
  942. * Users settings has been rewritten as lua plugin
  943. * Reworked headers system as gmime's based one misses many headers and is
  944. very slow to get headers values
  945. * Reorganized code and removed embedded jannsson by using UCL for all json
  946. parsing
  947. * Migrated to `librdns` for DNS resolving that improves concurrency for
  948. DNS requests significantly
  949. * Fixed tonns of bugs in MIME processing
  950. * Improved metrcis and default symbol's weights
  951. * Added new RBL's
  952. * Fixed a number of issues in the modules
  953. * Removed several memory leaks found
  954. * Fix unicode processing
  955. * Fix fuzzy checking for unicode parts
  956. * Significantly improve documentation and especially LUA API docs
  957. * See migration notes at https://rspamd.com/doc/migration.html
  958. 0.6.8:
  959. * Controller now listen for localhost and not for 127.0.0.1 by default
  960. * Allow FCrDNS-style RBL lookups (by @fatalbanana)
  961. * Reduce threshold for parts_differ function.
  962. * Fix hostname lookup for rdns rbl (by @AlexeySa)
  963. * Fix HFILTER_URL_ONELINE to reduce false positive rate.
  964. * Fix whitelist module.
  965. * Allow override system predefined settings without touching system ones
  966. by .try_include macro (by @andrejzverev)
  967. * Check for [ip.address]-style HELO and suppress lookups. (by
  968. @fatalbanana)
  969. * Optimize hfilter (by @AlexeySa)
  970. * Fix issue with random numbers generator in dns.
  971. * Use more clever time values to setup entropy.
  972. * Synced with the recent libucl.
  973. 0.6.7:
  974. * Use ChaCha20 for DNS generator (more secure DNS id)
  975. * Unknown symbols now has zero weight and not 1.0
  976. * Fix fuzzy hashes expire time
  977. * Fix critical issue in statfiles on FreeBSD 9 (and some other platforms)
  978. * Add .include_map macro to ucl parser
  979. * Update libucl
  980. * Fix headers end detection for DKIM module
  981. * Fix a bug in received headers parser
  982. * Validate IP addresses before pushing them to lua
  983. * Start new documentation project
  984. * Fixed tonns of other minor bugs
  985. * Start to prepare for 0.7 with HTTP protocol and new settings
  986. 0.6.6:
  987. * Removed issue with BUFSIZ limitation in the controller output
  988. * Simplify logging symbols escaping
  989. * Adjusted weights for several rules
  990. * Improve spamhaus rbl support
  991. * Removed PBL for received headers checks
  992. * Added hfilter module that performs various HELO and IP checks.
  993. * Rspamd can now be reloaded by HUP signal
  994. * Fuzzy storage should expire hashes properly
  995. * Build system has been reworked for better supportof pkg-config
  996. * Various minor bugfixes
  997. 0.6.5:
  998. * Fixed critical bug in DNS resolver, introduced in 0.6.4
  999. * Improved multimap and rbl plugins to skip
  1000. * Add dns_sockets option for tuning sockets per server in DNS resolver
  1001. * Improved packages for rspamd
  1002. 0.6.4:
  1003. * Added io channels for DNS request to balance load and reduce id
  1004. collisions chance
  1005. * Fixed a bug in SPF filter that may cause core dump in specific
  1006. circumstances
  1007. * FIxed default config for rbl module
  1008. * It is possible to get a list of rspamc commands with their descriptions
  1009. * Added SORBS bl to the default config
  1010. * 2tld file for surbl module has been significantly extended
  1011. * Perl modules has been removed from the code.
  1012. * Fixed an issue in libucl when parsing macros
  1013. 0.6.3:
  1014. * Fixed issues with DNS:
  1015. - labels decompression algorithm was fixed;
  1016. - added resolve_mx to lua API;
  1017. - fixed modules that use DNS.
  1018. * Lua modules once_received and emails reworked for new resolver API and UCL.
  1019. * Debian package was polished.
  1020. * Fixed a bug in fuzzy_check module that prevents correct processing messages
  1021. without valid parts.
  1022. 0.6.2:
  1023. * Fuzzy check module has been reworked:
  1024. - now fuzzy_check operates with a group of rules, that define which
  1025. servers sre to be checked;
  1026. - it is possible to specify read_only groups to avoid learning errors;
  1027. - turn fuzzy_check to one_shot mode permanently;
  1028. - fuzzy_check module configuration is now incompatible with the previous
  1029. versions.
  1030. * Imported bugfixes from libucl.
  1031. * Fixed whitelist plugin.
  1032. * Fixed statfiles resizing.
  1033. * Improved logging initialization order.
  1034. * Fixed race condition in the controller worker.
  1035. 0.6.1:
  1036. * Critical bugfixes:
  1037. - fixed build system;
  1038. - fixed in_class setting in bayes learning;
  1039. 0.6.0:
  1040. * Use UCL instead xml for configuration (https://github.com/vstakhov/libucl)
  1041. * Fix statistics module normalization
  1042. * Rework the many modules for the new configuration:
  1043. - surbl has incompatible configuration;
  1044. - fuzzy_check has incompatible configuration;
  1045. - multimap has now new configuration;
  1046. - received_rbl is removed and replaced by rbl module.
  1047. * Removed deprecated options:
  1048. - statfile_pool_size;
  1049. - action and required/reject score for a metric.
  1050. * Simplify build system and unify configuration for all platforms.
  1051. * Improved URL detector (reduced false positive rate).
  1052. * Lua 5.2 is now the default and fully supported version.
  1053. * Tons of bugfixes and minor improvements.
  1054. 0.5.6:
  1055. * Fix bug with counters incrementing in rolling history
  1056. * Detect expl and exp2l as some systems do not have it
  1057. * Support input streams without Content-Length
  1058. * Implement counters output via rspamc and controller interface
  1059. * Fix bug with udp sockets in fuzzy storage
  1060. 0.5.5:
  1061. * New bayes normalizator based on inverse chi-square function
  1062. * Various fixes to fuzzy storage
  1063. * Allow update fuzzy storage only from specific IP addresses
  1064. * Better support of IPv6 and address selection algorithms
  1065. * Add CentOS spec file
  1066. 0.5.4:
  1067. * Fixed issues with diff algorithm
  1068. * Added support of RRD statistics
  1069. * Add webui worker for interface interaction
  1070. * Fix a lot of issues with dynamic conf
  1071. * Fix critical memory leak in settings code
  1072. * Improve stability of the system
  1073. 0.5.3:
  1074. * Added dynamic options
  1075. * Added advanced metaclassfication
  1076. * Added RESTfull API for controller
  1077. * Improved hashing algorithms
  1078. * Various fixes for rspamc client:
  1079. - allow interacting with unix sockets
  1080. - librspamdclient major cleanup
  1081. - bayes is now default classifier
  1082. 0.5.2:
  1083. * Added lua bindings for:
  1084. - basic mime parts, that allows checkign attachements for example;
  1085. - DNS resolver;
  1086. * Existing lua bindings now works without task object allowing to use them
  1087. in custom code.
  1088. * Threads system was reworked to avoid global lua interpreter lock.
  1089. * DKIM module now converts all line endings to CRLF how opendkim does.
  1090. * URL detector is now more accurate for text parts.
  1091. * Several critical bugs and memory leaks were fixed.
  1092. 0.5.1:
  1093. * Added lua worker type to handle network connections in lua.
  1094. * Added lua bindings for async_session, IO dispatcher, memory_pool, and
  1095. worker.
  1096. * Composites can now uses other composites in expressions.
  1097. * Fixes for debian package and for FreeBSD >= 9.1
  1098. * Add support of gmime-2.6 if gmime-2.4 is not found.
  1099. * Improve url detection and phishing detection.
  1100. * Add lua mime_part library to get an access to all message part
  1101. attributes (like filename, length, type).
  1102. 0.5.0:
  1103. * Added SMTP lightweight balancing proxy with XCLIENT support.
  1104. * Added lua bindings for upstreams objects and API.
  1105. * New pre-filters are implemented to support initial checking for messages.
  1106. * Added ratelimit plugin that uses redis protocol to store data.
  1107. * Added ipv6 support to spf and some other modules.
  1108. * Unbreak spf plugin.
  1109. * Allow options with the same name be threated as list.
  1110. * DKIM plugin an parsing code was added.
  1111. * Separate build system to put logic in several shared libraries.
  1112. * Many bugfixes.
  1113. 0.3.2:
  1114. * Add error handling for regexps
  1115. * Fix quit command in controller interface
  1116. * Write symbols weights to rspamc output
  1117. * Improve logic of selecting rspamc version
  1118. * Do not try to parse broken DNS replies
  1119. * Add 'raw' flag to FROM_EXCESS_BASE64 rule (requested by citrin)
  1120. * Output message id in rspamc reply
  1121. * Fix inserting composite symbol
  1122. * Fix output of log line
  1123. * Document composites
  1124. * Add logging for fuzzy checks
  1125. * Add logging for learning
  1126. * Improve logic of learning messages - do not learn more than specific threshold
  1127. * Fix inserting results for symbols that were incorrectly (for example more than 1 time) defined in config file
  1128. * Do not output control characters if output is not terminal
  1129. * Fix some logic errors in learning
  1130. * Consider lua plugins errors as fatal configuration errors
  1131. * Fix wirting message id during fuzzy_add command
  1132. * Display weight of symbols correctly
  1133. * Fixes to winnow learning
  1134. * One more try to improve accuracy of winnow algorithm
  1135. * Add bayesian classifier (initial version)
  1136. * Remove normalizer as it is winnow specific thing, so all statistic algorithms now returns value from 0 to 1
  1137. * Some fixes to fuzzy hashes expiration:
  1138. * Fix assertion while look up value in NULL hash (found by cirtin)
  1139. * Fix normalization for systems that have not tanhl function
  1140. * Ignore rfc822 group addresses
  1141. * Move images library to core rspamd
  1142. * Add lua api to access images properties
  1143. * Add post filters to lua API - filters that would be called after all message's processing
  1144. * Add ability to check for specified symbol in task results from lua
  1145. * Add ability to check for metric's results from lua
  1146. * Add ability to learn specified statfile form lua
  1147. * Add ability to extract filename and size of images from lua
  1148. * Fix assertion while extracting internet address
  1149. * Fix races in fuzzy storage
  1150. * Make spf parser case insensitive
  1151. * Add ability to check hashes of selected mime types
  1152. * Add ability to set minimum size in bytes for mime types
  1153. * Add ability to set minimum dimensions for images
  1154. * Assume all text/* content types as text/plain
  1155. * Fix getting data wrapper for gmime24
  1156. * Many fixes to statfile syncronization system
  1157. * Fixed statfile pool initialization and synchronization with disk
  1158. * Prepare 0.3.2
  1159. * Fix Mail::Rspamd::Config for new rspamd features
  1160. * Use Mail::Rspamd::Config in rspamc client
  1161. * Write user's name to rspamd log
  1162. * Prepare rspamd build infrastructure for creating rpm and deb packages
  1163. * Fix depends
  1164. * Add start script for linux systems
  1165. * Fix shared usage of statfiles
  1166. * Add invalidation of statfiles in case of learning, so now statfiles
  1167. * This should fix shared usage of statfile pool by several processes
  1168. * Fix misprint (reported by az)
  1169. * Fix stupid error when all checks can be done in a single pass
  1170. * New trie based url scanner (based on libcamel)
  1171. * Small fixes to rspamd perl client
  1172. * Write fuzzy hashes info to log
  1173. * Add trie interface to lua api
  1174. * Explain sample config and cleanup it
  1175. 0.3.1:
  1176. * Add modules documentation
  1177. * Continue implementing smtp proxy
  1178. * Implement new learning system, now rspamd should be much more intelligent while learning messages
  1179. * Convert statistic sums to use long double for counters
  1180. * Use hyperbolic tangent for internal normalizer
  1181. * In classify normalize result after comparing, not before
  1182. * New symbols sorter
  1183. * Fix strict aliasing while compiling with optimization
  1184. * Fix tanhl detection for platforms that have not implementation of it
  1185. * Remove several compile warnings
  1186. * Add experimental support of dynamic rules to regexp module
  1187. * Document views configuration
  1188. * Several fixes to documentation
  1189. * Add more logic for dynamic rules
  1190. * Add documentation for dynamic rules
  1191. * Add ability to make negations in networks in dynamic rules
  1192. * Clean up cache items correctly
  1193. * Implement basic SMTP dialog:
  1194. * Implement interaction with smtp upstream (with support of XCLIENT)
  1195. * Check messages received via smtp proxy
  1196. * Add support for sendfile in io dispatcher
  1197. * Fix issues with compatibility of worker_task and smtp proxy
  1198. * Proxy DATA command
  1199. * Fix SMTP
  1200. * Change metric logic
  1201. * Completely remove lex/yacc readers for config
  1202. * Make common sense of metric/action and symbols
  1203. * Sync changes with all plugins
  1204. * Incorrectly removed in previous commit
  1205. * Fix misprint (by Andrej Zverev)
  1206. * announce the "password" keyword in usage list
  1207. * Implement initial version of greylisting triplets storage
  1208. * Fix issues with smtp worker
  1209. * Fix QUIT command in SMTP worker
  1210. * Some fixes about new metrics system (may be incomplete)
  1211. * Get weights of symbol from default metric for symbols cache
  1212. * Fix setting task->from/task->rctp in smtp client
  1213. * Copy from and rcpt correctly
  1214. * Some performance improvements to IO dispatcher (do not drain the whole buffer after a single line readed)
  1215. * Fix smtp data input
  1216. * Fix misprint
  1217. * Add limit of maximum allowed smtp session errors
  1218. * New logic of SURBL module:
  1219. * Use system mkstemp(3) on systems where it is available as glib implementation
  1220. * Try to fix memmove issues in io dispatcher
  1221. * Remove debug from SURBL module
  1222. * Rewrite buffered input for line policy (again)
  1223. * Fix issue with links that are ip addresses in numeric form in surbl
  1224. * On Darwin use BSD style sendfile definition
  1225. * Reorganize platform specific knobs in CMakeLists
  1226. * Use gettimeofday on systems that have not clock_getres
  1227. * Use ftime for dns trans id generation on systems without clock_getres
  1228. * Darwin sendfile(2) support
  1229. * TIMEDB->TIMEB
  1230. * More to previous commit
  1231. * Pass env from main() arguments instead of platform specific global environ
  1232. * Fix compatibility issues
  1233. * Fix -lintl detection
  1234. * Init some variables to avoid problems
  1235. * Remove garbadge (gnome terminal sucks)
  1236. * Add more information about why we drop smtp connection
  1237. * Fix mkstemp call
  1238. * Send to upstream QUIT command at the end of session
  1239. * Check return value of each rspamd_dispatcher_write as in case of write errors sessions can be destroyed early
  1240. * Fix states in smtp dialog
  1241. * Use rspamd_snprintf instead of libc one
  1242. * Fix URLS command
  1243. * Fix reconfigure process of surbl module
  1244. * Fix destroying smtp session (unmap memory and do not delete pool early)
  1245. * Delete pool after using its variables
  1246. * Delay timer must be registered in async session to correctly handle connection termination
  1247. * Register dns requests in session too
  1248. * Make session before registering events
  1249. * Remove events in handlers
  1250. * Add ability to set filters for smtp worker for each smtp stage
  1251. * Add very initial version of DNS resolver (many things to be done)
  1252. * Announce weights and sync
  1253. * Fix few typo
  1254. * Understand short names of facility in logging config
  1255. * Add ability to make whitelist for spf checks
  1256. * Misprint != -> ==
  1257. * Handle lua tag in way that it is not required to write additional text:
  1258. * Strip all starting whitespace symbols from xml texts
  1259. * Fix stupid bug in calculating buffer length while reading file maps
  1260. * Add resolv.conf parsing into dns.c
  1261. * Fix microseconds<->milliseconds conversions
  1262. * Take callback argument in Mail::Rspamd::Client for processing files and directories
  1263. * Print results if rspamc is called for a directory
  1264. * Fix stupid error with surbl module reconfig (another one, blame me)
  1265. * Do not show duplicate urls in url header
  1266. * Fix detection of numeric urls (reported by citrin)
  1267. * Write real time of message's scan to log (not only virtual)
  1268. * Fix chartable module in utf mode
  1269. * Fix parsing of some broken urls
  1270. * Add ability to test regexp with 'T' flag
  1271. * Write more code for DNS resolver:
  1272. * Make DNS resolver working
  1273. * Many improvements to rspamd test suite: now it CAN be used for testing rspamd functionality
  1274. * Write DNS resolver tests
  1275. * Fix issues with memory_pool mutexes and with creating of statfiles
  1276. * Forgotten in previous commit
  1277. * Add support for parsing SPF and SRV records
  1278. * Fix PTR parsing
  1279. * Add tests
  1280. * Make SURBL module to use rspamd dns module
  1281. * Several fixes to DNS logic
  1282. * Remove evdns and use only rspamd resolver
  1283. * Very hard to detect problem with race among error in socket and destroying task while we are writing to socket and go through a hash table
  1284. * Fix resolving in smtp module
  1285. * Init events before configuring resolver in smtp worker
  1286. * Set resolver inside task
  1287. * Fix reload signal (reported by citrin)
  1288. * Some improvements to redirector
  1289. * Call has_forked method to inform POE about fork
  1290. * Fix lua DNS code
  1291. * Decompress labels in DNS packets more strictly
  1292. * Fix some problems with TXT records
  1293. * Try to fix removing of DNS events
  1294. * Do not insert unparsed RR's into reply
  1295. * Calling callbacks may cause destroying session from which we are calling callback so we MUST call callback as the latest action
  1296. * Fix check_smtp_data function
  1297. * Add ability to make views by recipient
  1298. * Add ability to set metric's action from config file
  1299. * Fix bug with writing garbadge if message has no urls or no messages
  1300. * Fix bug with incorrect behaviour of compare_parts_distance function
  1301. * Add ability to assign several actions to one metric
  1302. * Report action in rspamc protocol
  1303. * Mail::Rspamd::Client and rspamc can now understand Action header too
  1304. * Write action to log as well
  1305. * Make valgrind happy about comparing symbols
  1306. * Add more debug to comparing parts distance function
  1307. * Write action even if message has no symbols
  1308. * Make improvements to HTML entites decoder: now it replaces entities with common characters and
  1309. * Add -d option to force debug output
  1310. * Assume 7bit as default transfer encoding
  1311. * Do not overwrite lua plugins and configs if they already exists in target directory
  1312. * Improve logging
  1313. * Write queue id to log
  1314. * Remove test messages from cmake
  1315. * Reopen log file by USR1 signal
  1316. * Add reopenlog method to FreeBSD rc script
  1317. * Adopt foreach for cmake 2.6
  1318. * Fix to rc script
  1319. * Do not try to resolve names with several dots in a row
  1320. * Fix surbl request formatting for ip addresses
  1321. * Handle cases of broken requests
  1322. * Fix problems with parsing compressed names
  1323. * Fix TXT records parsing
  1324. * Fix expanding spf macros that may fail in rare cases
  1325. * Fix another error with early task destroying
  1326. * Handle empty from header
  1327. * Improve reopenlog command in rc script
  1328. * Strip trailing whitespace characters in Mail::Rspamd::Client
  1329. * Use ungreedy match to strip trailing whitespaces
  1330. * Stupid error in calculation compressed label length
  1331. * Some optimizations to client library
  1332. * Do not compare empty parts
  1333. * Empty and non-empty parts are allways different
  1334. * Save in regexp cache the whole regexp with header name (if exists) and with flags
  1335. * Add rspamd_log variable to lua plugins to access logging functions
  1336. * Each part in rspamd task now can have parent part
  1337. * Check for parts distance only for multipart/alternative subparts
  1338. * Do not check attachements even if they are text (but attached as file)
  1339. * Do not die if write (2) returned ENOSPACE while doing logging, turn on throttling mode instead (1 write try in a second)
  1340. * Add ability to turn on debug for specific symbols
  1341. * Add ability to configure dns timeouts and dns retransmits in config file
  1342. * More debug
  1343. * Fix extracting arguments in lua logger interface
  1344. * Turn off debug_ip during reload if it was disabled by new config
  1345. * Improve lua logging
  1346. * Pre-init symbols cache when rereading config
  1347. * Fix lua representing of invalid ip (nil, not 255.255.255.255)
  1348. * Fix R_TO_SEEMS_AUTO rule (by citrin)
  1349. * Add multimap lua plugin
  1350. * Fix some multimap issues
  1351. * Try to save images hashes to fuzzy storage to stop some annoying spammers
  1352. * Allocate some more bytes for read buffer to avoid incorrect behavoiur
  1353. * Add ability to check dns black lists by multimap module
  1354. * Add multimap documentation
  1355. * Fix labels parsing
  1356. * Another try to save regexps in cache correctly
  1357. * Improve test logs for regexps
  1358. * Fix parsing txt records to avoid reading of uninitialized data
  1359. * Fix error with writing symbols cache file
  1360. * Fix error while working in utf mode when raw regexps was not created properly
  1361. * Do not add extra byte while converting text to utf
  1362. * Add error handling for regexps