You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.

ChangeLog 14KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282283284285286287288289290291292293294295296297298299300301302303304305306307308309310311312313314315316
  1. 0.5.6:
  2. * Fix bug with counters incrementing in rolling history
  3. * Detect expl and exp2l as some systems do not have it
  4. * Support input streams without Content-Length
  5. * Implement counters output via rspamc and controller interface
  6. * Fix bug with udp sockets in fuzzy storage
  7. 0.5.5:
  8. * New bayes normalizator based on inverse chi-square function
  9. * Various fixes to fuzzy storage
  10. * Allow update fuzzy storage only from specific IP addresses
  11. * Better support of IPv6 and address selection algorithms
  12. * Add CentOS spec file
  13. 0.5.4:
  14. * Fixed issues with diff algorithm
  15. * Added support of RRD statistics
  16. * Add webui worker for interface interaction
  17. * Fix a lot of issues with dynamic conf
  18. * Fix critical memory leak in settings code
  19. * Improve stability of the system
  20. 0.5.3:
  21. * Added dynamic options
  22. * Added advanced metaclassfication
  23. * Added RESTfull API for controller
  24. * Improved hashing algorithms
  25. * Various fixes for rspamc client:
  26. - allow interacting with unix sockets
  27. - librspamdclient major cleanup
  28. - bayes is now default classifier
  29. 0.5.2:
  30. * Added lua bindings for:
  31. - basic mime parts, that allows checkign attachements for example;
  32. - DNS resolver;
  33. * Existing lua bindings now works without task object allowing to use them
  34. in custom code.
  35. * Threads system was reworked to avoid global lua interpreter lock.
  36. * DKIM module now converts all line endings to CRLF how opendkim does.
  37. * URL detector is now more accurate for text parts.
  38. * Several critical bugs and memory leaks were fixed.
  39. 0.5.1:
  40. * Added lua worker type to handle network connections in lua.
  41. * Added lua bindings for async_session, IO dispatcher, memory_pool, and
  42. worker.
  43. * Composites can now uses other composites in expressions.
  44. * Fixes for debian package and for FreeBSD >= 9.1
  45. * Add support of gmime-2.6 if gmime-2.4 is not found.
  46. * Improve url detection and phishing detection.
  47. * Add lua mime_part library to get an access to all message part
  48. attributes (like filename, length, type).
  49. 0.5.0:
  50. * Added SMTP lightweight balancing proxy with XCLIENT support.
  51. * Added lua bindings for upstreams objects and API.
  52. * New pre-filters are implemented to support initial checking for messages.
  53. * Added ratelimit plugin that uses redis protocol to store data.
  54. * Added ipv6 support to spf and some other modules.
  55. * Unbreak spf plugin.
  56. * Allow options with the same name be threated as list.
  57. * DKIM plugin an parsing code was added.
  58. * Separate build system to put logic in several shared libraries.
  59. * Many bugfixes.
  60. 0.3.2:
  61. * Add error handling for regexps
  62. * Fix quit command in controller interface
  63. * Write symbols weights to rspamc output
  64. * Improve logic of selecting rspamc version
  65. * Do not try to parse broken DNS replies
  66. * Add 'raw' flag to FROM_EXCESS_BASE64 rule (requested by citrin)
  67. * Output message id in rspamc reply
  68. * Fix inserting composite symbol
  69. * Fix output of log line
  70. * Document composites
  71. * Add logging for fuzzy checks
  72. * Add logging for learning
  73. * Improve logic of learning messages - do not learn more than specific threshold
  74. * Fix inserting results for symbols that were incorrectly (for example more than 1 time) defined in config file
  75. * Do not output control characters if output is not terminal
  76. * Fix some logic errors in learning
  77. * Consider lua plugins errors as fatal configuration errors
  78. * Fix wirting message id during fuzzy_add command
  79. * Display weight of symbols correctly
  80. * Fixes to winnow learning
  81. * One more try to improve accuracy of winnow algorithm
  82. * Add bayesian classifier (initial version)
  83. * Remove normalizer as it is winnow specific thing, so all statistic algorithms now returns value from 0 to 1
  84. * Some fixes to fuzzy hashes expiration:
  85. * Fix assertion while look up value in NULL hash (found by cirtin)
  86. * Fix normalization for systems that have not tanhl function
  87. * Ignore rfc822 group addresses
  88. * Move images library to core rspamd
  89. * Add lua api to access images properties
  90. * Add post filters to lua API - filters that would be called after all message's processing
  91. * Add ability to check for specified symbol in task results from lua
  92. * Add ability to check for metric's results from lua
  93. * Add ability to learn specified statfile form lua
  94. * Add ability to extract filename and size of images from lua
  95. * Fix assertion while extracting internet address
  96. * Fix races in fuzzy storage
  97. * Make spf parser case insensitive
  98. * Add ability to check hashes of selected mime types
  99. * Add ability to set minimum size in bytes for mime types
  100. * Add ability to set minimum dimensions for images
  101. * Assume all text/* content types as text/plain
  102. * Fix getting data wrapper for gmime24
  103. * Many fixes to statfile syncronization system
  104. * Fixed statfile pool initialization and synchronization with disk
  105. * Prepare 0.3.2
  106. * Fix Mail::Rspamd::Config for new rspamd features
  107. * Use Mail::Rspamd::Config in rspamc client
  108. * Write user's name to rspamd log
  109. * Prepare rspamd build infrastructure for creating rpm and deb packages
  110. * Fix depends
  111. * Add start script for linux systems
  112. * Fix shared usage of statfiles
  113. * Add invalidation of statfiles in case of learning, so now statfiles
  114. * This should fix shared usage of statfile pool by several processes
  115. * Fix misprint (reported by az)
  116. * Fix stupid error when all checks can be done in a single pass
  117. * New trie based url scanner (based on libcamel)
  118. * Small fixes to rspamd perl client
  119. * Write fuzzy hashes info to log
  120. * Add trie interface to lua api
  121. * Explain sample config and cleanup it
  122. 0.3.1:
  123. * Add modules documentation
  124. * Continue implementing smtp proxy
  125. * Implement new learning system, now rspamd should be much more intelligent while learning messages
  126. * Convert statistic sums to use long double for counters
  127. * Use hyperbolic tangent for internal normalizer
  128. * In classify normalize result after comparing, not before
  129. * New symbols sorter
  130. * Fix strict aliasing while compiling with optimization
  131. * Fix tanhl detection for platforms that have not implementation of it
  132. * Remove several compile warnings
  133. * Add experimental support of dynamic rules to regexp module
  134. * Document views configuration
  135. * Several fixes to documentation
  136. * Add more logic for dynamic rules
  137. * Add documentation for dynamic rules
  138. * Add ability to make negations in networks in dynamic rules
  139. * Clean up cache items correctly
  140. * Implement basic SMTP dialog:
  141. * Implement interaction with smtp upstream (with support of XCLIENT)
  142. * Check messages received via smtp proxy
  143. * Add support for sendfile in io dispatcher
  144. * Fix issues with compatibility of worker_task and smtp proxy
  145. * Proxy DATA command
  146. * Fix SMTP
  147. * Change metric logic
  148. * Completely remove lex/yacc readers for config
  149. * Make common sense of metric/action and symbols
  150. * Sync changes with all plugins
  151. * Incorrectly removed in previous commit
  152. * Fix misprint (by Andrej Zverev)
  153. * announce the "password" keyword in usage list
  154. * Implement initial version of greylisting triplets storage
  155. * Fix issues with smtp worker
  156. * Fix QUIT command in SMTP worker
  157. * Some fixes about new metrics system (may be incomplete)
  158. * Get weights of symbol from default metric for symbols cache
  159. * Fix setting task->from/task->rctp in smtp client
  160. * Copy from and rcpt correctly
  161. * Some performance improvements to IO dispatcher (do not drain the whole buffer after a single line readed)
  162. * Fix smtp data input
  163. * Fix misprint
  164. * Add limit of maximum allowed smtp session errors
  165. * New logic of SURBL module:
  166. * Use system mkstemp(3) on systems where it is available as glib implementation
  167. * Try to fix memmove issues in io dispatcher
  168. * Remove debug from SURBL module
  169. * Rewrite buffered input for line policy (again)
  170. * Fix issue with links that are ip addresses in numeric form in surbl
  171. * On Darwin use BSD style sendfile definition
  172. * Reorganize platform specific knobs in CMakeLists
  173. * Use gettimeofday on systems that have not clock_getres
  174. * Use ftime for dns trans id generation on systems without clock_getres
  175. * Darwin sendfile(2) support
  176. * TIMEDB->TIMEB
  177. * More to previous commit
  178. * Pass env from main() arguments instead of platform specific global environ
  179. * Fix compatibility issues
  180. * Fix -lintl detection
  181. * Init some variables to avoid problems
  182. * Remove garbadge (gnome terminal sucks)
  183. * Add more information about why we drop smtp connection
  184. * Fix mkstemp call
  185. * Send to upstream QUIT command at the end of session
  186. * Check return value of each rspamd_dispatcher_write as in case of write errors sessions can be destroyed early
  187. * Fix states in smtp dialog
  188. * Use rspamd_snprintf instead of libc one
  189. * Fix URLS command
  190. * Fix reconfigure process of surbl module
  191. * Fix destroying smtp session (unmap memory and do not delete pool early)
  192. * Delete pool after using its variables
  193. * Delay timer must be registered in async session to correctly handle connection termination
  194. * Register dns requests in session too
  195. * Make session before registering events
  196. * Remove events in handlers
  197. * Add ability to set filters for smtp worker for each smtp stage
  198. * Add very initial version of DNS resolver (many things to be done)
  199. * Announce weights and sync
  200. * Fix few typo
  201. * Understand short names of facility in logging config
  202. * Add ability to make whitelist for spf checks
  203. * Misprint != -> ==
  204. * Handle lua tag in way that it is not required to write additional text:
  205. * Strip all starting whitespace symbols from xml texts
  206. * Fix stupid bug in calculating buffer length while reading file maps
  207. * Add resolv.conf parsing into dns.c
  208. * Fix microseconds<->milliseconds conversions
  209. * Take callback argument in Mail::Rspamd::Client for processing files and directories
  210. * Print results if rspamc is called for a directory
  211. * Fix stupid error with surbl module reconfig (another one, blame me)
  212. * Do not show duplicate urls in url header
  213. * Fix detection of numeric urls (reported by citrin)
  214. * Write real time of message's scan to log (not only virtual)
  215. * Fix chartable module in utf mode
  216. * Fix parsing of some broken urls
  217. * Add ability to test regexp with 'T' flag
  218. * Write more code for DNS resolver:
  219. * Make DNS resolver working
  220. * Many improvements to rspamd test suite: now it CAN be used for testing rspamd functionality
  221. * Write DNS resolver tests
  222. * Fix issues with memory_pool mutexes and with creating of statfiles
  223. * Forgotten in previous commit
  224. * Add support for parsing SPF and SRV records
  225. * Fix PTR parsing
  226. * Add tests
  227. * Make SURBL module to use rspamd dns module
  228. * Several fixes to DNS logic
  229. * Remove evdns and use only rspamd resolver
  230. * Very hard to detect problem with race among error in socket and destroying task while we are writing to socket and go through a hash table
  231. * Fix resolving in smtp module
  232. * Init events before configuring resolver in smtp worker
  233. * Set resolver inside task
  234. * Fix reload signal (reported by citrin)
  235. * Some improvements to redirector
  236. * Call has_forked method to inform POE about fork
  237. * Fix lua DNS code
  238. * Decompress labels in DNS packets more strictly
  239. * Fix some problems with TXT records
  240. * Try to fix removing of DNS events
  241. * Do not insert unparsed RR's into reply
  242. * Calling callbacks may cause destroying session from which we are calling callback so we MUST call callback as the latest action
  243. * Fix check_smtp_data function
  244. * Add ability to make views by recipient
  245. * Add ability to set metric's action from config file
  246. * Fix bug with writing garbadge if message has no urls or no messages
  247. * Fix bug with incorrect behaviour of compare_parts_distance function
  248. * Add ability to assign several actions to one metric
  249. * Report action in rspamc protocol
  250. * Mail::Rspamd::Client and rspamc can now understand Action header too
  251. * Write action to log as well
  252. * Make valgrind happy about comparing symbols
  253. * Add more debug to comparing parts distance function
  254. * Write action even if message has no symbols
  255. * Make improvements to HTML entites decoder: now it replaces entities with common characters and
  256. * Add -d option to force debug output
  257. * Assume 7bit as default transfer encoding
  258. * Do not overwrite lua plugins and configs if they already exists in target directory
  259. * Improve logging
  260. * Write queue id to log
  261. * Remove test messages from cmake
  262. * Reopen log file by USR1 signal
  263. * Add reopenlog method to FreeBSD rc script
  264. * Adopt foreach for cmake 2.6
  265. * Fix to rc script
  266. * Do not try to resolve names with several dots in a row
  267. * Fix surbl request formatting for ip addresses
  268. * Handle cases of broken requests
  269. * Fix problems with parsing compressed names
  270. * Fix TXT records parsing
  271. * Fix expanding spf macros that may fail in rare cases
  272. * Fix another error with early task destroying
  273. * Handle empty from header
  274. * Improve reopenlog command in rc script
  275. * Strip trailing whitespace characters in Mail::Rspamd::Client
  276. * Use ungreedy match to strip trailing whitespaces
  277. * Stupid error in calculation compressed label length
  278. * Some optimizations to client library
  279. * Do not compare empty parts
  280. * Empty and non-empty parts are allways different
  281. * Save in regexp cache the whole regexp with header name (if exists) and with flags
  282. * Add rspamd_log variable to lua plugins to access logging functions
  283. * Each part in rspamd task now can have parent part
  284. * Check for parts distance only for multipart/alternative subparts
  285. * Do not check attachements even if they are text (but attached as file)
  286. * Do not die if write (2) returned ENOSPACE while doing logging, turn on throttling mode instead (1 write try in a second)
  287. * Add ability to turn on debug for specific symbols
  288. * Add ability to configure dns timeouts and dns retransmits in config file
  289. * More debug
  290. * Fix extracting arguments in lua logger interface
  291. * Turn off debug_ip during reload if it was disabled by new config
  292. * Improve lua logging
  293. * Pre-init symbols cache when rereading config
  294. * Fix lua representing of invalid ip (nil, not 255.255.255.255)
  295. * Fix R_TO_SEEMS_AUTO rule (by citrin)
  296. * Add multimap lua plugin
  297. * Fix some multimap issues
  298. * Try to save images hashes to fuzzy storage to stop some annoying spammers
  299. * Allocate some more bytes for read buffer to avoid incorrect behavoiur
  300. * Add ability to check dns black lists by multimap module
  301. * Add multimap documentation
  302. * Fix labels parsing
  303. * Another try to save regexps in cache correctly
  304. * Improve test logs for regexps
  305. * Fix parsing txt records to avoid reading of uninitialized data
  306. * Fix error with writing symbols cache file
  307. * Fix error while working in utf mode when raw regexps was not created properly
  308. * Do not add extra byte while converting text to utf
  309. * Add error handling for regexps