* New fuzzy check logic:
	- use shingles algorithm for fuzzy matching
	- use blake2 instead of md5 for larger output space
	- combine fuzzy and strict matching
	- allow to organize private storages by means of keys
	- preserve compatibility with previous versions
* New fuzzy storage:
	- use sqlite instead of own memory based hash tables
	- rework commands interface
	- add conversion from the old format
	- add fuzzy match by shignles
	- support old rspamd versions
* Add lemmatizing for words used in fuzzy hashes that allows to improve match
quality by using of the first forms of all words
* Rework language detection
* Fix several critical bugs, memory leaks and deadlocks:
	- memory leak in HTML nodes parsing
	- deadlock in logger code
	- deadlock in signals processing
	- crashes in fuzzy_storage
	- crashes in tokenizers if the input was empty
* Import new libucl with several bugfixes and improvements
* Support listening on ipv6 addresses only
* Fix macro expansion in SPF module
* Several bugfixes in DKIM module
* Add load headers support for mime parts to the lua API
* Add documentation for:
	- workers in general
	- fuzzy_storage worker
	- fuzzy_check plugin
	- mimepart and textpart lua API modules

Signed-off-by: Vsevolod Stakhov <vsevolod@highsecure.ru>

* Apply boundary fix for dkim simple canonization
* Fix ping command
* Return nil if header was not found in lua_task
* Fix hang in upstreams revive logic
* Decode entitles when normalizing HTML parts
* Fix logic of finding URLs in HTML parts
* Do not include \0 into length of text when performing conversion to utf8
* Fix raw vs parsed reperesentations
	Raw parts are now:
		- decoded b64/qp, but *NOT* converted to utf-8
	Processed parts are now:
		- converted to UTF-8
		- normalized if needed (e.g. HTML tags are stripped)
* Rework DKIM canonization to line based
* Fix fuzzy hashes addding
* Use more specific hash function for fuzzy
* Fix leaking of iconv descriptors
* Fix PTR resolving in lua resolver
* Rework spf module.
	- Copy data to memory pool as cached record might be destroyed causing
	    freed memory being passed to the protocol output (use after free)
	- Allow SPF_NEUTRAL policy to be handled separately
	- Add R_SPF_NEUTRAL to the default config
* Rework `register_symbols` function
* Allow to disable components of hfilter

Signed-off-by: Vsevolod Stakhov <vsevolod@highsecure.ru>

* Fix owner when creating folder /run/rspamd (by @sfirmery)
* Fix IP validity checks
* Decode URLs obtained from HTML tags
* Fix crash with unweighted upstreams
* Stop processing headers in parts
* Set sockaddr.sa_family properly when connectig to upstreams
* Fix reload issues in surbl and fuzzy_check (reported by @citrin)
* Fix timeouts in redirector
* Improve lua errors reporting
* Fix lua closures processing in libucl
* Rework calling of lua functions from regexp module
* Choose raw regexp for raw headers
* Rework conversion to utf since glib one is broken
* Ignore SGML style tags in html
* Fix old bug with non-capturing https urls
* Fix memory corruption on fuzzy reload (reported by @citrin)
* Fix percents display in rspamc
* Fix buffer update for DKIM
* Do not validate utf for raw headers

Signed-off-by: Vsevolod Stakhov <vsevolod@highsecure.ru>

* New upstreams code:
	- simplify upstreams API;
	- unify strings parsing in upstreams definition;
	- add configuration options for the upstreams;
	- for failed upstreams re-resolve their addresses;
	- use all resolved addresses for an upstream (round-robin);
	- implement stable hashing and use it by default for upstreams;
	- add unit test for upstreams module.
* Rework signals processing in all rspamd workers:
	- signals are now processed in the event loop;
	- implement the most common signal handlers for all workers;
	- add callbacks for workers specific signal handlers
*  Fix critical issue with fuzzy storage:
	Fuzzy stroage could not save any hashes on termination due to bugged
	signals handling
* Fix roll history IP storage
* Rework ipv4/ipv6 handling in parsing addresses:
	    - turn off support of IPV6_V6ONLY socket option;
	    - create ipv6 socket prior to ipv4 one to handle systems with v6/v4
	    sockets enabled (Linux)
* Remove CBL as it's wholly included in Spamhaus XBL (by @fatalbanana)
* Remove nszones.com fake RBL (by @citrin)
* Fix upstreams interaction for fuzzy_check
* Verify spf PTR records (reported by @citrin)
* Fix spf MX records parsing
* Add compatibility for old libevent (by @yellowman)
* Sync bugfixes from libucl

Signed-off-by: Vsevolod Stakhov <vsevolod@highsecure.ru>

* Fix typo in stat output.
* Fix issues with includes crossing with the system includes
* Restore testing framework
* Add radix trie test suite
* Implement new path-compressed radix trie.
    - The performance benefit over the old algorithm is about 1.5 times.
        - Memory usage is significantly lower as well.
    - Now radix trie can accept any IPv4/IPv6 values
* Various improvements to the memory pools code
* Fix writing reply to a client when no filters are defined
* Write base32 encoded fuzzy
* Fix 'soft reject' action
* Fix rspamd reload and modules reconfiguration
* Fix subject rewriting for the default subject
* Fix states for processing task and pre-filters
* Fix issues with connection closing
* Fix crashes in rdns
* Fix ratelimit pre-filter
* Update exim patch.
        - Update to the recent exim version
        - Strip extra leading src/ from the patch
        - Remove sendfile since it was broken
        - Fix rspamd spam report for exim
* Improve documentation

Signed-off-by: Vsevolod Stakhov <vsevolod@highsecure.ru>

There is no significant advantage to use Judy arrays over glib
HashTables to store hashes in fuzzy storage. Therefore, drop support of
Judy completely. Also rename `use_judy` parameter to `strict_hash`
indicating that hashes are matched strictly (not a fuzzy match but a hash
lookup).

Now there is a way to specify cmake to skip linking with undesired
libraries.

Fix rpm spec to include libevent and optional Judy.

--HG--
rename : centos/sources/rspam.logrotate => centos/sources/rspamd.logrotate