]> source.dussan.org Git - rspamd.git/log
rspamd.git
5 years ago[Conf] Add DWL support in the default configuration
Vsevolod Stakhov [Mon, 29 Oct 2018 17:41:17 +0000 (17:41 +0000)]
[Conf] Add DWL support in the default configuration

5 years ago[Fix] Fix DKIM based RBLs
Vsevolod Stakhov [Mon, 29 Oct 2018 17:35:18 +0000 (17:35 +0000)]
[Fix] Fix DKIM based RBLs

5 years ago[Rules] Add LEAKED_PASSWORD_SCAM rule
Vsevolod Stakhov [Mon, 29 Oct 2018 16:51:39 +0000 (16:51 +0000)]
[Rules] Add LEAKED_PASSWORD_SCAM rule

5 years ago[Rework] Change time handling
Vsevolod Stakhov [Mon, 29 Oct 2018 13:19:14 +0000 (13:19 +0000)]
[Rework] Change time handling

5 years ago[Minor] Fix deps
Vsevolod Stakhov [Mon, 29 Oct 2018 13:04:48 +0000 (13:04 +0000)]
[Minor] Fix deps

5 years ago[Project] Rework dynamic parts of symcache items
Vsevolod Stakhov [Mon, 29 Oct 2018 12:58:58 +0000 (12:58 +0000)]
[Project] Rework dynamic parts of symcache items

5 years ago[Project] Another rework for symbols cache
Vsevolod Stakhov [Mon, 29 Oct 2018 12:22:46 +0000 (12:22 +0000)]
[Project] Another rework for symbols cache

5 years ago[Minor] g_abort requires quite a recent glib
Vsevolod Stakhov [Mon, 29 Oct 2018 10:04:39 +0000 (10:04 +0000)]
[Minor] g_abort requires quite a recent glib

5 years ago[Minor] Fix dependencies resolution
Vsevolod Stakhov [Sun, 28 Oct 2018 11:38:54 +0000 (11:38 +0000)]
[Minor] Fix dependencies resolution

5 years ago[Minor] Sigh, another issue with classifier pseudo-filter
Vsevolod Stakhov [Sun, 28 Oct 2018 10:32:51 +0000 (10:32 +0000)]
[Minor] Sigh, another issue with classifier pseudo-filter

5 years agoMerge pull request #2612 from citrin/luacov-merge
Vsevolod Stakhov [Sun, 28 Oct 2018 10:25:13 +0000 (10:25 +0000)]
Merge pull request #2612 from citrin/luacov-merge

Speedup lua coverage collecting for functional test

5 years ago[Minor] Another hack for classifiers
Vsevolod Stakhov [Sun, 28 Oct 2018 10:21:21 +0000 (10:21 +0000)]
[Minor] Another hack for classifiers

5 years ago[Minor] Allow to add conditions for bayes symbol
Vsevolod Stakhov [Sun, 28 Oct 2018 10:17:34 +0000 (10:17 +0000)]
[Minor] Allow to add conditions for bayes symbol

5 years agoSync lua coverage with .drone.yml 2612/head
Anton Yuzhaninov [Sat, 27 Oct 2018 21:22:40 +0000 (17:22 -0400)]
Sync lua coverage with .drone.yml

5 years ago[Minor] Convert some enums to static macros
Vsevolod Stakhov [Sat, 27 Oct 2018 17:55:44 +0000 (18:55 +0100)]
[Minor] Convert some enums to static macros

5 years agoSpeedup lua coverage collecting for functional test
Anton Yuzhaninov [Sat, 27 Oct 2018 17:18:04 +0000 (13:18 -0400)]
Speedup lua coverage collecting for functional test

luacov-coveralls merge mode (-j flag) was created to join reports
containing coverage for different source files (e.g. C and Lua code).
Coverage for the same file in two report is not merged, instead one
source file is added several times to source_files array in JSON. As
a result if we use luacov-coveralls -j on report for same source files
it ends up spending a lot of time on parsing and dumping big JSON files.

This change reduces functional test time from 7+ minutes to 4+ minutes.

5 years ago[Feature] Allow to add 3rd party clang plugins
Vsevolod Stakhov [Sat, 27 Oct 2018 17:18:00 +0000 (18:18 +0100)]
[Feature] Allow to add 3rd party clang plugins

5 years ago[Minor] Fix format strings
Vsevolod Stakhov [Sat, 27 Oct 2018 17:03:27 +0000 (18:03 +0100)]
[Minor] Fix format strings

5 years ago[Fix] Remove ambigious format flag from printf
Vsevolod Stakhov [Sat, 27 Oct 2018 16:56:47 +0000 (17:56 +0100)]
[Fix] Remove ambigious format flag from printf

5 years ago[Minor] Fix LLVM detection
Vsevolod Stakhov [Sat, 27 Oct 2018 16:41:06 +0000 (17:41 +0100)]
[Minor] Fix LLVM detection

5 years ago[Fix] Fix squeezed symbols when using settings
Vsevolod Stakhov [Sat, 27 Oct 2018 14:23:40 +0000 (15:23 +0100)]
[Fix] Fix squeezed symbols when using settings

5 years ago[Minor] Various fixes around async events
Vsevolod Stakhov [Fri, 26 Oct 2018 16:09:58 +0000 (17:09 +0100)]
[Minor] Various fixes around async events

5 years ago[Minor] Improve debugging for lua squeeze
Vsevolod Stakhov [Fri, 26 Oct 2018 15:37:28 +0000 (16:37 +0100)]
[Minor] Improve debugging for lua squeeze

5 years ago[Minor] Improve debug traces for async events
Vsevolod Stakhov [Fri, 26 Oct 2018 15:22:17 +0000 (16:22 +0100)]
[Minor] Improve debug traces for async events

5 years ago[Rework] Add more traces to async events, get rid of GQuarks
Vsevolod Stakhov [Fri, 26 Oct 2018 15:06:12 +0000 (16:06 +0100)]
[Rework] Add more traces to async events, get rid of GQuarks

5 years ago[Minor] Fix variable name
Vsevolod Stakhov [Fri, 26 Oct 2018 14:30:10 +0000 (15:30 +0100)]
[Minor] Fix variable name

5 years ago[Minor] Fix var name
Vsevolod Stakhov [Fri, 26 Oct 2018 14:27:47 +0000 (15:27 +0100)]
[Minor] Fix var name

5 years ago[Rework] Completely rework symbols cache management
Vsevolod Stakhov [Fri, 26 Oct 2018 14:25:41 +0000 (15:25 +0100)]
[Rework] Completely rework symbols cache management

5 years ago[Minor] Add more attributes
Vsevolod Stakhov [Fri, 26 Oct 2018 13:17:17 +0000 (14:17 +0100)]
[Minor] Add more attributes

5 years ago[Minor] Add specific attributes to mempool functions
Vsevolod Stakhov [Fri, 26 Oct 2018 13:08:49 +0000 (14:08 +0100)]
[Minor] Add specific attributes to mempool functions

5 years ago[Minor] Try harder to track DNS based chaining
Vsevolod Stakhov [Thu, 25 Oct 2018 16:24:18 +0000 (17:24 +0100)]
[Minor] Try harder to track DNS based chaining

5 years ago[Minor] Fix lua warnings
Vsevolod Stakhov [Thu, 25 Oct 2018 16:08:52 +0000 (17:08 +0100)]
[Minor] Fix lua warnings

5 years ago[Minor] Fix configwizard behaviour when DB is empty
Vsevolod Stakhov [Thu, 25 Oct 2018 13:22:20 +0000 (14:22 +0100)]
[Minor] Fix configwizard behaviour when DB is empty

5 years ago[Minor] Fix debugm logic
Vsevolod Stakhov [Thu, 25 Oct 2018 13:22:06 +0000 (14:22 +0100)]
[Minor] Fix debugm logic

5 years ago[Minor] Add ability to debug lua redis calls
Vsevolod Stakhov [Thu, 25 Oct 2018 13:21:42 +0000 (14:21 +0100)]
[Minor] Add ability to debug lua redis calls

5 years ago[Minor] Fix error callback invocation
Vsevolod Stakhov [Thu, 25 Oct 2018 13:21:27 +0000 (14:21 +0100)]
[Minor] Fix error callback invocation

5 years ago[Minor] Remove assertion as this case can actually happen
Vsevolod Stakhov [Thu, 25 Oct 2018 12:30:22 +0000 (13:30 +0100)]
[Minor] Remove assertion as this case can actually happen

5 years ago[Minor] Remove last elt optimization for now
Vsevolod Stakhov [Thu, 25 Oct 2018 11:25:10 +0000 (12:25 +0100)]
[Minor] Remove last elt optimization for now

5 years agoMerge pull request #2610 from citrin/functional-test-fix
Vsevolod Stakhov [Thu, 25 Oct 2018 09:56:32 +0000 (10:56 +0100)]
Merge pull request #2610 from citrin/functional-test-fix

Fix test case: Cases.210 Clickhouse.001

5 years agoMerge pull request #2607 from citrin/drone_improvements
Vsevolod Stakhov [Thu, 25 Oct 2018 09:56:10 +0000 (10:56 +0100)]
Merge pull request #2607 from citrin/drone_improvements

Run GDB on cores dumped by functional test

5 years agoMerge pull request #2609 from HeinleinSupport/master
Vsevolod Stakhov [Thu, 25 Oct 2018 09:47:19 +0000 (10:47 +0100)]
Merge pull request #2609 from HeinleinSupport/master

[Fix] Antivirus - virus names with 0 were recognized as tables

5 years agoTCP Connect robot keyword 2610/head
Anton Yuzhaninov [Thu, 25 Oct 2018 01:08:31 +0000 (21:08 -0400)]
TCP Connect robot keyword

* reduce timeout to a reasonable value
* explicitly close socket, don't wait for GC

5 years agoFilter Wait Until Keyword Succeeds in robot log
Anton Yuzhaninov [Thu, 25 Oct 2018 00:16:50 +0000 (20:16 -0400)]
Filter Wait Until Keyword Succeeds in robot log

Remove all but the last failing keyword inside `BuiltIn.Wait Until
Keyword Succeeds` to reduce amount of useless information in robot log.

5 years agoFilter Wait Until Keyword Succeeds in robot log
Anton Yuzhaninov [Thu, 25 Oct 2018 00:13:58 +0000 (20:13 -0400)]
Filter Wait Until Keyword Succeeds in robot log

Remove all but the last failing keyword inside `BuiltIn.Wait Until
Keyword Succeeds` to reduse amount of useless inforamtion in robot log.

5 years agoFix race in Cases.210 Clickhouse.001
Anton Yuzhaninov [Thu, 25 Oct 2018 00:10:14 +0000 (20:10 -0400)]
Fix race in Cases.210 Clickhouse.001

Clickhouse test sometimes fails with an error:
ConnectionError: HTTPConnectionPool(host='localhost', port=18123): Max retries exceeded with url: /?default_format=JSONEachRow (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f40ad96fdd0>: Failed to establish a new connection: [Errno 111] Connection refused',))

Fix this by waiting for TCP port instead pid file.

5 years agoAdd variable for clickhouse port
Anton Yuzhaninov [Wed, 24 Oct 2018 22:46:11 +0000 (18:46 -0400)]
Add variable for clickhouse port

5 years ago[FIX] Antivirus - virus names #2 2609/head
Carsten Rosenberg [Wed, 24 Oct 2018 20:25:10 +0000 (22:25 +0200)]
[FIX] Antivirus - virus names #2

5 years ago[Fix] Antivirus - virus names with 0 were recognized as tables
Carsten Rosenberg [Wed, 24 Oct 2018 20:13:36 +0000 (22:13 +0200)]
[Fix] Antivirus - virus names with 0 were recognized as tables

5 years ago[Minor] Some fixes in surbl module events processing
Vsevolod Stakhov [Wed, 24 Oct 2018 17:26:07 +0000 (18:26 +0100)]
[Minor] Some fixes in surbl module events processing

5 years ago[Minor] Avoid double quoting
Vsevolod Stakhov [Wed, 24 Oct 2018 15:34:33 +0000 (16:34 +0100)]
[Minor] Avoid double quoting

5 years ago[Minor] Optimize symbols execution
Vsevolod Stakhov [Wed, 24 Oct 2018 15:13:32 +0000 (16:13 +0100)]
[Minor] Optimize symbols execution

5 years ago[Minor] Restore item when pushing redis result
Vsevolod Stakhov [Wed, 24 Oct 2018 12:41:51 +0000 (13:41 +0100)]
[Minor] Restore item when pushing redis result

5 years ago[Minor] Add safety guards for fuzzy checks
Vsevolod Stakhov [Wed, 24 Oct 2018 09:54:50 +0000 (10:54 +0100)]
[Minor] Add safety guards for fuzzy checks

5 years ago[Minor] Fix dns resolve with no current item
Vsevolod Stakhov [Wed, 24 Oct 2018 09:30:38 +0000 (10:30 +0100)]
[Minor] Fix dns resolve with no current item

5 years ago[Feature] Add specialised functions for generating encrypted cookies
Vsevolod Stakhov [Tue, 23 Oct 2018 18:50:30 +0000 (19:50 +0100)]
[Feature] Add specialised functions for generating encrypted cookies

5 years agogdb invocation nitpick 2607/head
Anton Yuzhaninov [Tue, 23 Oct 2018 17:36:22 +0000 (13:36 -0400)]
gdb invocation nitpick

* pagination is disabled by --batch
* use options order like in gdb docs

5 years agoMerge branch 'master' into drone_improvements
Anton Yuzhaninov [Tue, 23 Oct 2018 17:35:11 +0000 (13:35 -0400)]
Merge branch 'master' into drone_improvements

5 years agoPrint backtrace for cores dumped by functional test
Anton Yuzhaninov [Tue, 23 Oct 2018 17:26:32 +0000 (13:26 -0400)]
Print backtrace for cores dumped by functional test

5 years ago[Minor] Pet luacheck
Vsevolod Stakhov [Tue, 23 Oct 2018 16:02:12 +0000 (17:02 +0100)]
[Minor] Pet luacheck

5 years agoRemove indentation from yaml '>' blocks
Anton Yuzhaninov [Tue, 23 Oct 2018 15:57:37 +0000 (11:57 -0400)]
Remove indentation from yaml '>' blocks

With indentation block literal is not folded as expected.

5 years ago[CritFix] Fix \0 processing when doing RSA sign
Vsevolod Stakhov [Tue, 23 Oct 2018 15:32:32 +0000 (16:32 +0100)]
[CritFix] Fix \0 processing when doing RSA sign

5 years ago[Feature] Fold b= value when doing arc sealing
Vsevolod Stakhov [Tue, 23 Oct 2018 15:08:24 +0000 (16:08 +0100)]
[Feature] Fold b= value when doing arc sealing

5 years ago[Minor] Allow to fold base64 encoding of signatures
Vsevolod Stakhov [Tue, 23 Oct 2018 15:08:07 +0000 (16:08 +0100)]
[Minor] Allow to fold base64 encoding of signatures

5 years ago[Minor] Allow to create upstreams without a context
Vsevolod Stakhov [Tue, 23 Oct 2018 15:07:53 +0000 (16:07 +0100)]
[Minor] Allow to create upstreams without a context

5 years agoMerge pull request #2605 from citrin/drone_improvements
Vsevolod Stakhov [Tue, 23 Oct 2018 11:22:50 +0000 (12:22 +0100)]
Merge pull request #2605 from citrin/drone_improvements

Drone improvements

5 years ago[Feature] Tune upstream limits in Rspamd proxy
Vsevolod Stakhov [Tue, 23 Oct 2018 08:57:44 +0000 (09:57 +0100)]
[Feature] Tune upstream limits in Rspamd proxy

5 years ago[Feature] Allow to set custom limits for upstream lists
Vsevolod Stakhov [Tue, 23 Oct 2018 08:47:10 +0000 (09:47 +0100)]
[Feature] Allow to set custom limits for upstream lists

5 years ago[Minor] Add some protection against bad values
Vsevolod Stakhov [Tue, 23 Oct 2018 08:33:24 +0000 (09:33 +0100)]
[Minor] Add some protection against bad values

5 years agoFix grammar 2605/head
Anton Yuzhaninov [Tue, 23 Oct 2018 03:31:10 +0000 (23:31 -0400)]
Fix grammar

5 years agoDon't write xunit.xml
Anton Yuzhaninov [Tue, 23 Oct 2018 03:17:27 +0000 (23:17 -0400)]
Don't write xunit.xml

It is not currently used.

5 years agoShare robot log and report on https://ci.rspamd.com/testlogs/
Anton Yuzhaninov [Tue, 23 Oct 2018 02:19:29 +0000 (22:19 -0400)]
Share robot log and report on https://ci.rspamd.com/testlogs/

Sending functional test log (about 5Mb) in a email attachmend was temporary
solution.
Upload them to https://ci.rspamd.com/testlogs/ instead.
Link to log/report will be printed in build log.

5 years agoSimplify: default working directory is source root
Anton Yuzhaninov [Tue, 23 Oct 2018 00:26:29 +0000 (20:26 -0400)]
Simplify: default working directory is source root

5 years agoEnable core dumps for funcutional test
Anton Yuzhaninov [Mon, 22 Oct 2018 23:39:51 +0000 (19:39 -0400)]
Enable core dumps for funcutional test

Don't run gdb yet, it requires more work and can be done when it will be
needed.

5 years ago[Minor] Fix issues in lua http
Vsevolod Stakhov [Mon, 22 Oct 2018 16:28:23 +0000 (17:28 +0100)]
[Minor] Fix issues in lua http

5 years agoMerge pull request #2604 from moisseev/webui
Vsevolod Stakhov [Mon, 22 Oct 2018 15:38:11 +0000 (16:38 +0100)]
Merge pull request #2604 from moisseev/webui

[Minor] Update Bootstrap to 3.3.7

5 years ago[Minor] More fixes to the internal modules
Vsevolod Stakhov [Mon, 22 Oct 2018 15:21:29 +0000 (16:21 +0100)]
[Minor] More fixes to the internal modules

5 years ago[Minor] Various logs fixes
Vsevolod Stakhov [Mon, 22 Oct 2018 15:21:20 +0000 (16:21 +0100)]
[Minor] Various logs fixes

5 years ago[Minor] Add more fail-safety checks to symbols execution
Vsevolod Stakhov [Mon, 22 Oct 2018 13:10:04 +0000 (14:10 +0100)]
[Minor] Add more fail-safety checks to symbols execution

5 years ago[Minor] Check deps before processing of rdeps
Vsevolod Stakhov [Mon, 22 Oct 2018 12:02:48 +0000 (13:02 +0100)]
[Minor] Check deps before processing of rdeps

5 years ago[Minor] Another fix in spf plugin
Vsevolod Stakhov [Mon, 22 Oct 2018 10:30:57 +0000 (11:30 +0100)]
[Minor] Another fix in spf plugin

5 years ago[Fix] Various fixes in embedded plugins
Vsevolod Stakhov [Sun, 21 Oct 2018 19:35:44 +0000 (20:35 +0100)]
[Fix] Various fixes in embedded plugins

5 years ago[WebUI] Add history rows per page control 2604/head
Alexander Moisseev [Sun, 21 Oct 2018 18:53:15 +0000 (21:53 +0300)]
[WebUI] Add history rows per page control

5 years ago[Minor] Update Bootstrap to 3.3.7
Alexander Moisseev [Sun, 21 Oct 2018 16:16:42 +0000 (19:16 +0300)]
[Minor] Update Bootstrap to 3.3.7

5 years ago[Fix] Fix finalization for internal plugins
Vsevolod Stakhov [Sun, 21 Oct 2018 09:31:41 +0000 (10:31 +0100)]
[Fix] Fix finalization for internal plugins

5 years ago[Minor] Fix docs
Vsevolod Stakhov [Sun, 21 Oct 2018 08:47:22 +0000 (09:47 +0100)]
[Minor] Fix docs

5 years ago[Fix] Use proper syntax for making DNS requests
Vsevolod Stakhov [Sun, 21 Oct 2018 08:42:22 +0000 (09:42 +0100)]
[Fix] Use proper syntax for making DNS requests

5 years ago[Project] Remove unneeded phases, add safe guards, fix issues
Vsevolod Stakhov [Sat, 20 Oct 2018 18:43:04 +0000 (19:43 +0100)]
[Project] Remove unneeded phases, add safe guards, fix issues

5 years ago[Project] Adopt C modules and stuff
Vsevolod Stakhov [Sat, 20 Oct 2018 17:32:25 +0000 (18:32 +0100)]
[Project] Adopt C modules and stuff

5 years ago[Project] Add items logic in DNS resolver
Vsevolod Stakhov [Sat, 20 Oct 2018 16:23:55 +0000 (17:23 +0100)]
[Project] Add items logic in DNS resolver

5 years ago[Project] Adopt lua tcp
Vsevolod Stakhov [Sat, 20 Oct 2018 16:23:45 +0000 (17:23 +0100)]
[Project] Adopt lua tcp

5 years ago[Project] Adopt lua redis
Vsevolod Stakhov [Sat, 20 Oct 2018 16:01:10 +0000 (17:01 +0100)]
[Project] Adopt lua redis

5 years ago[Project] Adopt lua http
Vsevolod Stakhov [Sat, 20 Oct 2018 15:52:44 +0000 (16:52 +0100)]
[Project] Adopt lua http

5 years ago[Project] Fix Lua DNS code
Vsevolod Stakhov [Sat, 20 Oct 2018 13:54:07 +0000 (14:54 +0100)]
[Project] Fix Lua DNS code

5 years ago[Project] Further cleanup from the watchers
Vsevolod Stakhov [Sat, 20 Oct 2018 13:48:06 +0000 (14:48 +0100)]
[Project] Further cleanup from the watchers

5 years ago[Project] Kill async watchers as they are way too complex
Vsevolod Stakhov [Sat, 20 Oct 2018 13:34:08 +0000 (14:34 +0100)]
[Project] Kill async watchers as they are way too complex

5 years ago[Project] Add logic of the async events counter
Vsevolod Stakhov [Sat, 20 Oct 2018 13:29:46 +0000 (14:29 +0100)]
[Project] Add logic of the async events counter

5 years ago[Project] Implement counter for async events in symcache item
Vsevolod Stakhov [Sat, 20 Oct 2018 12:42:37 +0000 (13:42 +0100)]
[Project] Implement counter for async events in symcache item

5 years ago[Project] Rework symbols processing logic
Vsevolod Stakhov [Sat, 20 Oct 2018 12:29:42 +0000 (13:29 +0100)]
[Project] Rework symbols processing logic

5 years ago[Project] Pass cache item to the callback functions
Vsevolod Stakhov [Sat, 20 Oct 2018 11:39:29 +0000 (12:39 +0100)]
[Project] Pass cache item to the callback functions

5 years agoFix coverage (#2603)
Anton Yuzhaninov [Sat, 20 Oct 2018 08:15:40 +0000 (04:15 -0400)]
Fix coverage (#2603)

* Add utility to prepare C coverage for upload to coveralls.io

It turned out that it is more easy to write own script then debug
and fix coveralls utility (https://github.com/eddyxu/cpp-coveralls).

gcov-coveralls.py can be used as a replacement for coveralls.

* Save coverage data from .gcda files only once

Coverage data in .gcda files is merged after each binary invocation,
so we can run all test and then gather coverage data.

If we dump them two times execution counts will be more then they be.

* Switch from coveralls (cpp-coveralls) to own script

Problem with coveralls was, that coverage for source files outside build
directory was not added to the report.

* Add tool to dump info from json for coveralls.io

* Add debug

* Fix: don't die if there is no service_job_id in json

* Debug

* Fix dump_coveralls.py

* Rename to gcov_coveralls.py (s/-/_/)

For most files in this repo '_' is used as separator.

* Don't add source code to coveralls JSON

According to https://docs.coveralls.io/api-introduction
Coverals don't need source code, only MD5 digest to tracks changes.

Anyway source code is already added by luacov-coveralls and source_digest
is added by cpp-coveralls and gcov_coveralls.py
Both options seems to work for now.

* Provide path to source directory to merge_coveralls.py

merge_coveralls.py has code to filter files and remove prefixes.
When --root points to source directory merge_coveralls.py can strip
prefix from absolute path in JSONs generated by luacov-coveralls.

* Style

Don't add parameters with default values.

* Make --output optional

It useful mainly for debugging. We can send report without saving it.

* Log CI_COMMIT_AUTHOR env var

It is not clear from drone.io source how CI_COMMIT_AUTHOR variable is
set. Log it to see what it means.

* Move merge_coveralls.py to test/tools

This script is used not only for funcional test coverage, but for
rspamd-test coverage too.

* Remove debug

* Style

Use more compact formatting.

* Write comment about parallel tests running [SKIP CI]

Document why running tests in parallel may be bad idea (but still do so).

* Fix typo [SKIP CI]