XMPP Server functional tests.

  1. Get server version
  2. Server configuration
  3. Server statistics
  4. Script with functional tests for all basic XMPP/Jabber features
  5. Testing bosh component
  6. Testing bosh component in keep-alive mode
  7. Multi-threaded tests for various XMPP functions
  8. Script with functional tests for Administrator ad-hoc commands

Test start time: Sep 19, 2018 6:26:07 AM

Server version info:

Name:  Tigase
Version:  8.0.0-SNAPSHOT-b5244/3b41c664(2018-09-19/03:50:50)
OS:  Linux-amd64-4.4.0-1052-aws, Java HotSpot(TM) 64-Bit Server VM-25.162-b12-Oracle Corporation
    
Local IP:  127.0.0.1
Remote IP:  127.0.0.1

Server basic configuration parameters:

unknown:Content admins = [ 'admin@test-d' ]

Tests results:

Test name Result Total time OK Average Description History
Version success 0 sec 1 68 ms Get server version Version
Configuration success 0 sec 1 77 ms Server configuration Configuration
Statistics success 0 sec 1 95 ms Server statistics Statistics
Basic 1 (c2s) success 0 sec 1 6 ms Stream open to server. Basic 1 (c2s)
Basic 2 (c2s) success 0 sec 1 90 ms XEP-0077 - In-Band Registration, register Basic 2 (c2s)
Basic 3 (c2s) success 0 sec 1 75 ms XEP-0077 - In-Band Registration - user unregister Basic 3 (c2s)
Basic 4 (c2s) success 0 sec 1 16 ms XEP-0078 Non-SASL authorization with plain password. Basic 4 (c2s)
Basic 5 (c2s) success 0 sec 1 17 ms XEP-0078 Non-SASL authorization with digest password. Basic 5 (c2s)
Basic 6 (c2s) success 0 sec 1 58 ms Send a message to self user and don't wait for response Basic 6 (c2s)
Basic 7 (c2s) success 0 sec 1 70 ms Message send to correct/available full JID: all-xmpp-test_1@test-d/def-user-resource, expecting response Basic 7 (c2s)
Basic 8 (c2s) success 0 sec 1 68 ms Message send to correct/available bare JID: all-xmpp-test_1@test-d, expecting response Basic 8 (c2s)
Basic 9 (c2s) success 0 sec 1 56 ms IQ stanza send to incorrect/unavailable full JID: all-xmpp-test_1@test-d/wrong-resource, expecting error response Basic 9 (c2s)
Basic 10 (c2s) success 0 sec 1 61 ms XEP-0092 - get entity version Basic 10 (c2s)
Basic 11 (c2s) success 0 sec 1 106 ms XEP-0039 Statistics Gathering Basic 11 (c2s)
Basic 12 (c2s) success 0 sec 1 377 ms Roster management test Basic 12 (c2s)
Basic 13 (c2s) success 0 sec 1 106 ms Roster with uppercase characters test, this tests verifies if the roster item removed in previous test is really removed from DB and empty on user relogin. Basic 13 (c2s)
Basic 14 (c2s) success 0 sec 1 83 ms XEP-0049: Private XML Storage Basic 14 (c2s)
Basic 15 (c2s) success 0 sec 1 56 ms Test for feature-not-implemented error which should be returned when client sends unsupported stanza Basic 15 (c2s)
Basic 16 (c2s) success 0 sec 1 81 ms XEP-0054: vcard-temp Basic 16 (c2s)
Basic 17 (c2s) success 0 sec 1 63 ms XEP-0199: XMPP Ping to domain 'test-d' the user is logged in Basic 17 (c2s)
Basic 18 (c2s) FAILURE 0 sec 0 0 ms XEP-0199: XMPP Ping to another, vrtual domain 'test-domain' on the server Basic 18 (c2s)
Basic 19 (c2s) success 0 sec 1 66 ms XEP-0030: XMPP Service Discovery Basic 19 (c2s)
Basic 20 (c2s) success 0 sec 1 55 ms Send a message without resource binding and expect an error response. Basic 20 (c2s)
Basic 21 (c2s) success 0 sec 1 304 ms Bug #431 - XMLUtil encoding problem: https://projects.tigase.org/issues/431 Basic 21 (c2s)
SSL 1 (c2s) success 0 sec 1 252 ms SSL socket connect. SSL 1 (c2s)
TLS 1 (c2s) success 0 sec 1 142 ms TLS connection open TLS 1 (c2s)
TLS 2 (c2s) success 0 sec 1 211 ms SASL authorization TLS 2 (c2s)
TLS 3 (c2s) success 0 sec 1 193 ms XMPP resource bind TLS 3 (c2s)
TLS 4 (c2s) success 0 sec 1 195 ms Establish XMPP session TLS 4 (c2s)
TLS Required 1 (c2s) FAILURE 0 sec 0 0 ms XEP-0077 - In-Band Registration, for domain requiring TLS but without TLS activation, expecting error. TLS Required 1 (c2s)
TLS Required 2 (c2s) FAILURE 0 sec 0 0 ms XEP-0077 - In-Band Registration, for domain requiring TLS with TLS activation, expecting success. TLS Required 2 (c2s)
Packet Order 1 (c2s) success 0 sec 1 81 ms Packet order test Packet Order 1 (c2s)
Packet Order 2 (c2s) success 0 sec 1 112 ms Packet order test Packet Order 2 (c2s)
Packet Order 3 (c2s) success 0 sec 1 110 ms Packet order test Packet Order 3 (c2s)
Packet Order 4 (c2s) success 0 sec 1 114 ms Packet order test Packet Order 4 (c2s)
Packet Order 5 (c2s) success 0 sec 1 111 ms Packet order test Packet Order 5 (c2s)
Privacy 1 (c2s) success 0 sec 1 93 ms Privacy lists management test Privacy 1 (c2s)
Privacy 2 (c2s) success 0 sec 1 59 ms Privacy lists - send a message to blocking-test-user_1 user Privacy 2 (c2s)
Privacy 3 (c2s) success 0 sec 1 59 ms Send a message to long-list-user_1 user Privacy 3 (c2s)
Presence 1 (c2s) success 1 sec 2 366 ms Presence subscription test between 'admin' and 'all-xmpp-test'. Presence 1 (c2s)
Presence 2 (c2s) success 0 sec 2 222 ms Presence cancel test between 'admin' and 'all-xmpp-test'. Presence 2 (c2s)
Presence 3 (c2s) success 1 sec 2 311 ms Presence unsubscribe test between 'admin' and 'all-xmpp-test'. Presence 3 (c2s)
Presence 4 (c2s) success 1 sec 2 344 ms Presence subscription between 'admin' and 'all-xmpp-test' again to prepare for the next test. Presence 4 (c2s)
Presence 5 (c2s) success 1 sec 2 351 ms Remove subscribed contact 'all-xmpp-test' from the roster of the user 'admin', all subscriptions should be cancelled automatically by the server. Presence 5 (c2s)
Presence 6 (c2s) success 0 sec 2 202 ms 2 user connections, each using a different resource. Presence 6 (c2s)
Presence 7 (c2s) success 1 sec 2 291 ms Presence subscription deny test between 'admin' and 'all-xmpp-test'. Presence 7 (c2s)
User Status 1 (c2s) FAILURE 0 sec 0 0 ms USER_STATUS command test to ensure interoperability with Yate User Status 1 (c2s)
User Status 2 (c2s) FAILURE 0 sec 0 0 ms USER_STATUS command test to ensure security, should receive forbidden error. User Status 2 (c2s)
Dynamic Roster 1 (c2s) success 0 sec 1 69 ms Dynamic roster storage test Dynamic Roster 1 (c2s)
Dynamic Roster 2 (c2s) success 0 sec 1 172 ms Dynamic roster merge test Dynamic Roster 2 (c2s)
Test IO (c2s) success 0 sec 10 33 ms Checking Tigase IO subsystem Test IO (c2s)
Load 1 (c2s) success 0 sec 1 51 ms Check whether the tester user account responds Load 1 (c2s)
Load 10 (c2s) success 0 sec 1 65 ms Send a command to tester_1 user to generate 10 messages on the server. Load 10 (c2s)
Load 100 (c2s) success 0 sec 1 104 ms Send a command to tester_1 user to generate 100 messages on the server. Load 100 (c2s)
Load 1000 (c2s) success 0 sec 1 515 ms Send a command to tester_1 user to generate 1000 messages on the server. Load 1000 (c2s)
Load 10000 (c2s) success 4 sec 1 4248 ms Send a command to tester_1 user to generate 10000 messages on the server. Load 10000 (c2s)
MUC 1 (c2s) success 0 sec 1 65 ms Send room create presence request to MUC component. MUC 1 (c2s)
PubSub 1 (c2s) success 0 sec 1 58 ms Get version from the pubsub component. PubSub 1 (c2s)
PubSub 2 (c2s) success 0 sec 1 75 ms Create a new node in the pubsub component. PubSub 2 (c2s)
PubSub 3 (c2s) success 0 sec 1 59 ms Add subscriptions to the node in the pubsub component. PubSub 3 (c2s)
PubSub 4 (c2s) success 0 sec 1 57 ms Add affiliations to the node in the pubsub component. PubSub 4 (c2s)
PubSub 5 (c2s) success 0 sec 1 111 ms Create a collection node in the pubsub component. PubSub 5 (c2s)
VHost 1 (c2s) FAILURE 0 sec 0 0 ms XEP-0199: XMPP Ping to virtual domain 'test-domain' on the server VHost 1 (c2s)
VHost 2 (c2s) success 0 sec 1 56 ms Reloading VHosts from non-admin account, expecting error message VHost 2 (c2s)
VHost 3 (c2s) success 0 sec 1 102 ms Updating VHost from non-admin account, expecting error message VHost 3 (c2s)
VHost 4 (c2s) success 0 sec 1 61 ms Removing VHost from non-admin account, expecting error message VHost 4 (c2s)
VHost 5 (c2s) success 0 sec 1 63 ms Reloading VHosts from admin account... VHost 5 (c2s)
VHost 6 (c2s) success 0 sec 1 162 ms XEP-0199: XMPP Ping to virtual domain 'vhost-1' which is not on the server, expecting error response VHost 6 (c2s)
VHost 7 (c2s) success 0 sec 1 76 ms Adding VHost 'vhost-1' from admin account VHost 7 (c2s)
VHost 8 (c2s) success 0 sec 1 60 ms XEP-0199: XMPP Ping to virtual domain 'vhost-1' on the server VHost 8 (c2s)
VHost 9 (c2s) success 0 sec 1 53 ms Removing VHost 'vhost-1' from admin account VHost 9 (c2s)
VHost 10 (c2s) success 0 sec 1 86 ms XEP-0199: XMPP Ping to virtual domain 'vhost-1' which is not on the server, expecting error response VHost 10 (c2s)
VHost 11 (c2s) success 20 sec 200 101 ms XEP-0199: XMPP Ping 200 non-existen vhosts on the server, expecting error responses VHost 11 (c2s)
VHost 12 (c2s) success 0 sec 200 3 ms Adding 200 virtual hosts from admin account VHost 12 (c2s)
VHost 13 (c2s) success 0 sec 200 0 ms XEP-0199: XMPP Ping all 200 virtual hosts on the server VHost 13 (c2s)
VHost 14 (c2s) success 0 sec 1 59 ms Reloading all VHosts from admin account... VHost 14 (c2s)
VHost 15 (c2s) success 0 sec 200 3 ms Removing 200 VHosts from admin account VHost 15 (c2s)
VHost 16 (c2s) success 19 sec 200 98 ms XEP-0199: XMPP Ping 200 non-existen vhosts on the server, expecting error responses VHost 16 (c2s)
VHost 17 (c2s) success 0 sec 1 52 ms Reloading all VHosts from admin account... VHost 17 (c2s)
Basic 1 (bosh) success 0 sec 1 120 ms Stream open to server. Basic 1 (bosh)
Basic 2 (bosh) success 0 sec 1 379 ms XEP-0077 - In-Band Registration, register Basic 2 (bosh)
Basic 3 (bosh) FAILURE 15 sec 0 0 ms XEP-0077 - In-Band Registration - user unregister Basic 3 (bosh)
Basic 4 (bosh) FAILURE 0 sec 0 0 ms XEP-0078 Non-SASL authorization with plain password. Basic 4 (bosh)
Basic 5 (bosh) FAILURE 0 sec 0 0 ms XEP-0078 Non-SASL authorization with digest password. Basic 5 (bosh)
Basic 6 (bosh) FAILURE 15 sec 0 0 ms Send a message to self user and don't wait for response Basic 6 (bosh)
Basic 7 (bosh) FAILURE 15 sec 0 0 ms Message send to correct/available full JID: all-xmpp-test_1@test-d/def-user-resource, expecting response Basic 7 (bosh)
Basic 8 (bosh) FAILURE 15 sec 0 0 ms Message send to correct/available bare JID: all-xmpp-test_1@test-d, expecting response Basic 8 (bosh)
Basic 9 (bosh) FAILURE 15 sec 0 0 ms IQ stanza send to incorrect/unavailable full JID: all-xmpp-test_1@test-d/wrong-resource, expecting error response Basic 9 (bosh)
Basic 10 (bosh) success 15 sec 1 15326 ms XEP-0092 - get entity version Basic 10 (bosh)
Basic 11 (bosh) FAILURE 15 sec 0 0 ms XEP-0039 Statistics Gathering Basic 11 (bosh)
Basic 12 (bosh) FAILURE 30 sec 0 0 ms Roster management test Basic 12 (bosh)
Basic 13 (bosh) FAILURE 30 sec 0 0 ms Roster with uppercase characters test, this tests verifies if the roster item removed in previous test is really removed from DB and empty on user relogin. Basic 13 (bosh)
Basic 14 (bosh) FAILURE 15 sec 0 0 ms XEP-0049: Private XML Storage Basic 14 (bosh)
Basic 15 (bosh) success 15 sec 1 15436 ms Test for feature-not-implemented error which should be returned when client sends unsupported stanza Basic 15 (bosh)
Basic 16 (bosh) FAILURE 15 sec 0 0 ms XEP-0054: vcard-temp Basic 16 (bosh)
Basic 17 (bosh) success 15 sec 1 15323 ms XEP-0199: XMPP Ping to domain 'test-d' the user is logged in Basic 17 (bosh)
Basic 18 (bosh) FAILURE 30 sec 0 0 ms XEP-0199: XMPP Ping to another, vrtual domain 'test-domain' on the server Basic 18 (bosh)
Basic 19 (bosh) FAILURE 30 sec 0 0 ms XEP-0030: XMPP Service Discovery Basic 19 (bosh)
Basic 20 (bosh) FAILURE 15 sec 0 0 ms Send a message without resource binding and expect an error response. Basic 20 (bosh)
Basic 21 (bosh) FAILURE 30 sec 0 0 ms Bug #431 - XMLUtil encoding problem: https://projects.tigase.org/issues/431 Basic 21 (bosh)
Basic 1 (bosh-keep-alive) success 0 sec 1 114 ms Stream open to server. Basic 1 (bosh-keep-alive)
Basic 2 (bosh-keep-alive) FAILURE 0 sec 0 0 ms XEP-0077 - In-Band Registration, register Basic 2 (bosh-keep-alive)
Basic 3 (bosh-keep-alive) FAILURE 15 sec 0 0 ms XEP-0077 - In-Band Registration - user unregister Basic 3 (bosh-keep-alive)
Basic 4 (bosh-keep-alive) FAILURE 0 sec 0 0 ms XEP-0078 Non-SASL authorization with plain password. Basic 4 (bosh-keep-alive)
Basic 5 (bosh-keep-alive) FAILURE 0 sec 0 0 ms XEP-0078 Non-SASL authorization with digest password. Basic 5 (bosh-keep-alive)
Basic 6 (bosh-keep-alive) FAILURE 15 sec 0 0 ms Send a message to self user and don't wait for response Basic 6 (bosh-keep-alive)
Basic 7 (bosh-keep-alive) FAILURE 15 sec 0 0 ms Message send to correct/available full JID: all-xmpp-test_1@test-d/def-user-resource, expecting response Basic 7 (bosh-keep-alive)
Basic 8 (bosh-keep-alive) FAILURE 15 sec 0 0 ms Message send to correct/available bare JID: all-xmpp-test_1@test-d, expecting response Basic 8 (bosh-keep-alive)
Basic 9 (bosh-keep-alive) FAILURE 15 sec 0 0 ms IQ stanza send to incorrect/unavailable full JID: all-xmpp-test_1@test-d/wrong-resource, expecting error response Basic 9 (bosh-keep-alive)
Basic 10 (bosh-keep-alive) success 15 sec 1 15324 ms XEP-0092 - get entity version Basic 10 (bosh-keep-alive)
Basic 11 (bosh-keep-alive) FAILURE 15 sec 0 0 ms XEP-0039 Statistics Gathering Basic 11 (bosh-keep-alive)
Basic 12 (bosh-keep-alive) FAILURE 30 sec 0 0 ms Roster management test Basic 12 (bosh-keep-alive)
Basic 13 (bosh-keep-alive) FAILURE 30 sec 0 0 ms Roster with uppercase characters test, this tests verifies if the roster item removed in previous test is really removed from DB and empty on user relogin. Basic 13 (bosh-keep-alive)
Basic 14 (bosh-keep-alive) FAILURE 15 sec 0 0 ms XEP-0049: Private XML Storage Basic 14 (bosh-keep-alive)
Basic 15 (bosh-keep-alive) success 15 sec 1 15425 ms Test for feature-not-implemented error which should be returned when client sends unsupported stanza Basic 15 (bosh-keep-alive)