Skip to content

Commit

Permalink
merge code from sep_conn to master
Browse files Browse the repository at this point in the history
  • Loading branch information
jinfahua committed Aug 23, 2018
2 parents 34fef1b + af09e2f commit 0edf972
Show file tree
Hide file tree
Showing 29 changed files with 1,088 additions and 790 deletions.
1 change: 1 addition & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -3,3 +3,4 @@
.settings/
target/
.metadata/
.DS_Store
Binary file not shown.
110 changes: 55 additions & 55 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,109 +1,89 @@
# Release
The version 1.0 is released at 18th, Dec, 2017. Now the plugin supports share MQTT connection in the same threadgroup. Also, this version fixed some of bugs reported in the community.
# mqtt-jmeter Overview
MQTT JMeter Plugin extends your JMeter's capability to test against MQTT protocol, just as easy as ordinary HTTP protocal.

# mqtt-jmeter
MQTT JMeter Plugin, it's used for testing MQTT protocol. The plugin was used for EMQ's performance benchmark test, and here is [report link](https://github.com/emqtt/emq-xmeter-cn).
The plugin is developed and maintained by [XMeter](https://www.xmeter.net). XMeter is a professional performance testing service provider.
It has been used to benchmark EMQ server performance, and here is the [report link](https://github.com/emqtt/emq-xmeter-cn).

This plugin is developed and maintained by [XMeter](https://www.xmeter.net). XMeter is a professional performance testing service provider.

# Install instruction
The plugin is a standard JMeter plugin. You can download the latest version of mqtt-jmeter from [here](https://github.com/emqtt/mqtt-jmeter/releases), and then copy the downloaded JAR files into $JMETER_HOME/lib/ext folder. After restart the JMeter, then you can see the 3 samplers provided by this plugin.
The plugin is a standard JMeter plugin. You can download the latest version of mqtt-jmeter from [here](https://github.com/emqtt/mqtt-jmeter/releases), and then copy the downloaded JAR files into $JMETER_HOME/lib/ext folder. After restarting the JMeter, you can see "MQTT samplers" provided by this plugin.

We recommend to use JMeter 3.0 or above.
To use this plugin, we recommend you to install JMeter 3.2 or above.

## Build from source code

If you'd like to build binary by yourself, please clone the project and run 'mvn install'. Maven will download some JMeter dependency binary files, so the build elapsed time will up to your network status.

# How to use
The plugin includes 3 samplers:
The plugin includes 4 samplers:

- Connection sampler, which can be used for connection mock. For example, in a large scale system, there could have lots of backend connections with no data transimission except some hearbeat signal. The sampler can be used in this case.
- Connect sampler: Initiate MQTT server connection on behalf of a device. In addition to normal connection setup, this sampler can be used to simulate massive "background" connections(no data transimission but regular hearbeat signals) to the designated MQTT server or cluster system.

- Pub sampler, which can be used for publish message to MQTT server.
- Pub sampler: publish various messages to the target MQTT server.

- Sub sampler, which can be used for sub message from MQTT server.
- Sub sampler: subscribe message(s) from target MQTT server.

If MQTT JMeter plugin is installed successfully, then open JMeter and below 3 MQTT samplers can be found under 'Sampler'.
- DisConnect sampler: Reset the connection to target MQTT server.

![mqtt_jmeter_plugin](screenshots/mqtt_jmeter_plugin.png)
If MQTT JMeter plugin is successfully installed, you can find these MQTT samplers under JMeter 'Sampler' context menu.

![mqtt_jmeter_plugin](screenshots/mqtt_jmeter_plugin.png)

## Connection sampler

## Connect Sampler
![conn_sampler](screenshots/conn_sampler.png)

### MQTT connection

This section includes basic connection settings.

- **Server name or IP**: The server install with MQTT server, it can be either IP address or server name. The default value is 127.0.0.1. **DO NOT** add protocol (e.g. tcp:// or ssl://) before server name or IP address!
- **Server name or IP**: The MQTT target to be tested. It can be either IP address or server name. The default value is 127.0.0.1. **DO NOT** add protocol (e.g. tcp:// or ssl://) before server name or IP address!

- **Port number**: The port that opens by MQTT server, the default value is 1883 for TCP protocol, and normally 8883 for SSL protocol.
- **Port number**: The port opened by MQTT server. Typically 1883 is for TCP protocol, and 8883 for SSL protocol.

- **MQTT version**: The MQTT version, default is 3.1, and another option is 3.1.1. Sometimes the version is probably required for establish connection to [Azure IoTHub](https://github.com/emqtt/mqtt-jmeter/issues/21).
- **MQTT version**: The MQTT version, default is 3.1, and another option is 3.1.1. Sometimes we found version 3.1.1 is required to establish connection to [Azure IoTHub](https://github.com/emqtt/mqtt-jmeter/issues/21).

- **Timeout(s)**: The connection timeout seconds while connecting to MQTT server. The default is 10 seconds.

### MQTT Protocol

The sampler supports for 2 protocols, TCP and SSL. For the SSL protocol, it includes normal SSL and dual SSL authentication.
The sampler supports 2 protocols, TCP and SSL. For SSL protocol, it includes normal SSL and dual SSL authentication.

If **'Dual SSL authentication'** is checked, please follow 'Certification files for SSL/TLS connections' at end of this doc to set the client SSL configuration.
If **'Dual SSL authentication'** is checked, please follow 'Certification files for SSL/TLS connections' at end of this doc to set the client SSL configuration properly.

![protocol_setting](screenshots/protocol_setting.png)

### User authentication

User can configure MQTT server with user name & password authentication, refer to [EMQ user name and password authentication guide](http://emqtt.com/docs/v2/guide.html#id3).

- **User name**: If MQTT server configured with user name, then specify user name here.
- **User name**: If MQTT server is configured with user name, then specify user name here.

- **Password**: If MQTT server configured with password, then specify password here.
- **Password**: If MQTT server is configured with password, then specify password here.

### Connection options

- **ClientId**: Identification of the client. (Default value is 'conn_'.) If 'Add random client id suffix' is selected, JMeter plugin will append generated uuid as suffix to represent the client, otherwise, the text of 'ClientId' will be passed as 'clientId' of current connection.
- **ClientId**: Identification of the client, i.e. virtual user or JMeter thread. Default value is 'conn_'. If 'Add random client id suffix' is selected, JMeter plugin will append generated uuid as suffix to represent the client, otherwise, the text of 'ClientId' will be passed as 'clientId' of current connection.

- **Keep alive(s)**: Ping packet send interval in seconds. Default value is 300, which means each connection sends a ping packet to MQTT server every 5 minutes.

- **Connection keep time(s)**: The value is to set the connection elapsed time after successfully establishing MQTT connection. The default value is 1800 seconds, which means that the connection will be alive within 30 minutes.

- **Connect attampt max**: The maximum number of reconnect attempts before an error is reported back to the client on the first attempt by the client to connect to a server. Set to -1 to use unlimited attempts. Defaults to 0.

- **Reconnect attampt max**: The maximum number of reconnect attempts before an error is reported back to the client after a server connection had previously been established. Set to -1 to use unlimited attempts. Defaults to 0.

## Pub sampler
![pub_sampler](screenshots/pub_sampler.png)

For **MQTT connection**, **User authentication**, **Connection options** and **MQTT version** section settings, please refer to *Connection sampler* for more detailed information.

- **Share conn in thread**: This option allows all of pub and sub samplers in the same threadgroup shares the same connection, this can simulate the situation of one device can be either pub or sub. For example, one IoT device can either send message to server, or receive the control message from server. Please notice, only those samplers in the same threadgroup check this option, then the connection will be shared. Also, the connection settings of first pub/sub sampler in the threadgroup will be used for shared connections, rests of connection settings in other samplers will be ignored if the option is checked. Please take a look at following 3 examples.

```
ThreadGroupSample1
PubSampler1 (shared connection), the connection settings will be used for the shared connection.
SubSampler1 (shared connection), use shared connection of PubSampler1, the connection setting of this sampler will be ignored.
ThreadGroupSample2
PubSampler1 (shared connection), the connection settings will be used for the shared connection.
SubSampler1 (not shared connection), another connection will be created with configuration in this sampler.

## Pub Sampler
![pub_sampler](screenshots/pub_sampler.png)

ThreadGroupSample3
PubSampler1 (not shared connection), one connection will be created for the connection setting in this sampler.
SubSampler1 (shared connection), the connection settings will be used for the shared connection.
SubSampler2 (shared connection), use shared connection of SubSampler1, so the connection setting of this sampler will be ignored.
```
Pub sampler reuses previously established connection (by Connect sampler) to publish a message. If connection is not ready at this moment, pub sampler will just fail immediately.

### Pub options

- **QoS level**: The available QoS value, 0 is AT_MOST_ONCE, 1 is AT_LEAST_ONCE and 2 is EXACTLY_ONCE.

- **Topic name**: The topic name that the message will send to.
- **Topic name**: Name of the topic that the message will be sent to.

- **Add timestamp in payload**: Add timestamp in the payload or not. If the checkbox is enabled, then timestamp of running pub sampler will be added ahead of payload. Mostly it can be used together with **Sub sampler** to calculate message latency time.
- **Add timestamp in payload**: Add timestamp in the payload or not. If the checkbox is enabled, then timestamp of running pub sampler will be added before real payload. Mostly it's used together with **Sub sampler** to calculate message latency time.

### Payloads

Expand All @@ -117,18 +97,17 @@ ThreadGroupSample3

![payload_setting](screenshots/payload_setting.png)

## Sub sampler
![sub_sampler](screenshots/sub_sampler.png)

For **MQTT connection**, **User authentication**, **Connection options** and **MQTT version** section settings, please refer to *Connection sampler* for more detailed information.
## Sub Sampler
![sub_sampler](screenshots/sub_sampler.png)

For **Share conn in thread**, please refer to the Pub sampler.
Sub sampler reuses previously established connection (by Connect sampler) to subscribe message(s). If connection is not ready at this moment, sub sampler will just fail immediately.

### Sub options

- **QoS level**: The available QoS value, 0 is AT_MOST_ONCE, 1 is AT_LEAST_ONCE and 2 is EXACTLY_ONCE.

- **Topic name**: The topic name that subscriber will subscribe to. If want to subscribe multiple topics, please use comma to separate the different topics.
- **Topic name(s)**: A list of topic names (comma-separated) that will be subscribed to.

- **Payload includes timestamp**: If the checkbox is enabled, then it means the payload includes timestamp. It can be used to calcuate the message latency time.

Expand All @@ -138,9 +117,29 @@ message_latency = timestamp_in_sub_when_receive_msg - timestamp_in_payload (time
Please notice, if the machine publish message is not the same as subscriber, then the calculated message latency time is not accurate.
It's because the time is almost not the same in different machines. So the latency time calculated by sub sampler could be only be a reference.
```
- **Sample on**: It controls how to sample. The default value is '**elapsed with specified time(ms)**', which means a sub sampler will be occurred every ms specified in next text field (default is 1000ms). During the 1000 ms, multiple messages could be received, and result in report is the summarized data during 1000 ms. If the value is set to 2000, then means summarized report during 2000 ms. Another option is '**received number of message**', which means a sub sampler will be occurred when received number of message that specified in next text field (default is 1).
- **Sample on**: It controls how to sample. The default value is '**elapsed with specified time(ms)**', which means a sub sampler will occur every specified milli-seconds (default is 1000ms). During the 1000 ms, multiple messages could be received, and result in report is the summarized data during 1000 ms. If the value is set to 2000, then means summarized report during 2000 ms. Another option is '**number of received messages**', which means a sub sampler will occur after receiving these specified number of messages (default is 1).

- **Debug response**: If checked, the received message will be print in response. It's recommended to enable this option when you debug your script.


## DisConnect Sampler
![disconn_sampler](screenshots/disconn_sampler.png)

- **Debug response**: If it's checked, then the received message will be print in response. It's recommend to enable it when you're debugging script.
This sampler is very simple, it just clear the previous created connection. Therefore, next time you run Connect sampler, it will initiate a new MQTT server connection for you. As you can imagine, Disconnect sample will fail immediately if no connection is detected at this moment.


## Example JMeter Scripts
As a reference, you can check out some example scripts in SampleScripts folder.
1) background_connection.jmx:
Simulate massive background MQTT connections to server. You can optionally subscribe to a topic when connecting. (Please modify "xmeter_runtime_vars" UDV to fit your needs.)

2) pubsub_unidirection.jmx:
Demonstrate how sub sampler can get messages from corresponding pub sampler, with two JMeter user groups and delay between opertions.

3) pubsub_bidirection.jmx:
Demonstrate how a set of Devices and Mobiles exchange messages in both directions.

![example_scripts](screenshots/example_scripts.png "example script structure")

## Certification files for SSL/TLS connections
After deploying emqtt server, you get the following OOTB (out of the box) SSL/TLS certification files under ${EMQTTD_HOME}/etc/certs directory:
Expand Down Expand Up @@ -170,3 +169,4 @@ openssl pkcs12 -export -inkey client-key.pem -in client-cert.pem -out client.p12
#### Specify key store, client certfication and corresponding pass phrases in plugin sampler:

![ssl_conn](screenshots/ssl_conn.png)

Loading

0 comments on commit 0edf972

Please sign in to comment.