Skip to content
This repository has been archived by the owner on Feb 20, 2021. It is now read-only.

REDIS Stress Test Report – Phase I

Jump to bottom
unknown edited this page Nov 5, 2014 · 7 revisions

Scope

This report describes the test strategy and results of testing the completeness of REDIS DB Server implementation for Windows.

Test Coverage

  • Redis servers:

  • version 2.4

  • 32bit

  • 64bit

  • version 2.6

  • 32bit

  • 64bit

  • All value types including:

  • Strings

  • Lists

  • Sets

  • Hashes

  • Sorted sets

  • Client-server configurations:

  • 1 master - 0 slaves - 4 clients (4 clients per server)

Redis Test Configuration 1

  • 1 master - 2 slaves - 4 clients (2 clients per server)

Redis Test Configuration 2

  • 1 master - 4 slaves - 4 clients (1 client per server)

Redis Test Configuration 3

Testing Procedures

Generally procedure can be described as follows:

  • While version < max
    • Take REDIS Server of correspondent version
    • While configuration setup < max
    • Deploy one of the client-server configuration
    • Fill database with initial values (7000 of each value type)
    • Verify that data added to the database without problems
    • Store number of values added and value of memory used field
    • Run the automated test for specified time
    • Compare number of values added and value of memory used field with initial
    • Check logs for errors
    • Check process memory usage
    • Loop
  • Loop

Automation Scenario

##Client 1

  • Add 5000 sets
  • Add 5000 strings
  • SYNC
  • Remove 5000 strings
  • SYNC
  • Add 5000 sorted sets
  • SYNC
  • Add 5000 strings
  • Remove 5000 sets
  • SYNC
  • Remove 5000 lists
  • SYNC
  • Remove 5000 hashes
  • SYNC
  • Add 5000 sorted sets

Client 2

  • Add 5000 lists
  • Remove 5000 lists
  • SYNC
  • Add 5000 hashes
  • SYNC
  • Add 5000 lists
  • SYNC
  • Remove 5000 strings
  • SYNC
  • Remove 5000 sets
  • SYNC
  • Remove 5000 sorted sets
  • SYNC
  • Add 5000 hashes

Client 3

  • Add 5000 hashes
  • Remove 5000 hashes
  • SYNC
  • Remove 5000 sets
  • SYNC
  • Add 5000 sets
  • SYNC
  • Remove 5000 hashes
  • SYNC
  • Add 5000 sorted sets
  • SYNC
  • Add 5000 strings
  • SYNC
  • Remove 5000 lists
  • Remove 5000 hashes

Client 4

  • Add 5000 sorted sets
  • Remove 5000 sorted sets
  • SYNC
  • Remove 5000 sorted sets
  • SYNC
  • Add 5000 sets
  • SYNC
  • Add 5000 hashes
  • SYNC
  • Add 5000 lists
  • SYNC
  • Remove 5000 strings
  • Remove 5000 sorted sets

Test Execution

  • Windows azure - 14 day continuous run
    • 1-4-4 setup
    • All versions
  • Local machines - 1 day continuous run
    • All setups
    • All versions
  • Local machines - 16 days continuous run
    • 1-4-4 setup
    • 2.6-32
    • 2.6-64

Redis.conf

Redis configuration file used for both Master and Replicas can be found here

Bugs found

  • Server crash due to closing empty handle
  • Wrong console memory reporting (initially assumed as memory leak).

=== REDIS BUG REPORT START: Cut & paste starting from here === [4776] 29 Dec 09:13:11.730 # Redis version: 3.0.504 [4776] 29 Dec 09:13:11.730 # --- EXCEPTION_ACCESS_VIOLATION [4776] 29 Dec 09:13:11.730 # --- STACK TRACE redis-server.exe!LogStackTrace(c:\release\redis\src\win32_interop\win32_stacktrace.cpp:95)(0x0014DFA0, 0x0014FF60, 0x0014DFA0, 0x40124730) redis-server.exe!UnhandledExceptiontHandler(c:\release\redis\src\win32_interop\win32_stacktrace.cpp:185)(0x40028E60, 0x40028E60, 0x0014DFA0, 0x00000010) KERNELBASE.dll!UnhandledExceptionFilter(c:\release\redis\src\win32_interop\win32_stacktrace.cpp:185)(0x00000000, 0x95B02008, 0x00000000, 0x00000000) ntdll.dll!memset(c:\release\redis\src\win32_interop\win32_stacktrace.cpp:185)(0x0014EC30, 0xFEEEFEEE, 0x0014EC30, 0x0014E568) ntdll.dll!_C_specific_handler(c:\release\redis\src\win32_interop\win32_stacktrace.cpp:185)(0x00000000, 0x0014E550, 0x00000000, 0x40000000) ntdll.dll!_chkstk(c:\release\redis\src\win32_interop\win32_stacktrace.cpp:185)(0x0014E550, 0x00000000, 0x9365BC3C, 0x935B0000) ntdll.dll!RtlWalkFrameChain(c:\release\redis\src\win32_interop\win32_stacktrace.cpp:185)(0x0EADE9EA, 0xFE8E3B55, 0x0014F5F8, 0x959D7F3D) ntdll.dll!KiUserExceptionDispatcher(c:\release\redis\src\win32_interop\win32_stacktrace.cpp:185)(0x4008E920, 0x00000030, 0x400DD251, 0x04407040) redis-server.exe!dictGenHashFunction(c:\release\redis\src\dict.c:127)(0x00000030, 0x400DD251, 0x04407040, 0x0014F6B0) redis-server.exe!dictFind(c:\release\redis\src\dict.c:514)(0x0014F5F8, 0x00000001, 0x04407040, 0x04407070) redis-server.exe!getExpire(c:\release\redis\src\db.c:804)(0x0014F6B0, 0x0FBC1A40, 0x064B65A0, 0x064B65A0) redis-server.exe!rdbSaveRio(c:\release\redis\src\rdb.c:693)(0x40150210, 0x01630000, 0x00000005, 0x01A32754) redis-server.exe!rdbSave(c:\release\redis\src\rdb.c:758)(0x01630000, 0x5FD7F6A3, 0x01630000, 0x00000005) redis-server.exe!QForkChildInit(c:\release\redis\src\win32_interop\win32_qfork.cpp:337)(0x00000005, 0x00000000, 0x0057DFA0, 0x00000005) redis-server.exe!QForkStartup(c:\release\redis\src\win32_interop\win32_qfork.cpp:515)(0x00000006, 0x00000000, 0x00000000, 0x00565640) redis-server.exe!main(c:\release\redis\src\win32_interop\win32_qfork.cpp:1240)(0x00000000, 0x00000000, 0x00000000, 0x00000000) redis-server.exe!__tmainCRTStartup(f:\dd\vctools\crt\crtw32\startup\crt0.c:255)(0x00000000, 0x00000000, 0x00000000, 0x00000000) KERNEL32.DLL!BaseThreadInitThunk(f:\dd\vctools\crt\crtw32\startup\crt0.c:255)(0x00000000, 0x00000000, 0x00000000, 0x00000000) ntdll.dll!RtlUserThreadStart(f:\dd\vctools\crt\crtw32\startup\crt0.c:255)(0x00000000, 0x00000000, 0x00000000, 0x00000000) ntdll.dll!RtlUserThreadStart(f:\dd\vctools\crt\crtw32\startup\crt0.c:255)(0x00000000, 0x00000000, 0x00000000, 0x00000000) [4776] 29 Dec 09:13:11.730 # --- INFO OUTPUT

Server

redis_version:3.0.504 redis_git_sha1:00000000 redis_git_dirty:0 redis_build_id:a4f7a6e86f2d60b3 redis_mode:standalone os:Windows
arch_bits:64 multiplexing_api:WinSock_IOCP process_id:4776 run_id:f6e90d287241e61ad8cbd212aee43e72ab1bb563 tcp_port:6379 uptime_in_seconds:1616860 uptime_in_days:18 hz:10 lru_clock:15385071 config_file:C:\Program Files\Redis\redis.windows-service.conf

Clients

connected_clients:283 client_longest_output_list:1 client_biggest_input_buf:4265607760 blocked_clients:0

Memory

used_memory:944 used_memory_human:944B used_memory_rss:307938944 used_memory_peak:551673856 used_memory_peak_human:526.12M used_memory_lua:-32010591232 mem_fragmentation_ratio:326206.50 mem_allocator:jemalloc-3.6.0

Persistence

loading:0 rdb_changes_since_last_save:248539 rdb_bgsave_in_progress:1 rdb_last_save_time:1609220530 rdb_last_bgsave_status:ok rdb_last_bgsave_time_sec:2 rdb_current_bgsave_time_sec:1609220592 aof_enabled:0 aof_rewrite_in_progress:0 aof_rewrite_scheduled:0 aof_last_rewrite_time_sec:-1 aof_current_rewrite_time_sec:-1 aof_last_bgrewrite_status:ok aof_last_write_status:ok

Stats

total_connections_received:2145 total_commands_processed:6532475159 instantaneous_ops_per_sec:22654 total_net_input_bytes:772342079093 total_net_output_bytes:8913770464992 instantaneous_input_kbps:2717.40 instantaneous_output_kbps:26171.58 rejected_connections:0 sync_full:0 sync_partial_ok:0 sync_partial_err:0 expired_keys:158349869 evicted_keys:0 keyspace_hits:2863444947 keyspace_misses:290755433 pubsub_channels:1 pubsub_patterns:0 latest_fork_usec:20866 migrate_cached_sockets:0

Replication

role:master connected_slaves:0 master_repl_offset:0 repl_backlog_active:0 repl_backlog_size:1048576 repl_backlog_first_byte_offset:0 repl_backlog_histlen:0

CPU

used_cpu_sys:0.08 used_cpu_user:0.06 used_cpu_sys_children:0.00 used_cpu_user_children:0.00

Commandstats

Cluster

cluster_enabled:0

Keyspace

db0:keys=2,expires=1,avg_ttl=21168130416 db1:keys=323823,expires=323823,avg_ttl=498062 db2:keys=597,expires=597,avg_ttl=660808 db3:keys=1,expires=0,avg_ttl=0 [4776] 29 Dec 09:13:11.730 # === REDIS BUG REPORT END. Make sure to include from START to END. ===

   Please report this bug by following the instructions at:

 http://github.com/MSOpenTech/redis/wiki/Submitting-an-Issue

Suspect RAM error? Use redis-server --test-memory to verify it.

[3708] 29 Dec 09:13:12.104 # fork operation failed

Clone this wiki locally