- Sponsor
-
Notifications
You must be signed in to change notification settings - Fork 1.1k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Redis server crash when adding lots of hash keys #12
Comments
Can you observe and share some statistics about usage of Redis - in terms of number of keys, data ingestion rate, and so on? I'm looking for some clues how to reproduce this :) |
I could send you the exe that does the trick. I will need your mail
address...
Op 21 mrt. 2018 14:47 schreef "Tomasz Poradowski" <notifications@github.com
…:
Can you observe and share some statistics about usage of Redis - in terms
of number of keys, data ingestion rate, and so on? I'm looking for some
clues how to reproduce this :)
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
<#12 (comment)>,
or mute the thread
<https://github.com/notifications/unsubscribe-auth/ATFzjxeyDNSjCkxhLraP0umu5pQd4Akgks5tglnVgaJpZM4Sz2Ur>
.
|
tomasz@poradowski.com (it's also in my profile) |
@Kortenbach please ping me here when you send it as it might go to spam by accident |
ping |
Pong! As expected, landed in spam folder due to suspicious attachment ;) |
@Kortenbach I've just sent you fixed version for testing via email. If it also works fine for you - I will commit the changes and release version 4.0.2.2. Thanks! |
Thanks !
Will test next Monday.
|
=== REDIS BUG REPORT START: Cut & paste starting from here === Hi,version 4.0.2.2 still has this bug。 |
@wywdstc can you provide some steps to reproduce it? |
@tporadowski |
Could you please be a little more specific? :) What is "lots of hash key"? Are you adding new hashes or setting many entries in one or more hashes? |
The bug machion is slave node,os is win2012, 错误应用程序名称: redis-server.exe,版本: 4.0.2.2,时间戳: 0x5ab8cd85 |
192.168.0.229:14229> info Serverredis_version:4.0.2.2 Clientsconnected_clients:1 Memoryused_memory:3225813168 Persistenceloading:1 Statstotal_connections_received:1 Replicationrole:master CPUused_cpu_sys:10.08 Clustercluster_enabled:1 Keyspacedb0:keys=10724999,expires=0,avg_ttl=0 |
Thanks for the details. I am currently feeding my test instance with 1M hashes with 100 items each (random string values of 40 characters), so far no issue at all. I'll see what happens in cluster mode. Could you please share your configuration (if not here, then via email from my profile)? |
ok,here is it. |
i have restarted this node,bug still occurs .168.0.226:13226@23226 master === REDIS BUG REPORT START: Cut & paste starting from here === Serverredis_version:4.0.2.2 Clientsconnected_clients:0 Memoryused_memory:2206297760 Persistenceloading:1 Statstotal_connections_received:0 Replicationrole:slave CPUused_cpu_sys:45.31 CommandstatsClustercluster_enabled:1 Keyspacedb0:keys=5907544,expires=0,avg_ttl=0
|
It seems memory full caused this issue? |
I suppose that's quite likely. Yesterday I tried a 3+3 cluster with a million of hashes (200 keys with 10 random characters as values) and with |
Hi, Crash detailsFaulting application name: redis-server.exe, version: 0.0.0.0, time stamp: 0x57767e0b
|
@ChandraModemGM version 3.2.100 was the last released by MS OpenTech team in July 2016 and then it got suddenly stopped. You can try the latest v5.0.9 from this fork (https://github.com/tporadowski/redis/releases) and if you still run into issues - report them in issues. |
@tporadowski Thanks much, will take a look. |
My Redis server is crashing at seemingly random points. Mostly when I'm setting a lot of Hash keys, but it could be something else. So far the server has crashed 5 times. Below is the report I copied from the server console:
[14676] 21 Mar 14:21:37.249 # fork operation complete
[14676] 21 Mar 14:21:37.250 * Background saving terminated with success
[14676] 21 Mar 14:21:51.051 * Starting automatic rewriting of AOF on 100% growth
[14676] 21 Mar 14:21:51.052 * Background append only file rewriting started by p
id 13768
=== REDIS BUG REPORT START: Cut & paste starting from here ===
Redis version: 4.0.2.1
[13768] 21 Mar 14:21:51.130 # --- EXCEPTION_ACCESS_VIOLATION
[13768] 21 Mar 14:21:51.131 # --- STACK TRACE
redis-server.exe!UnhandledExceptiontHandler(d:\dev\github\redis\src\win32_intero
p\win32_stacktrace.cpp:185)(0x00000001, 0x00000000, 0x00000001, 0x1400497A2)
kernel32.dll!UnhandledExceptionFilter(d:\dev\github\redis\src\win32_interop\win3
2_stacktrace.cpp:185)(0x0012E530, 0x00000006, 0x00000000, 0x100000001)
ntdll.dll!EtwEventSetInformation(d:\dev\github\redis\src\win32_interop\win32_sta
cktrace.cpp:185)(0x0012F170, 0x0334D8F8, 0x140170830, 0x00000000)
ntdll.dll!C_specific_handler(d:\dev\github\redis\src\win32_interop\win32_stackt
race.cpp:185)(0x00130000, 0x0012FF90, 0x0012FF90, 0x778EF818)
ntdll.dll!RtlDecodePointer(d:\dev\github\redis\src\win32_interop\win32_stacktrac
e.cpp:185)(0x00130000, 0x7779DD88, 0x000127EC, 0x001C0080)
ntdll.dll!RtlUnwindEx(d:\dev\github\redis\src\win32_interop\win32_stacktrace.cpp
:185)(0x0012F170, 0x0012EC80, 0x00000000, 0x00000000)
ntdll.dll!KiUserExceptionDispatcher(d:\dev\github\redis\src\win32_interop\win32
stacktrace.cpp:185)(0x14019AEA4, 0x1400DA5E7, 0x14019AEA4, 0x00000002)
redis-server.exe!rioWriteBulkObject(d:\dev\github\redis\src\aof.c:796)(0x0000000
0, 0x0000000E, 0x00000002, 0x14007DB77)
redis-server.exe!rioWriteHashIteratorCursor(d:\dev\github\redis\src\aof.c:979)(0
x0012F56E, 0x0012F520, 0x00000002, 0x0012F5D0)
redis-server.exe!rewriteHashObject(d:\dev\github\redis\src\aof.c:998)(0x0012F5D0
, 0x0012F5C8, 0x14019AEA6, 0x7E112AE6CC0)
redis-server.exe!rewriteAppendOnlyFile(d:\dev\github\redis\src\aof.c:1100)(0x025
70000, 0x02570000, 0x00000000, 0x02570000)
redis-server.exe!QForkChildInit(d:\dev\github\redis\src\win32_interop\win32_qfor
k.cpp:350)(0x0039B1E0, 0x00000178, 0x003A78E0, 0x1401B8D18)
redis-server.exe!QForkStartup(d:\dev\github\redis\src\win32_interop\win32_qfork.
cpp:525)(0x0039B1E0, 0x00000000, 0x00000005, 0x00000006)
redis-server.exe!main(d:\dev\github\redis\src\win32_interop\win32_qfork.cpp:1284
)(0x00000000, 0x00000000, 0x1401BAD98, 0x00000000)
redis-server.exe!__scrt_common_main_seh(f:\dd\vctools\crt\vcstartup\src\startup
exe_common.inl:283)(0x00000000, 0x00000000, 0x00000000, 0x00000000)
kernel32.dll!BaseThreadInitThunk(f:\dd\vctools\crt\vcstartup\src\startup\exe_com
mon.inl:283)(0x00000000, 0x00000000, 0x00000000, 0x00000000)
ntdll.dll!RtlUserThreadStart(f:\dd\vctools\crt\vcstartup\src\startup\exe_common.
inl:283)(0x00000000, 0x00000000, 0x00000000, 0x00000000)
ntdll.dll!RtlUserThreadStart(f:\dd\vctools\crt\vcstartup\src\startup\exe_common.
inl:283)(0x00000000, 0x00000000, 0x00000000, 0x00000000)
[13768] 21 Mar 14:21:51.153 # --- INFO OUTPUT
[14676] 21 Mar 14:22:04.652 # fork operation failed
[14676] 21 Mar 14:22:04.658 # Background AOF rewrite terminated by signal 1
[14676] 21 Mar 14:22:04.759 * Starting automatic rewriting of AOF on 110% growth
[14676] 21 Mar 14:22:04.759 * Background append only file rewriting started by p
id 14272
=== REDIS BUG REPORT START: Cut & paste starting from here ===
Redis version: 4.0.2.1
[14272] 21 Mar 14:22:04.798 # --- EXCEPTION_ACCESS_VIOLATION
[14272] 21 Mar 14:22:04.798 # --- STACK TRACE
redis-server.exe!UnhandledExceptiontHandler(d:\dev\github\redis\src\win32_intero
p\win32_stacktrace.cpp:185)(0x00000001, 0x00000000, 0x00000001, 0x1400497A2)
kernel32.dll!UnhandledExceptionFilter(d:\dev\github\redis\src\win32_interop\win3
This repeats until I close the server
The text was updated successfully, but these errors were encountered: