Skip to content

daily_run_test

daily_run_test #491

Triggered via schedule December 22, 2024 14:27
Status Failure
Total duration 3h 59m 17s
Artifacts 1

daily-run-test.yml

on: schedule
Matrix: build-pypi-lmdeploy
build-pypi
18s
build-pypi
Matrix: fullbench_run_test
Matrix: prepare_env
Matrix: daily_run_test
notify_to_feishu
6s
notify_to_feishu
Fit to window
Zoom out
Zoom in

Annotations

18 errors and 5 warnings
fullbench_run_test (base_long_context)
Process completed with exit code 1.
fullbench_run_test (base_objective)
Process completed with exit code 1.
fullbench_run_test (chat_long_context)
Process completed with exit code 1.
fullbench_run_test (chat_objective)
unable to access 'https://github.com/open-compass/opencompass/': GnuTLS recv error (-110): The TLS connection was non-properly terminated.
fullbench_run_test (chat_objective)
unable to access 'https://github.com/open-compass/opencompass/': GnuTLS recv error (-110): The TLS connection was non-properly terminated.
fullbench_run_test (chat_objective)
unable to access 'https://github.com/open-compass/opencompass/': Failed to connect to github.com port 443: Connection timed out
fullbench_run_test (chat_objective)
The process '/usr/bin/git' failed with exit code 128
fullbench_run_test (chat_subjective)
Process completed with exit code 1.
fullbench_run_test (chat_subjective)
unable to access 'https://github.com/open-compass/opencompass/': Failed to connect to github.com port 443: Connection timed out
fullbench_run_test (chat_subjective)
unable to access 'https://github.com/open-compass/opencompass/': GnuTLS recv error (-110): The TLS connection was non-properly terminated.
daily_run_test (dsw_cu12, base_models)
Process completed with exit code 1.
daily_run_test (dsw_cu12, api)
No space left on device : '/cpfs01/user/qa-llm-cicd/actions-runner-cu12/_diag/blocks/577ba08b-74cc-4577-b35a-2489fd3196f6_d94bd5eb-bda8-568e-bb54-5523887fd9b5.1'
daily_run_test (dsw_cu12, base_fullbench)
No space left on device : '/cpfs01/user/qa-llm-cicd/actions-runner-cu12/_work/_actions/_temp_bb3fbf01-5728-4a30-8a19-c37c1e339966/5ac3bd8a-05ed-4a5f-be3f-68dd2c33329b.tar.gz'
daily_run_test (dsw_cu12, chat_models)
System.IO.IOException: No space left on device : '/cpfs01/user/qa-llm-cicd/actions-runner-cu12/_diag/Worker_20241222-174339-utc.log' at System.IO.RandomAccess.WriteAtOffset(SafeFileHandle handle, ReadOnlySpan`1 buffer, Int64 fileOffset) at System.IO.Strategies.OSFileStreamStrategy.Write(ReadOnlySpan`1 buffer) at System.IO.Strategies.BufferedFileStreamStrategy.WriteSpan(ReadOnlySpan`1 source, ArraySegment`1 arraySegment) at System.IO.Strategies.BufferedFileStreamStrategy.Write(ReadOnlySpan`1 buffer) at System.IO.StreamWriter.Flush(Boolean flushStream, Boolean flushEncoder) at System.IO.StreamWriter.WriteLine(String value) at System.Diagnostics.TextWriterTraceListener.WriteLine(String message) at GitHub.Runner.Common.HostTraceListener.WriteLine(String message) at GitHub.Runner.Common.HostTraceListener.TraceEvent(TraceEventCache eventCache, String source, TraceEventType eventType, Int32 id, String message) at System.Diagnostics.TraceSource.TraceEvent(TraceEventType eventType, Int32 id, String message) at GitHub.Runner.Common.Tracing.Trace(TraceEventType eventType, String message) at GitHub.Runner.Common.Tracing.Info(String message) at GitHub.Runner.Worker.Worker.RunAsync(String pipeIn, String pipeOut) at GitHub.Runner.Worker.Program.MainAsync(IHostContext context, String[] args) System.IO.IOException: No space left on device : '/cpfs01/user/qa-llm-cicd/actions-runner-cu12/_diag/Worker_20241222-174339-utc.log' at System.IO.RandomAccess.WriteAtOffset(SafeFileHandle handle, ReadOnlySpan`1 buffer, Int64 fileOffset) at System.IO.Strategies.OSFileStreamStrategy.Write(ReadOnlySpan`1 buffer) at System.IO.Strategies.BufferedFileStreamStrategy.WriteSpan(ReadOnlySpan`1 source, ArraySegment`1 arraySegment) at System.IO.Strategies.BufferedFileStreamStrategy.Write(ReadOnlySpan`1 buffer) at System.IO.StreamWriter.Flush(Boolean flushStream, Boolean flushEncoder) at System.Diagnostics.TextWriterTraceListener.Flush() at GitHub.Runner.Common.HostTraceListener.Write(String message) at GitHub.Runner.Common.HostTraceListener.WriteHeader(String source, TraceEventType eventType, Int32 id) at GitHub.Runner.Common.HostTraceListener.TraceEvent(TraceEventCache eventCache, String source, TraceEventType eventType, Int32 id, String message) at System.Diagnostics.TraceSource.TraceEvent(TraceEventType eventType, Int32 id, String message) at GitHub.Runner.Common.Tracing.Trace(TraceEventType eventType, String message) at GitHub.Runner.Common.Tracing.Error(Exception exception) at GitHub.Runner.Worker.Program.MainAsync(IHostContext context, String[] args) Unhandled exception. System.IO.IOException: No space left on device : '/cpfs01/user/qa-llm-cicd/actions-runner-cu12/_diag/Worker_20241222-174339-utc.log' at System.IO.RandomAccess.WriteAtOffset(SafeFileHandle handle, ReadOnlySpan`1 buffer, Int64 fileOffset) at System.IO.Strategies.OSFileStreamStrategy.Write(ReadOnlySpan`1 buffer) at System.IO.Strategies.BufferedFileStreamStrategy.Flush(Boolean flushToDisk) at System.IO.StreamWriter.Flush(Boolean flushStream, Boolean flushEncoder) at System.Diagnostics.TextWriterTraceListener.Flush() at System.Diagnostics.TraceSource.Flush() at GitHub.Runner.Common.Tracing.Dispose(Boolean disposing) at GitHub.Runner.Common.Tracing.Dispose() at GitHub.Runner.Common.TraceManager.Dispose(Boolean disposing) at GitHub.Runner.Common.TraceManager.Dispose() at GitHub.Runner.Common.HostContext.Dispose(Boolean disposing) at GitHub.Runner.Common.HostContext.Dispose() at GitHub.Runner.Worker.Program.Main(String[] args)
daily_run_test (dsw_cu12, chat_obj_fullbench)
Process completed with exit code 1.
daily_run_test (dsw_cu12, chat_obj_fullbench)
No space left on device : '/cpfs01/user/qa-llm-cicd/actions-runner-cu12/_work/_temp/_github_workflow/event.json'
daily_run_test (dsw_cu12, chat_sub_fullbench)
System.IO.IOException: No space left on device : '/cpfs01/user/qa-llm-cicd/actions-runner-cu12/_diag/Worker_20241222-182638-utc.log' at System.IO.RandomAccess.WriteAtOffset(SafeFileHandle handle, ReadOnlySpan`1 buffer, Int64 fileOffset) at System.IO.Strategies.OSFileStreamStrategy.Write(ReadOnlySpan`1 buffer) at System.IO.Strategies.BufferedFileStreamStrategy.WriteSpan(ReadOnlySpan`1 source, ArraySegment`1 arraySegment) at System.IO.Strategies.BufferedFileStreamStrategy.Write(ReadOnlySpan`1 buffer) at System.IO.StreamWriter.Flush(Boolean flushStream, Boolean flushEncoder) at System.IO.StreamWriter.WriteLine(String value) at System.Diagnostics.TextWriterTraceListener.WriteLine(String message) at GitHub.Runner.Common.HostTraceListener.WriteLine(String message) at GitHub.Runner.Common.HostTraceListener.TraceEvent(TraceEventCache eventCache, String source, TraceEventType eventType, Int32 id, String message) at System.Diagnostics.TraceSource.TraceEvent(TraceEventType eventType, Int32 id, String message) at GitHub.Runner.Common.Tracing.Trace(TraceEventType eventType, String message) at GitHub.Runner.Common.Tracing.Info(String message) at GitHub.Runner.Worker.Worker.RunAsync(String pipeIn, String pipeOut) at GitHub.Runner.Worker.Program.MainAsync(IHostContext context, String[] args) System.IO.IOException: No space left on device : '/cpfs01/user/qa-llm-cicd/actions-runner-cu12/_diag/Worker_20241222-182638-utc.log' at System.IO.RandomAccess.WriteAtOffset(SafeFileHandle handle, ReadOnlySpan`1 buffer, Int64 fileOffset) at System.IO.Strategies.OSFileStreamStrategy.Write(ReadOnlySpan`1 buffer) at System.IO.Strategies.BufferedFileStreamStrategy.WriteSpan(ReadOnlySpan`1 source, ArraySegment`1 arraySegment) at System.IO.Strategies.BufferedFileStreamStrategy.Write(ReadOnlySpan`1 buffer) at System.IO.StreamWriter.Flush(Boolean flushStream, Boolean flushEncoder) at System.Diagnostics.TextWriterTraceListener.Flush() at GitHub.Runner.Common.HostTraceListener.Write(String message) at GitHub.Runner.Common.HostTraceListener.WriteHeader(String source, TraceEventType eventType, Int32 id) at GitHub.Runner.Common.HostTraceListener.TraceEvent(TraceEventCache eventCache, String source, TraceEventType eventType, Int32 id, String message) at System.Diagnostics.TraceSource.TraceEvent(TraceEventType eventType, Int32 id, String message) at GitHub.Runner.Common.Tracing.Trace(TraceEventType eventType, String message) at GitHub.Runner.Common.Tracing.Error(Exception exception) at GitHub.Runner.Worker.Program.MainAsync(IHostContext context, String[] args) Unhandled exception. System.IO.IOException: No space left on device : '/cpfs01/user/qa-llm-cicd/actions-runner-cu12/_diag/Worker_20241222-182638-utc.log' at System.IO.RandomAccess.WriteAtOffset(SafeFileHandle handle, ReadOnlySpan`1 buffer, Int64 fileOffset) at System.IO.Strategies.OSFileStreamStrategy.Write(ReadOnlySpan`1 buffer) at System.IO.Strategies.BufferedFileStreamStrategy.Flush(Boolean flushToDisk) at System.IO.StreamWriter.Flush(Boolean flushStream, Boolean flushEncoder) at System.Diagnostics.TextWriterTraceListener.Flush() at System.Diagnostics.TraceSource.Flush() at GitHub.Runner.Common.Tracing.Dispose(Boolean disposing) at GitHub.Runner.Common.Tracing.Dispose() at GitHub.Runner.Common.TraceManager.Dispose(Boolean disposing) at GitHub.Runner.Common.TraceManager.Dispose() at GitHub.Runner.Common.HostContext.Dispose(Boolean disposing) at GitHub.Runner.Common.HostContext.Dispose() at GitHub.Runner.Worker.Program.Main(String[] args)
daily_run_test (dsw_cu12, cmd)
System.IO.IOException: No space left on device : '/cpfs01/user/qa-llm-cicd/actions-runner-cu12/_diag/Worker_20241222-182645-utc.log' at System.IO.RandomAccess.WriteAtOffset(SafeFileHandle handle, ReadOnlySpan`1 buffer, Int64 fileOffset) at System.IO.Strategies.OSFileStreamStrategy.Write(ReadOnlySpan`1 buffer) at System.IO.Strategies.BufferedFileStreamStrategy.WriteSpan(ReadOnlySpan`1 source, ArraySegment`1 arraySegment) at System.IO.Strategies.BufferedFileStreamStrategy.Write(ReadOnlySpan`1 buffer) at System.IO.StreamWriter.Flush(Boolean flushStream, Boolean flushEncoder) at System.IO.StreamWriter.WriteLine(String value) at System.Diagnostics.TextWriterTraceListener.WriteLine(String message) at GitHub.Runner.Common.HostTraceListener.WriteLine(String message) at GitHub.Runner.Common.HostTraceListener.TraceEvent(TraceEventCache eventCache, String source, TraceEventType eventType, Int32 id, String message) at System.Diagnostics.TraceSource.TraceEvent(TraceEventType eventType, Int32 id, String message) at GitHub.Runner.Common.Tracing.Trace(TraceEventType eventType, String message) at GitHub.Runner.Common.Tracing.Info(String message) at GitHub.Runner.Worker.Worker.RunAsync(String pipeIn, String pipeOut) at GitHub.Runner.Worker.Program.MainAsync(IHostContext context, String[] args) System.IO.IOException: No space left on device : '/cpfs01/user/qa-llm-cicd/actions-runner-cu12/_diag/Worker_20241222-182645-utc.log' at System.IO.RandomAccess.WriteAtOffset(SafeFileHandle handle, ReadOnlySpan`1 buffer, Int64 fileOffset) at System.IO.Strategies.OSFileStreamStrategy.Write(ReadOnlySpan`1 buffer) at System.IO.Strategies.BufferedFileStreamStrategy.WriteSpan(ReadOnlySpan`1 source, ArraySegment`1 arraySegment) at System.IO.Strategies.BufferedFileStreamStrategy.Write(ReadOnlySpan`1 buffer) at System.IO.StreamWriter.Flush(Boolean flushStream, Boolean flushEncoder) at System.Diagnostics.TextWriterTraceListener.Flush() at GitHub.Runner.Common.HostTraceListener.Write(String message) at GitHub.Runner.Common.HostTraceListener.WriteHeader(String source, TraceEventType eventType, Int32 id) at GitHub.Runner.Common.HostTraceListener.TraceEvent(TraceEventCache eventCache, String source, TraceEventType eventType, Int32 id, String message) at System.Diagnostics.TraceSource.TraceEvent(TraceEventType eventType, Int32 id, String message) at GitHub.Runner.Common.Tracing.Trace(TraceEventType eventType, String message) at GitHub.Runner.Common.Tracing.Error(Exception exception) at GitHub.Runner.Worker.Program.MainAsync(IHostContext context, String[] args) Unhandled exception. System.IO.IOException: No space left on device : '/cpfs01/user/qa-llm-cicd/actions-runner-cu12/_diag/Worker_20241222-182645-utc.log' at System.IO.RandomAccess.WriteAtOffset(SafeFileHandle handle, ReadOnlySpan`1 buffer, Int64 fileOffset) at System.IO.Strategies.OSFileStreamStrategy.Write(ReadOnlySpan`1 buffer) at System.IO.Strategies.BufferedFileStreamStrategy.Flush(Boolean flushToDisk) at System.IO.StreamWriter.Flush(Boolean flushStream, Boolean flushEncoder) at System.Diagnostics.TextWriterTraceListener.Flush() at System.Diagnostics.TraceSource.Flush() at GitHub.Runner.Common.Tracing.Dispose(Boolean disposing) at GitHub.Runner.Common.Tracing.Dispose() at GitHub.Runner.Common.TraceManager.Dispose(Boolean disposing) at GitHub.Runner.Common.TraceManager.Dispose() at GitHub.Runner.Common.HostContext.Dispose(Boolean disposing) at GitHub.Runner.Common.HostContext.Dispose() at GitHub.Runner.Worker.Program.Main(String[] args)
build-pypi
ubuntu-latest pipelines will use ubuntu-24.04 soon. For more details, see https://github.com/actions/runner-images/issues/10636
daily_run_test (dsw_cu12, base_fullbench)
Failed to download action 'https://api.github.com/repos/actions/checkout/tarball/ee0669bd1cc54295c223e0bb666b733df41de1c5'. Error: No space left on device : '/cpfs01/user/qa-llm-cicd/actions-runner-cu12/_work/_actions/_temp_bb3fbf01-5728-4a30-8a19-c37c1e339966/5ac3bd8a-05ed-4a5f-be3f-68dd2c33329b.tar.gz' 7522:2BD903:B8CB2:189EF4:67684F7F
daily_run_test (dsw_cu12, base_fullbench)
Back off 18.82 seconds before retry.
daily_run_test (dsw_cu12, base_fullbench)
Failed to download action 'https://api.github.com/repos/actions/checkout/tarball/ee0669bd1cc54295c223e0bb666b733df41de1c5'. Error: No space left on device : '/cpfs01/user/qa-llm-cicd/actions-runner-cu12/_work/_actions/_temp_bb3fbf01-5728-4a30-8a19-c37c1e339966/5ac3bd8a-05ed-4a5f-be3f-68dd2c33329b.tar.gz' 71CE:08D1:DF6C:1D4EE:67684F93
daily_run_test (dsw_cu12, base_fullbench)
Back off 11.483 seconds before retry.

Artifacts

Produced during runtime
Name Size
my-artifact-12455093817
3.35 MB