Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Segmentation violation running Azcopy jobs list on mac os #2714

Closed
pgabioud opened this issue Jun 12, 2024 · 3 comments · Fixed by #2763
Closed

Segmentation violation running Azcopy jobs list on mac os #2714

pgabioud opened this issue Jun 12, 2024 · 3 comments · Fixed by #2763
Assignees
Labels
Milestone

Comments

@pgabioud
Copy link

pgabioud commented Jun 12, 2024

Which version of the AzCopy was used?

AzCopy 10.25.0

Which platform are you using? (ex: Windows, Mac, Linux)

macOS Sonoma 14.5
2.4 GHz 8-Core Intel Core i9

What command did you run?

azcopy jobs list

What problem was encountered?

unexpected fault address 0x1109f59b8
fatal error: fault
[signal SIGSEGV: segmentation violation code=0x1 addr=0x1109f59b8 pc=0x10eecc881]

goroutine 1 gp=0xc0000061c0 m=0 mp=0x1103f90e0 [running]:
runtime.throw({0x10f84be8f?, 0x0?})
runtime/panic.go:1023 +0x5c fp=0xc0006bf590 sp=0xc0006bf560 pc=0x10ee9425c
runtime.sigpanic()
runtime/signal_unix.go:895 +0x285 fp=0xc0006bf5f0 sp=0xc0006bf590 pc=0x10eeacd05
runtime.memmove()
runtime/memmove_amd64.s:200 +0x181 fp=0xc0006bf5f8 sp=0xc0006bf5f0 pc=0x10eecc881
fmt.(*buffer).writeString(...)
fmt/print.go:108
fmt.(*fmt).padString(0xc00003ac00?, {0x1109f59b8, 0x5c})

.....

net.init.func1({0x10fcedf48?, 0xc0005be1e0?}, 0x100000000000000?, {0x10f84afdd?, 0x0?}, {0xc0001ba330?, 0x0?})
net/hook.go:22 +0x37 fp=0xc000094ee0 sp=0xc000094ea0 pc=0x10f0130b7
net.(*Resolver).lookupIPAddr.func1()
net/lookup.go:334 +0x37 fp=0xc000094f38 sp=0xc000094ee0 pc=0x10f030df7
internal/singleflight.(*Group).doCall(0x1103f6250, 0xc0005be230, {0xc0001ba390, 0x2c}, 0xc0005c8000?)
internal/singleflight/singleflight.go:93 +0x35 fp=0xc000094fa8 sp=0xc000094f38 pc=0x10f012015
internal/singleflight.(*Group).DoChan.gowrap1()
internal/singleflight/singleflight.go:86 +0x30 fp=0xc000094fe0 sp=0xc000094fa8 pc=0x10f011fb0
runtime.goexit({})
runtime/asm_amd64.s:1695 +0x1 fp=0xc000094fe8 sp=0xc000094fe0 pc=0x10eecb921
created by internal/singleflight.(*Group).DoChan in goroutine 43
internal/singleflight/singleflight.go:86 +0x2d2

How can we reproduce the problem in the simplest way?

brew install azcopy

when list empty, output string "Existing Jobs"
azcopy jobs list

test job
azcopy copy [source] [destination]

works
azcopy jobs show [job-id]

seg fault
azcopy jobs list

Have you found a mitigation/solution?

No.
Tried to uninstall - reinstall, with brew or with azure exec file

@ptc-lfruehstueck
Copy link

ptc-lfruehstueck commented Jun 12, 2024

This is not only happening on macOS. We see the same issue with AZcopy 10.25 on ubuntu-latest Github Actions runner images.

GitHub Runner:

Current runner version: '2.317.0'
Operating System
  Ubuntu 22.04.4 LTS
Runner Image
  Image: ubuntu-22.04
  Version: 20240609.1.0
  Included Software: https://github.com/actions/runner-images/blob/ubuntu22/20240609.1/images/ubuntu/Ubuntu2204-Readme.md
  Image Release: https://github.com/actions/runner-images/releases/tag/ubuntu22%2F20240609.1
Runner Image Provisioner
  2.0.370.1

It happens quite often but not every time

Crash log when running azcopy jobs list --output-type json
unexpected fault address 0x7f0c51c3d9b8
fatal error: fault
[signal SIGSEGV: segmentation violation code=0x1 addr=0x7f0c51c3d9b8 pc=0x721a4b]

goroutine 1 gp=0xc0000061c0 m=3 mp=0xc000073008 [running]:
runtime.throw({0x10adab5?, 0x80?})
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/panic.go:1023 +0x5c fp=0xc0005bf130 sp=0xc0005bf100 pc=0x43ddbc
runtime.sigpanic()
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/signal_unix.go:895 +0x285 fp=0xc0005bf190 sp=0xc0005bf130 pc=0x456725
encoding/json.appendString[...]({0xc00004c2e3?, 0xc000046fc0?, 0x101a380?}, {0x7f0c51c3d9b8?, 0x21a}, 0x1)
/opt/hostedtoolcache/go/1.22.3/x64/src/encoding/json/encode.go:960 +0xab fp=0xc0005bf238 sp=0xc0005bf190 pc=0x721a4b
encoding/json.stringEncoder(0xc00007e6c0, {0xe99240?, 0xc0001c8190?, 0x0?}, {0x1?, 0x0?})
/opt/hostedtoolcache/go/1.22.3/x64/src/encoding/json/encode.go:589 +0x3c7 fp=0xc0005bf300 sp=0xc0005bf238 pc=0x716827
encoding/json.structEncoder.encode({{{0xc00055e008, 0x4, 0x4}, 0xc0000a3050, 0xc0000a3080}}, 0xc00007e6c0, {0xfdc2a0?, 0xc0001c8180?, 0xc0000706e0?}, {0x0, ...})
/opt/hostedtoolcache/go/1.22.3/x64/src/encoding/json/encode.go:704 +0x21e fp=0xc0005bf3b0 sp=0xc0005bf300 pc=0x716f9e
encoding/json.structEncoder.encode-fm(0xe84a80?, {0xfdc2a0?, 0xc0001c8180?, 0x30?}, {0x68?, 0xf4?})
:1 +0x65 fp=0xc0005bf410 sp=0xc0005bf3b0 pc=0x728165
encoding/json.arrayEncoder.encode({0x8?}, 0xc00007e6c0, {0xe84a80?, 0xc0000a2f10?, 0x3423c8d3cb5ae8c2?}, {0x80?, 0x3f?})
/opt/hostedtoolcache/go/1.22.3/x64/src/encoding/json/encode.go:847 +0xcf fp=0xc0005bf480 sp=0xc0005bf410 pc=0x71862f
encoding/json.arrayEncoder.encode-fm(0xc0005bf4f8?, {0xe84a80?, 0xc0000a2f10?, 0xf3eec0?}, {0x32?, 0x0?})
:1 +0x3f fp=0xc0005bf4c0 sp=0xc0005bf480 pc=0x727eff
encoding/json.sliceEncoder.encode({0x408be8?}, 0xc00007e6c0, {0xe84a80?, 0xc0000a2f10?, 0xe99240?}, {0xf?, 0x0?})
/opt/hostedtoolcache/go/1.22.3/x64/src/encoding/json/encode.go:820 +0x347 fp=0xc0005bf5e8 sp=0xc0005bf4c0 pc=0x718187
encoding/json.sliceEncoder.encode-fm(0xf6ece0?, {0xe84a80?, 0xc0000a2f10?, 0x0?}, {0x40?, 0x18?})
:1 +0x3f fp=0xc0005bf628 sp=0xc0005bf5e8 pc=0x727fbf
encoding/json.structEncoder.encode({{{0xc0003f87e0, 0x2, 0x2}, 0xc0000a3110, 0xc0000a3140}}, 0xc00007e6c0, {0xf6ece0?, 0xc0000a2f00?, 0x412f1b?}, {0x0, ...})
/opt/hostedtoolcache/go/1.22.3/x64/src/encoding/json/encode.go:704 +0x21e fp=0xc0005bf6d8 sp=0xc0005bf628 pc=0x716f9e
encoding/json.structEncoder.encode-fm(0xf6ece0?, {0xf6ece0?, 0xc0000a2f00?, 0x73008?}, {0xe8?, 0xbf?})
:1 +0x65 fp=0xc0005bf738 sp=0xc0005bf6d8 pc=0x728165
encoding/json.(*encodeState).reflectValue(0xc00007e6c0, {0xf6ece0?, 0xc0000a2f00?, 0x4132c5?}, {0x38?, 0x0?})
/opt/hostedtoolcache/go/1.22.3/x64/src/encoding/json/encode.go:321 +0x73 fp=0xc0005bf790 sp=0xc0005bf738 pc=0x7143b3
encoding/json.(*encodeState).marshal(0x412f1b?, {0xf6ece0?, 0xc0000a2f00?}, {0x5c?, 0x5d?})
/opt/hostedtoolcache/go/1.22.3/x64/src/encoding/json/encode.go:297 +0xc5 fp=0xc0005bf808 sp=0xc0005bf790 pc=0x714185
encoding/json.Marshal({0xf6ece0, 0xc0000a2f00})
/opt/hostedtoolcache/go/1.22.3/x64/src/encoding/json/encode.go:163 +0xd0 fp=0xc0005bf8c8 sp=0xc0005bf808 pc=0x713a70
github.com/Azure/azure-storage-azcopy/v10/cmd.PrintExistingJobIds.func1(0x1df7a0?)
/home/vsts/work/1/s/cmd/jobsList.go:102 +0xe5 fp=0xc0005bf9f0 sp=0xc0005bf8c8 pc=0xdb4605
github.com/Azure/azure-storage-azcopy/v10/common.(*lifecycleMgr).Exit(0xc0001df7a0, 0xc0000a2ed0?, 0x0)
/home/vsts/work/1/s/common/lifecyleMgr.go:392 +0x64 fp=0xc0005bfa68 sp=0xc0005bf9f0 pc=0xc95b24
github.com/Azure/azure-storage-azcopy/v10/cmd.PrintExistingJobIds({{0x0, 0x0}, {0xc0001c8180, 0x6, 0x8}})
/home/vsts/work/1/s/cmd/jobsList.go:100 +0x13a fp=0xc0005bfaf0 sp=0xc0005bfa68 pc=0xdb447a
github.com/Azure/azure-storage-azcopy/v10/cmd.HandleListJobsCommand(0x64)
/home/vsts/work/1/s/cmd/jobsList.go:88 +0x7e fp=0xc0005bfb38 sp=0xc0005bfaf0 pc=0xdb431e
github.com/Azure/azure-storage-azcopy/v10/cmd.init.7.func2(0xc0000ae2c8?, {0xc00051a1c0?, 0x0?, 0x10ad17a?})
/home/vsts/work/1/s/cmd/jobsList.go:67 +0x90 fp=0xc0005bfb88 sp=0xc0005bfb38 pc=0xdb4230
github.com/spf13/cobra.(*Command).execute(0xc0000ae2c8, {0xc00051a1a0, 0x2, 0x2})
/home/vsts/go/pkg/mod/github.com/spf13/cobra@v1.4.0/command.go:860 +0x684 fp=0xc0005bfc78 sp=0xc0005bfb88 pc=0xcd7824
github.com/spf13/cobra.(*Command).ExecuteC(0x199fd60)
/home/vsts/go/pkg/mod/github.com/spf13/cobra@v1.4.0/command.go:974 +0x38d fp=0xc0005bfd30 sp=0xc0005bfc78 pc=0xcd7e6d
github.com/spf13/cobra.(*Command).Execute(...)
/home/vsts/go/pkg/mod/github.com/spf13/cobra@v1.4.0/command.go:902
github.com/Azure/azure-storage-azcopy/v10/cmd.Execute({0xc00003c094?, 0x1985960?}, {0xc00003c259?, 0xc0000c6048?}, 0xc0005bfea0?, {0xf18d26bd, 0x91ad, 0x7d4a, {0x73, 0x95, ...}})
/home/vsts/work/1/s/cmd/root.go:220 +0xec fp=0xc0005bfdc0 sp=0xc0005bfd30 pc=0xdc4fac
main.main()
/home/vsts/work/1/s/main.go:79 +0x47b fp=0xc0005bff50 sp=0xc0005bfdc0 pc=0xdf7c3b
runtime.main()
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/proc.go:271 +0x29d fp=0xc0005bffe0 sp=0xc0005bff50 pc=0x44087d
runtime.goexit({})
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc0005bffe8 sp=0xc0005bffe0 pc=0x474941

goroutine 2 gp=0xc000006c40 m=nil [force gc (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/proc.go:402 +0xce fp=0xc00006cfa8 sp=0xc00006cf88 pc=0x440cae
runtime.goparkunlock(...)
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/proc.go:408
runtime.forcegchelper()
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/proc.go:326 +0xb3 fp=0xc00006cfe0 sp=0xc00006cfa8 pc=0x440b33
runtime.goexit({})
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc00006cfe8 sp=0xc00006cfe0 pc=0x474941
created by runtime.init.6 in goroutine 1
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/proc.go:314 +0x1a

goroutine 3 gp=0xc000007180 m=nil [GC sweep wait]:
runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?)
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/proc.go:402 +0xce fp=0xc00006d780 sp=0xc00006d760 pc=0x440cae
runtime.goparkunlock(...)
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/proc.go:408
runtime.bgsweep(0xc000044310)
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/mgcsweep.go:318 +0xdf fp=0xc00006d7c8 sp=0xc00006d780 pc=0x42b2df
runtime.gcenable.gowrap1()
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/mgc.go:203 +0x25 fp=0xc00006d7e0 sp=0xc00006d7c8 pc=0x41fbe5
runtime.goexit({})
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc00006d7e8 sp=0xc00006d7e0 pc=0x474941
created by runtime.gcenable in goroutine 1
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/mgc.go:203 +0x66

goroutine 4 gp=0xc000007340 m=nil [GC scavenge wait]:
runtime.gopark(0x10000?, 0x1272398?, 0x0?, 0x0?, 0x0?)
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/proc.go:402 +0xce fp=0xc00006df78 sp=0xc00006df58 pc=0x440cae
runtime.goparkunlock(...)
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/proc.go:408
runtime.(*scavengerState).park(0x19ae400)
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/mgcscavenge.go:425 +0x49 fp=0xc00006dfa8 sp=0xc00006df78 pc=0x428c89
runtime.bgscavenge(0xc000044310)
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/mgcscavenge.go:658 +0x59 fp=0xc00006dfc8 sp=0xc00006dfa8 pc=0x429239
runtime.gcenable.gowrap2()
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/mgc.go:204 +0x25 fp=0xc00006dfe0 sp=0xc00006dfc8 pc=0x41fb85
runtime.goexit({})
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc00006dfe8 sp=0xc00006dfe0 pc=0x474941
created by runtime.gcenable in goroutine 1
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/mgc.go:204 +0xa5

goroutine 18 gp=0xc000106380 m=nil [finalizer wait]:
runtime.gopark(0xc00006c648?, 0x4132c5?, 0xa8?, 0x1?, 0xc0000061c0?)
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/proc.go:402 +0xce fp=0xc00006c620 sp=0xc00006c600 pc=0x440cae
runtime.runfinq()
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/mfinal.go:194 +0x107 fp=0xc00006c7e0 sp=0xc00006c620 pc=0x41ec27
runtime.goexit({})
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc00006c7e8 sp=0xc00006c7e0 pc=0x474941
created by runtime.createfing in goroutine 1
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/mfinal.go:164 +0x3d

goroutine 19 gp=0xc0001e3c00 m=nil [select]:
runtime.gopark(0xc000068778?, 0x3?, 0x8?, 0x1?, 0xc000068772?)
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/proc.go:402 +0xce fp=0xc000068618 sp=0xc0000685f8 pc=0x440cae
runtime.selectgo(0xc000068778, 0xc00006876c, 0xc0001b1800?, 0x0, 0x0?, 0x1)
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/select.go:327 +0x725 fp=0xc000068738 sp=0xc000068618 pc=0x4529c5
go.opencensus.io/stats/view.(*worker).start(0xc0001b1800)
/home/vsts/go/pkg/mod/go.opencensus.io@v0.24.0/stats/view/worker.go:292 +0x9f fp=0xc0000687c8 sp=0xc000068738 pc=0xaca67f
go.opencensus.io/stats/view.init.0.gowrap1()
/home/vsts/go/pkg/mod/go.opencensus.io@v0.24.0/stats/view/worker.go:34 +0x25 fp=0xc0000687e0 sp=0xc0000687c8 pc=0xac99e5
runtime.goexit({})
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc0000687e8 sp=0xc0000687e0 pc=0x474941
created by go.opencensus.io/stats/view.init.0 in goroutine 1
/home/vsts/go/pkg/mod/go.opencensus.io@v0.24.0/stats/view/worker.go:34 +0x8d

goroutine 20 gp=0xc00041afc0 m=nil [chan receive]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/proc.go:402 +0xce fp=0xc000068db0 sp=0xc000068d90 pc=0x440cae
runtime.chanrecv(0xc0004448a0, 0xc000068f60, 0x1)
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/chan.go:583 +0x3bf fp=0xc000068e28 sp=0xc000068db0 pc=0x40b9bf
runtime.chanrecv1(0x0?, 0x0?)
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/chan.go:442 +0x12 fp=0xc000068e50 sp=0xc000068e28 pc=0x40b5d2
github.com/Azure/azure-storage-azcopy/v10/common.(*lifecycleMgr).processOutputMessage(0xc0001df7a0)
/home/vsts/work/1/s/common/lifecyleMgr.go:445 +0x6a fp=0xc000068fc8 sp=0xc000068e50 pc=0xc95e6a
github.com/Azure/azure-storage-azcopy/v10/common.init.func4.gowrap1()
/home/vsts/work/1/s/common/lifecyleMgr.go:38 +0x25 fp=0xc000068fe0 sp=0xc000068fc8 pc=0xc7e805
runtime.goexit({})
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000068fe8 sp=0xc000068fe0 pc=0x474941
created by github.com/Azure/azure-storage-azcopy/v10/common.init.func4 in goroutine 1
/home/vsts/work/1/s/common/lifecyleMgr.go:38 +0x1d8

goroutine 21 gp=0xc00041b180 m=nil [sleep]:
runtime.gopark(0x3a84dbf5e5?, 0xc000069598?, 0x69?, 0x78?, 0x1000?)
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/proc.go:402 +0xce fp=0xc000069568 sp=0xc000069548 pc=0x440cae
time.Sleep(0x7a120)
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/time.go:195 +0x115 fp=0xc0000695a8 sp=0xc000069568 pc=0x471595
github.com/Azure/azure-storage-azcopy/v10/common.(*lifecycleMgr).watchInputs(0xc0001df7a0)
/home/vsts/work/1/s/common/lifecyleMgr.go:120 +0x235 fp=0xc0000697c8 sp=0xc0000695a8 pc=0xc94815
github.com/Azure/azure-storage-azcopy/v10/common.init.func4.gowrap2()
/home/vsts/work/1/s/common/lifecyleMgr.go:41 +0x25 fp=0xc0000697e0 sp=0xc0000697c8 pc=0xc7e7a5
runtime.goexit({})
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc0000697e8 sp=0xc0000697e0 pc=0x474941
created by github.com/Azure/azure-storage-azcopy/v10/common.init.func4 in goroutine 1
/home/vsts/work/1/s/common/lifecyleMgr.go:41 +0x216

goroutine 22 gp=0xc00041b6c0 m=nil [GC worker (idle)]:
runtime.gopark(0x3a84d18a30?, 0x0?, 0x0?, 0x0?, 0x0?)
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/proc.go:402 +0xce fp=0xc000069f50 sp=0xc000069f30 pc=0x440cae
runtime.gcBgMarkWorker()
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/mgc.go:1310 +0xe5 fp=0xc000069fe0 sp=0xc000069f50 pc=0x421cc5
runtime.goexit({})
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000069fe8 sp=0xc000069fe0 pc=0x474941
created by runtime.gcBgMarkStartWorkers in goroutine 1
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/mgc.go:1234 +0x1c

goroutine 5 gp=0xc000007880 m=nil [GC worker (idle)]:
runtime.gopark(0x3a84d36023?, 0x0?, 0x0?, 0x0?, 0x0?)
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/proc.go:402 +0xce fp=0xc00006e750 sp=0xc00006e730 pc=0x440cae
runtime.gcBgMarkWorker()
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/mgc.go:1310 +0xe5 fp=0xc00006e7e0 sp=0xc00006e750 pc=0x421cc5
runtime.goexit({})
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc00006e7e8 sp=0xc00006e7e0 pc=0x474941
created by runtime.gcBgMarkStartWorkers in goroutine 1
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/mgc.go:1234 +0x1c

goroutine 23 gp=0xc000007a40 m=nil [sleep]:
runtime.gopark(0x3a84e031a5?, 0x0?, 0x0?, 0x0?, 0x0?)
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/proc.go:402 +0xce fp=0xc000525eb8 sp=0xc000525e98 pc=0x440cae
time.Sleep(0x5f5e100)
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/time.go:195 +0x115 fp=0xc000525ef8 sp=0xc000525eb8 pc=0x471595
github.com/Azure/azure-storage-azcopy/v10/ste.(*tokenBucketPacer).pacerBody(0xc00007e000)
/home/vsts/work/1/s/ste/pacer-tokenBucketPacer.go:173 +0x1e6 fp=0xc000525fc8 sp=0xc000525ef8 pc=0xd412c6
github.com/Azure/azure-storage-azcopy/v10/ste.NewTokenBucketPacer.gowrap1()
/home/vsts/work/1/s/ste/pacer-tokenBucketPacer.go:87 +0x25 fp=0xc000525fe0 sp=0xc000525fc8 pc=0xd40e05
runtime.goexit({})
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000525fe8 sp=0xc000525fe0 pc=0x474941
created by github.com/Azure/azure-storage-azcopy/v10/ste.NewTokenBucketPacer in goroutine 1
/home/vsts/work/1/s/ste/pacer-tokenBucketPacer.go:87 +0xe9

goroutine 24 gp=0xc000007c00 m=nil [select]:
runtime.gopark(0xc00006ef78?, 0x2?, 0xa8?, 0xee?, 0xc00006ef6c?)
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/proc.go:402 +0xce fp=0xc00006ee10 sp=0xc00006edf0 pc=0x440cae
runtime.selectgo(0xc00006ef78, 0xc00006ef68, 0x0?, 0x0, 0x0?, 0x1)
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/select.go:327 +0x725 fp=0xc00006ef30 sp=0xc00006ee10 pc=0x4529c5
github.com/Azure/azure-storage-azcopy/v10/jobsAdmin.(*jobsAdmin).slicePoolPruneLoop(0xc0004d8000)
/home/vsts/work/1/s/jobsAdmin/JobsAdmin.go:544 +0xdb fp=0xc00006efc8 sp=0xc00006ef30 pc=0xd8c73b
github.com/Azure/azure-storage-azcopy/v10/jobsAdmin.initJobsAdmin.gowrap1()
/home/vsts/work/1/s/jobsAdmin/JobsAdmin.go:159 +0x25 fp=0xc00006efe0 sp=0xc00006efc8 pc=0xd89d25
runtime.goexit({})
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc00006efe8 sp=0xc00006efe0 pc=0x474941
created by github.com/Azure/azure-storage-azcopy/v10/jobsAdmin.initJobsAdmin in goroutine 1
/home/vsts/work/1/s/jobsAdmin/JobsAdmin.go:159 +0x605

goroutine 25 gp=0xc000007dc0 m=nil [chan receive]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/proc.go:402 +0xce fp=0xc00006f608 sp=0xc00006f5e8 pc=0x440cae
runtime.chanrecv(0xc000102960, 0xc00006f7a0, 0x1)
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/chan.go:583 +0x3bf fp=0xc00006f680 sp=0xc00006f608 pc=0x40b9bf
runtime.chanrecv1(0xc192823c33fdeb7c?, 0xffffffe40fd710f9?)
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/chan.go:442 +0x12 fp=0xc00006f6a8 sp=0xc00006f680 pc=0x40b5d2
github.com/Azure/azure-storage-azcopy/v10/jobsAdmin.(*jobsAdmin).messageHandler(0xc0004d8000, 0xc000102960)
/home/vsts/work/1/s/jobsAdmin/JobsAdmin.go:609 +0x9a fp=0xc00006f7c0 sp=0xc00006f6a8 pc=0xd8cc7a
github.com/Azure/azure-storage-azcopy/v10/jobsAdmin.initJobsAdmin.gowrap2()
/home/vsts/work/1/s/jobsAdmin/JobsAdmin.go:161 +0x25 fp=0xc00006f7e0 sp=0xc00006f7c0 pc=0xd89cc5
runtime.goexit({})
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc00006f7e8 sp=0xc00006f7e0 pc=0x474941
created by github.com/Azure/azure-storage-azcopy/v10/jobsAdmin.initJobsAdmin in goroutine 1
/home/vsts/work/1/s/jobsAdmin/JobsAdmin.go:161 +0x673

goroutine 26 gp=0xc00041bc00 m=nil [select]:
runtime.gopark(0xc0000534b8?, 0x4?, 0xb8?, 0x32?, 0xc0000533d8?)
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/proc.go:402 +0xce fp=0xc000053270 sp=0xc000053250 pc=0x440cae
runtime.selectgo(0xc0000534b8, 0xc0000533d0, 0xc000510af0?, 0x0, 0x10f20b8?, 0x1)
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/select.go:327 +0x725 fp=0xc000053390 sp=0xc000053270 pc=0x4529c5
net/http.(*Transport).getConn(0xc0001e4140, 0xc0004de8c0, {{}, 0x0, {0x10f20b8, 0x5}, {0xc000132270, 0x2c}, 0x0})
/opt/hostedtoolcache/go/1.22.3/x64/src/net/http/transport.go:1406 +0x5a5 fp=0xc0000535a0 sp=0xc000053390 pc=0x6ddf65
net/http.(*Transport).roundTrip(0xc0001e4140, 0xc000182a20)
/opt/hostedtoolcache/go/1.22.3/x64/src/net/http/transport.go:595 +0x73a fp=0xc0000537c8 sp=0xc0000535a0 pc=0x6d9d5a
net/http.(*Transport).RoundTrip(0x0?, 0x1279b00?)
/opt/hostedtoolcache/go/1.22.3/x64/src/net/http/roundtrip.go:17 +0x13 fp=0xc0000537e8 sp=0xc0000537c8 pc=0x6cabb3
net/http.send(0xc000182a20, {0x1279b00, 0xc0001e4140}, {0x1?, 0x0?, 0x0?})
/opt/hostedtoolcache/go/1.22.3/x64/src/net/http/client.go:259 +0x5e4 fp=0xc0000539c8 sp=0xc0000537e8 pc=0x69c964
net/http.(*Client).send(0xc0004e4240, 0xc000182a20, {0x0?, 0x0?, 0x0?})
/opt/hostedtoolcache/go/1.22.3/x64/src/net/http/client.go:180 +0x98 fp=0xc000053a40 sp=0xc0000539c8 pc=0x69c218
net/http.(*Client).do(0xc0004e4240, 0xc000182a20)
/opt/hostedtoolcache/go/1.22.3/x64/src/net/http/client.go:724 +0x8dc fp=0xc000053c30 sp=0xc000053a40 pc=0x69e53c
net/http.(*Client).Do(0x0?, 0xc0004de840?)
/opt/hostedtoolcache/go/1.22.3/x64/src/net/http/client.go:590 +0x13 fp=0xc000053c50 sp=0xc000053c30 pc=0x69dc33
github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/exported.transportPolicy.Do({{0x1279a40?, 0xc0004e4240?}}, 0x412f01?)
/home/vsts/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.9.2/internal/exported/pipeline.go:47 +0x34 fp=0xc000053c70 sp=0xc000053c50 pc=0x728a54
github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/exported.(*transportPolicy).Do(0xc000053cd0?, 0x414411?)
:1 +0x31 fp=0xc000053c98 sp=0xc000053c70 pc=0x72ab31
github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/exported.(*Request).Next(0xc0004de800)
/home/vsts/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.9.2/internal/exported/request.go:107 +0xf0 fp=0xc000053cd8 sp=0xc000053c98 pc=0x729150
github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.bodyDownloadPolicy(0xc0004de800)
/home/vsts/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.9.2/runtime/policy_body_download.go:20 +0x1c fp=0xc000053d20 sp=0xc000053cd8 pc=0x77317c
github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/exported.PolicyFunc.Do(0xc000053d68?, 0xc000182242?)
/home/vsts/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.9.2/internal/exported/request.go:177 +0x19 fp=0xc000053d38 sp=0xc000053d20 pc=0x7297d9
github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/exported.(*Request).Next(0xc0004de7c0)
/home/vsts/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.9.2/internal/exported/request.go:107 +0xf0 fp=0xc000053d78 sp=0xc000053d38 pc=0x729150
github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.(*logPolicy).Do(0xc00050e648, 0xc0004de7c0)
/home/vsts/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.9.2/runtime/policy_logging.go:122 +0x398 fp=0xc000053eb0 sp=0xc000053d78 pc=0x775258
github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/exported.(*Request).Next(0xc0004de780)
/home/vsts/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.9.2/internal/exported/request.go:107 +0xf0 fp=0xc000053ef0 sp=0xc000053eb0 pc=0x729150
github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.(*httpTracePolicy).Do(0xc0005121a8, 0xc0004de780)
/home/vsts/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.9.2/runtime/policy_http_trace.go:93 +0x7b2 fp=0xc0000541d0 sp=0xc000053ef0 pc=0x774052
github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/exported.(*Request).Next(0xc0004de740)
/home/vsts/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.9.2/internal/exported/request.go:107 +0xf0 fp=0xc000054210 sp=0xc0000541d0 pc=0x729150
github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.httpHeaderPolicy(0xc0004de740)
/home/vsts/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.9.2/runtime/policy_http_header.go:31 +0xbd fp=0xc000054328 sp=0xc000054210 pc=0x7734dd
github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/exported.PolicyFunc.Do(0x4?, 0x41b598?)
/home/vsts/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.9.2/internal/exported/request.go:177 +0x19 fp=0xc000054340 sp=0xc000054328 pc=0x7297d9
github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/exported.(*Request).Next(0xc0004de700)
/home/vsts/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.9.2/internal/exported/request.go:107 +0xf0 fp=0xc000054380 sp=0xc000054340 pc=0x729150
github.com/Azure/azure-storage-azcopy/v10/ste.statsPolicy.Do({}, 0xc0004de700)
/home/vsts/work/1/s/ste/xferStatsPolicy.go:191 +0x3b fp=0xc000054400 sp=0xc000054380 pc=0xd7d5bb
github.com/Azure/azure-storage-azcopy/v10/ste.(*statsPolicy).Do(0x0?, 0x0?)
:1 +0x25 fp=0xc000054418 sp=0xc000054400 pc=0xd88925
github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/exported.(*Request).Next(0xc000054508)
/home/vsts/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.9.2/internal/exported/request.go:107 +0xf0 fp=0xc000054458 sp=0xc000054418 pc=0x729150
github.com/Azure/azure-storage-azcopy/v10/ste.logPolicy.Do({{{0xb2d05e00, 0x0}, 0x1148e50, 0x1148e48}, 0xc0004e42a0, 0xc0004e42d0, 0xc0004e4b70}, 0xc0004de680)
/home/vsts/work/1/s/ste/xferLogPolicy.go:164 +0x4d0 fp=0xc000054638 sp=0xc000054458 pc=0xd7abd0
github.com/Azure/azure-storage-azcopy/v10/ste.(*logPolicy).Do(0x4?, 0xf58840?)
:1 +0x6c fp=0xc0000546c0 sp=0xc000054638 pc=0xd888ac
github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/exported.(*Request).Next(0xc0004de640)
/home/vsts/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.9.2/internal/exported/request.go:107 +0xf0 fp=0xc000054700 sp=0xc0000546c0 pc=0x729150
github.com/Azure/azure-storage-azcopy/v10/ste.(*retryNotificationPolicy).Do(0x0?, 0xc0004de640)
/home/vsts/work/1/s/ste/xferRetryNotificationPolicy.go:64 +0x2a fp=0xc000054798 sp=0xc000054700 pc=0xd7c66a
github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/exported.(*Request).Next(0xc0000d2868)
/home/vsts/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.9.2/internal/exported/request.go:107 +0xf0 fp=0xc0000547d8 sp=0xc000054798 pc=0x729150
github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.(*retryPolicy).Do(0x7f0c08f3af40?, 0xc0004de5c0)
/home/vsts/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.9.2/runtime/policy_retry.go:126 +0x4ee fp=0xc000054a68 sp=0xc0000547d8 pc=0x776d8e
github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/exported.(*Request).Next(0xc0004de580)
/home/vsts/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.9.2/internal/exported/request.go:107 +0xf0 fp=0xc000054aa8 sp=0xc000054a68 pc=0x729150
github.com/Azure/azure-storage-azcopy/v10/ste.(*fileUploadRangeFromURLFixPolicy).Do(0x45ba4b?, 0xc0004de580)
/home/vsts/work/1/s/ste/sender-azureFileFromURL.go:118 +0x165 fp=0xc000054ae8 sp=0xc000054aa8 pc=0xd4e5c5
github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/exported.(*Request).Next(0xc0004de540)
/home/vsts/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.9.2/internal/exported/request.go:107 +0xf0 fp=0xc000054b28 sp=0xc000054ae8 pc=0x729150
github.com/Azure/azure-storage-azcopy/v10/ste.(*versionPolicy).Do(0xc00050e6a8?, 0xc0004de540)
/home/vsts/work/1/s/ste/xferVersionPolicy.go:49 +0x127 fp=0xc000054b78 sp=0xc000054b28 pc=0xd7d907
github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/exported.(*Request).Next(0xc0004de500)
/home/vsts/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.9.2/internal/exported/request.go:107 +0xf0 fp=0xc000054bb8 sp=0xc000054b78 pc=0x729150
github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.(*requestIDPolicy).Do(0xc0000d2c60?, 0xc0004de500)
/home/vsts/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.9.2/runtime/policy_request_id.go:33 +0x145 fp=0xc000054c30 sp=0xc000054bb8 pc=0x7766e5
github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/exported.(*Request).Next(0xc0004de4c0)
/home/vsts/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.9.2/internal/exported/request.go:107 +0xf0 fp=0xc000054c70 sp=0xc000054c30 pc=0x729150
github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.telemetryPolicy.Do({{0xc00017e340?, 0xfe3f20?}}, 0xc0004de4c0)
/home/vsts/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.9.2/runtime/policy_telemetry.go:70 +0x1b4 fp=0xc000054d08 sp=0xc000054c70 pc=0x777fb4
github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.(*telemetryPolicy).Do(0x7f0c519c0108?, 0x20?)
:1 +0x31 fp=0xc000054d30 sp=0xc000054d08 pc=0x779a51
github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/exported.(*Request).Next(0xc0004de480)
/home/vsts/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.9.2/internal/exported/request.go:107 +0xf0 fp=0xc000054d70 sp=0xc000054d30 pc=0x729150
github.com/Azure/azure-sdk-for-go/sdk/azcore/runtime.includeResponsePolicy(0xc0004de480)
/home/vsts/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.9.2/runtime/policy_include_response.go:19 +0x1c fp=0xc000054db0 sp=0xc000054d70 pc=0x7748fc
github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/exported.PolicyFunc.Do(0xc0000d2ee8?, 0xc00014c160?)
/home/vsts/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.9.2/internal/exported/request.go:177 +0x19 fp=0xc000054dc8 sp=0xc000054db0 pc=0x7297d9
github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/exported.(*Request).Next(0xc0004de440)
/home/vsts/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.9.2/internal/exported/request.go:107 +0xf0 fp=0xc000054e08 sp=0xc000054dc8 pc=0x729150
github.com/Azure/azure-sdk-for-go/sdk/azcore/internal/exported.Pipeline.Do({{0xc0001e43c0?, 0x1283eb8?, 0x1a0f8c0?}}, 0x0?)
/home/vsts/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/azcore@v1.9.2/internal/exported/pipeline.go:76 +0x45 fp=0xc000054e28 sp=0xc000054e08 pc=0x728b45
github.com/Azure/azure-sdk-for-go/sdk/storage/azblob/internal/generated.(*BlobClient).Download(, {, _}, _, _, , )
/home/vsts/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/storage/azblob@v1.3.1/internal/generated/zz_blob_client.go:901 +0xaa fp=0xc0000551b0 sp=0xc000054e28 pc=0x78ea2a
github.com/Azure/azure-sdk-for-go/sdk/storage/azblob/blob.(*Client).DownloadStream(
, {
, _}, _)
/home/vsts/go/pkg/mod/github.com/!azure/azure-sdk-for-go/sdk/storage/azblob@v1.3.1/blob/client.go:408 +0xfa fp=0xc000055738 sp=0xc0000551b0 pc=0x7f1dda
github.com/Azure/azure-storage-azcopy/v10/cmd.beginDetectNewVersion.func1()
/home/vsts/work/1/s/cmd/root.go:308 +0x1c8 fp=0xc000055fe0 sp=0xc000055738 pc=0xdc56a8
runtime.goexit({})
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000055fe8 sp=0xc000055fe0 pc=0x474941
created by github.com/Azure/azure-storage-azcopy/v10/cmd.beginDetectNewVersion in goroutine 1
/home/vsts/work/1/s/cmd/root.go:279 +0x5f

goroutine 7 gp=0xc0001e36c0 m=nil [runnable]:
github.com/Azure/azure-storage-azcopy/v10/common.(*proxyLookupCache).getProxy.gowrap2()
/home/vsts/work/1/s/common/ProxyLookupCache.go:147 fp=0xc00006ffe0 sp=0xc00006ffd8 pc=0xc7f280
runtime.goexit({})
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc00006ffe8 sp=0xc00006ffe0 pc=0x474941
created by github.com/Azure/azure-storage-azcopy/v10/common.(*proxyLookupCache).getProxy in goroutine 26
/home/vsts/work/1/s/common/ProxyLookupCache.go:147 +0x50b

goroutine 8 gp=0xc0001e3880 m=nil [select]:
runtime.gopark(0xc0000d3528?, 0x2?, 0x8?, 0x38?, 0xc0000d33d8?)
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/proc.go:402 +0xce fp=0xc0000d3278 sp=0xc0000d3258 pc=0x440cae
runtime.selectgo(0xc0000d3528, 0xc0000d33d4, 0x2c?, 0x0, 0x41b2c5?, 0x1)
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/select.go:327 +0x725 fp=0xc0000d3398 sp=0xc0000d3278 pc=0x4529c5
net.(*Resolver).lookupIPAddr(0x19ad0e0, {0x12840b0, 0xc00015af50}, {0x10acbfd, 0x3}, {0xc000132270, 0x28})
/opt/hostedtoolcache/go/1.22.3/x64/src/net/lookup.go:342 +0x3d1 fp=0xc0000d3580 sp=0xc0000d3398 pc=0x5d1311
net.(*Resolver).internetAddrList(0x19ad0e0?, {0x12840b0?, 0xc00015af50?}, {0x10acbfd, 0x3}, {0xc000132270?, 0x10?})
/opt/hostedtoolcache/go/1.22.3/x64/src/net/ipsock.go:288 +0x4d9 fp=0xc0000d36a0 sp=0xc0000d3580 pc=0x5ce959
net.(*Resolver).resolveAddrList(0x19ad0e0, {0x12840b0, 0xc00015af50}, {0x10ad326, 0x4}, {0x10acbfd?, 0xc000080a48?}, {0xc000132270, 0x2c}, {0x0, ...})
/opt/hostedtoolcache/go/1.22.3/x64/src/net/dial.go:283 +0x3e5 fp=0xc0000d37a0 sp=0xc0000d36a0 pc=0x5ba0a5
net.(*Dialer).DialContext(0xc00015a070, {0x1284008, 0xc0004e4de0}, {0x10acbfd, 0x3}, {0xc000132270, 0x2c})
/opt/hostedtoolcache/go/1.22.3/x64/src/net/dial.go:490 +0x405 fp=0xc0000d38c0 sp=0xc0000d37a0 pc=0x5baf65
github.com/Azure/azure-storage-azcopy/v10/ste.(*dialRateLimiter).DialContext(0xc000510970, {0x1284008, 0xc0004e4de0}, {0x10acbfd, 0x3}, {0xc000132270, 0x2c})
/home/vsts/work/1/s/ste/mgr-JobPartMgr.go:129 +0x125 fp=0xc0000d3948 sp=0xc0000d38c0 pc=0xd37c45
github.com/Azure/azure-storage-azcopy/v10/ste.(*dialRateLimiter).DialContext-fm({0x1284008?, 0xc0004e4de0?}, {0x10acbfd?, 0x0?}, {0xc000132270?, 0xc0000809e8?})
:1 +0x49 fp=0xc0000d3990 sp=0xc0000d3948 pc=0xd88a89
net/http.(*Transport).dial(0xc0004e4de0?, {0x1284008?, 0xc0004e4de0?}, {0x10acbfd?, 0x41b0bb?}, {0xc000132270?, 0x12915c8?})
/opt/hostedtoolcache/go/1.22.3/x64/src/net/http/transport.go:1187 +0xd2 fp=0xc0000d39f8 sp=0xc0000d3990 pc=0x6dd172
net/http.(*Transport).dialConn(0xc0001e4140, {0x1284008, 0xc0004e4de0}, {{}, 0x0, {0x10f20b8, 0x5}, {0xc000132270, 0x2c}, 0x0})
/opt/hostedtoolcache/go/1.22.3/x64/src/net/http/transport.go:1648 +0x7e8 fp=0xc0000d3ea8 sp=0xc0000d39f8 pc=0x6e0128
net/http.(*Transport).dialConnFor(0xc0001e4140, 0xc000418a50)
/opt/hostedtoolcache/go/1.22.3/x64/src/net/http/transport.go:1485 +0xcd fp=0xc0000d3fc0 sp=0xc0000d3ea8 pc=0x6deb6d
net/http.(*Transport).queueForDial.gowrap1()
/opt/hostedtoolcache/go/1.22.3/x64/src/net/http/transport.go:1449 +0x25 fp=0xc0000d3fe0 sp=0xc0000d3fc0 pc=0x6dea65
runtime.goexit({})
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc0000d3fe8 sp=0xc0000d3fe0 pc=0x474941
created by net/http.(*Transport).queueForDial in goroutine 26
/opt/hostedtoolcache/go/1.22.3/x64/src/net/http/transport.go:1449 +0x3c9

goroutine 9 gp=0xc0001e3a40 m=nil [runnable]:
runtime.memclrNoHeapPointersChunked(0x10000?, 0xc0000e6000?)
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/malloc.go:1367 +0x90 fp=0xc000080820 sp=0xc000080818 pc=0x413290
runtime.mallocgc(0x10000, 0xe992c0, 0x1)
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/malloc.go:1283 +0x778 fp=0xc0000808a8 sp=0xc000080820 pc=0x412ff8
runtime.makeslice(0x10bb6c0?, 0x12?, 0x0?)
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/slice.go:107 +0x49 fp=0xc0000808d0 sp=0xc0000808a8 pc=0x457869
net.open({0x10bb6c0?, 0xa?})
/opt/hostedtoolcache/go/1.22.3/x64/src/net/parse.go:80 +0x45 fp=0xc000080910 sp=0xc0000808d0 pc=0x5d8285
net.parseNSSConfFile({0x10bb6c0?, 0x40b7eb?})
/opt/hostedtoolcache/go/1.22.3/x64/src/net/nss.go:150 +0x31 fp=0xc000080988 sp=0xc000080910 pc=0x5d7111
net.(*nsswitchConfig).init(0x19adcc0)
/opt/hostedtoolcache/go/1.22.3/x64/src/net/nss.go:43 +0x28 fp=0xc0000809a8 sp=0xc000080988 pc=0x5d6cc8
net.(*nsswitchConfig).init-fm()
:1 +0x25 fp=0xc0000809c0 sp=0xc0000809a8 pc=0x5e8385
sync.(*Once).doSlow(0x40be01?, 0xc000080a48?)
/opt/hostedtoolcache/go/1.22.3/x64/src/sync/once.go:74 +0xc2 fp=0xc000080a20 sp=0xc0000809c0 pc=0x493522
sync.(*Once).Do(...)
/opt/hostedtoolcache/go/1.22.3/x64/src/sync/once.go:65
net.(*nsswitchConfig).tryUpdate(0x19adcc0)
/opt/hostedtoolcache/go/1.22.3/x64/src/net/nss.go:50 +0x5a fp=0xc000080ab8 sp=0xc000080a20 pc=0x5d6dda
net.getSystemNSS()
/opt/hostedtoolcache/go/1.22.3/x64/src/net/nss.go:34 +0x1a fp=0xc000080ae0 sp=0xc000080ab8 pc=0x5d6c1a
net.(*conf).lookupOrder(0x1994a40, 0xc000080bf0?, {0xc000132270, 0x28})
/opt/hostedtoolcache/go/1.22.3/x64/src/net/conf.go:349 +0x29b fp=0xc000080b88 sp=0xc000080ae0 pc=0x5b8f9b
net.(*conf).hostLookupOrder(0x0?, 0x0?, {0xc000132270?, 0x0?})
/opt/hostedtoolcache/go/1.22.3/x64/src/net/conf.go:227 +0x87 fp=0xc000080c00 sp=0xc000080b88 pc=0x5b8b67
net.(*Resolver).lookupIP(0x19ad0e0, {0x1284040, 0xc00044c230}, {0x10acbfd, 0x3}, {0xc000132270, 0x28})
/opt/hostedtoolcache/go/1.22.3/x64/src/net/lookup_unix.go:64 +0xa7 fp=0xc000080e58 sp=0xc000080c00 pc=0x5d4dc7
net.(*Resolver).lookupIP-fm({0x1284040?, 0xc00044c230?}, {0x10acbfd?, 0xc0004e4de0?}, {0xc000132270?, 0x10f20b8?})
:1 +0x49 fp=0xc000080ea0 sp=0xc000080e58 pc=0x5e84c9
net.init.func1({0x1284040?, 0xc00044c230?}, 0x100000000000000?, {0x10acbfd?, 0x0?}, {0xc000132270?, 0x0?})
/opt/hostedtoolcache/go/1.22.3/x64/src/net/hook.go:22 +0x37 fp=0xc000080ee0 sp=0xc000080ea0 pc=0x5b7117
net.(*Resolver).lookupIPAddr.func1()
/opt/hostedtoolcache/go/1.22.3/x64/src/net/lookup.go:334 +0x37 fp=0xc000080f38 sp=0xc000080ee0 pc=0x5d1d57
internal/singleflight.(*Group).doCall(0x19ad0f0, 0xc00044c280, {0xc0001322a0, 0x2c}, 0xc000418a50?)
/opt/hostedtoolcache/go/1.22.3/x64/src/internal/singleflight/singleflight.go:93 +0x35 fp=0xc000080fa8 sp=0xc000080f38 pc=0x5b6195
internal/singleflight.(*Group).DoChan.gowrap1()
/opt/hostedtoolcache/go/1.22.3/x64/src/internal/singleflight/singleflight.go:86 +0x30 fp=0xc000080fe0 sp=0xc000080fa8 pc=0x5b6130
runtime.goexit({})
/opt/hostedtoolcache/go/1.22.3/x64/src/runtime/asm_amd64.s:1695 +0x1 fp=0xc000080fe8 sp=0xc000080fe0 pc=0x474941
created by internal/singleflight.(*Group).DoChan in goroutine 8
/opt/hostedtoolcache/go/1.22.3/x64/src/internal/singleflight/singleflight.go:86 +0x2d2

@siminsavani-msft
Copy link
Contributor

Hi @pgabioud and @ptc-lfruehstueck ! Thanks for reporting this issue. I was able to reproduce this issue and have marked this as a bug. Please give us some time to investigate further.

If it is possible, please try using AzCopy 10.24 using this link in the meantime - https://azcopyvnextrelease.blob.core.windows.net/releases/release-10.24.0-20240326/azcopy_linux_amd64_10.24.0.tar.gz

@dphulkar-msft dphulkar-msft self-assigned this Oct 8, 2024
@dphulkar-msft dphulkar-msft added this to the 10.27.0 milestone Oct 8, 2024
@vibhansa-msft vibhansa-msft linked a pull request Oct 14, 2024 that will close this issue
@vibhansa-msft
Copy link
Member

Fix will be available in the next release i.e. 10.27.0

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging a pull request may close this issue.

5 participants