request library fails with Sentry enabled on Node 20

[simllll]

Is there an existing issue for this?

• I have checked for existing issues https://github.com/getsentry/sentry-javascript/issues
• I have reviewed the documentation https://docs.sentry.io/
• I am using the latest SDK release https://github.com/getsentry/sentry-javascript/releases

How do you use Sentry?

Self-hosted/on-premise

Which SDK are you using?

@sentry/node

SDK Version

7.57.0

Framework Version

No response

Link to Sentry event

No response

SDK Setup

Sentry.init({
	dsn: 'https://0068cfe558e44d329481bc767d6b4e41@sentry.HOSTNAME/12'
});

Steps to Reproduce

node20 + arm64 + request library + sentry

script:

import * as Sentry from '@sentry/node';
import * as request from 'requestretry';

// comment this, and it works, otherwise oyu get error 403
Sentry.init({
        dsn: 'https://0068cfe558e44d329481bc767d6b4e41@test.com/0'
});

const test = async () => {
const result = await request.get({
                                url: 'https://files.test.hokify.com/undefined565c67d6e855735aa2eab974_1510057848572.jpg'
                        });
console.log('RESULT', result);
};

test();

run with ts-node test.ts
~

body returns
body: '\n' +
'AccessDeniedAccess Denied2W0387H91RPD35YJupEwGHmpd6/Em0HdUtLK6jW0tLKNnKKRdO2o/w1pEFWPsSLGxAeym4tVYhZVCO92PmM8bgk9jQQ=',
attempts: 1,

but it should actually return the image (buffer)
this behaviour is ONLY happening on arm64, not on amd64.
it also only happens with node20, node18 works fine too.

Expected Result

the url is public available, and is retrievable like it is without sentry.init()

Actual Result

it throws a 403 error, somehow senty modifies the request

I assume this is a node bug, as it only happen son arm64, but need help to narrow this down what can cause this.

[simllll]

related request/request#3458

[simllll]

This is a quite serious issue, especially since it is happening in a very unexpected way. I can imagine that more people will run into this, and maybe even do not recognise it in the beginning. E.g. our test suite didn't detect any issues as there is no sentry initialised at this time. Anything we can do to support getting this resolved?

[winnyschuster]

i think we are having the very same issue at open source project iobroker. I have to contradict that it is only happening on arm64 systems, i use amd64(debian-bullseye, node 20.5.0, latest sentry 7.60.0) We found only issues where the request() lib is used but i think it has to do with exchange of the node:http module to the sentry-http module once sentry is initialized, so could probably happen elsewhere.

i have nailed it down to sentry somehow cutting the Request URI from (in your example) /undefined565c67d6e855735aa2eab974_1510057848572.jpg to just /. So, your 403 comes from the fact that host https://files.test.hokify.com/ is just not accessible.

i have changed protocol to http in your request and monitored this with wireshark where you can truly see whats going on at the end. see attached pic with 1st line has sentry enabled and 2nd disabled

Hope this helps the team over here to find the issue. Of course i'm willing to do further testing if asked for

[winnyschuster]

I assume this is a node bug, as it only happen son arm64, but need help to narrow this down what can cause this.

not an expert but i wonder how could that be node when plain node just does the job and sentry does not in this case? I've tried to debug things but failed except that i could see that node:http is not even touched during the request. And as stated before, it is also happening on amd64 systems

[lforst]

Hey, internally we are a bit stomped as to why this might be happening. We don't have any functionality specific to cpu architecture. However, we are definitely modifying requests by monkeypatching the http module. Generally, we are only modifying the outgoing headers of requests (for distributed tracing) though and not any request paths.

Can we rule out that this is not a bug in the requestretry package?

[Apollon77]

We also have big issues with this in ioBroker ... I will link the relevant issues here too. request library is still very commonly used in older projects :-(

[lforst]

Seems like this is a bug in Node.js being tracked here: nodejs/node#48921

They merged a fix here: nodejs/node#48928

Seems like it's a matter of time until this is released in the newest Node.js version.

Props to @Zhangdroid for the genius-level debugging and fixing! <3

[Apollon77]

Did someone verified that this nodejs fix also fixes the issue?

[lforst]

@Apollon77 I'd assume you would have to apply the node patch. The version that should include this isn't out yet.

[winnyschuster]

Did someone verified that this nodejs fix also fixes the issue?

i just did with node 20.6.0 and that solved the issue

[lforst]

@winnyschuster Thanks for confirming! Closing this then :)

[Apollon77]

Thank you all!