Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Injected @Body in POST request handler is undefined #13107

Closed
3 of 15 tasks
fdbatista opened this issue Jan 28, 2024 · 17 comments
Closed
3 of 15 tasks

Injected @Body in POST request handler is undefined #13107

fdbatista opened this issue Jan 28, 2024 · 17 comments

Comments

@fdbatista
Copy link

Is there an existing issue for this?

  • I have searched the existing issues

Current behavior

Hello.

I am trying to apply validations to a request, following the official docs.
This is the request I try to send. Content-Type header is application/json:

Screenshot 2024-01-28 175931

I have a middleware that captures correctly the parameters:

Screenshot 2024-01-28 175159

However, when the request reaches its controller function, the body is empty:

Screenshot 2024-01-28 175220

This is my bootstrap function:

async function bootstrap() {
  const app = await NestFactory.create(AppModule);

  app.enableVersioning({
    type: VersioningType.URI,
  });

  app.useGlobalPipes(
    new ValidationPipe({
      transform: true,
    }),
  );

  await app.listen(3000);
}

If I remove completely the payload, the request still hits the controller, which means it is bypassing the validation rules, which are the exact same as the ones from the official docs:

export class LoginDto {
  @IsEmail()
  email: string;

  @IsNotEmpty()
  password: string;
}

I organized the controllers into custom folders by module, so this controller is located under src\modules\auth.

Any ideas why this could be happening?
Thanks.

Minimum reproduction code

https://github.com/ahk-reminder/backend

Steps to reproduce

No response

Expected behavior

The controller function should receive a valid payload.

Package

  • I don't know. Or some 3rd-party package
  • @nestjs/common
  • @nestjs/core
  • @nestjs/microservices
  • @nestjs/platform-express
  • @nestjs/platform-fastify
  • @nestjs/platform-socket.io
  • @nestjs/platform-ws
  • @nestjs/testing
  • @nestjs/websockets
  • Other (see below)

Other package

No response

NestJS version

No response

Packages versions

{
"dependencies": {
    "@nestjs/common": "^10.0.0",
    "@nestjs/config": "^3.1.1",
    "@nestjs/core": "^10.0.0",
    "@nestjs/platform-express": "^10.0.0",
    "@nestjs/typeorm": "^10.0.1",
    "body-parser": "^1.20.2",
    "class-transformer": "^0.5.1",
    "class-validator": "^0.14.1",
    "mysql2": "^3.9.0",
    "reflect-metadata": "^0.1.13",
    "rxjs": "^7.8.1",
    "typeorm": "^0.3.20"
  },
  "devDependencies": {
    "@nestjs/cli": "^10.0.0",
    "@nestjs/schematics": "^10.0.0",
    "@nestjs/testing": "^10.3.1",
    "@types/express": "^4.17.21",
    "@types/jest": "^29.5.2",
    "@types/node": "^20.3.1",
    "@types/supertest": "^6.0.0",
    "@typescript-eslint/eslint-plugin": "^6.0.0",
    "@typescript-eslint/parser": "^6.0.0",
    "eslint": "^8.42.0",
    "eslint-config-prettier": "^9.0.0",
    "eslint-plugin-prettier": "^5.0.0",
    "jest": "^29.5.0",
    "prettier": "^3.0.0",
    "source-map-support": "^0.5.21",
    "supertest": "^6.3.3",
    "ts-jest": "^29.1.0",
    "ts-loader": "^9.4.3",
    "tsconfig-paths": "^4.2.0",
    "typescript": "^5.1.3"
  },
}

Node.js version

v20.9.0

In which operating systems have you tested?

  • macOS
  • Windows
  • Linux

Other

No response

@fdbatista fdbatista added the needs triage This issue has not been looked into label Jan 28, 2024
@fdbatista
Copy link
Author

I just added a new module, service and controller, and requests just work.
So I guess I will just replace the buggy one with this newly-added and that's it.

Closing.

@fdbatista
Copy link
Author

fdbatista commented Jan 28, 2024

Really weird stuff happening here.
As soon as I renamed the new module to auth, @Body stopped working again.
So I had to give up and name the module authentication until I figure out why it's happening.

@fdbatista fdbatista reopened this Jan 28, 2024
@micalevisk
Copy link
Member

looks like your repository is private

@fdbatista
Copy link
Author

fdbatista commented Jan 28, 2024

looks like your repository is private

@micalevisk Yes, sorry. Just updated its visibility
I am building this from the ground up as an exercise to learn NestJS.
If u take a look at it, please note that I removed the problematic auth module, so right now, to reproduce the issue, you'd have to rename the authentication one back to auth.

@micalevisk
Copy link
Member

micalevisk commented Jan 28, 2024

after doing

curl "http://localhost:3000/v1/auth/login" -X POST -H 'content-type: application/json' --data '{"email":"[email protected]","password":"bar"}'

and with a console.log({loginDto}) at AuthenticationController#login

I got this output on my terminal:

image

which is expected, right? the JSON body was parsed to object

@fdbatista
Copy link
Author

Yeap.

after doing

curl "http://localhost:3000/v1/auth/login" -X POST -H 'content-type: application/json' --data '{"email":"[email protected]","password":"bar"}'

and with a console.log({loginDto}) at AuthenticationController#login

I got this output on my terminal:

image

which is expected, right? the JSON body was parsed to object

Yes, that is correct.
But if I rename the authorization module, service and controller to just auth it fails.

@micalevisk
Copy link
Member

let's do it again:

git clone [email protected]:ahk-reminder/backend.git
cd backend
## then remove the `TypeOrmModule.forRootAsync` from `AppModule` because it shouldn't be needed in order to reproduce this issue. 
## then add a console.log at src/modules/authentication/authentication.controller.ts
npm i
npm start

curl "http://localhost:3000/v1/auth/login" -X POST -H 'content-type: application/json' --data '{"email":"[email protected]","password":"bar"}'
# got a 404, as expected since there's no route registered in this 'auth' path

curl "http://localhost:3000/v1/authentication/login" -X POST -H 'content-type: application/json' --data '{"email":"[email protected]","password":"bar"}'
# works as expected

please edit your repro to reproduce the issue you're reporting. Everything looks fine so far.

@micalevisk micalevisk closed this as not planned Won't fix, can't repro, duplicate, stale Jan 28, 2024
@fdbatista
Copy link
Author

let's do it again:

git clone [email protected]:ahk-reminder/backend.git
cd backend
## then remove the `TypeOrmModule.forRootAsync` from `AppModule` because it shouldn't be needed in order to reproduce this issue. 
## then add a console.log at src/modules/authentication/authentication.controller.ts
npm i
npm start

curl "http://localhost:3000/v1/auth/login" -X POST -H 'content-type: application/json' --data '{"email":"[email protected]","password":"bar"}'
# got a 404, as expected since there's no route registered in this 'auth' path

curl "http://localhost:3000/v1/authentication/login" -X POST -H 'content-type: application/json' --data '{"email":"[email protected]","password":"bar"}'
# works as expected

please edit your repro to reproduce the issue you're reporting. Everything looks fine so far.

Nevermind. It works with the current setup, so thanks for keeping track :)

@mattezell
Copy link

I'm still trying to trace this, but we're now having the same issue as originally reported in one of our long running Nestjs APIs...

Due to org changes, our CI/CD pipeline removes the pacakge-lock.json - at which time 10.3.1 versions of various @nestjs libs began resolving on npm install.

One of our long working controllers now reports that it can't read a property of undefined when accessing the body - and when we inspect "@Body rb" in the controller, it is undefined...

In my debugging this afternoon, I see that we're landing here before hitting our controller without the expected body object:

If I revert back to a 10.0.5, everything behaves as expected...

Any ideas @kamilmysliwiec ?

@mattezell
Copy link

mattezell commented Jan 31, 2024

This appears to be related to the version bump of reflect-metadata in 10.3.0, where reflect-metadata was changed from 0.1.13 to 0.1.14.

0.1.14 introduced the following change that is causing this issue in our project: rbuckton/reflect-metadata@31dde5f

Specifically, changes to OrdinaryHasOwnMetadata, which is now calling a new GetMetadataProvider method that behaves differently than the previous GetOrCreateMetadataMap method.

@micalevisk
Copy link
Member

let's make this open until we fix that reflect-metadata thing, to avoid new issues

@micalevisk micalevisk reopened this Feb 1, 2024
@micalevisk micalevisk added type: bug 😭 and removed needs triage This issue has not been looked into labels Feb 1, 2024
@mattezell
Copy link

Thanks @micalevisk

So I've been back at it again this morning, doing a bit more diagnostics.

First off, apologies for any thrashing or confusion that I've introduced in my investigation... Hunting down dependency conflicts of dependency's dependencies is enough to make your head spin...

That said, I should have likely began my investigation by running an 'npm ls reflect-metadata' since I was pretty certain this is where the breakdown with populating our controller method's arg was happening.

I don't believe this is actually a problem with the latest release of NestJS itself - and instead was introduced to our project as a result of typeorm being a top level dependency in our project (before my time, so not sure why it was added, though I suspect it can be removed).

With typeorm as a top level dep in our project, and with it being ref'd via the ^, typeorm upgraded to 0.3.20 on a clean install (no package-lock.json), which resulted in a different, and apparently conflicting, version of reflect-metadata was also introduced (see ls output).

[email protected] /home/matt/w/MY-DB-Service-Bad
├─┬ @nestjs/[email protected]
│ └── [email protected] deduped
├─┬ @nestjs/[email protected]
│ └── [email protected] deduped
├─┬ @nestjs/[email protected]
│ └── [email protected] deduped
├─┬ @nestjs/[email protected]
│ └── [email protected] deduped
├─┬ @nestjs/[email protected]
│ └── [email protected] deduped
├─┬ @nestjs/[email protected]
│ └── [email protected] deduped
├─┬ [email protected]
│ ├─┬ @nestjs/[email protected]
│ │ └── [email protected] deduped
│ ├─┬ @nestjs/[email protected]
│ │ ├─┬ @nestjs/[email protected]
│ │ │ └── [email protected] deduped
│ │ └── [email protected] deduped
│ └── [email protected]
├─┬ [email protected]
│ └── [email protected] deduped
├─┬ [email protected]
│ └── [email protected] deduped
├─┬ [email protected]
│ └── [email protected] deduped
├── [email protected]
└─┬ [email protected]
  └── [email protected]

So in walking through with the debugger, I initially saw the top level node_modules/reflect-metadata/Reflect.js as being in play, and so incorrectly associated the issue with the recent upgrade to NestJS... But when digging in further this morning, I noticed that later down the chain, the 0.2.1 nested instance somehow assumed control from /node_modules/typeorm/node_modules/reflect-metadata/...

Apparently, this newer version of 0.2.1 introduces some notion of a Metadata Provider and Registry in order to support multiple imported version of reflect-metadata - which seemingly did the opposite of that in the case of our project, resulting in Nest.js no longer properly populating the controller method's @Body decorated arg...

rbuckton/reflect-metadata@31dde5f

By setting our top level reference of typeorm to the specific "0.3.19" version, which was the release immediately preceding their bump of reflect-metadata to 0.2.1... Now with the top level typeorm using 0.1.14 (deuped, so actually 0.1.13), all is well in our world..

[email protected] /home/matt/w/MY-DB-Service-Bad
├─┬ @nestjs/[email protected]
│ └── [email protected] deduped
├─┬ @nestjs/[email protected]
│ └── [email protected] deduped
├─┬ @nestjs/[email protected]
│ └── [email protected] deduped
├─┬ @nestjs/[email protected]
│ └── [email protected] deduped
├─┬ @nestjs/[email protected]
│ └── [email protected] deduped
├─┬ @nestjs/[email protected]
│ └── [email protected] deduped
├─┬ [email protected]
│ ├─┬ @nestjs/[email protected]
│ │ └── [email protected] deduped
│ ├─┬ @nestjs/[email protected]
│ │ ├─┬ @nestjs/[email protected]
│ │ │ └── [email protected] deduped
│ │ └── [email protected] deduped
│ └── [email protected]
├─┬ [email protected]
│ └── [email protected] deduped
├─┬ [email protected]
│ └── [email protected] deduped
├─┬ [email protected]
│ └── [email protected] deduped
├── [email protected]
└─┬ [email protected]
  └── [email protected] deduped

Now that the fire is out, I will look into if there's any reason for us to have typeorm as a direct import, since we are leveraging @nestjs/typeorm (I'm suspecting not based on a quick test by generating a new NestJS project and adding @nestjs/typeorm working as expected without a top level import).

Thanks for the attention on this - hoping this helps someone else who might stumble here from a similar issue...

@kamilmysliwiec
Copy link
Member

I left a comment on this in the typeorm repository here typeorm/typeorm#10671 (comment)

I believe this PR should fix this issue #12943 (updating the peer dependency constraint making it OK to use v0.2 and share it with other packages)

@kamilmysliwiec
Copy link
Member

This should be fixed in 10.3.2 (reflect-metadata v0.2 is now allowed which should lead to package managers using a deduped version of the package)

@micalevisk
Copy link
Member

seems to be fixed typeorm/typeorm#10671 (comment)

@SylvainSimon
Copy link

I am allowing myself to comment in this ticket. I'm using NestJS as a websocket server with socket.io

The decorators of the event methods (eg: @MessageBody()) are completely ignored if reflect-metadata is not updated to 0.2 when switching to NestJS 10. Everything worked fine in 9 and suddenly my decorators no longer had any kind of importance

Two days wasted.. If it can help anyone :)

@danbaghilovici
Copy link

I can confirm what @SylvainSimon said.
To fix this issue you need to explicitly set the version of reflect metadata to version ^0.2. Old versions of nest cli will put the version to ^0.1.13 which will break validation decorators (in my case @Body and @query were ignored). Setting the versions of nest core libraries to ^10.3.2 won't work either (suggested from @micalevisk link from the last comment)

// ignored when 'reflect-metadata' is still on 0.1.13
"@nestjs/common": "^10.3.2",
"@nestjs/core": "^10.3.2",
// works with any nestjs core lib
"reflect-metadata": "^0.2.0",

If you upgrade your nest cli to the latest version with npm i -g @nestjs/cli you will get the latest version of 'reflect-metadata' and so you won't encounter this issue anymore.

@nestjs nestjs locked and limited conversation to collaborators Feb 26, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

6 participants