andreww2012 / mongoose-zod

A library which allows to author mongoose ("a MongoDB object modeling tool") schemas using zod ("a TypeScript-first schema declaration and validation library").
MIT License
49 stars 7 forks source link
mongodb mongoose zod

mongoose-zod

A library which allows to author mongoose ("a MongoDB object modeling tool") schemas using zod ("a TypeScript-first schema declaration and validation library").

[!WARNING] This version and all the previous ones only support mongoose 6.x <6.8. Please consult peerDependencies section of package.json for more information.

Purpose

Declaring mongoose schemas in TypeScript environment has always been tricky in terms of getting the most out of type safety:

This library aims to solve many of the aforementioned problems utilizing zod as a schema authoring tool.

Installation

[!WARNING] Please do not forget to read the caveats section when you're done with the main documentation.

Install the package from npm:

npm i mongoose-zod
pnpm i mongoose-zod
yarn add mongoose-zod
⚠️ Important installation notes This package has [peer dependencies](https://docs.npmjs.com/cli/v8/configuring-npm/package-json#peerdependencies) being `mongoose` and `zod` as well as [optional peer dependencies](https://docs.npmjs.com/cli/v8/configuring-npm/package-json#peerdependenciesmeta) being a number of mongoose plugins which automatically added to schemas created with `mongoose-zod` if found. - Starting from version 7, [NPM automatically installs peer dependencies](https://github.blog/2020-10-13-presenting-v7-0-0-of-the-npm-cli/). Keep an eye on installed peer dependencies' versions! - Consequently, you need to **install required peer dependencies yourself** if you're using NPM <7. - There was a bug [in some of the 7.x.x versions of NPM resulting in optional peer dependencies being installed automatically too](https://github.com/npm/feedback/discussions/225). Please check if optional peer dependencies were not installed if you don't need them (or use [--legacy-peer-deps flag](https://docs.npmjs.com/cli/v7/using-npm/config#legacy-peer-deps) when installing dependencies or this package to skip installing *all* peer dependencies and then install all required peer dependencies yourself). - As of October 2022, the latest NPM version, `8.19.2`, [does NOT remove optional peer dependencies after uninstalling them](https://github.com/npm/cli/issues/4737). Which also may mean they will still be considered "found" by `mongoose-zod` even if you uninstalled them. In you encounter such an issue, you need to clean your `package-lock.json` from optional peer dependencies definitions that you have uninstalled and then run `npm i`.

Usage

Firstly, you may want to perform a set up. Here you can pass your own z instance (you can get "our" z by importing z from this package) or opt out of adding new functions to zod prototype altogether. Please only call the setup function at the entrypoint of your application.

import {setup, z: theirZ} from 'mongoose-zod';
import {z: myZ} from 'zod';

setup({z: myZ}); // mongoose-zod will add new functions to the prototype of `myZ`
// NB: this is only an example of calling `setup` multiple times. In reality,
// all subsequent `setup` calls will be ignored!
setup({z: null}); // mongoose-zod will NOT add new functions to the prototype of zod altogether
setup(); // Equivalent to the default behaviour (also equivalent to `setup({z: theirZ})`).

Define the schema and use it as follows:

import {z} from 'zod';
import {genTimestampsSchema, toMongooseSchema, mongooseZodCustomType} from 'mongoose-zod';

export const userZodSchema = z
  .object({
    // Sub schema
    info: z.object({
      // Define type options like this (NOT recommended - better to use `typeOptions` passed to `.mongoose()` - see FAQ)
      // [instead `.mongooseTypeOptions()`, you may use `addMongooseTypeOptions` if you opt out of extending zod prototype]
      nickname: z.string().min(1).mongooseTypeOptions({unique: true}),
      birthday: z.tuple([
        z.number().int().min(1900),
        z.number().int().min(1).max(12),
        z.number().int().min(1).max(31),
      ]),
      // Unlike mongoose, arrays won't have an empty array `[]` as a default value!
      friends: z.number().int().min(1).array().optional(),
      // Making the field optional
      status: z.enum(['😊', '😔', '🤔']).optional(),
      // Use this function to use special (Buffer, ObjectId, ...) and custom (Long, ...) types
      avatar: mongooseZodCustomType('Buffer'),
    }),
    // Default values set with zod's .default() are respected
    regDate: z.date().default(new Date()),
  })
  // Schema merging supported natively by zod. We make use of this feature
  // by providing a schema generator for creating type-safe timestamp fields
  .merge(genTimestampsSchema('crAt', 'upAt'))
  // Define schema options here:
  // [instead `.mongoose()`, you may use `toZodMongooseSchema` if you opt out of extending zod prototype]
  .mongoose({
    schemaOptions: {
      collection: 'users',

      // Full type safety in virtuals, as well as in statics, methods and query methods
      virtuals: {
        bday: {
          get() {
            const [y, m, d] = this.info.birthday;
            return new Date(y, m - 1, d);
          },
          set(d: Date) {
            this.info.birthday = [d.getFullYear(), d.getMonth() + 1, d.getDate()];
          },
        },
      },

      statics: { ... },
      methods: { ... },
      query: { ... },
    },

    // Ability to override type schema options
    typeOptions: {
      upAt: {
        index: false,
      },
    },
  });

const UserSchema = toMongooseSchema(userZodSchema, { ...options... });

const User = M.model('User', UserSchema);

const user = new User().toJSON();

Result:

User model instance type

toMongooseSchema accepts some options in the optional second parameter that control the unknown keys handling and automatic plugin registration. You can read more on this in the next section. Worth nothing that you may set these options globally, in the setup call.

Additional safety measures

Since the overarching goal of this library is to simplify working with mongoose schemas, one way to accomplish that is to also get rid of non-obvious, too permissive or annoying behaviour of mongoose. That's why by default:

But that's not all.

Type-safe validate and required options

You can use special validate and required type options alternatives we provide, mzValidate and mzRequired respectively. In contrast to their vanilla counterparts, they not only guarantee type safety, but their runtime behaviour matches the declared types. They will actually have this set to undefined when run during update operation (click here for mongoose docs on this) and mzValidate will have a proper type of its argument.

⚠️ Some warnings:

Certain plugins are automatically added to schemas if found

If the following plugins are installed, they will be automatically registered on every schema you create with mongoose-zod:

You can opt out of this behaviour when creating a schema in the following manner:

const Schema = toMongooseSchema( ... , {
  disablePlugins: {
    leanVirtuals: true,
    leanDefaults: true,
    leanGetters: true,
  } | true,
});

Or set the options globally in the setup call (see above for more info on setup):

setup({
  ...,
  defaultToMongooseSchemaOptions: {disablePlugins: true, unknownKeys: 'strip'},
});

mongoose-zod is smart enough to gradually re-enable certain plugins if all were disabled globally. That means that with this global config, if you specify say disablePlugins: {leanVirtuals: false} for a certain schema, only mongoose-lean-virtuals plugin will be added to this schema.

The most intriguing thing is that you won't have to explicitly make them work on every .lean() call:

const user = await User.findOne({ ... }).lean();
// is equivalent to (if respective plugins are installed):
const user = await User.findOne({ ... }).lean({
  virtuals: true,
  defaults: true,
  getters: true,
  versionKey: false, // <-- Bonus
});

Note that versionKey: false is also always set regardless of plugins!

You can override certain options if you wish:

// If `mongoose-lean-getters` is installed, `getters: true` will still be implicitly set
const user = await User.findOne({ ... }).lean({ virtuals: false, anyOtherOption: true });

Notes:

More on schema's strict option

By default mongoose-zod sets strict option to throw instead of true for a root schema and sub schemas. You can control this behaviour by changing unknownKeys option when creating a schema:

FAQ

What is the recommended way of defining type options?

The example above demonstrates that there are three ways of defining type options for the field: .mongooseTypeOptions({ ... }), .mongoose({typeOptions: { ... }}) or by using a stand-alone function addMongooseTypeOptions({ ... }). There's a good reason why these options exist and here is the recipe for their correct usage:

How to obtain a schema type and what to do with it?

You have two options:

The good thing is they both should be equal! Then you can use it say in your frontend code by using TypeScript's type only import to make sure no actual code is imported, only types:

// user.model.ts (backend):
...
const userZodSchema = z.object({ ... }).mongoose();
const UserSchema = toMongooseSchema(userZodSchema);
...
export type IUser = z.infer<typeof userZodSchema>;
// OR
export type IUser = mongoose.InferSchemaType<typeof UserSchema>;
...

// somewhere on frontend, notice "import type":
import type {IUser} from '<...>/user.model';
...

How to use special types like Buffer, ObjectId, Decimal128 or custom ones like Long?

Use a stand-alone function called mongooseZodCustomType.

import {z} from 'zod';
import {mongooseZodCustomType} from 'mongoose-zod';

const zodSchema = z.object({
  refs: mongooseZodCustomType('ObjectId').array(),
  data: mongooseZodCustomType('Buffer').optional(),
}).mongoose();

Don't we still have type safety for options like alias and timestamps?

Yes, we don't. Instead timestamps, merge your schema with a timestamps schema generator exported under the genTimestampsSchema name.

Instead alias, simply use a virtual (which is what mongoose aliases actually are).

What zod types are supported and how are they mapped to mongoose types?

zod type mongoose type
Number, number finite literal, native numeric enum, numbers union MongooseZodNumber
String, Enum, string literal, native string enum, strings union MongooseZodString
Date, dates union MongooseZodDate
Boolean, boolean literal, booleans union MongooseZodBoolean
Map Map
NaN, NaN literal Mixed
Null, null literal ^
Heterogeneous1 NativeEnum ^
Unknown ^
Record ^
Union ^
DiscriminatedUnion2 ^
Intersection ^
Type ^
TypeAny ^
Any depends3
Array mongoose type corresponding to the unwrapped schema's type
Other types not supported

1 Enums with mixed values, e.g. with both string and numbers. Also see TypeScript docs.
2 Has nothing to do with mongoose discriminators.
3 A class provided with mongooseZodCustomType() or Mixed instead.

How do I access the data set by .mongooseTypeOptions/.mongoose?

We expose MongooseTypeOptionsSymbol and MongooseSchemaOptionsSymbol symbols respectively that you can use to get to the data set with the respective methods in the following way:

const zodSchema = z.object({ ... }).mongoose({ ... });
const schemaOptions = zodSchema._def[MongooseSchemaOptionsSymbol];

⚠️ Caveats ⚠️

I get the error: .mongooseTypeOptions/.mongoose is not a function

It is due to that mongoose-zod extends the prototype of z to chain the functions you are experiencing trouble with. This error indicates that zod extensions this package adds have not been registered yet. This may happen when (1) you've used either of these methods but haven't imported anything from mongoose-zod (2) you're (accidentally) using a different zod or mongoose instance or version in your code. In the first case the best strategy would probably be to import the package at the entrypoint of your application like that:

import 'mongoose-zod';
...

You can also use the z that is included in mongoose-zod instead of the z from zod directly to be sure you have the correct z reference:

import {z} from 'mongoose-zod';

...
const userZodSchema = z.object({ ... }).mongoose();
const UserSchema = toMongooseSchema(userZodSchema);

When this is not possible in your use case, or you prefer a function over a prototype extend you can use the following:

import {addMongooseTypeOptions, toZodMongooseSchema} from './extensions';

const zodSchema = toZodMongooseSchema(z.object({
  nickname: addMongooseTypeOptions(z.string().min(1), {unique: true}),
  friends: z.number().int().min(1).array().optional(),
}))

instead of

const zodSchema = z.object({
  nickname: z.string().min(1).mongooseTypeOptions({unique: true}),
  friends: z.number().int().min(1).array().optional(),
}).mongoose();

Be careful when using shared schemas with .mongooseTypeOptions/.mongoose

If the schema of multiple fields is structurally the same, we highly recommend that you do NOT create a shared schema. Instead, create a factory, because the data attached with .mongooseTypeOptions/.mongoose will also be shared, and that's not always what you want.

// ❌ DON'T do:
const PositiveInt = z.number().int().min(1);
... // somewhere in the schema definition:
  userId: PositiveInt.mongooseTypeOptions({ index: true}),
  country: PositiveInt, // surprise, this field will have "index: true" as well!
...

// ✅ do:
const PositiveInt = () => z.number().int().min(1);
...
  userId: PositiveInt().mongooseTypeOptions({ index: true}),
  country: PositiveInt(),
...

Prefer ZodRecord over ZodMap

We highly recommend that you do not use ZodMap. Map values are problematic to serialize and they're stored as BSON objects anyway, therefore now can be safely replaced with ZodRecord. (Well, actually, prefer arrays over records, unless you really need them).

ZodObject as a member of union is not treated like a sub schema

It means that no default schema options will be set (because mongoose's sub schema won't be created in the first place) for a ZodObject in a ZodUnion. For example this results in unknown keys are not being removed. You must use zod's .strict()/.passthrough() methods to control this behaviour.

Values in an array of objects still casted by mongoose

Unfortunately I haven't found a way yet to disable casting in this case. PR's and presenting your ideas on how to achieve that are more than welcome!

That's an illustration on what is meant here:

const Schema = toMongooseSchema(
  ...
  arrayOfObjects: z.object({a: z.string()}).array()
  ...
);
const Model = mongoose.model('model_name', Schema);
const doc = new Model({ ..., arrayOfObjects: [{a: ''}]}, ...);
// becomes :(
{ ..., arrayOfObjects: [{a: undefined}], ...}

License

See LICENSE.md.