Skip to content

Latest commit

 

History

History
38 lines (25 loc) · 1.09 KB

README.md

File metadata and controls

38 lines (25 loc) · 1.09 KB
Raw

mongoose-to-spark-schema

Generate Spark StructType schema JSON from a Mongoose model

NPM version

npm

Install

$ git clone
$ cd mongoose-to-spark-schema
$ npm install

Usage

// output to stdout
node index.js --model=./path-to-mongoose-model.js

// output to file
node index.js --model=./path-to-mongoose-model.js --output=./path-to-output-schema.json

Caveats:

  • Remove all dependencies from mongoose model file (plugins, hooks etc.) except mongoose before running.
  • Fields with type Mixed/Object cannot be handled in Spark StructType. Either remove or replace with the exact structure of the object in the model file.

Todo

  • export a generateSchema() function that can be imported within a NodeJS app.
    • parameter could be file path or mongoose model object

Dependencies