Sort compiler files into more manageable structure

[haxscramper]

Organized compiler source code into smaller sections - if we plan to untangle implementation parts from each other, we can start small, with simple file organization and later continue to remove unnecessary cross-directory imports and so on.

current moved files:

 { => ast}/ast.nim 
 { => ast}/ast_types.nim 
 { => ast}/astalgo.nim 
 { => ast}/astmsgs.nim 
 { => ast}/enumtostr.nim 
 { => ast}/errorhandling.nim 
 { => ast}/errorreporting.nim 
 { => ast}/layouter.nim 
 { => ast}/lexer.nim 
 { => ast}/lineinfos.nim 
 { => ast}/linter.nim 
 { => ast}/llstream.nim 
 { => ast}/ndi.nim 
 { => ast}/nimlexbase.nim 
 { => ast}/nimsets.nim 
 { => ast}/parser.nim 
 { => ast}/renderer.nim 
 { => ast}/reports.nim 
 { => ast}/syntaxes.nim 
 { => ast}/trees.nim 
 { => ast}/treetab.nim 
 { => ast}/types.nim 
 { => ast}/typesrenderer.nim 
 { => ast}/wordrecg.nim 
 { => backend}/ccgcalls.nim 
 { => backend}/ccgexprs.nim 
 { => backend}/ccgliterals.nim 
 { => backend}/ccgmerge_unused.nim 
 { => backend}/ccgreset.nim 
 { => backend}/ccgstmts.nim 
 { => backend}/ccgthreadvars.nim 
 { => backend}/ccgtrav.nim 
 { => backend}/ccgtypes.nim 
 { => backend}/ccgutils.nim 
 { => backend}/cgen.nim 
 { => backend}/cgendata.nim 
 { => backend}/cgmeth.nim 
 { => backend}/extccomp.nim (99%)
 { => backend}/jsgen.nim 
 { => backend}/jstypes.nim 
 { => backend}/tccgen.nim 
 { => font}/cli_reporter.nim 
 { => font}/cmdlinehelper.nim 
 { => font}/commands.nim 
 { => font}/condsyms.nim 
 { => font}/main.nim 
 { => font}/msgs.nim 
 { => font}/nimconf.nim 
 { => font}/options.nim 
 { => font}/scriptconfig.nim 
 { => modules}/depends.nim 
 { => modules}/importer.nim 
 { => modules}/magicsys.nim 
 { => modules}/modulegraphs.nim 
 { => modules}/modulepaths.nim 
 { => modules}/modules.nim 
 { => modules}/nimblecmd.nim 
 { => modules}/nimpaths.nim 
 { => modules}/packagehandling.nim 
 { => sem}/aliases.nim 
 { => sem}/closureiters.nim 
 { => sem}/concepts.nim 
 { => sem}/debuginfo.nim 
 { => sem}/dfa.nim 
 { => sem}/evaltempl.nim 
 { => sem}/filter_tmpl.nim 
 { => sem}/filters.nim 
 { => sem}/guards.nim 
 { => sem}/hlo.nim 
 { => sem}/idents.nim 
 { => sem}/index.nim 
 { => sem}/injectdestructors.nim 
 { => sem}/installer.ini 
 { => sem}/isolation_check.nim 
 { => sem}/lambdalifting.nim 
 { => sem}/liftdestructors.nim 
 { => sem}/liftlocals.nim 
 { => sem}/lookups.nim 
 { => sem}/lowerings.nim 
 { => sem}/nilcheck.nim 
 { => sem}/nilcheck_enums.nim 
 { => sem}/optimizer.nim 
 { => sem}/parampatterns.nim 
 { => sem}/passaux.nim 
 { => sem}/passes.nim 
 { => sem}/patterns.nim 
 { => sem}/pragmas.nim 
 { => sem}/procfind.nim 
 { => sem}/renderverbatim.nim 
 { => sem}/reorder.nim 
 { => sem}/rodutils.nim 
 { => sem}/sem.nim 
 { => sem}/semcall.nim 
 { => sem}/semdata.nim 
 { => sem}/semexprs.nim 
 { => sem}/semfields.nim 
 { => sem}/semfold.nim 
 { => sem}/semgnrc.nim 
 { => sem}/seminst.nim 
 { => sem}/semmacrosanity.nim 
 { => sem}/semmagic.nim 
 { => sem}/semobjconstr.nim 
 { => sem}/semparallel.nim 
 { => sem}/sempass2.nim 
 { => sem}/semstmts.nim 
 { => sem}/semtempl.nim 
 { => sem}/semtypes.nim 
 { => sem}/semtypinst.nim 
 { => sem}/sighashes.nim 
 { => sem}/sigmatch.nim 
 { => sem}/sinkparameter_inference.nim 
 { => sem}/sizealignoffsetimpl.nim 
 { => sem}/sourcemap.nim 
 { => sem}/spawn.nim 
 { => sem}/transf.nim 
 { => sem}/typeallowed.nim 
 { => sem}/varpartitions.nim 
 { => tools}/docgen.nim 
 { => tools}/docgen2.nim 
 { => tools}/suggest.nim 
 { => utils}/bitsets.nim 
 { => utils}/btrees.nim 
 { => utils}/debugutils.nim 
 { => utils}/int128.nim 
 { => utils}/nodejs.nim 
 { => utils}/nversion.nim 
 { => utils}/pathutils.nim 
 { => utils}/platform.nim 
 { => utils}/pluginsupport.nim 
 { => utils}/prefixmatches.nim 
 { => utils}/ropes.nim 
 { => utils}/saturate.nim 
 { => utils}/strutils2.nim 
 { => vm}/evalffi.nim 
 { => vm}/gorgeimpl.nim 
 { => vm}/macrocacheimpl.nim 
 { => vm}/nimeval.nim 
 { => vm}/vm.nim 
 { => vm}/vm_enums.nim 
 { => vm}/vmconv.nim 
 { => vm}/vmdef.nim 
 { => vm}/vmdeps.nim 
 { => vm}/vmgen.nim 
 { => vm}/vmhooks.nim 
 { => vm}/vmops.nim 
 { => vm}/vmprofiler.nim 

directory structure

├── ast
│   ├── astalgo.nim
│   ├── astmsgs.nim
│   ├── ast.nim
│   ├── ast_types.nim
│   ├── enumtostr.nim
│   ├── errorhandling.nim
│   ├── errorreporting.nim
│   ├── layouter.nim
│   ├── lexer.nim
│   ├── lineinfos.nim
│   ├── linter.nim
│   ├── llstream.nim
│   ├── ndi.nim
│   ├── nimlexbase.nim
│   ├── nimsets.nim
│   ├── parser.nim
│   ├── renderer.nim
│   ├── reports.nim
│   ├── syntaxes.nim
│   ├── trees.nim
│   ├── treetab.nim
│   ├── types.nim
│   ├── typesrenderer.nim
│   └── wordrecg.nim
├── backend
│   ├── ccgcalls.nim
│   ├── ccgexprs.nim
│   ├── ccgliterals.nim
│   ├── ccgmerge_unused.nim
│   ├── ccgreset.nim
│   ├── ccgstmts.nim
│   ├── ccgthreadvars.nim
│   ├── ccgtrav.nim
│   ├── ccgtypes.nim
│   ├── ccgutils.nim
│   ├── cgendata.nim
│   ├── cgen.nim
│   ├── cgmeth.nim
│   ├── extccomp.nim
│   ├── jsgen.nim
│   ├── jstypes.nim
│   └── tccgen.nim
├── font
│   ├── cli_reporter.nim
│   ├── cmdlinehelper.nim
│   ├── commands.nim
│   ├── condsyms.nim
│   ├── main.nim
│   ├── msgs.nim
│   ├── nimconf.nim
│   ├── options.nim
│   └── scriptconfig.nim
├── htmldocs
│   ├── ast_types.html
│   └── nimdoc.out.css
├── ic
│   ├── bitabs.nim
│   ├── cbackend.nim
│   ├── dce.nim
│   ├── design.rst
│   ├── ic
│   ├── ic.nim
│   ├── integrity.nim
│   ├── navigator.nim
│   ├── packed_ast.nim
│   ├── replayer.nim
│   └── rodfiles.nim
├── modules
│   ├── depends.nim
│   ├── importer.nim
│   ├── magicsys.nim
│   ├── modulegraphs.nim
│   ├── modulepaths.nim
│   ├── modules.nim
│   ├── nimblecmd.nim
│   ├── nimpaths.nim
│   └── packagehandling.nim
├── nim.cfg
├── nimfix
│   ├── nimfix.nim
│   ├── nimfix.nim.cfg
│   └── prettybase.nim
├── nim.nim
├── plugins
│   ├── active.nim
│   ├── itersgen.nim
│   └── locals.nim
├── readme.md
├── sem
│   ├── aliases.nim
│   ├── closureiters.nim
│   ├── concepts.nim
│   ├── debuginfo.nim
│   ├── dfa.nim
│   ├── evaltempl.nim
│   ├── filters.nim
│   ├── filter_tmpl.nim
│   ├── guards.nim
│   ├── hlo.nim
│   ├── idents.nim
│   ├── index.nim
│   ├── injectdestructors.nim
│   ├── installer.ini
│   ├── isolation_check.nim
│   ├── lambdalifting.nim
│   ├── liftdestructors.nim
│   ├── liftlocals.nim
│   ├── lookups.nim
│   ├── lowerings.nim
│   ├── nilcheck_enums.nim
│   ├── nilcheck.nim
│   ├── optimizer.nim
│   ├── parampatterns.nim
│   ├── passaux.nim
│   ├── passes.nim
│   ├── patterns.nim
│   ├── pragmas.nim
│   ├── procfind.nim
│   ├── renderverbatim.nim
│   ├── reorder.nim
│   ├── rodutils.nim
│   ├── semcall.nim
│   ├── semdata.nim
│   ├── semexprs.nim
│   ├── semfields.nim
│   ├── semfold.nim
│   ├── semgnrc.nim
│   ├── seminst.nim
│   ├── semmacrosanity.nim
│   ├── semmagic.nim
│   ├── sem.nim
│   ├── semobjconstr.nim
│   ├── semparallel.nim
│   ├── sempass2.nim
│   ├── semstmts.nim
│   ├── semtempl.nim
│   ├── semtypes.nim
│   ├── semtypinst.nim
│   ├── sighashes.nim
│   ├── sigmatch.nim
│   ├── sinkparameter_inference.nim
│   ├── sizealignoffsetimpl.nim
│   ├── sourcemap.nim
│   ├── spawn.nim
│   ├── transf.nim
│   ├── typeallowed.nim
│   └── varpartitions.nim
├── tools
│   ├── docgen2.nim
│   ├── docgen.nim
│   └── suggest.nim
├── utils
│   ├── bitsets.nim
│   ├── btrees.nim
│   ├── debugutils.nim
│   ├── int128.nim
│   ├── nodejs.nim
│   ├── nversion.nim
│   ├── pathutils.nim
│   ├── platform.nim
│   ├── pluginsupport.nim
│   ├── prefixmatches.nim
│   ├── ropes.nim
│   ├── saturate.nim
│   └── strutils2.nim
└── vm
    ├── evalffi.nim
    ├── gorgeimpl.nim
    ├── macrocacheimpl.nim
    ├── nimeval.nim
    ├── vmconv.nim
    ├── vmdef.nim
    ├── vmdeps.nim
    ├── vm_enums.nim
    ├── vmgen.nim
    ├── vmhooks.nim
    ├── vm.nim
    ├── vmops.nim
    └── vmprofiler.nim

for now this is just a placeholder, so comment on the file movements, and general directory structure, and when we are ok with this, I will do a full compiler import fix.

[canelhasmateus]

god's work.

[haxscramper]

Also sorting out all stdlib imports into compiler and making them use std/ prefix while I'm at it

[saem]

Did an initial scan mostly ok, but one thing is nagging me:

If we have imports like compiler/foothen that implies we could just as easily end up with testament/bar as an import. At least right now we'd spot the .. and know it's broken more easily than a myriad of directories one might import.

I don't think we should start from the root instead we should be within the compiler and std is just nim itself bringing in the standard library. Hell I'd argue that we should disable relative import by default and people should have to enable it as a special case -- separate PR.

[saem]

Sorry I fell really compelled to be nitpicky here -- just because it's going to end up everywhere.

Can we align the comments so all the starting # line up in instance where we gave lists like this?

[haxscramper]

About vertical spacing:

1. They allow for trailing comments without reformatting
2. If new import is added it is easy to spot
3. If merge conflict happens it is very localized wrt. to imports, and not this kind of thing:

<<<<<<< HEAD:compiler/cli_reporter.nim
import reports,
       ast,
       types,
       renderer,
       astmsgs,
       astalgo,
       msgs,
       lineinfos,
       nilcheck_enums,
       vm_enums,
       platform,
       nversion

import options as compiler_options
import std/[
  strutils, terminal, options, algorithm,
  sequtils, strformat, tables, intsets,
  json
]
=======
import
  std/[
    strutils,
    terminal,
    options,
    algorithm,
    sequtils,
    strformat,
    tables,
    intsets,
    json
  ],
  ast/[
    lineinfos,
    astalgo,
    astmsgs,
    renderer,
    types,
    ast,
    reports
  ],
  front/[
    msgs
  ],
  sem/[
    nilcheck_enums
  ],
  vm/[
    vm_enums
  ]
>>>>>>> 8e6087ba9 (.):compiler/front/cli_reporter.nim

[haxscramper]

bors try

[bors]

try

Build failed:

• All reproducibility tests passed

[haxscramper]

bors try

[bors]

try

Build succeeded:

• All check passed
• All reproducibility tests passed

[haxscramper]

Can be merged, and since this will bitrot really quickly (due to modification of all imports) better done soon.

[saem]

Bors r+

[bors]

Build succeeded:

• All check passed
• All reproducibility tests passed