Lazy load workspace libraries

[musjj]

I'm using sumneko_lua with Neovim and I wanted to have completions from the Lua plugins I have installed, so I inserted all the paths to the plugins that I have into Lua.workspace.library

But the problem is that it that sumneko_lua loads all the files inside those libraries right on startup, causing a massive increase to my RAM usage. Normally sumneko_lua only takes up 100-200 MB, but after adding 40+ library paths, sumneko now takes up to 600-700 MB.

Is it possible to load the libraries into the workspace, only when it is needed?
For example, I don't believe the library needs to be loaded when you're only completing a require statement:

local foobar = require("foob|

sumneko_lua only needs to scan the directories listed in Lua.workspace.library to find the correct files.

Once the require statement is completed, and its return value is interacted with:

local foobar = require("foobar")
foobar.call_functi|

sumneko_lua can now then load the library in order to produce the completions.

Is it possible for something like this to be implemented?

[sumneko]

I need to analyze them to search for the global variables and class.

[musjj]

True, but if the library isn't imported yet, the global variables/classes set inside those library won't be available right?

[sumneko]

No, they may required by host.
For example, you never required io, but you can use io.open.

[musjj]

Ah, I see what you mean. I'm not really sure how it works, but is it possible to use Lua.diagnostics.globals to determine that?
On a related issue, is it possible for sumneko_lua's RAM usage to be optimized in general? It seems that it uses up a lot more RAM compared to other LSPs like pyright.

[sumneko]

I have an idea at present, if I find that a file does not define any global variables, and have not defined ---@class ---@alias ---@enum, I can free this file.

But this requires some experiments.

[sumneko]

@musjj Could you please checkout this branch: https://github.com/sumneko/lua-language-server/tree/save-memory to test if it improved?

[sumneko]

Besides, test with setting completion.autoRequire to false

[sumneko]

I have merged branch into master.