Doesn't even build on Mac with cabal: internal error in InstallPlan.completed

[mouse07410]

MacOS Catalina 10.15.5, Xcode-11.5, Cabal-3.2.0.0, GHC-8.10.1, 8.8.3, 8.6.5. Stack-2.3.1 installed, but prefer to build with Cabal:

$ git clone https://github.com/haskell/haskell-language-server --recurse-submodules
Cloning into 'haskell-language-server'...
remote: Enumerating objects: 2026, done.
remote: Total 2026 (delta 0), reused 0 (delta 0), pack-reused 2026
Receiving objects: 100% (2026/2026), 453.12 KiB | 1.27 MiB/s, done.
Resolving deltas: 100% (1141/1141), done.
Submodule 'ghcide' (https://github.com/wz1000/ghcide.git) registered for path 'ghcide'
Cloning into '/Users/ur20980/src/haskell-language-server/ghcide'...
remote: Enumerating objects: 58, done.        
remote: Counting objects: 100% (58/58), done.        
remote: Compressing objects: 100% (38/38), done.        
remote: Total 7644 (delta 21), reused 31 (delta 9), pack-reused 7586        
Receiving objects: 100% (7644/7644), 2.30 MiB | 25.62 MiB/s, done.
Resolving deltas: 100% (4362/4362), done.
Submodule path 'ghcide': checked out '747ec1401c62257ec849319eb2dda966a8008b09'
$ cd haskell-language-server/
$ git submodule update --init --recursive
$ time ./cabal-hls-install hls
Resolving dependencies...
Build profile: -w ghc-8.8.3 -O1
In order, the following will be built (use -v for more details):
 - base16-bytestring-0.1.1.7 (lib) (requires download & build)
 - cabal-doctest-1.0.8 (lib) (requires build)
 - cryptohash-sha256-0.11.101.0 (lib) (requires build)
 - dlist-0.8.0.8 (lib) (requires build)
 - hsc2hs-0.68.7 (exe:hsc2hs) (requires build)
 - js-dgtable-0.5.2 (lib) (requires build)
 - unordered-containers-0.2.11.0 (lib) (requires build)
 - scientific-0.3.6.2 (lib) (requires build)
 - splitmix-0.1 (lib) (requires download & build)
 - tar-0.5.1.1 (lib) (requires build)
 - vector-binary-instances-0.2.5.1 (lib) (requires build)
 - extra-1.7.3 (lib) (requires build)
 - distributive-0.6.2 (lib:distributive) (requires build)
internal error in InstallPlan.completed: not in configured state: Installed lkk-0.1.1.2-5c05fa72
CallStack (from HasCallStack):
  error, called at ./Distribution/Client/InstallPlan.hs:260:25 in main:Distribution.Client.InstallPlan
  internalError, called at ./Distribution/Client/InstallPlan.hs:656:26 in main:Distribution.Client.InstallPlan

real	0m2.887s
user	0m1.655s
sys	0m0.453s

$ ./cabal-hls-install ghcs
Resolving dependencies...
Build profile: -w ghc-8.8.3 -O1
In order, the following will be built (use -v for more details):
 - base16-bytestring-0.1.1.7 (lib) (requires download & build)
 - cabal-doctest-1.0.8 (lib) (requires build)
 - cryptohash-sha256-0.11.101.0 (lib) (requires build)
 - dlist-0.8.0.8 (lib) (requires build)
 - hsc2hs-0.68.7 (exe:hsc2hs) (requires build)
 - js-dgtable-0.5.2 (lib) (requires build)
 - unordered-containers-0.2.11.0 (lib) (requires build)
 - scientific-0.3.6.2 (lib) (requires build)
 - splitmix-0.1 (lib) (requires download & build)
 - tar-0.5.1.1 (lib) (requires build)
 - vector-binary-instances-0.2.5.1 (lib) (requires build)
 - extra-1.7.3 (lib) (requires build)
 - distributive-0.6.2 (lib:distributive) (requires build)
internal error in InstallPlan.completed: not in configured state: Installed lkk-0.1.1.2-5c05fa72
CallStack (from HasCallStack):
  error, called at ./Distribution/Client/InstallPlan.hs:260:25 in main:Distribution.Client.InstallPlan
  internalError, called at ./Distribution/Client/InstallPlan.hs:656:26 in main:Distribution.Client.InstallPlan

[jneira]

It seems the problem is related with the lukko library, a dependency of the install script itself.
It's strange you are getting the error with hls but no for hie, cause the hls install script was copied from the hie one and they have the same dependencies, including lukko.
What is the result of cd ./install && cabal build lukko?

[mouse07410]

First, I gave it a try with stack, and (of course!) it failed. I guess nobody tried dynamic builds before.

$ cd ./install
$ cabal build lukko
. . . . .
    include time-1.9.3
    include transformers-0.5.6.2
    Cabal.Config=cbl-nstll-prsrs-0.3.0.1-64285a08:Cabal.Config,Cabal.Index=cbl-nstll-prsrs-0.3.0.1-64285a08:Cabal.Index,Cabal.Optimization=cbl-nstll-prsrs-0.3.0.1-64285a08:Cabal.Optimization,Cabal.Package=cbl-nstll-prsrs-0.3.0.1-64285a08:Cabal.Package,Cabal.Parse=cbl-nstll-prsrs-0.3.0.1-64285a08:Cabal.Parse,Cabal.Project=cbl-nstll-prsrs-0.3.0.1-64285a08:Cabal.Project,Cabal.SourceRepo=cbl-nstll-prsrs-0.3.0.1-64285a08:Cabal.SourceRepo
Component graph for hls-install-0.8.0.0: component lib
component hls-install-0.8.0.0-inplace
    include base-4.13.0.0
    include cbl-nstll-prsrs-0.3.0.1-64285a08
    include directory-1.3.6.0
    include xtr-1.7.3-ec27bac7
    include filepath-1.4.2.1
    include shk-0.18.5-621fcfb7
    include text-1.2.4.0
unit hls-install-0.8.0.0-inplace
    include base-4.13.0.0
    include cbl-nstll-prsrs-0.3.0.1-64285a08
    include directory-1.3.6.0
    include xtr-1.7.3-ec27bac7
    include filepath-1.4.2.1
    include shk-0.18.5-621fcfb7
    include text-1.2.4.0
    HlsInstall=hls-install-0.8.0.0-inplace:HlsInstall
Up to date
creating
/Users/ur20980/src/haskell-language-server/install/dist-newstyle/build
creating /Users/ur20980/src/haskell-language-server/install/dist-newstyle/tmp
$ cabal install lukko --lib
Wrote tarball sdist to
/Users/ur20980/src/haskell-language-server/install/dist-newstyle/sdist/hls-install-0.8.0.0.tar.gz
Resolving dependencies...
Build profile: -w ghc-8.8.3 -O1
In order, the following will be built (use -v for more details):
 - process-1.6.10.0 (lib:process) (requires download & build)
 - hsc2hs-0.68.7 (exe:hsc2hs) (requires build)
 - lukko-0.1.1.2 (lib) (requires build)
Downloading  process-1.6.10.0
Downloaded   process-1.6.10.0
Starting     process-1.6.10.0 (all, legacy fallback)
Building     process-1.6.10.0 (all, legacy fallback)
Haddock      process-1.6.10.0 (all, legacy fallback)
Installing   process-1.6.10.0 (all, legacy fallback)
Completed    process-1.6.10.0 (all, legacy fallback)
Starting     hsc2hs-0.68.7 (exe:hsc2hs)
Building     hsc2hs-0.68.7 (exe:hsc2hs)
Installing   hsc2hs-0.68.7 (exe:hsc2hs)
Completed    hsc2hs-0.68.7 (exe:hsc2hs)
Starting     lukko-0.1.1.2 (lib)
Building     lukko-0.1.1.2 (lib)
Haddock      lukko-0.1.1.2 (lib)
Installing   lukko-0.1.1.2 (lib)
Completed    lukko-0.1.1.2 (lib)
$ 

But if HLS gives such hiccups with GHC-8.8.3, I rather doubt it would do anything sensible with 8.10.1 - and for me the whole point is making it possible to use IDE (VS Code) with GHC-8.10.1. For 8.8.3 I can happily stay with HIE that works...

Update

Seeing that Cabal complains about "configuration", I decided to try in the blind:

$ ./cabal-hls-install hls-8.8.3
Resolving dependencies...
Build profile: -w ghc-8.8.3 -O1
In order, the following will be built (use -v for more details):
 - base16-bytestring-0.1.1.7 (lib) (requires download & build)
 - cabal-doctest-1.0.8 (lib) (requires build)
 - cryptohash-sha256-0.11.101.0 (lib) (requires build)
 - dlist-0.8.0.8 (lib) (requires build)
 - hsc2hs-0.68.7 (exe:hsc2hs) (requires build)
 - js-dgtable-0.5.2 (lib) (requires build)
 - unordered-containers-0.2.11.0 (lib) (requires build)
 - scientific-0.3.6.2 (lib) (requires build)
 - splitmix-0.1 (lib) (requires download & build)
 - tar-0.5.1.1 (lib) (requires build)
 - vector-binary-instances-0.2.5.1 (lib) (requires build)
 - extra-1.7.3 (lib) (requires build)
 - distributive-0.6.2 (lib:distributive) (requires build)
internal error in InstallPlan.completed: not in configured state: Installed lkk-0.1.1.2-5c05fa72
CallStack (from HasCallStack):
  error, called at ./Distribution/Client/InstallPlan.hs:260:25 in main:Distribution.Client.InstallPlan
  internalError, called at ./Distribution/Client/InstallPlan.hs:656:26 in main:Distribution.Client.InstallPlan
$ cabal v2-configure
Resolving dependencies...
Build profile: -w ghc-8.8.3 -O1
In order, the following would be built (use -v for more details):
 - Diff-0.4.0 (lib) (requires build)
 - blaze-markup-0.8.2.7 (lib) (requires download & build)
 - base16-bytestring-0.1.1.7 (lib) (requires download & build)
 - call-stack-0.2.0 (lib) (requires build)
 - cryptohash-sha1-0.11.100.1 (lib) (requires build)
 - czipwith-1.0.1.3 (lib) (requires download & build)
 - uuid-types-1.0.3 (lib) (requires build)
 - dec-0.0.3 (lib) (requires build)
 - dlist-0.8.0.8 (lib) (requires build)
 - data-default-0.7.1.1 (requires build)
 - data-tree-print-0.1.0.2 (lib) (requires build)
 - file-embed-0.0.12.0 (lib) (requires build)
 - ghc-paths-0.1.0.12 (requires build)
 - ghc-tcplugins-extra-0.4 (lib) (requires download & build)
 - ghcide-0.2.0 (exe:ghcide-test-preprocessor) (first run)
 - githash-0.1.4.0 (lib) (requires build)
 - gitrev-1.3.1 (lib) (requires build)
 - haddock-library-1.9.0 (lib) (requires download & build)
 - hsc2hs-0.68.7 (exe:hsc2hs) (requires build)
 - haskell-src-exts-1.23.1 (lib) (requires download & build)
 - hspec-discover-2.7.1 (exe:hspec-discover) (requires build)
 - js-dgtable-0.5.2 (lib) (requires build)
 - alex-3.2.5 (exe:alex) (requires build)
 - microlens-0.4.11.2 (lib) (requires build)
 - multistate-0.8.0.3 (lib) (requires download & build)
 - monad-memo-0.5.1 (lib) (requires build)
 - unbounded-delays-0.1.1.0 (requires build)
 - unordered-containers-0.2.11.0 (lib) (requires build)
 - unsafe-0.0 (requires build)
 - parallel-3.2.2.0 (lib) (requires build)
 - primes-0.2.1.0 (requires build)
 - prettyprinter-1.6.2 (lib) (requires download & build)
 - psqueues-0.2.7.2 (lib) (requires build)
 - quickcheck-io-0.2.0 (lib) (requires build)
 - reflection-2.1.6 (lib) (requires download & build)
 - regex-tdfa-1.3.1.0 (lib) (requires build)
 - rope-utf16-splay-0.3.1.0 (lib) (requires build)
 - scientific-0.3.6.2 (lib) (requires build)
 - split-0.2.3.4 (lib) (requires build)
 - sorted-list-0.2.1.0 (lib) (requires build)
 - strict-0.3.2 (requires build)
 - tf-random-0.5 (lib) (requires build)
 - these-1.1 (lib) (requires build)
 - topograph-1.0.0.1 (lib) (requires build)
 - vector-algorithms-0.8.0.3 (lib) (requires build)
 - void-0.7.3 (lib) (requires build)
 - wcwidth-0.0.2 (requires build)
 - exceptions-0.10.4 (lib) (requires build)
 - extra-1.7.3 (lib) (requires build)
internal error in InstallPlan.completed: not in configured state: Installed hspc-xpcttns-0.8.2-1b1e5e90
CallStack (from HasCallStack):
  error, called at ./Distribution/Client/InstallPlan.hs:260:25 in main:Distribution.Client.InstallPlan
  internalError, called at ./Distribution/Client/InstallPlan.hs:656:26 in main:Distribution.Client.InstallPlan
$ cabal v2-install --dependencies-only
Wrote tarball sdist to
/Users/ur20980/src/haskell-language-server/dist-newstyle/sdist/haskell-language-server-0.2.0.0.tar.gz
Wrote tarball sdist to
/Users/ur20980/src/haskell-language-server/dist-newstyle/sdist/ghcide-0.2.0.tar.gz
Resolving dependencies...
Build profile: -w ghc-8.8.3 -O1
In order, the following will be built (use -v for more details):
 - base-compat-batteries-0.11.1 (lib) (requires build)
 - base16-bytestring-0.1.1.7 (lib) (requires download & build)
 - clock-0.8 (lib) (requires build)
 - comonad-5.0.6 (lib:comonad) (requires build)
 - czipwith-1.0.1.3 (lib) (requires download & build)
 - dlist-0.8.0.8 (lib) (requires build)
 - filepattern-0.1.2 (lib) (requires build)
 - ghc-check-0.5.0.1 (lib) (requires download & build)
 - ghc-lib-parser-8.10.1.20200523 (lib) (requires download & build)
 - githash-0.1.4.0 (lib) (requires build)
 - haddock-library-1.9.0 (lib) (requires download & build)
 - haskell-src-exts-1.23.1 (lib) (requires download & build)
 - js-dgtable-0.5.2 (lib) (requires build)
 - js-jquery-3.3.1 (lib) (requires build)
 - multistate-0.8.0.3 (lib) (requires download & build)
 - unordered-containers-0.2.11.0 (lib) (requires build)
 - network-3.1.1.1 (lib:network) (requires build)
 - network-uri-2.6.3.0 (lib) (requires build)
 - opentelemetry-0.4.2 (lib) (requires download & build)
 - primitive-0.7.1.0 (lib) (requires build)
 - prettyprinter-1.6.2 (lib) (requires download & build)
 - reflection-2.1.6 (lib) (requires download & build)
 - sorted-list-0.2.1.0 (lib) (requires build)
 - typed-process-0.2.6.0 (lib) (requires build)
 - void-0.7.3 (lib) (requires build)
internal error in InstallPlan.completed: not in configured state: Installed xtr-1.7.3-3da6d11d
CallStack (from HasCallStack):
  error, called at ./Distribution/Client/InstallPlan.hs:260:25 in main:Distribution.Client.InstallPlan
  internalError, called at ./Distribution/Client/InstallPlan.hs:656:26 in main:Distribution.Client.InstallPlan

Sorry to sound harsh, but this isn't even beta-ready...

[jneira]

Thanks for the report and for updating the related cabal issue. It seems cabal is the main culprit here and that removing the cabal store could be a workaround, have you tried it?

[lukel97]

As does indeed seem like an issue with Cabal upstream. For what it's worth I can't recreate it on Catalina either, so nuking ~/.cabal/store is probably your best bet

[mouse07410]

Wiped out the entire Cabal installation (only about 14GB worth of binaries), re-installed. Updated the repo clone to the latest (as of this evening). After third or so "reincarnation", the Cabal-based build with GHC-8.8.3 succeeded (assuming you care to see the "good" log): cabal-8.8.3-out.txt

Is it supposed to work with GHC-8.10.1? Or it's not worth even trying, lest it just messes up my installation? Yes, it appears to work correctly. Build on two Macs with GHC-8.10.1 succeeded.

Also, ./cabal-hls-install data is not supposed to work? Any reason why...?

$ ./cabal-hls-install data
Resolving dependencies...
Build profile: -w ghc-8.8.3 -O1
In order, the following will be built (use -v for more details):
 - fake-package-0 (exe:script) (configuration changed)
Configuring executable 'script' for fake-package-0..
Preprocessing executable 'script' for fake-package-0..
Building executable 'script' for fake-package-0..
[1 of 1] Compiling Main             ( Main.hs, /Users/ur20980/src/haskell-language-server/dist-newstyle/build/x86_64-osx/ghc-8.8.3/fake-package-0/x/script/build/script/script-tmp/Main.dyn_o )
Linking /Users/ur20980/src/haskell-language-server/dist-newstyle/build/x86_64-osx/ghc-8.8.3/fake-package-0/x/script/build/script/script ...
# cabal (for check)
# git (for submodules)
Synchronizing submodule url for 'ghcide'
# git (for submodules)
Options:
    Verbosity level: Info
Generation of hoogle data files is disabled for now.
Build completed in 0.25s