Cannot load -dynamic objects (hie-8.6.5)

[jasagredo]

This other issue addresses a similar error but it was not answered #1101.
TL;DR: Check the Actual behaviour section

Installing & GHC versions

I fresh installed the hie for 8.6.5 using stack ./install.hs stack-hie-8.6.5. My project is using lts-13.21 which sets the GHC version to 8.6.5.

Project structure

Global

My project structure is as follows:

.
├── a
│   ├── app
│   ├── package.yaml
│   ├── Setup.hs
│   ├── src
│   └── stack.yaml
├── b
│   ├── package.yaml
│   ├── Setup.hs
│   ├── src
│   └── stack.yaml
├── c
│   ├── package.yaml
│   ├── Setup.hs
│   ├── src
│   └── stack.yaml
└── stack.yaml

Then stack.yaml specifies:

packages:
- a
- b
- c

A

a/stack.yaml specifies:

packages:
- .

B

b/stack.yaml specifies:

packages:
- .

extra-deps:
- ../a/

Followed by a declaration on b/package.yaml:

dependencies:
- a

C

and c/stack.yaml specifies:

packages:
- .

extra-deps:
- ../a/
- ../b/

Followed by a declaration on c/package.yaml:

dependencies:
- a
- b

Editor

I am using Emacs with lsp-mode, lsp-ui, treemacs, lsp-treemacs (I also use Rust and all of this is working nicely, no issues at all) and lsp-haskell. I also use haskell-mode and intero which I guess should work fine, as they work fine if I don't activate lsp-haskell They are all recently installed/updated so there are no outdated versions installed.

I have also tried in VS Code with the same error output.

Expected behaviour

I would expect the hie lsp server to start nicely.

Actual behaviour

The very moment I open a haskell file I get one of these two messages:

LSP :: Got error while processing diagnostics: src/Lib.hs:1:1: fatal:
    Cannot load -dynamic objects when GHC is built the normal way
    To fix this, either:
      (1) Use -fexternal-interpreter, or
      (2) Build the program twice: once the normal way, and then
          with -dynamic using -osuf to set a different object file suffix.

or

Couldn't satisfy -package-id a-<random-hash>

Running it directly

If I run hie-wrapper both in the project root and in c/, it starts nicely:

javier@Javier-Workstation  ~/    hie-wrapper
2019-11-04 15:16:09.563716995 [ThreadId 4] - run entered for hie-wrapper(hie-wrapper) Version 0.13.0.0, Git revision 7cf1295a2804a527381331bb7b73d58255721edc (3051 commits) x86_64 ghc-8.6.5
2019-11-04 15:16:09.566838585 [ThreadId 4] - Current directory:/home/javier/project
2019-11-04 15:16:09.567888035 [ThreadId 4] - Operating system:linux
2019-11-04 15:16:09.570729931 [ThreadId 4] - Cradle directory:/home/javier/project
2019-11-04 15:16:09.570937925 [ThreadId 4] - Using stack GHC version
2019-11-04 15:16:09.733335887 [ThreadId 4] - Project GHC version:8.6.5
2019-11-04 15:16:09.733508678 [ThreadId 4] - hie exe candidates :["hie-8.6.5","hie-8.6","hie"]
2019-11-04 15:16:09.733786427 [ThreadId 4] - found hie exe at:/home/javier/.local/bin/hie-8.6.5
2019-11-04 15:16:09.733951666 [ThreadId 4] - args:[]
2019-11-04 15:16:09.734060731 [ThreadId 4] - launching ....



2019-11-04 15:16:09.735337688 [ThreadId 4] - Using stack GHC version
2019-11-04 15:16:09.90009249 [ThreadId 4] - Run entered for HIE(hie-8.6.5) Version 0.13.0.0, Git revision 7cf1295a2804a527381331bb7b73d58255721edc (3051 commits) x86_64 ghc-8.6.5
2019-11-04 15:16:09.900571282 [ThreadId 4] - Current directory:/home/javier/project
2019-11-04 15:16:09.900758684 [ThreadId 4] - args:[]
^Cuser interrupt
hie-wrapper: callProcess: /home/javier/.local/bin/hie-8.6.5 (exit 1): failed
 ✘ javier@Javier-Workstation  ~/    cd c 
 javier@Javier-Workstation  ~/c    hie-wrapper  
2019-11-04 15:16:16.026020944 [ThreadId 4] - run entered for hie-wrapper(hie-wrapper) Version 0.13.0.0, Git revision 7cf1295a2804a527381331bb7b73d58255721edc (3051 commits) x86_64 ghc-8.6.5
2019-11-04 15:16:16.027281796 [ThreadId 4] - Current directory:/home/javier/project/c
2019-11-04 15:16:16.027778145 [ThreadId 4] - Operating system:linux
2019-11-04 15:16:16.341402984 [ThreadId 4] - Cradle directory:/home/javier/project/c
2019-11-04 15:16:16.341923057 [ThreadId 4] - Using stack GHC version
2019-11-04 15:16:16.506474309 [ThreadId 4] - Project GHC version:8.6.5
2019-11-04 15:16:16.506646263 [ThreadId 4] - hie exe candidates :["hie-8.6.5","hie-8.6","hie"]
2019-11-04 15:16:16.506914166 [ThreadId 4] - found hie exe at:/home/javier/.local/bin/hie-8.6.5
2019-11-04 15:16:16.507066794 [ThreadId 4] - args:[]
2019-11-04 15:16:16.507166858 [ThreadId 4] - launching ....



2019-11-04 15:16:16.50833484 [ThreadId 4] - Using stack GHC version
2019-11-04 15:16:16.67503773 [ThreadId 4] - Run entered for HIE(hie-8.6.5) Version 0.13.0.0, Git revision 7cf1295a2804a527381331bb7b73d58255721edc (3051 commits) x86_64 ghc-8.6.5
2019-11-04 15:16:16.675573273 [ThreadId 4] - Current directory:/home/javier/project/c
2019-11-04 15:16:16.675810275 [ThreadId 4] - args:[]

Questions

• I don't know where to put the settings.json file if it is even needed.
• It says I should recompile the program dynamically again but which program? HIE or my project one?
• Why can't it find a dependency that is specified in stack.yaml file?

[jneira]

Hi, it seems that your ghc installation could have some problem related with dynamic linking (that afaik is needed to open a ghc repl (ghci) that in turn is needed by hie to get the possible warnings or errors about the code)
how did you get your ghc? letting stack download it automatically or using a preexisting one?
could you share your stack, ghc used in the project and the machine/os versions?
f.e. (in a shell inside the root dir of the project):

D:\ws\haskell\stack-test>stack --version
Version 2.1.3, Git revision 0fa51b9925decd937e4a993ad90cb686f88fa282 (7739 commits) x86_64 hpack-0.31.2

D:\ws\haskell\stack-test>ghc --version
The Glorious Glasgow Haskell Compilation System, version 8.6.5

D:\ws\haskell\stack-test>stack path --compiler-exe
D:\bin\Programs\stack\x86_64-windows\ghc-8.6.5\bin\ghc.EXE

D:\ws\haskell\stack-test>stack repl
Using main module: 1. Package `stack-test' component stack-test:exe:stack-test-exe with main-is file: D:\ws\haskell\stack-test\app\Main.hs
stack-test> initial-build-steps (lib + exe)
The following GHC options are incompatible with GHCi and have not been passed to it: -threaded
Configuring GHCi with the following packages: stack-test
GHCi, version 8.6.5: http://www.haskell.org/ghc/  :? for help
[1 of 2] Compiling Lib              ( D:\ws\haskell\stack-test\src\Lib.hs, interpreted )
[2 of 2] Compiling Main             ( D:\ws\haskell\stack-test\app\Main.hs, interpreted )
Ok, two modules loaded.
Loaded GHCi configuration from C:\TEMP\haskell-stack-ghci\xxxxxx\ghci-script
*Main Lib> :m + System.Info
*Main Lib System.Info> os
"mingw32"
*Main Lib System.Info> arch
"x86_64"

Note that stack is able to open a repl in the project (and it likely will fail for your environment)

[jasagredo]

The project structure I wrote is kind of a mockup of the actual project as it is in my job and I can't post it here.

In any case, the output is as follows:

> stack --version
Version 2.1.3, Git revision 636e3a759d51127df2b62f90772def126cdf6d1f (7735 commits) x86_64 hpack-0.31.2
> stack path --compiler-exe      
/home/javier/.stack/programs/x86_64-linux/ghc-tinfo6-8.6.5/bin/ghc-8.6.5
> ghc --version
The Glorious Glasgow Haskell Compilation System, version 8.6.5
> which ghc
/usr/local/bin/ghc

So my installation is the one provided by stack and the ghc is unaltered. I am actually not able to open a repl as my code has some foreign exports that are rejected saying:

    • Illegal foreign declaration: requires unregisterised, llvm (-fllvm) or native code generation (-fasm)
    • When checking declaration:

But if I understand correctly, Intero also uses a similar approach and it doesn't complain at all.

[jneira]

I am not familiar with intero but there should be some diff with hie in the way they load the program (maybe intero uses ghci directly and hie doesnt f.e.).
To isolate the possible cause we could try to setup a simple stack project (wit stack init or similar) using the same lts where stack repl works and see if the error is reproduced with hie. I wonder if the error shown with stack repl is related with the other one.

[jasagredo]

A project structure as described in the opening message, works with HIE without any issues.

(Just added a random argument to someFunc and I get completions and suggestions)

[jneira]

Mmm, so the cause is probably within the project. One test more could be remove the foreign exports temporaly (if it is possible) to see if it fixes the hie handling of the project.

[nponeccop]

the actual project as it is in my job

actual Haskell jobs are rare so congratulations!