EXCEPTION_ACCESS_VIOLATION in strlen when gc is run. #10249

KristofferC · 2015-02-19T12:37:25Z

Trying to generate a random matrix and getting EXCEPTION_ACCESS_VIOLATION with newest Julia nightly. The first command to rand works but it then crashes on the second (which I guess is when the gc is run). The problem seems to be in the strlen function in msvcrt.dll.

Commands and error message:

               _
   _       _ _(_)_     |  A fresh approach to technical computing
  (_)     | (_) (_)    |  Documentation: http://docs.julialang.org
   _ _   _| |_  __ _   |  Type "help()" for help.
  | | | | | | |/ _` |  |
  | | |_| | | | (_| |  |  Version 0.4.0-dev+3434 (2015-02-19 07:50 UTC)
 _/ |\__'_|_|_|\__'_|  |  Commit 28ccffe* (0 days old master)
|__/                   |  x86_64-w64-mingw32

julia> rand(3, 10^6)
3x1000000 Array{Float64,2}:
 0.153078  0.344277  0.455856  0.338394  0.22878   0.148569  0.582351  .  0.149935  0.828556  0.871439  0.577591  0.0350696  0.819783  0.254
 0.887146  0.228346  0.21714   0.989861  0.248539  0.98502   0.851168     0.91924   0.467418  0.841175  0.888225  0.157663   0.783142  0.866
 0.336424  0.962366  0.407604  0.616228  0.922652  0.807424  0.496115     0.126479  0.399813  0.837771  0.307922  0.723622   0.476062  0.253

julia> rand(3,10^6)

Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: EXCEPTION_ACCESS_VIOLATION at 0x7fefe1d5a01 -- strlen at C:\Windows\system32\msvcrt.dll (unknown line)
jl_load_and_lookup at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia.dll (unknown line)
jl_load_and_lookup at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia.dll (unknown line)
jl_compile at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia.dll (unknown line)
jl_trampoline at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia.dll (unknown line)
jl_apply_generic at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia.dll (unknown line)
jl_unprotect_stack at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia.dll (unknown line)
gdbbacktrace at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia.dll (unknown line)
jl_throw at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia.dll (unknown line)
jl_type_error_rt at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia.dll (unknown line)
jl_type_error at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia.dll (unknown line)
jl_f_get_field at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia.dll (unknown line)
typeinf at inference.jl:1431
jlcall_typeinf_54 at  (unknown line)
jl_apply_generic at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia.dll (unknown line)
typeinf_ext at inference.jl:1332
jl_apply_generic at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia.dll (unknown line)
jl_method_cache_insert at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia.dll (unknown line)
jl_method_cache_insert at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia.dll (unknown line)
jl_apply_generic at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia.dll (unknown line)
jl_unprotect_stack at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia.dll (unknown line)
gdbbacktrace at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia.dll (unknown line)
jl_throw at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia.dll (unknown line)
jl_type_error_rt at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia.dll (unknown line)
jl_type_error at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia.dll (unknown line)
jl_f_get_field at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia.dll (unknown line)
f_argnames at inference.jl:1323
typeinf at inference.jl:1426
jlcall_typeinf_54 at  (unknown line)
jl_apply_generic at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia.dll (unknown line)
typeinf_ext at inference.jl:1332
jl_apply_generic at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia.dll (unknown line)
jl_method_cache_insert at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia.dll (unknown line)
jl_method_cache_insert at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia.dll (unknown line)
jl_apply_generic at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia.dll (unknown line)
eval_user_input at REPL.jl:61
jlcall_eval_user_input_1305 at  (unknown line)
jl_apply_generic at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia.dll (unknown line)
anonymous at task.jl:83
jl_unprotect_stack at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia.dll (unknown line)

The text was updated successfully, but these errors were encountered:

ihnorton · 2015-02-19T17:58:38Z

I can't reproduce on the latest.

 Version 0.4.0-dev+3437 (2015-02-19 15:59 UTC)
 Commit d4cb873* (0 days old master)

quinnj · 2015-02-19T18:03:05Z

Not seeing it here either

Version 0.4.0-dev+3307 (2015-02-11 21:42 UTC)
Commit a387920* (7 days old master)
x86_64-apple-darwin14.1.0

64-bit OSX

KristofferC · 2015-02-19T18:03:48Z

I can add that the problem does not seem to occur on the debug version of Julia.

Debug

D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin>julia-debug.exe
               _
   _       _ _(_)_     |  A fresh approach to technical computing
  (_)     | (_) (_)    |  Documentation: http://docs.julialang.org
   _ _   _| |_  __ _   |  Type "help()" for help.
  | | | | | | |/ _` |  |
  | | |_| | | | (_| |  |  Version 0.4.0-dev+3434 (2015-02-19 07:50 UTC)
 _/ |\__'_|_|_|\__'_|  |  Commit 28ccffe* (0 days old master)
|__/                   |  x86_64-w64-mingw32

julia> rand(3, 10^5)
3x100000 Array{Float64,2}:


julia> rand(3, 10^6)
3x1000000 Array{Float64,2}:


julia> rand(3, 10^6)
3x1000000 Array{Float64,2}:

Release

D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin>julia.exe
               _
   _       _ _(_)_     |  A fresh approach to technical computing
  (_)     | (_) (_)    |  Documentation: http://docs.julialang.org
   _ _   _| |_  __ _   |  Type "help()" for help.
  | | | | | | |/ _` |  |
  | | |_| | | | (_| |  |  Version 0.4.0-dev+3434 (2015-02-19 07:50 UTC)
 _/ |\__'_|_|_|\__'_|  |  Commit 28ccffe* (0 days old master)
|__/                   |  x86_64-w64-mingw32

julia> rand(3, 10^6)
3x1000000 Array{Float64,2}:

julia> rand(3, 10^6)

Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: EXCEPTION_ACCESS_VIOLATION at 0x7fefe1d5a01 -- strlen at C:\Windows\system32\msvcrt.dll (unknown line)

Just tell me what I can do to help.

KristofferC · 2015-02-19T18:28:25Z

Weird,

If I go rand(3, 10^6) into another rand(3, 10^6) it always crashes.

However, if I first go a rand(3,10^5) I can do however many rand(3, 10^6) I want and it never crashes.

tkelman · 2015-02-19T23:11:55Z

What version of Windows is this?

ihnorton · 2015-02-19T23:37:23Z

FWIW, I tried that exact build (Version 0.4.0-dev+3434 (2015-02-19 07:50 UTC)) and could not reproduce on Win7 Pro.

tkelman · 2015-02-20T04:00:23Z

I also can't reproduce this on Win7 with x86_64 Julia.

KristofferC · 2015-02-20T09:37:01Z

It seems to crash in julia-debug now as well (maybe better error message this time?) I am using Windows 7 by the way.:

D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin>julia-debug.exe
               _
   _       _ _(_)_     |  A fresh approach to technical computing
  (_)     | (_) (_)    |  Documentation: http://docs.julialang.org
   _ _   _| |_  __ _   |  Type "help()" for help.
  | | | | | | |/ _` |  |
  | | |_| | | | (_| |  |  Version 0.4.0-dev+3434 (2015-02-19 07:50 UTC)
 _/ |\__'_|_|_|\__'_|  |  Commit 28ccffe* (1 day old master)
|__/                   |  x86_64-w64-mingw32

julia> rand(3, 10^6)
3x1000000 Array{Float64,2}:

julia> rand(3, 10^6)
A s s e r t i o n   f a i l e d !

 P r o g r a m :   D : \ U s e r s \ k r i c a r l . N E T \ A p p D a t a \ L o c a l \ J u l i a - 0 . 4 . 0 - d e v \ b i n \ j u l i a - d e b u g
 . e x e
 F i l e :   a s t . c ,   L i n e   7 4 3

 E x p r e s s i o n :   j l _ i s _ e x p r ( e x )

This application has requested the Runtime to terminate it in an unusual way.
Please contact the application's support team for more information.

ihnorton · 2015-02-20T12:51:11Z

What is windows version?
On Feb 20, 2015 4:37 AM, "Kristoffer Carlsson" notifications@github.com
wrote:

It seems to crash in julia-debug now as well (maybe better error message
this time?):

D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin>julia-debug.exe
_
_ _ ()_ | A fresh approach to technical computing
() | () () | Documentation: http://docs.julialang.org
_ _ | | __ _ | Type "help()" for help.
| | | | | | |/ ` | |
| | || | | | (| | | Version 0.4.0-dev+3434 (2015-02-19 07:50 UTC)
/ |_'|||__'| | Commit 28ccffe* (1 day old master)
|__/ | x86_64-w64-mingw32

julia> rand(3, 10^6)
3x1000000 Array{Float64,2}:

julia> rand(3, 10^6)
A s s e r t i o n f a i l e d !

P r o g r a m : D : \ U s e r s \ k r i c a r l . N E T \ A p p D a t a \ L o c a l \ J u l i a - 0 . 4 . 0 - d e v \ b i n \ j u l i a - d e b u g
. e x e
F i l e : a s t . c , L i n e 7 4 3

E x p r e s s i o n : j l _ i s _ e x p r ( e x )

This application has requested the Runtime to terminate it in an unusual way.
Please contact the application's support team for more information.

—
Reply to this email directly or view it on GitHub
#10249 (comment).

tkelman · 2015-02-20T12:53:40Z

There is a non-negligible chance the new GC might not work on XP or something? I personally think we should stop trying to support XP (for 0.4), but no idea whether that's related here.

KristofferC · 2015-02-20T14:26:46Z

I am using Windows 7.

KristofferC · 2015-02-20T14:31:54Z

My Julia gc seems to be just strange in general. Getting this for some code now (creating a BallTree that works fine on 0.3).

Since no one can reproduce I am guessing something is up with my installation or Windows. I will try to reinstall Julia etc and see if I can get something to work.

Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: EXCEPTION_ACCESS_VIOLATION at 0x6c53956a -- jl_gc_setmark at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.
nown line)
gc_queue_root at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_gc_setmark at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
gc_queue_root at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_gc_setmark at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
gc_queue_root at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_gc_setmark at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_gc_setmark at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
gc_queue_root at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_gc_setmark at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_gc_setmark at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
gc_queue_root at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_gc_setmark at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_gc_collect at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_gc_free_array at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_gc_free_array at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
allocobj at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_array_store_unboxed at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_array_store_unboxed at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_alloc_array_1d at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
./ at array.jl:806
create_bsphere at Z:\.julia\v0.4\NearestNeighbour\src\ball_tree.jl:37
build_BallTree at Z:\.julia\v0.4\NearestNeighbour\src\ball_tree.jl:220
build_BallTree at Z:\.julia\v0.4\NearestNeighbour\src\ball_tree.jl:216
build_BallTree at Z:\.julia\v0.4\NearestNeighbour\src\ball_tree.jl:216
build_BallTree at Z:\.julia\v0.4\NearestNeighbour\src\ball_tree.jl:213
build_BallTree at Z:\.julia\v0.4\NearestNeighbour\src\ball_tree.jl:213
build_BallTree at Z:\.julia\v0.4\NearestNeighbour\src\ball_tree.jl:216
build_BallTree at Z:\.julia\v0.4\NearestNeighbour\src\ball_tree.jl:216
build_BallTree at Z:\.julia\v0.4\NearestNeighbour\src\ball_tree.jl:216
build_BallTree at Z:\.julia\v0.4\NearestNeighbour\src\ball_tree.jl:213
build_BallTree at Z:\.julia\v0.4\NearestNeighbour\src\ball_tree.jl:213
build_BallTree at Z:\.julia\v0.4\NearestNeighbour\src\ball_tree.jl:213
build_BallTree at Z:\.julia\v0.4\NearestNeighbour\src\ball_tree.jl:216
build_BallTree at Z:\.julia\v0.4\NearestNeighbour\src\ball_tree.jl:216
build_BallTree at Z:\.julia\v0.4\NearestNeighbour\src\ball_tree.jl:213
build_BallTree at Z:\.julia\v0.4\NearestNeighbour\src\ball_tree.jl:216
build_BallTree at Z:\.julia\v0.4\NearestNeighbour\src\ball_tree.jl:213
build_BallTree at Z:\.julia\v0.4\NearestNeighbour\src\ball_tree.jl:213
build_BallTree at Z:\.julia\v0.4\NearestNeighbour\src\ball_tree.jl:213
build_BallTree at Z:\.julia\v0.4\NearestNeighbour\src\ball_tree.jl:213
call at Z:\.julia\v0.4\NearestNeighbour\src\ball_tree.jl:112
call at Z:\.julia\v0.4\NearestNeighbour\src\ball_tree.jl:80
jl_operator_precedence at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_trampoline at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_init_types at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_apply_generic at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_getFunctionInfo at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_interpret_toplevel_expr_in at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_eval_global_var at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_eval_global_var at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_toplevel_eval_body at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_toplevel_eval_body at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_toplevel_eval_flex at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_toplevel_eval at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_toplevel_eval_in at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_f_top_eval at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
eval_user_input at REPL.jl:54
jlcall_eval_user_input_1307 at  (unknown line)
jl_init_types at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_apply_generic at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
anonymous at task.jl:83
jl_operator_precedence at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_trampoline at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_exit_on_sigint at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_exit_on_sigint at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)

ihnorton · 2015-02-20T14:58:15Z

Try starting julia from the command prompt with an empty PATH variable.
On Feb 20, 2015 9:32 AM, "Kristoffer Carlsson" notifications@github.com
wrote:

My Julia gc seems to be just strange in general. Getting this for some
code now (creating a BallTree that works fine on 0.3).

Since no one can reproduce I am guessing something is up with my
installation or Windows. I will try to reinstall Julia etc and see if I can
get something to work.

Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: EXCEPTION_ACCESS_VIOLATION at 0x6c53956a -- jl_gc_setmark at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.
nown line)
gc_queue_root at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_gc_setmark at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
gc_queue_root at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_gc_setmark at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
gc_queue_root at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_gc_setmark at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_gc_setmark at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
gc_queue_root at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_gc_setmark at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_gc_setmark at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
gc_queue_root at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_gc_setmark at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_gc_collect at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_gc_free_array at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_gc_free_array at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
allocobj at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_array_store_unboxed at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_array_store_unboxed at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_alloc_array_1d at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
./ at array.jl:806
create_bsphere at Z:.julia\v0.4\NearestNeighbour\src\ball_tree.jl:37
build_BallTree at Z:.julia\v0.4\NearestNeighbour\src\ball_tree.jl:220
build_BallTree at Z:.julia\v0.4\NearestNeighbour\src\ball_tree.jl:216
build_BallTree at Z:.julia\v0.4\NearestNeighbour\src\ball_tree.jl:216
build_BallTree at Z:.julia\v0.4\NearestNeighbour\src\ball_tree.jl:213
build_BallTree at Z:.julia\v0.4\NearestNeighbour\src\ball_tree.jl:213
build_BallTree at Z:.julia\v0.4\NearestNeighbour\src\ball_tree.jl:216
build_BallTree at Z:.julia\v0.4\NearestNeighbour\src\ball_tree.jl:216
build_BallTree at Z:.julia\v0.4\NearestNeighbour\src\ball_tree.jl:216
build_BallTree at Z:.julia\v0.4\NearestNeighbour\src\ball_tree.jl:213
build_BallTree at Z:.julia\v0.4\NearestNeighbour\src\ball_tree.jl:213
build_BallTree at Z:.julia\v0.4\NearestNeighbour\src\ball_tree.jl:213
build_BallTree at Z:.julia\v0.4\NearestNeighbour\src\ball_tree.jl:216
build_BallTree at Z:.julia\v0.4\NearestNeighbour\src\ball_tree.jl:216
build_BallTree at Z:.julia\v0.4\NearestNeighbour\src\ball_tree.jl:213
build_BallTree at Z:.julia\v0.4\NearestNeighbour\src\ball_tree.jl:216
build_BallTree at Z:.julia\v0.4\NearestNeighbour\src\ball_tree.jl:213
build_BallTree at Z:.julia\v0.4\NearestNeighbour\src\ball_tree.jl:213
build_BallTree at Z:.julia\v0.4\NearestNeighbour\src\ball_tree.jl:213
build_BallTree at Z:.julia\v0.4\NearestNeighbour\src\ball_tree.jl:213
call at Z:.julia\v0.4\NearestNeighbour\src\ball_tree.jl:112
call at Z:.julia\v0.4\NearestNeighbour\src\ball_tree.jl:80
jl_operator_precedence at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_trampoline at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_init_types at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_apply_generic at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_getFunctionInfo at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_interpret_toplevel_expr_in at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_eval_global_var at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_eval_global_var at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_toplevel_eval_body at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_toplevel_eval_body at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_toplevel_eval_flex at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_toplevel_eval at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_toplevel_eval_in at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_f_top_eval at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
eval_user_input at REPL.jl:54
jlcall_eval_user_input_1307 at (unknown line)
jl_init_types at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_apply_generic at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
anonymous at task.jl:83
jl_operator_precedence at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_trampoline at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_exit_on_sigint at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_exit_on_sigint at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)

—
Reply to this email directly or view it on GitHub
#10249 (comment).

KristofferC · 2015-02-20T15:14:12Z

No luck:

D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin>PATH
PATH=""

D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin>julia
               _
   _       _ _(_)_     |  A fresh approach to technical computing
  (_)     | (_) (_)    |  Documentation: http://docs.julialang.org
   _ _   _| |_  __ _   |  Type "help()" for help.
  | | | | | | |/ _` |  |
  | | |_| | | | (_| |  |  Version 0.4.0-dev+3472 (2015-02-20 05:10 UTC)
 _/ |\__'_|_|_|\__'_|  |  Commit 8c87a32* (0 days old master)
|__/                   |  x86_64-w64-mingw32

julia> rand(3, 10^6)
3x1000000 Array{Float64,2}:
julia> rand(3, 10^6)

Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: EXCEPTION_ACCESS_VIOLATION at 0x7feff885a01 -- strlen at C:\Windows\system32\msvcrt.dll (unknown line)
jl_load_and_lookup at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia.dll (unknown line)
.
.

ihnorton · 2015-02-20T16:06:27Z

Other things to try, possibly would help to narrow this down:

run some varations of gc() -- right at start, immediately after calling the first rand, etc.
run error("foo") before and after the rand call.
use Dependency Walker and send a list of all loaded DLLs. My first suspicion is that you are picking up some incompatible DLL from the environment (although the PATH test reduces the likelihood that this is the case).
In terms of system differences, another usual suspect is on-access virus scanning (should be possible to temporarily disable if you want to try just for kicks).

KristofferC · 2015-02-20T16:27:41Z

More information. Sorry about the long error messages but I don't know what is important and what is not.

Something that might be relevant. Recently Julia decided to move from using my D-drive for its .julia map to the network Z-drive. I don't remember having these problems before that but I am not sure.

Link to Dependecy Walker results: https://dl.dropboxusercontent.com/u/14340581/julia.dwi
Running gc() in julia-debug at any time gives

Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: EXCEPTION_ACCESS_VIOLATION at 0x6c53966a -- jl_gc_setmark at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unk
nown line)
gc_queue_root at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_gc_setmark at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
gc_queue_root at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_gc_setmark at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
gc_queue_root at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_gc_setmark at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_gc_setmark at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
gc_queue_root at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_gc_setmark at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_gc_setmark at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
gc_queue_root at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_gc_setmark at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_gc_collect at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_gc_collect at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
gc at base.jl:165
gc at base.jl:165
jlcall_gc_1489 at  (unknown line)
jl_operator_precedence at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_trampoline at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_init_types at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_apply_generic at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_getFunctionInfo at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_interpret_toplevel_expr_in at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_eval_global_var at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_interpret_toplevel_expr at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_toplevel_eval_flex at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_toplevel_eval at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_toplevel_eval_in at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_f_top_eval at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
eval_user_input at REPL.jl:54
jlcall_eval_user_input_1329 at  (unknown line)
jl_init_types at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_apply_generic at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
anonymous at task.jl:83
jl_operator_precedence at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_trampoline at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_exit_on_sigint at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)
jl_exit_on_sigint at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia-debug.dll (unknown line)

Running gc() in julia at any time:

Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: EXCEPTION_ACCESS_VIOLATION at 0x6bfb2382 -- jl_profile_is_running at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia.dll (u
nknown line)
jl_profile_is_running at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia.dll (unknown line)
jl_profile_is_running at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia.dll (unknown line)
jl_profile_is_running at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia.dll (unknown line)
jl_profile_is_running at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia.dll (unknown line)
jl_profile_is_running at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia.dll (unknown line)
jl_profile_is_running at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia.dll (unknown line)
jl_gc_collect at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia.dll (unknown line)
gc at base.jl:165
gc at base.jl:165
jlcall_gc_1298 at  (unknown line)
jl_apply_generic at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia.dll (unknown line)
jl_interpret_toplevel_expr at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia.dll (unknown line)
jl_interpret_toplevel_thunk_with at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia.dll (unknown line)
jl_eval_with_compiler_p at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia.dll (unknown line)
jl_toplevel_eval_in at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia.dll (unknown line)
eval_user_input at REPL.jl:54
jlcall_eval_user_input_1297 at  (unknown line)
jl_apply_generic at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia.dll (unknown line)
anonymous at task.jl:83
jl_unprotect_stack at D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\libjulia.dll (unknown line)

Starting julia and running rand(3, 10^6) two times gives:

Exception: EXCEPTION_ACCESS_VIOLATION at 0x7feff885a01 -- strlen at C:\Windows\system32\msvcrt.dll (unknown line)`

Starting julia-debug and running rand(3, 10^6) two times gives:

Assertion failed!
Program:D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin\julia-debug.exe
File: ast.c, Line 743
Expression: jl_is_expr(ex)

Starting julia or julia-debug and running rand(3, 10^5) first and then any number of rand(3, 10^6) gives no crash. gc() still crashed julia though.

tkelman · 2015-02-21T05:57:10Z

Something that might be relevant. Recently Julia decided to move from using my D-drive for its .julia map to the network Z-drive. I don't remember having these problems before that but I am not sure.

You might want to try changing some combination of JULIA_PKGDIR, HOME, HOMEDRIVE, and/or HOMEPATH at least temporarily for testing this.

vtjnash · 2015-02-21T21:37:47Z

also try deleting sys.dll after building

KristofferC · 2015-02-22T21:36:25Z

I will try all of these when I get back to my laptop at work where I have the problem.

pao · 2015-03-06T02:25:58Z

I'm reproducing this trace trying to do package installation (and indeed, by calling gc() explicitly) as of 6d0db53 (from the buildbot), also on Windows 7.

pao · 2015-03-06T02:27:39Z

It looks like buildbot builds do not include sys.dll at this time.

julia> versioninfo()
Julia Version 0.4.0-dev+3678
Commit 6d0db53* (2015-03-05 20:20 UTC)
Platform Info:
  System: Windows (x86_64-w64-mingw32)
  CPU: Intel(R) Core(TM) i7-2640M CPU @ 2.80GHz
  WORD_SIZE: 64
  BLAS: libopenblas (USE64BITINT DYNAMIC_ARCH NO_AFFINITY Sandybridge)
  LAPACK: libopenblas
  LIBM: libopenlibm
  LLVM: libLLVM-3.3

pao · 2015-03-06T02:36:31Z

The win32 build below is unaffected:

julia> versioninfo()
Julia Version 0.4.0-dev+3679
Commit 136227b* (2015-03-05 23:06 UTC)
Platform Info:
  System: Windows (i686-w64-mingw32)
  CPU: Intel(R) Core(TM) i7-2640M CPU @ 2.80GHz
  WORD_SIZE: 32
  BLAS: libopenblas (DYNAMIC_ARCH NO_AFFINITY Nehalem)
  LAPACK: libopenblas
  LIBM: libopenlibm
  LLVM: libLLVM-3.3

pao · 2015-03-09T06:17:37Z

Good news everyone: I have a second machine where this does not occur.

julia> versioninfo(true)
Julia Version 0.4.0-dev+3727
Commit 768401c* (2015-03-08 23:04 UTC)
Platform Info:
  System: Windows (x86_64-w64-mingw32)
  CPU: Intel(R) Core(TM) i7-2720QM CPU @ 2.20GHz
  WORD_SIZE: 64
           Microsoft Windows [Version 6.1.7601]
  uname: MINGW32_NT-6.1 1.0.12(0.46/3/2) 2012-07-05 14:56 i686 unknown
Memory: 15.885982513427734 GB (11376.34375 MB free)
Uptime: 230143.5308832 sec
Load Avg:  0.0  0.0  0.0
Intel(R) Core(TM) i7-2720QM CPU @ 2.20GHz:
       speed         user       nice        sys       idle        irq ticks
#1  2192 MHz   19089374          0   11373050  199681482    1038342 ticks
#2  2192 MHz    3184822          0    1654702  225303991       3260 ticks
#3  2192 MHz   23337874          0    7015988  199789529      24273 ticks
#4  2192 MHz    4414765          0     706434  225022066       4789 ticks
#5  2192 MHz   20974911          0    6079452  203088778      22838 ticks
#6  2192 MHz    5186783          0     840034  224116200       4789 ticks
#7  2192 MHz   25409567          0    7608043  197125281      21403 ticks
#8  2192 MHz    4420381          0     922277  224800108       5335 ticks

  BLAS: libopenblas (USE64BITINT DYNAMIC_ARCH NO_AFFINITY Sandybridge)
  LAPACK: libopenblas
  LIBM: libopenlibm
  LLVM: libLLVM-3.3
Environment:
  HOME = C:\Users\patrick
  HOMEDRIVE = C:
  HOMEPATH = \Users\patrick
  JAVA_HOME = C:\Program Files\Java\jdk1.7.0_05
  PATHEXT = .COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH;.MSC;.RB;.RBW
  TSMPATH = C:\Program Files\ThinkPad\UltraNav Utility
  VBOX_MSI_INSTALL_PATH = C:\Program Files\Oracle\VirtualBox\

Will get versioninfo(true) off the machine showing the bug tomorrow.

KristofferC · 2015-03-09T09:08:01Z

Here is my versioninfo(true) for my computer where the bug is happening:

julia> versioninfo(true)
Julia Version 0.4.0-dev+3727
Commit 768401c* (2015-03-08 23:04 UTC)
Platform Info:
  System: Windows (x86_64-w64-mingw32)
  CPU: Intel(R) Core(TM) i7-4600U CPU @ 2.10GHz
  WORD_SIZE: 64
           Microsoft Windows [Version 6.1.7601]
  uname: MINGW32_NT-6.1 1.0.12(0.46/3/2) 2012-07-05 14:56 i686 unknown
Memory: 15.907730102539062 GB (7901.046875 MB free)
Uptime: 71085.7633244 sec
Load Avg:  0.0  0.0  0.0
Intel(R) Core(TM) i7-4600U CPU @ 2.10GHz:
       speed         user       nice        sys       idle        irq ticks
#1  2693 MHz    5156379          0    4975542   60951431     117343 ticks
#2  2693 MHz    2760500          0    3183044   65139512     766994 ticks
#3  2693 MHz    3843427          0    3198722   64040781      25412 ticks
#4  2693 MHz    2185277          0    2187009   66710520      19281 ticks

  BLAS: libopenblas (USE64BITINT DYNAMIC_ARCH NO_AFFINITY Haswell)
  LAPACK: libopenblas
  LIBM: libopenlibm
  LLVM: libLLVM-3.3
Environment:
  HOMEDRIVE = Z:
  HOMEPATH = \
  HOMESHARE = \\file00.chalmers.se\home\kricarl
  MIC_LD_LIBRARY_PATH = C:\Program Files (x86)\Common Files\Intel\Shared Libraries\compiler\lib\mic
  PATHEXT = .COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH;.MSC
  VBOX_MSI_INSTALL_PATH = C:\Program Files\Oracle\VirtualBox\

Package Directory: Z:\.julia\v0.4

pao · 2015-03-09T15:10:20Z

Bad machine:

julia> versioninfo(true)
Julia Version 0.4.0-dev+3678
Commit 6d0db53* (2015-03-05 20:20 UTC)
Platform Info:
  System: Windows (x86_64-w64-mingw32)
  CPU: Intel(R) Core(TM) i7-2640M CPU @ 2.80GHz
  WORD_SIZE: 64
           Microsoft Windows [Version 6.1.7601]
  uname: MINGW32_NT-6.1 1.0.12(0.46/3/2) 2012-07-05 14:56 i686 unknown
Memory: 7.8836822509765625 GB (1613.4921875 MB free)
Uptime: 297563.5444239 sec
Load Avg:  0.0  0.0  0.0
Intel(R) Core(TM) i7-2640M CPU @ 2.80GHz:
       speed         user       nice        sys       idle        irq ticks
#1  2793 MHz   40090884          0   41043098  216453056    1546937 ticks
#2  2793 MHz   14950777          0    6715983  275919935      95644 ticks
#3  2793 MHz   46409486          0   32516177  218660907     794965 ticks
#4  2793 MHz    2629771          0    1601615  293355060      25240 ticks

  BLAS: libopenblas (USE64BITINT DYNAMIC_ARCH NO_AFFINITY Sandybridge)
  LAPACK: libopenblas
  LIBM: libopenlibm
  LLVM: libLLVM-3.3
Environment:
  CUDA_PATH = C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v5.0\
  CUDA_PATH_V5_0 = C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v5.0\
  HOME = C:\Users\olearypa
  HOMEDRIVE = C:
  HOMEPATH = \Users\olearypa
  JAVA_HOME = C:\Program Files\Java\jdk1.7.0_17
  M2_HOME = C:\Users\olearypa\AppData\Local\Apps\apache-maven-3.0.5
  NVTOOLSEXT_PATH = C:\Program Files\NVIDIA GPU Computing Toolkit\nvToolsExt\
  PATHEXT = .COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH;.MSC
  TERM = msys
  VBOX_MSI_INSTALL_PATH = C:\Program Files\Oracle\VirtualBox\
  WORKON_HOME = C:\Users\olearypa\.virtualenvs

I am not seeing anything that differentiates this and @KristofferC's machine from my home machine here. This is a (likely incomplete) corporate annoyanceware list; see anything in common?

Symantec Endpoint Protection
Symantec Management Agent
Symantec Endpoint Encryption
McAfee ??? (it doesn't identify itself)
BeyondTrust PowerBroker

KristofferC · 2015-03-09T17:24:15Z

Yes, I have to use some of that crapware for work.

Symantec Endpoint Protection - check
Symantec Management Agent - check

pao · 2015-03-09T17:30:18Z

I wonder if it's related to https://www.virtualbox.org/ticket/13187 (which also afflicts this machine...)

@tkelman do we have Win64 builds archived from immediately before and after the GGC commit?

KristofferC · 2015-03-09T17:33:02Z

Maybe I am missunderstanding but I am not running Windows through a VM. I have one installed though as can be seen from the versioninfo

pao · 2015-03-09T18:08:25Z

No, what I mean is the DLL injection that Symantec is doing breaks more recent versions of VirtualBox--I'm wondering if the same DLL injection is also breaking something in Julia because of a recent Julia change.

ihnorton · 2015-03-09T18:17:51Z

Do either of you have access to the endpoint risk log? That might give some
indication of what it thinks is the problem:
http://www.symantec.com/connect/forums/windows-server-2008-r2-sp1-symantec-endpoint-protection-sepoct-updates-0xc0000005

Also, to verify this is the problem, can either of you create an endpoint
exclusion for Julia?
http://www.symantec.com/connect/articles/creating-application-control-exclusions-symantec-endpoint-protection-121

On Mon, Mar 9, 2015 at 2:08 PM, pao notifications@github.com wrote:

No, what I mean is the DLL injection that Symantec is doing breaks more
recent versions of VirtualBox--I'm wondering if the same DLL injection is
also breaking something in Julia because of a recent Julia change.

—
Reply to this email directly or view it on GitHub
#10249 (comment).

pao · 2015-03-09T19:09:57Z

I have access to some logs, but none of them seem relevant--they don't have entries corresponding to crash times. Good thought, though.

can either of you create an endpoint exclusion for Julia?

I lack the required authority (which is why I'm stuck on an old version of VirtualBox.)

tkelman · 2015-03-09T23:32:47Z

do we have Win64 builds archived from immediately before and after the GGC commit?

I don't think we keep nightlies around for that long. Browsing http://julianightlies.s3.amazonaws.com/ the furthest back I see for Win64 is February 11th. We could probably build a new one and post it somewhere for you though.

pao · 2015-03-10T00:09:54Z

If it were more than a hunch right now, I might ask, but for now let's hold off. Thanks!

I'll try to play with some stuff.

tkelman · 2015-03-10T00:25:23Z

I suspect it's a pretty good hunch, this might also be related to #10390 in some way.

pao · 2015-03-10T00:43:26Z

Your call.

tkelman · 2015-03-10T01:19:20Z

Luckily the buildbots make it really easy - find commit sha, hit button, wait ~30 minutes, binary: http://julianightlies.s3.amazonaws.com/bin/winnt/x64/0.4/julia-0.4.0-b75638ce2b-win64.exe

KristofferC · 2015-03-10T10:04:16Z

gc() does not crash on my machine for the posted exe.

I do not have access to the symantec risk log.

pao · 2015-03-10T19:35:42Z

Yep, cannot reproduce with b75638c.

ListDLLs gives me the same DLLs in process in both cases (up to the Julia installation directory), so nothing funky is happening where we are looking at linking a different DLL in one case vs. the other.

Back in the crashy version, WinDbg (after a .symfix; .reload) gives me this exception analysis:

0:000> !analyze -v
*******************************************************************************
*                                                                             *
*                        Exception Analysis                                   *
*                                                                             *
*******************************************************************************

*** ERROR: Symbol file could not be found.  Defaulted to export symbols for C:\Users\olearypa\AppData\Local\Julia-0.4.0-dev\bin\julia.exe - 
*** ERROR: Module load completed but symbols could not be loaded for C:\Windows\system32\privman64.dll
*** ERROR: Symbol file could not be found.  Defaulted to export symbols for C:\Users\olearypa\AppData\Local\Julia-0.4.0-dev\bin\libopenblas.DLL - 

FAULTING_IP: 
libjulia!jl_profile_is_running+2d22
00000000`6bfb2122 488b01          mov     rax,qword ptr [rcx]

EXCEPTION_RECORD:  ffffffffffffffff -- (.exr 0xffffffffffffffff)
ExceptionAddress: 000000006bfb2122 (libjulia!jl_profile_is_running+0x0000000000002d22)
   ExceptionCode: c0000005 (Access violation)
  ExceptionFlags: 00000000
NumberParameters: 2
   Parameter[0]: 0000000000000000
   Parameter[1]: 0000000080038000
Attempt to read from address 0000000080038000

FAULTING_THREAD:  0000000000003a80

DEFAULT_BUCKET_ID:  INVALID_POINTER_READ

PROCESS_NAME:  julia.exe

ERROR_CODE: (NTSTATUS) 0xc0000005 - The instruction at 0x%08lx referenced memory at 0x%08lx. The memory could not be %s.

EXCEPTION_CODE: (NTSTATUS) 0xc0000005 - The instruction at 0x%08lx referenced memory at 0x%08lx. The memory could not be %s.

EXCEPTION_PARAMETER1:  0000000000000000

EXCEPTION_PARAMETER2:  0000000080038000

READ_ADDRESS:  0000000080038000 

FOLLOWUP_IP: 
libjulia!jl_profile_is_running+2d22
00000000`6bfb2122 488b01          mov     rax,qword ptr [rcx]

DETOURED_IMAGE: 1

NTGLOBALFLAG:  401

APPLICATION_VERIFIER_FLAGS:  0

APP:  julia.exe

PRIMARY_PROBLEM_CLASS:  INVALID_POINTER_READ

BUGCHECK_STR:  APPLICATION_FAULT_INVALID_POINTER_READ

LAST_CONTROL_TRANSFER:  from 000000006bfb222c to 000000006bfb2122

STACK_TEXT:  
00000000`00d5ee30 00000000`6bfb222c : 00000000`00d5ef40 00000000`00000006 00000000`6cb80d70 00000001`80bd4ab8 : libjulia!jl_profile_is_running+0x2d22
00000000`00d5eeb0 00000000`6bfb222c : 00000000`050237b0 00000000`00000030 00000000`002204a0 00000001`80bd4a80 : libjulia!jl_profile_is_running+0x2e2c
00000000`00d5ef30 00000000`6bfb3d29 : 00000000`00000154 00000000`0000000a 00000001`82daffc0 fff80000`00000001 : libjulia!jl_profile_is_running+0x2e2c
00000000`00d5efb0 00000000`6bfb2f9d : 00000001`82daffc0 00000000`6cca9372 00000001`829fffa8 00000001`82dabfc0 : libjulia!jl_profile_is_running+0x4929
00000000`00d5f020 00000000`6bfb3d29 : 00000001`818f7ed0 00000001`819cff00 00000001`8248fde0 00000001`82ba3e80 : libjulia!jl_profile_is_running+0x3b9d
00000000`00d5f0a0 00000000`6bfb517f : 00000001`82cbb600 00000001`82ab7800 00000000`00d5f1b0 00000000`6bffcd1b : libjulia!jl_profile_is_running+0x4929
00000000`00d5f110 00000000`6bfb6d85 : 00000001`8003c000 00000000`00000000 00000000`069d78d0 00000000`069d7900 : libjulia!jl_profile_is_running+0x5d7f
00000000`00d5f170 00000000`0441ced4 : 00000000`00d5f230 00000000`00000001 00000000`00000005 00000000`00000000 : libjulia!jl_gc_collect+0x475
00000000`00d5f260 00000000`0441ce64 : 00000000`00d5f398 00000000`00000000 00000001`810549c0 00000001`8105d240 : 0x441ced4
00000000`00d5f290 00000000`6bf5414a : 00000000`03700687 00000000`00000003 00000000`040c5e00 00000000`037006b0 : 0x441ce64
00000000`00d5f2c0 00000000`6bf97e12 : 00000000`00d5fa88 00000001`80038720 00000001`80038720 00000000`00000030 : libjulia!jl_apply_generic+0xea
00000000`00d5f360 00000000`6bf974b5 : 00000000`00000000 00000000`6bfd3c11 00000001`81a14940 00000000`00000000 : libjulia!jl_interpret_toplevel_expr+0xe2
00000000`00d5f410 00000000`6bfaa889 : 00000000`00d5f6d0 00000000`6bfa14dd 00000000`0415b798 00000000`069c9470 : libjulia!jl_interpret_toplevel_thunk_with+0xc75
00000000`00d5f670 00000000`6bf5cfde : 00000000`00d5f770 00000000`6bfa14dd 00000000`6ccc0db4 00000000`0419bce0 : libjulia!jl_eval_with_compiler_p+0x349
00000000`00d5f710 00000000`0441cc2a : 00000000`06928778 00000000`00000000 00000000`0419b9c0 00000000`00000001 : libjulia!jl_toplevel_eval_in+0xfe
00000000`00d5f880 00000000`0441c6cb : 00000000`00d5fcc0 00000000`00000002 00000001`8034b540 00000001`803510e0 : 0x441cc2a
00000000`00d5fb70 00000000`6bf5414a : 00000001`80030000 00000001`8003c000 00000000`069c6260 00000001`8004c000 : 0x441c6cb
00000000`00d5fba0 00000000`0440b644 : 00000001`82ba2080 00000001`8037a9a0 00000001`820bed40 00000001`8037a9a0 : libjulia!jl_apply_generic+0xea
00000000`00d5fc40 00000000`6bf9f704 : 00000000`00000001 00000000`77aa1fc0 00000000`00d5fdd0 00000000`00000000 : 0x440b644
00000000`00d5fd20 00000000`00000000 : 00000000`77aa1fc0 00000000`00d5fdd0 00000000`00000000 00000000`00000000 : libjulia!jl_unprotect_stack+0x144


SYMBOL_STACK_INDEX:  0

SYMBOL_NAME:  libjulia!jl_profile_is_running+2d22

FOLLOWUP_NAME:  MachineOwner

MODULE_NAME: libjulia

IMAGE_NAME:  libjulia.dll

DEBUG_FLR_IMAGE_TIMESTAMP:  0

STACK_COMMAND:  dt ntdll!LdrpLastDllInitializer BaseDllName ; dt ntdll!LdrpFailureData ; ~0s ; kb

FAILURE_BUCKET_ID:  INVALID_POINTER_READ_c0000005_libjulia.dll!jl_profile_is_running

BUCKET_ID:  X64_APPLICATION_FAULT_INVALID_POINTER_READ_DETOURED_libjulia!jl_profile_is_running+2d22

Followup: MachineOwner
---------

For the heck of it, I turned on full page heap verification with gflags for the process, but the crash occurs at the same place with no obvious signs of invalid memory access.

pao · 2015-04-02T18:34:48Z

Been meaning to check a newer version for a while in light of various GC related fixes. The following is from the previously-failing machine:

               _
   _       _ _(_)_     |  A fresh approach to technical computing
  (_)     | (_) (_)    |  Documentation: http://docs.julialang.org
   _ _   _| |_  __ _   |  Type "help()" for help.
  | | | | | | |/ _` |  |
  | | |_| | | | (_| |  |  Version 0.4.0-dev+4137 (2015-04-02 13:30 UTC)
 _/ |\__'_|_|_|\__'_|  |  Commit d61c7e4* (0 days old master)
|__/                   |  x86_64-w64-mingw32

julia> gc()

julia> gc()

julia> gc()

julia> gc()

julia> gc()

julia> rand(6000,6000);

julia> gc()

julia> versioninfo()
Julia Version 0.4.0-dev+4137
Commit d61c7e4* (2015-04-02 13:30 UTC)
Platform Info:
  System: Windows (x86_64-w64-mingw32)
  CPU: Intel(R) Core(TM) i7-2640M CPU @ 2.80GHz
  WORD_SIZE: 64
  BLAS: libopenblas (USE64BITINT DYNAMIC_ARCH NO_AFFINITY Sandybridge)
  LAPACK: libopenblas
  LIBM: libopenlibm
  LLVM: libLLVM-3.3

@KristofferC, able to confirm?

KristofferC · 2015-04-03T10:24:53Z

I will check in a few days when I am back at work.

KristofferC · 2015-04-05T17:58:13Z

Just downloaded new nightly. Unfortunately, my situation is not as good as yours, I can't even get to REPL right now:

D:\Users\kricarl.NET\AppData\Local\Julia-0.4.0-dev\bin>julia
ERROR: stat: unknown error (UNKNOWN)
 in stat at stat.jl:40
 in try_include at client.jl:184
 in load_juliarc at client.jl:340
 in process_options at client.jl:262
 in _start at client.jl:389

tkelman · 2015-04-05T21:27:55Z

That's odd. Do you have something in your juliarc that's trying to access a network drive or something? Or is your home folder on an inaccessible network share?

KristofferC · 2015-04-05T21:48:33Z

Oh sh*t. I realize my .julia folder got set to a network drive on my work network and I currently have my laptop on my home network. That's embarrasing. I will change the path and try again.

KristofferC · 2015-04-05T21:49:09Z

However, the error message could be improved.

tkelman · 2015-04-05T22:05:48Z

Indeed it could. I'm guessing isfile(abspath(homedir(),".juliarc.jl")) was throwing that error when you had the paths set for the network drive? I think I've said before that maybe try_include should actually be doing a try-catch, if stat throws an error on Windows then even more reason. I think we do stat by way of libuv, there's always a chance upstream libuv has possibly made improvements since the last time we rebased our fork (almost a year ago now).

KristofferC · 2015-04-06T09:21:11Z

Evertyhing working good here now! Since neither me nor @pao has any problems, whatever the problem was, it seemed to be fixed. Closing this.

tkelman · 2015-04-06T19:26:40Z

May want to open a separate issue (or better, PR) for suggestions on that network-drive juliarc error message

tkelman · 2015-04-06T19:31:24Z

Oh, you already did. #10757

deva567 · 2020-05-22T14:10:55Z

How to solve the below error , kindly help us to solve.

_ _ ()_ | Documentation: https://docs.julialang.org
() | () () |
_ _ | | __ _ | Type "?" for help, "]?" for Pkg help.
| | | | | | |/ ` | |
| | || | | | (| | | Version 1.4.1 (2020-04-14)
/ |_'|||_'_| | Official https://julialang.org/ release
|__/ |

julia> using Pkg

julia> Pkg.add("Pycall")
Cloning default registries into C:\Users\venna\.julia
Cloning registry from "https://github.com/JuliaRegistries/General.git"

Please submit a bug report with steps to reproduce this fault, and any error messages that follow (in their entirety). Thanks.
Exception: EXCEPTION_ACCESS_VIOLATION at 0x7ffd4642d501 -- strlen at C:\Windows\System32\msvcrt.dll (unknown line)
in expression starting at REPL[2]:1
strlen at C:\Windows\System32\msvcrt.dll (unknown line)
git_buf_puts at C:\Users\venna\AppData\Local\Programs\Julia\Julia-1.4.1\bin\libgit2.DLL (unknown line)
gitno_extract_url_parts at C:\Users\venna\AppData\Local\Programs\Julia\Julia-1.4.1\bin\libgit2.DLL (unknown line)
winhttp_stream_connect at C:\Users\venna\AppData\Local\Programs\Julia\Julia-1.4.1\bin\libgit2.DLL (unknown line)
winhttp_stream_read at C:\Users\venna\AppData\Local\Programs\Julia\Julia-1.4.1\bin\libgit2.DLL (unknown line)
git_smart__recv_cb at C:\Users\venna\AppData\Local\Programs\Julia\Julia-1.4.1\bin\libgit2.DLL (unknown line)
git_smart__store_refs at C:\Users\venna\AppData\Local\Programs\Julia\Julia-1.4.1\bin\libgit2.DLL (unknown line)
git_smart__connect at C:\Users\venna\AppData\Local\Programs\Julia\Julia-1.4.1\bin\libgit2.DLL (unknown line)
git_remote_fetch at C:\Users\venna\AppData\Local\Programs\Julia\Julia-1.4.1\bin\libgit2.DLL (unknown line)
git_clone at C:\Users\venna\AppData\Local\Programs\Julia\Julia-1.4.1\bin\libgit2.DLL (unknown line)
macro expansion at D:\buildbot\worker\package_win64\build\usr\share\julia\stdlib\v1.4\LibGit2\src\error.jl:99 [inlined]
clone at D:\buildbot\worker\package_win64\build\usr\share\julia\stdlib\v1.4\LibGit2\src\repository.jl:459
#clone#131 at D:\buildbot\worker\package_win64\build\usr\share\julia\stdlib\v1.4\LibGit2\src\LibGit2.jl:580
clone##kw at D:\buildbot\worker\package_win64\build\usr\share\julia\stdlib\v1.4\LibGit2\src\LibGit2.jl:559 [inlined]
#clone#4 at D:\buildbot\worker\package_win64\build\usr\share\julia\stdlib\v1.4\Pkg\src\GitTools.jl:141
clone##kw at D:\buildbot\worker\package_win64\build\usr\share\julia\stdlib\v1.4\Pkg\src\GitTools.jl:125 [inlined]
#92 at D:\buildbot\worker\package_win64\build\usr\share\julia\stdlib\v1.4\Pkg\src\Types.jl:930
#mktempdir#20 at .\file.jl:682
mktempdir at .\file.jl:680 [inlined]
mktempdir at .\file.jl:680 [inlined]
clone_or_cp_registries at D:\buildbot\worker\package_win64\build\usr\share\julia\stdlib\v1.4\Pkg\src\Types.jl:911
clone_or_cp_registries at D:\buildbot\worker\package_win64\build\usr\share\julia\stdlib\v1.4\Pkg\src\Types.jl:902 [inlined]
clone_or_cp_registries at D:\buildbot\worker\package_win64\build\usr\share\julia\stdlib\v1.4\Pkg\src\Types.jl:902 [inlined]
clone_default_registries at D:\buildbot\worker\package_win64\build\usr\share\julia\stdlib\v1.4\Pkg\src\Types.jl:821
find_registered! at D:\buildbot\worker\package_win64\build\usr\share\julia\stdlib\v1.4\Pkg\src\Types.jl:1167
registry_resolve! at D:\buildbot\worker\package_win64\build\usr\share\julia\stdlib\v1.4\Pkg\src\Types.jl:727
#add#28 at D:\buildbot\worker\package_win64\build\usr\share\julia\stdlib\v1.4\Pkg\src\API.jl:146
jfptr_#add#28_11409 at C:\Users\venna\AppData\Local\Programs\Julia\Julia-1.4.1\lib\julia\sys.dll (unknown line)
add at D:\buildbot\worker\package_win64\build\usr\share\julia\stdlib\v1.4\Pkg\src\API.jl:112
#add#27 at D:\buildbot\worker\package_win64\build\usr\share\julia\stdlib\v1.4\Pkg\src\API.jl:109 [inlined]
add at D:\buildbot\worker\package_win64\build\usr\share\julia\stdlib\v1.4\Pkg\src\API.jl:109 [inlined]
#add#24 at D:\buildbot\worker\package_win64\build\usr\share\julia\stdlib\v1.4\Pkg\src\API.jl:107 [inlined]
add at D:\buildbot\worker\package_win64\build\usr\share\julia\stdlib\v1.4\Pkg\src\API.jl:107 [inlined]
#add#23 at D:\buildbot\worker\package_win64\build\usr\share\julia\stdlib\v1.4\Pkg\src\API.jl:106
add at D:\buildbot\worker\package_win64\build\usr\share\julia\stdlib\v1.4\Pkg\src\API.jl:106
jl_apply at /cygdrive/d/buildbot/worker/package_win64/build/src\julia.h:1700 [inlined]
do_call at /cygdrive/d/buildbot/worker/package_win64/build/src\interpreter.c:369
eval_value at /cygdrive/d/buildbot/worker/package_win64/build/src\interpreter.c:458
eval_stmt_value at /cygdrive/d/buildbot/worker/package_win64/build/src\interpreter.c:409 [inlined]
eval_body at /cygdrive/d/buildbot/worker/package_win64/build/src\interpreter.c:799
jl_interpret_toplevel_thunk at /cygdrive/d/buildbot/worker/package_win64/build/src\interpreter.c:911
jl_toplevel_eval_flex at /cygdrive/d/buildbot/worker/package_win64/build/src\toplevel.c:814
jl_toplevel_eval_flex at /cygdrive/d/buildbot/worker/package_win64/build/src\toplevel.c:764
jl_toplevel_eval at /cygdrive/d/buildbot/worker/package_win64/build/src\toplevel.c:823 [inlined]
jl_toplevel_eval_in at /cygdrive/d/buildbot/worker/package_win64/build/src\toplevel.c:843
eval at .\boot.jl:331
eval_user_input at D:\buildbot\worker\package_win64\build\usr\share\julia\stdlib\v1.4\REPL\src\REPL.jl:86
macro expansion at D:\buildbot\worker\package_win64\build\usr\share\julia\stdlib\v1.4\REPL\src\REPL.jl:118 [inlined]
#26 at .\task.jl:358
jl_apply at /cygdrive/d/buildbot/worker/package_win64/build/src\julia.h:1700 [inlined]
start_task at /cygdrive/d/buildbot/worker/package_win64/build/src\task.c:687
Allocations: 2504 (Pool: 2494; Big: 10); GC: 0

StefanKarpinski · 2020-05-22T19:16:49Z

Necro-posting on an issue from 2015 is not a good way to seek help.
Please post questions to the Julia discourse discussion forum.

ihnorton added the system:windows label Feb 19, 2015

vtjnash added the bug label Mar 6, 2015

pao mentioned this issue Mar 6, 2015

poor performance of exp() on 32 bit #10425

Closed

pao mentioned this issue Mar 12, 2015

Pkg.update() makes julia 0.4 crash on Windows #10490

Closed

pao mentioned this issue Mar 20, 2015

IUP gc segfault #10570

Closed

KristofferC closed this as completed Apr 6, 2015

EXCEPTION_ACCESS_VIOLATION in strlen when gc is run. #10249

EXCEPTION_ACCESS_VIOLATION in strlen when gc is run. #10249

Comments

KristofferC commented Feb 19, 2015

ihnorton commented Feb 19, 2015

quinnj commented Feb 19, 2015

KristofferC commented Feb 19, 2015

KristofferC commented Feb 19, 2015

tkelman commented Feb 19, 2015

ihnorton commented Feb 19, 2015

tkelman commented Feb 20, 2015

KristofferC commented Feb 20, 2015

ihnorton commented Feb 20, 2015

tkelman commented Feb 20, 2015

KristofferC commented Feb 20, 2015

KristofferC commented Feb 20, 2015

ihnorton commented Feb 20, 2015

KristofferC commented Feb 20, 2015

ihnorton commented Feb 20, 2015

KristofferC commented Feb 20, 2015

tkelman commented Feb 21, 2015

vtjnash commented Feb 21, 2015

KristofferC commented Feb 22, 2015

pao commented Mar 6, 2015

pao commented Mar 6, 2015

pao commented Mar 6, 2015

pao commented Mar 9, 2015

KristofferC commented Mar 9, 2015

pao commented Mar 9, 2015

KristofferC commented Mar 9, 2015

pao commented Mar 9, 2015

KristofferC commented Mar 9, 2015

pao commented Mar 9, 2015

ihnorton commented Mar 9, 2015

pao commented Mar 9, 2015

tkelman commented Mar 9, 2015

pao commented Mar 10, 2015

tkelman commented Mar 10, 2015

pao commented Mar 10, 2015

tkelman commented Mar 10, 2015

KristofferC commented Mar 10, 2015

pao commented Mar 10, 2015

pao commented Apr 2, 2015

KristofferC commented Apr 3, 2015

KristofferC commented Apr 5, 2015

tkelman commented Apr 5, 2015

KristofferC commented Apr 5, 2015

KristofferC commented Apr 5, 2015

tkelman commented Apr 5, 2015

KristofferC commented Apr 6, 2015

tkelman commented Apr 6, 2015

tkelman commented Apr 6, 2015

deva567 commented May 22, 2020

StefanKarpinski commented May 22, 2020