Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test failure on OSX #9071

Closed
kartikkumar opened this issue Nov 19, 2014 · 18 comments
Closed

Test failure on OSX #9071

kartikkumar opened this issue Nov 19, 2014 · 18 comments

Comments

@kartikkumar
Copy link

Hi all,

I'm not sure when this problem started but I was facing some issues with OpenBLAS being loaded correctly, so I removed and reinstalled Julia and all dependencies using Homebrew and ran the test suite, resulting in the following error:

/usr/local/Cellar/julia/0.3.2/bin/julia -e "Base.runtests()"
    From worker 3:       * linalg2
    From worker 2:       * linalg1
    From worker 2:       * linalg3
    From worker 2:       * linalg4
    From worker 2:       * core
    From worker 2:       * keywordargs
    From worker 2:       * numbers
    From worker 3:       * strings
    From worker 3:       * collections
    From worker 2:       * hashing
    From worker 3:       * remote
    From worker 3:       * iobuffer
    From worker 3:       * arrayops
    From worker 2:       * reduce
    From worker 2:       * reducedim
    From worker 2:       * simdloop
    From worker 2:       * blas
    From worker 2:       * fft
    From worker 2:       * dsp
    From worker 3:       * sparse
    From worker 2:       * bitarray
    From worker 3:       * random
    From worker 3:       * math
    From worker 3:       * functional
    From worker 3:       * bigint
    From worker 3:       * sorting
    From worker 3:       * statistics
    From worker 2:       * spawn
    From worker 2:         [stdio passthrough ok]
    From worker 3:       * backtrace
    From worker 3:       * priorityqueue
    From worker 2:       * arpack
    From worker 3:       * file
    From worker 2:       * suitesparse
    From worker 2:       * version
    From worker 3:       * resolve
    From worker 2:       * pollfd
    From worker 2:       * mpfr
    From worker 3:       * broadcast
    From worker 2:       * complex
    From worker 2:       * socket
    From worker 2:       * floatapprox
    From worker 2:       * readdlm
    From worker 3:       * regex
    From worker 3:       * float16
    From worker 3:       * combinatorics
    From worker 3:       * sysinfo
    From worker 2:       * rounding
    From worker 2:       * ranges
    From worker 3:       * mod2pi
    From worker 3:       * euler
    From worker 3:       * show
    From worker 3:       * lineedit
exception on 3: ERROR: test failed: position(buf) == 0
 in error at error.jl:21
 in default_handler at test.jl:19
 in do_test at test.jl:39
 in anonymous at no file:145
 in runtests at /usr/local/Cellar/julia/0.3.2/share/julia/test/testdefs.jl:5
 in anonymous at multi.jl:855
 in run_work_thunk at multi.jl:621
 in anonymous at task.jl:855
while loading lineedit.jl, in expression starting on line 142
ERROR: test failed: position(buf) == 0
 in anonymous at task.jl:1367
while loading lineedit.jl, in expression starting on line 142
while loading /usr/local/Cellar/julia/0.3.2/share/julia/test/runtests.jl, in expression starting on line 39

ERROR: A test has failed. Please submit a bug report including error messages
above and the output of versioninfo():
Julia Version 0.3.2
Commit 8227746* (2014-10-21 22:05 UTC)
Platform Info:
  System: Darwin (x86_64-apple-darwin12.5.0)
  CPU: Intel(R) Core(TM) i7-4650U CPU @ 1.70GHz
  WORD_SIZE: 64
  BLAS: libopenblas (NO_AFFINITY NEHALEM)
  LAPACK: libopenblas
  LIBM: libopenlibm
  LLVM: libLLVM-3.3

 in error at error.jl:21
 in runtests at interactiveutil.jl:367
 in runtests at interactiveutil.jl:356
 in process_options at /usr/local/Cellar/julia/0.3.2/lib/julia/sys.dylib
 in _start at /usr/local/Cellar/julia/0.3.2/lib/julia/sys.dylib (repeats 2 times)

Can't really figure out what's wrong. Anybody suggestions on how to fix this?

Regards,

Kartik

@ViralBShah
Copy link
Member

Which version of Julia is this?

@kartikkumar
Copy link
Author

0.3.2 it seems. That's what my Homebrew has updated to.

@tkelman
Copy link
Contributor

tkelman commented Nov 21, 2014

That's a really odd one. Hooray for Base.runtests(), but dunno what exactly is happening. Would you be willing to try a source build of the release-0.3 branch to see whether this is reproducible with a non-homebrew build? That might help narrow things down.

@kartikkumar
Copy link
Author

I built 0.3.2 from the release page and ran all the tests again and the error still persists. Does that mean that there's a config problem on my end? I'm running 10.8.5; dunno if something got changed recently in the lineedit test that means it's not compatible with older OS X versions:

exception on 2: ERROR: test failed: position(buf) == 0
 in error at error.jl:21
 in default_handler at test.jl:19
 in do_test at test.jl:39
 in anonymous at no file:145
 in runtests at /usr/local/Cellar/julia/0.3.2/share/julia/test/testdefs.jl:5
 in anonymous at multi.jl:855
 in run_work_thunk at multi.jl:621
 in anonymous at task.jl:855
while loading lineedit.jl, in expression starting on line 142
ERROR: test failed: position(buf) == 0
 in anonymous at task.jl:1367
while loading lineedit.jl, in expression starting on line 142
while loading /usr/local/Cellar/julia/0.3.2/share/julia/test/runtests.jl, in expression starting on line 39

ERROR: A test has failed. Please submit a bug report including error messages
above and the output of versioninfo():
Julia Version 0.3.2
Commit 8227746* (2014-10-21 22:05 UTC)
Platform Info:
  System: Darwin (x86_64-apple-darwin12.5.0)
  CPU: Intel(R) Core(TM) i7-4650U CPU @ 1.70GHz
  WORD_SIZE: 64
  BLAS: libopenblas (NO_AFFINITY NEHALEM)
  LAPACK: libopenblas
  LIBM: libopenlibm
  LLVM: libLLVM-3.3

 in error at error.jl:21
 in runtests at interactiveutil.jl:367
 in runtests at interactiveutil.jl:356
 in process_options at /usr/local/Cellar/julia/0.3.2/lib/julia/sys.dylib
 in _start at /usr/local/Cellar/julia/0.3.2/lib/julia/sys.dylib (repeats 2 times)

@tkelman
Copy link
Contributor

tkelman commented Nov 21, 2014

@kartikkumar thanks that's useful. Did you do it from a git checkout or the tarball? If you did it from git, it would be useful (and much faster than the first time around, since the dependencies can all be reused) to try with the latest commit in the release-0.3 branch, since we're considering tagging 0.3.3 within the next few days. The REPL code has seen some recent patches, but I feel like we would've seen this earlier if it happened on a larger portion of macs.

@tkelman tkelman added this to the 0.3.3 milestone Nov 21, 2014
@kartikkumar
Copy link
Author

My bad, looks like the symlink in /usr/local/bin was still to the Homebrew version. I ran it with the build generated from source and the problem still persists:

    From worker 2:       * lineedit
exception on 2: ERROR: test failed: position(buf) == 0
 in error at error.jl:21
 in default_handler at test.jl:19
 in do_test at test.jl:39
 in anonymous at no file:145
 in runtests at /Users/kartikkumar/Downloads/julia/test/testdefs.jl:5
 in anonymous at multi.jl:855
 in run_work_thunk at multi.jl:621
 in anonymous at task.jl:855
while loading lineedit.jl, in expression starting on line 142
ERROR: test failed: position(buf) == 0
 in anonymous at task.jl:1367
while loading lineedit.jl, in expression starting on line 142
while loading /Users/kartikkumar/Downloads/julia/usr/share/julia/test/runtests.jl, in expression starting on line 39

ERROR: A test has failed. Please submit a bug report including error messages
above and the output of versioninfo():
Julia Version 0.3.2
Commit 8227746* (2014-10-21 22:05 UTC)
Platform Info:
  System: Darwin (x86_64-apple-darwin12.5.0)
  CPU: Intel(R) Core(TM) i7-4650U CPU @ 1.70GHz
  WORD_SIZE: 64
  BLAS: libopenblas (USE64BITINT DYNAMIC_ARCH NO_AFFINITY Haswell)
  LAPACK: libopenblas
  LIBM: libopenlibm
  LLVM: libLLVM-3.3

 in error at error.jl:21
 in runtests at interactiveutil.jl:367
 in runtests at interactiveutil.jl:356
 in process_options at ./client.jl:213
 in _start at ./client.jl:354
 in _start at /Users/kartikkumar/Downloads/julia/usr/lib/julia/sys.dylib

@kartikkumar
Copy link
Author

@tkelman I used the tarball, but I can run it again with a git clone of the latest version of release-0.3. I'll get the build up and running and report back if the problem persists.

@tkelman
Copy link
Contributor

tkelman commented Nov 21, 2014

Sounds good. Looks like line 142 has something to do with unicode combining characters

let buf = IOBuffer()
so this could also be related to utf8proc, or maybe something with your OS locale settings or libraries? Not positive. Are you running Julia under any unusual terminal setup? It could also help to run through that section of test/lineedit.jl manually in the REPL to see what position(buf) is ending up as. You'll probably need to manually do using Base.Test first.

edit: relevant section might just be

buf = IOBuffer()
Base.LineEdit.edit_insert(buf, "â")
Base.LineEdit.edit_move_left(buf)
position(buf)

@kartikkumar
Copy link
Author

No I don't have anything unusual under my terminal setup afaik. I pretty much install everything these days with Homebrew, so I don't tinker around in general with too many other settings.

I think it's maybe worth looking at the commit history for test/lineedit.jl, since this is a problem that I think is fairly recent. There might be some hints in the commit history as to what introduced the problem. I'll take a look and see if I can spot anything by running it through the REPL, though I'm travelling at the moment, so don't have a lot of time on my hands. Hopefully someone can spot the issue.

@tkelman
Copy link
Contributor

tkelman commented Nov 21, 2014

On the release-0.3 branch, test/lineedit.jl and base/LineEdit.jl have changed very little since August, so I feel like we would've seen this by now on someone else's Mac if it weren't specific to your computer in some way. I could easily be wrong though, if anyone can reproduce on a different computer.

@kartikkumar
Copy link
Author

Yea so rebuilding with the latest commit on release-0.3 results in the same error. So I'm guessing it's something specific to my machine. I'm way in over my head though to be able to debug this. I don't really even know what the specific test pertains to in terms of functionality. Is it something that I have to be worried about, or is it something I can comfortably ignore whilst writing Julia code?

@tkelman
Copy link
Contributor

tkelman commented Nov 21, 2014

Hm, thanks for trying that. Your REPL might do strange things with respect to unicode combining characters, I'm not sure. Is this a really old Mac that's gone through several OSX version upgrades by any chance? Have you reinstalled the latest xcode command line tools? Sometimes those will update system libraries that may have something to do with unicode support, but I'm not really a Mac guy so I'm not positive.

I made a post edit above which doesn't trigger an email notification so you maybe didn't notice. Can you try running

buf = IOBuffer()
Base.LineEdit.edit_insert(buf, "â")
Base.LineEdit.edit_move_left(buf)
position(buf)

and tell me what the output is for position(buf)?

@kartikkumar
Copy link
Author

It's not that old. It's a mid-2013 Macbook Air. I have the latest XCode command line tools installed.

Here's the REPL output:

julia> buf = IOBuffer()
IOBuffer(data=Uint8[...], readable=true, writable=true, seekable=true, append=false, size=0, maxsize=Inf, ptr=1, mark=-1)

julia> Base.LineEdit.edit_insert(buf, "â")
3

julia> Base.LineEdit.edit_move_left(buf)
true

julia> position(buf)
1

@tkelman
Copy link
Contributor

tkelman commented Nov 21, 2014

Paging our resident unicode experts @jiahao or @stevengj, any ideas what could cause this?

@stevengj
Copy link
Member

Looks like #6939.

@kartikkumar
Copy link
Author

@stevengj ah yes, guess it's the same issue. Should have scanned the issue list better before posting this.

@tkelman
Copy link
Contributor

tkelman commented Nov 21, 2014

@kartikkumar github issue searching is notoriously difficult to use effectively, duplicates aren't the end of the world. I'm going to close this though since it is covered by other open issues.

@tkelman tkelman closed this as completed Nov 21, 2014
@tkelman tkelman removed this from the 0.3.3 milestone Nov 21, 2014
@jiahao
Copy link
Member

jiahao commented Nov 21, 2014

So we actually need this, huh. I guess I'll make time to review the status of JuliaStrings/utf8proc#2 next week.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants