Code Monkey home page Code Monkey logo

Comments (16)

jwijffels avatar jwijffels commented on May 9, 2024

Thanks for the crash report. Issue #7 and #19 are unrelated but indeed I can confirm the core dump.

from image.

jwijffels avatar jwijffels commented on May 9, 2024

I can only reproduce this crash on Windows, not on an Ubuntu Linux machine which I have access to.

from image.

matthew-law avatar matthew-law commented on May 9, 2024

If it helps, I came across it running macOS (full details in the sessionInfo)

from image.

jwijffels avatar jwijffels commented on May 9, 2024

what do you get when you run the code using R -d valgrind?

from image.

matthew-law avatar matthew-law commented on May 9, 2024

Maybe a basic question, but how do I actually run the code using R -d valgrind? Is valgrind something I need to download, and do I run it from the terminal?

from image.

jwijffels avatar jwijffels commented on May 9, 2024

I thought on Mac this was brew install valgrind
And next start up R with R -d valgrind and pass on the code with gives the 💣

from image.

matthew-law avatar matthew-law commented on May 9, 2024

Hmm, I get

valgrind: Linux is required for this software.
Error: valgrind: An unsatisfied requirement failed this build.

when I run brew install valgrind

from image.

jwijffels avatar jwijffels commented on May 9, 2024

Ok, I'll find another way to debug this using GDB.

from image.

jwijffels avatar jwijffels commented on May 9, 2024

Debug trace using the address sanitizer RDsan using wch1/r-debug

> library(image.LineSegmentDetector)
> library(pixmap)
> 
> image <- read.pnm(file = system.file("extdata", "le-piree.pgm", package="image.LineSegmentDetector"), cellres = 1)
> 
> linesegments <- image_line_segment_detector(image@grey * 255, union = T)
=================================================================
==14==ERROR: AddressSanitizer: heap-use-after-free on address 0x602000575fb0 at pc 0x7fd75cf9fa10 bp 0x7ffc26c03a70 sp 0x7ffc26c03a60
READ of size 8 at 0x602000575fb0 thread T0
    #0 0x7fd75cf9fa0f in LineSegmentDetection /tmp/RtmpSYxsFy/R.INSTALLf35be2df52/image.LineSegmentDetector/src/lsd.c:2599
    #1 0x7fd75cf89fd2 in detect_line_segments(Rcpp::Vector<14, Rcpp::PreserveStorage>, int, int, double, double, double, double, double, double, int, int, double, int, double, double, double) /tmp/RtmpSYxsFy/R.INSTALLf35be2df52/image.LineSegmentDetector/src/line_segment_detector.cpp:31
    #2 0x7fd75cf5472f in _image_LineSegmentDetector_detect_line_segments /tmp/RtmpSYxsFy/R.INSTALLf35be2df52/image.LineSegmentDetector/src/RcppExports.cpp:30
    #3 0x7fd767109454 in R_doDotCall /tmp/r-source/src/main/dotcode.c:672
    #4 0x7fd767124014 in do_dotcall /tmp/r-source/src/main/dotcode.c:1284
    #5 0x7fd7671d7640 in bcEval /tmp/r-source/src/main/eval.c:7139
    #6 0x7fd7671a95e6 in Rf_eval /tmp/r-source/src/main/eval.c:748
    #7 0x7fd7671afca5 in R_execClosure /tmp/r-source/src/main/eval.c:1918
    #8 0x7fd7671af396 in Rf_applyClosure /tmp/r-source/src/main/eval.c:1844
    #9 0x7fd7671d6d6a in bcEval /tmp/r-source/src/main/eval.c:7107
    #10 0x7fd7671a95e6 in Rf_eval /tmp/r-source/src/main/eval.c:748
    #11 0x7fd7671afca5 in R_execClosure /tmp/r-source/src/main/eval.c:1918
    #12 0x7fd7671af396 in Rf_applyClosure /tmp/r-source/src/main/eval.c:1844
    #13 0x7fd7671aa7bf in Rf_eval /tmp/r-source/src/main/eval.c:871
    #14 0x7fd7671b7daa in do_set /tmp/r-source/src/main/eval.c:2990
    #15 0x7fd7671a9f71 in Rf_eval /tmp/r-source/src/main/eval.c:823
    #16 0x7fd7672588eb in Rf_ReplIteration /tmp/r-source/src/main/main.c:264
    #17 0x7fd767258dca in R_ReplConsole /tmp/r-source/src/main/main.c:316
    #18 0x7fd76725b43d in run_Rmainloop /tmp/r-source/src/main/main.c:1130
    #19 0x7fd76725b457 in Rf_mainloop /tmp/r-source/src/main/main.c:1137
    #20 0x55996bb02238 in main /tmp/r-source/src/main/Rmain.c:29
    #21 0x7fd7663140b2 in __libc_start_main (/usr/lib/x86_64-linux-gnu/libc.so.6+0x270b2)
    #22 0x55996bb0210d in _start (/usr/local/RDsan/lib/R/bin/exec/R+0x110d)

0x602000575fb0 is located 0 bytes inside of 16-byte region [0x602000575fb0,0x602000575fc0)
freed by thread T0 here:
    #0 0x7fd7678f11c7 in __interceptor_free ../../../../src/libsanitizer/asan/asan_malloc_linux.cpp:123
    #1 0x7fd75cf92950 in free_image_int /tmp/RtmpSYxsFy/R.INSTALLf35be2df52/image.LineSegmentDetector/src/lsd.c:408
    #2 0x7fd75cf9dd4e in line_segment_grower /tmp/RtmpSYxsFy/R.INSTALLf35be2df52/image.LineSegmentDetector/src/lsd.c:2344
    #3 0x7fd75cf9f8f6 in LineSegmentDetection /tmp/RtmpSYxsFy/R.INSTALLf35be2df52/image.LineSegmentDetector/src/lsd.c:2575
    #4 0x7fd75cf89fd2 in detect_line_segments(Rcpp::Vector<14, Rcpp::PreserveStorage>, int, int, double, double, double, double, double, double, int, int, double, int, double, double, double) /tmp/RtmpSYxsFy/R.INSTALLf35be2df52/image.LineSegmentDetector/src/line_segment_detector.cpp:31
    #5 0x7fd75cf5472f in _image_LineSegmentDetector_detect_line_segments /tmp/RtmpSYxsFy/R.INSTALLf35be2df52/image.LineSegmentDetector/src/RcppExports.cpp:30
    #6 0x7fd767109454 in R_doDotCall /tmp/r-source/src/main/dotcode.c:672
    #7 0x7fd767124014 in do_dotcall /tmp/r-source/src/main/dotcode.c:1284
    #8 0x7fd7671d7640 in bcEval /tmp/r-source/src/main/eval.c:7139
    #9 0x7fd7671a95e6 in Rf_eval /tmp/r-source/src/main/eval.c:748
    #10 0x7fd7671afca5 in R_execClosure /tmp/r-source/src/main/eval.c:1918
    #11 0x7fd7671af396 in Rf_applyClosure /tmp/r-source/src/main/eval.c:1844
    #12 0x7fd7671d6d6a in bcEval /tmp/r-source/src/main/eval.c:7107
    #13 0x7fd7671a95e6 in Rf_eval /tmp/r-source/src/main/eval.c:748
    #14 0x7fd7671afca5 in R_execClosure /tmp/r-source/src/main/eval.c:1918
    #15 0x7fd7671af396 in Rf_applyClosure /tmp/r-source/src/main/eval.c:1844
    #16 0x7fd7671aa7bf in Rf_eval /tmp/r-source/src/main/eval.c:871
    #17 0x7fd7671b7daa in do_set /tmp/r-source/src/main/eval.c:2990
    #18 0x7fd7671a9f71 in Rf_eval /tmp/r-source/src/main/eval.c:823
    #19 0x7fd7672588eb in Rf_ReplIteration /tmp/r-source/src/main/main.c:264
    #20 0x7fd767258dca in R_ReplConsole /tmp/r-source/src/main/main.c:316
    #21 0x7fd76725b43d in run_Rmainloop /tmp/r-source/src/main/main.c:1130
    #22 0x7fd76725b457 in Rf_mainloop /tmp/r-source/src/main/main.c:1137
    #23 0x55996bb02238 in main /tmp/r-source/src/main/Rmain.c:29
    #24 0x7fd7663140b2 in __libc_start_main (/usr/lib/x86_64-linux-gnu/libc.so.6+0x270b2)

previously allocated by thread T0 here:
    #0 0x7fd7678f1527 in __interceptor_malloc ../../../../src/libsanitizer/asan/asan_malloc_linux.cpp:145
    #1 0x7fd75cf92987 in new_image_int /tmp/RtmpSYxsFy/R.INSTALLf35be2df52/image.LineSegmentDetector/src/lsd.c:423
    #2 0x7fd75cf92aa3 in new_image_int_ini /tmp/RtmpSYxsFy/R.INSTALLf35be2df52/image.LineSegmentDetector/src/lsd.c:442
    #3 0x7fd75cf9e94d in LineSegmentDetection /tmp/RtmpSYxsFy/R.INSTALLf35be2df52/image.LineSegmentDetector/src/lsd.c:2489
    #4 0x7fd75cf89fd2 in detect_line_segments(Rcpp::Vector<14, Rcpp::PreserveStorage>, int, int, double, double, double, double, double, double, int, int, double, int, double, double, double) /tmp/RtmpSYxsFy/R.INSTALLf35be2df52/image.LineSegmentDetector/src/line_segment_detector.cpp:31
    #5 0x7fd75cf5472f in _image_LineSegmentDetector_detect_line_segments /tmp/RtmpSYxsFy/R.INSTALLf35be2df52/image.LineSegmentDetector/src/RcppExports.cpp:30
    #6 0x7fd767109454 in R_doDotCall /tmp/r-source/src/main/dotcode.c:672
    #7 0x7fd767124014 in do_dotcall /tmp/r-source/src/main/dotcode.c:1284
    #8 0x7fd7671d7640 in bcEval /tmp/r-source/src/main/eval.c:7139
    #9 0x7fd7671a95e6 in Rf_eval /tmp/r-source/src/main/eval.c:748
    #10 0x7fd7671afca5 in R_execClosure /tmp/r-source/src/main/eval.c:1918
    #11 0x7fd7671af396 in Rf_applyClosure /tmp/r-source/src/main/eval.c:1844
    #12 0x7fd7671d6d6a in bcEval /tmp/r-source/src/main/eval.c:7107
    #13 0x7fd7671a95e6 in Rf_eval /tmp/r-source/src/main/eval.c:748
    #14 0x7fd7671afca5 in R_execClosure /tmp/r-source/src/main/eval.c:1918
    #15 0x7fd7671af396 in Rf_applyClosure /tmp/r-source/src/main/eval.c:1844
    #16 0x7fd7671aa7bf in Rf_eval /tmp/r-source/src/main/eval.c:871
    #17 0x7fd7671b7daa in do_set /tmp/r-source/src/main/eval.c:2990
    #18 0x7fd7671a9f71 in Rf_eval /tmp/r-source/src/main/eval.c:823
    #19 0x7fd7672588eb in Rf_ReplIteration /tmp/r-source/src/main/main.c:264
    #20 0x7fd767258dca in R_ReplConsole /tmp/r-source/src/main/main.c:316
    #21 0x7fd76725b43d in run_Rmainloop /tmp/r-source/src/main/main.c:1130
    #22 0x7fd76725b457 in Rf_mainloop /tmp/r-source/src/main/main.c:1137
    #23 0x55996bb02238 in main /tmp/r-source/src/main/Rmain.c:29
    #24 0x7fd7663140b2 in __libc_start_main (/usr/lib/x86_64-linux-gnu/libc.so.6+0x270b2)

SUMMARY: AddressSanitizer: heap-use-after-free /tmp/RtmpSYxsFy/R.INSTALLf35be2df52/image.LineSegmentDetector/src/lsd.c:2599 in LineSegmentDetection
Shadow bytes around the buggy address:
  0x0c04800a6ba0: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fd fd
  0x0c04800a6bb0: fa fa fd fd fa fa fa fa fa fa fa fa fa fa fa fa
  0x0c04800a6bc0: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
  0x0c04800a6bd0: fa fa fd fd fa fa fd fd fa fa fd fd fa fa fa fa
  0x0c04800a6be0: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
=>0x0c04800a6bf0: fa fa 00 04 fa fa[fd]fd fa fa 03 fa fa fa fa fa
  0x0c04800a6c00: fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa fa
  0x0c04800a6c10: fa fa 00 fa fa fa fd fa fa fa 03 fa fa fa fd fd
  0x0c04800a6c20: fa fa fd fa fa fa fd fd fa fa fd fd fa fa fd fa
  0x0c04800a6c30: fa fa fd fa fa fa fd fa fa fa fd fa fa fa fd fa
  0x0c04800a6c40: fa fa fd fd fa fa fd fa fa fa fd fa fa fa fd fd
Shadow byte legend (one shadow byte represents 8 application bytes):
  Addressable:           00
  Partially addressable: 01 02 03 04 05 06 07 
  Heap left redzone:       fa
  Freed heap region:       fd
  Stack left redzone:      f1
  Stack mid redzone:       f2
  Stack right redzone:     f3
  Stack after return:      f5
  Stack use after scope:   f8
  Global redzone:          f9
  Global init order:       f6
  Poisoned by user:        f7
  Container overflow:      fc
  Array cookie:            ac
  Intra object redzone:    bb
  ASan internal:           fe
  Left alloca redzone:     ca
  Right alloca redzone:    cb
  Shadow gap:              cc
==14==ABORTING

coming from here https://github.com/bnosac/image/blob/master/image.LineSegmentDetector/src/lsd.c#L2599 caused by region->xsize and region->ysize equal to 0
image is being freed https://github.com/bnosac/image/blob/master/image.LineSegmentDetector/src/lsd.c#L2344 but as region->xsize and region->ysize are equal to 0, no new one is created

from image.

jwijffels avatar jwijffels commented on May 9, 2024

Hello @rafael-grompone-von-gioi
Can you shed some light on this crash using the LSD line segment detector implementation. It looks like an extra check is needed checking that region->xsize and region->ysize are bigger than 0

from image.

rafael-grompone-von-gioi avatar rafael-grompone-von-gioi commented on May 9, 2024

Hi,

I'm not sure of understanding the problem, but I see that lines 2339 to 2346 are different from the equivalent in my code which are:

  /* initialize some structures */
  if( reg_img != NULL && reg_x != NULL && reg_y != NULL ) /* save region data */
    region = new_image_int_ini(angles->xsize,angles->ysize,0);
  used = new_image_char_ini(xsize,ysize,NOTUSED);
  reg = (struct point *) calloc( (size_t) (xsize*ysize), sizeof(struct point) );
  if( reg == NULL ) error("not enough memory!");

As you can see, there is no memory freed in my version. Do you know why was it changed?

Anyway, all that about reg_img, reg_x and reg_y was just to be able to store and analyse the assigment of pixels into regions. It was useful for my while developping the algorithm, but I'm not sure it is of much use now. I think it could be removed.

I take the oportunity to point out a small bug (which was discovered by someone I can't remember now who). In lines 2600 and 2601 it should be

      if( region->xsize > (unsigned int) INT_MAX ||
          region->ysize > (unsigned int) INT_MAX )

while in line 2601 we now read region->xsize, so both times it is checking the X size.

I hope this helps. Don't hesitate if there are further questions.

Best!

from image.

rafael-grompone-von-gioi avatar rafael-grompone-von-gioi commented on May 9, 2024

Hi again,

I just see another difference with my code, probably the important for this problem. In my code, at the begining of the function LineSegmentDetection there is a series of checks to verify the input consistency; those checks were removed:

  /* check parameters */
  if( img == NULL || X <= 0 || Y <= 0 ) error("invalid image input.");
  if( scale <= 0.0 ) error("'scale' value must be positive.");
  if( sigma_scale <= 0.0 ) error("'sigma_scale' value must be positive.");
  if( quant < 0.0 ) error("'quant' value must be positive.");
  if( ang_th <= 0.0 || ang_th >= 180.0 )
    error("'ang_th' value must be in the range (0,180).");
  if( density_th < 0.0 || density_th > 1.0 )
    error("'density_th' value must be in the range [0,1].");
  if( n_bins <= 0 ) error("'n_bins' value must be positive.");

As you can see, the first check is that the image size is larger than zero. So this may explain why the check may be needed.

As my code was done assuming those conditions were satisfied, I would not remove those checks because there are probably many other places were they are assumed.

best

from image.

jwijffels avatar jwijffels commented on May 9, 2024

Regarding the removal of the check parameters.

That was needed in order to make CRAN happy, which didn't like the use of printf. And I didn't put time to replace it with the Rprintf R equivalent which was allowed and just commented it out. I don't think these are the culprit here as the default ones which are used in the example are the ones from the paper

image_line_segment_detector(
  x,
  scale = 0.8,
  sigma_scale = 0.6,
  quant = 2,
  ang_th = 22.5,
  log_eps = 0,
  density_th = 0.7,
  n_bins = 1024,
  union = FALSE,
  union_min_length = 5,
  union_max_distance = 5,
  union_ang_th = 7,
  union_use_NFA = FALSE,
  union_log_eps = 0
)

After a second look, I'll see if I can add the check at if( img == NULL || X <= 0 || Y <= 0 ) error("invalid image input."); and clean R nicely instead of letting it segfault.

About this,

  if( region->xsize > (unsigned int) INT_MAX ||
      region->ysize > (unsigned int) INT_MAX )

I saw that as well and tested out if this might have been the reason of the 💣 but that wasn't the cause

As you can see, there is no memory freed in my version. Do you know why was it changed?

Not sure, I thought I took the C code version 1.6 from http://www.ipol.im/pub/art/2012/gjmr-lsd/ but indeed it looks a bit different. Where is the last version of the code? Is it version 1.6 at http://www.ipol.im/pub/art/2012/gjmr-lsd/

On version 1.6 at ipol now there is in the comments

  HISTORY:
   - version 1.6 - nov 2011:
                             - changes in the interface,
                             - max_grad parameter removed,
                             - the factor 11 was added to the number of test
                               to consider the different precision values
                               tested,
                             - a minor bug corrected in the gradient sorting
                               code,
                             - the algorithm now also returns p and log_nfa
                               for each detection,
                             - a minor bug was corrected in the image scaling,
                             - the angle comparison in "isaligned" changed
                               from < to <=,
                             - "eps" variable renamed "log_eps",
                             - "lsd_scale_region" interface was added,
                             - minor changes to comments.

while this R wrapper has: https://github.com/bnosac/image/blob/master/image.LineSegmentDetector/src/lsd.c#L57
Maybe this wasn't the last version that you put on ipol?

    HISTORY:
    - version 1.6 - nov 2011: Changes in the interface,
                              max_grad parameter removed,
                              the factor 11 was added to the number of test
                              to consider the different precision values tested,
                              a minor bug corrected in the gradient sorting
                              code.

from image.

rafael-grompone-von-gioi avatar rafael-grompone-von-gioi commented on May 9, 2024

Yes, the last version of the LSD code is the 1.6 at Ipol you mention.

from image.

jwijffels avatar jwijffels commented on May 9, 2024

But one of the parameters checked is the image size. If you have X or Y equal to zero, that menas that test is needed. Or am I wrong?

yes, I'll add this check again. I disabled all the error() commands as they used printf and I should use Rprintf on R

from image.

rafael-grompone-von-gioi avatar rafael-grompone-von-gioi commented on May 9, 2024

Sorry, I saw you had already commented that, so I removed my comment.

from image.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.