Code Monkey home page Code Monkey logo

Comments (5)

klahnakoski avatar klahnakoski commented on July 20, 2024 1

The problem is a small drive size assigned to the ETL machines. I only wanted to confirm that grcov is removing its temp directory.

from grcov.

marco-c avatar marco-c commented on July 20, 2024

It should be, unless it doesn't exit cleanly.
Can you make sure the process is exiting cleanly?

from grcov.

marco-c avatar marco-c commented on July 20, 2024

The best way to handle it would be to use the subprocess as a context manager, otherwise you can implement this yourself: https://github.com/python/cpython/blob/3.5/Lib/subprocess.py#L711 (you'll just need to close the stdout pipe which you are opening at https://github.com/klahnakoski/ActiveData-ETL/blob/aef50f14f05720b79bfd2e45ecea6ec04c48bc68/activedata_etl/transforms/gcov_to_es.py#L240 and then call wait for waiting the termination of the process).

from grcov.

klahnakoski avatar klahnakoski commented on July 20, 2024

OK, I think I am doing it correctly now [1]. I do get an error, but I do not know if it is a symptom, or a cause, or both. I suspect the drive size on the workers is too small (6gigs).

ip-172-31-0-15 (pid 16960) - 2017-06-26 01:54:08 - ETL Loop 0 - "gcov_to_es.py:186" (run_grcov) - WARNING: grcov error
[
    "thread '<unnamed>' panicked at 'Failed to copy file from ZIP: Error { repr: Os { code: 28, message: \"No space left on device\" } }', /checkout/src/libcore/result.rs:860",
    "note: Run with `RUST_BACKTRACE=1` for a backtrace."
]
File "/home/ubuntu/ActiveData-ETL/activedata_etl/transforms/gcov_to_es.py", line 186, in run_grcov
File "/home/ubuntu/ActiveData-ETL/activedata_etl/transforms/gcov_to_es.py", line 120, in generator
File "/home/ubuntu/ActiveData-ETL/pyLibrary/aws/s3.py", line 347, in write_lines
File "/home/ubuntu/ActiveData-ETL/activedata_etl/sinks/s3_bucket.py", line 90, in write_lines
File "/home/ubuntu/ActiveData-ETL/activedata_etl/transforms/gcov_to_es.py", line 133, in process_directory
File "/home/ubuntu/ActiveData-ETL/activedata_etl/transforms/gcov_to_es.py", line 67, in process_gcda_artifact
File "/home/ubuntu/ActiveData-ETL/activedata_etl/transforms/cov_to_es.py", line 86, in process
File "activedata_etl/etl.py", line 182, in _dispatch_work
File "activedata_etl/etl.py", line 309, in loop
File "/home/ubuntu/ActiveData-ETL/mo_threads/threads.py", line 216, in _run

[1] https://github.com/klahnakoski/ActiveData-ETL/blob/19d0bd3475a54224693161d0f9026031a62f295c/activedata_etl/transforms/gcov_to_es.py#L172

from grcov.

marco-c avatar marco-c commented on July 20, 2024

How big is /tmp?
Have you cleaned up the old directories under /tmp?

I can add a new argument to grcov to let you extract the files in a different directory if /tmp is too small.

from grcov.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.