Code Monkey home page Code Monkey logo

design-baselines's People

Contributors

aviralkumar2907 avatar brandontrabucco avatar dependabot[bot] avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar

design-baselines's Issues

Unable to run the training bash script to reproduce table

Hi,

I am trying to run the set of experiments on different algorithms and different datasets by using the small bash script you provide in the README file, but I get the following error. This error is written into the error.txt file in the experiment folder. I create a file run.sh and place it inside design-baselines/design-baselines/ and then run it from that location. Is this correct?

Failure # 1 (occurred at 2022-08-11_01-17-15)
Traceback (most recent call last):
  File "/homes/kaushik/miniconda3/envs/design-baselines/lib/python3.7/site-packages/ray/tune/trial_runner.py", line 702, in _process_tr$
    results = self.trial_executor.fetch_result(trial)
  File "/homes/kaushik/miniconda3/envs/design-baselines/lib/python3.7/site-packages/ray/tune/ray_trial_executor.py", line 686, in fetch$
    result = ray.get(trial_future[0], timeout=DEFAULT_GET_TIMEOUT)
  File "/homes/kaushik/miniconda3/envs/design-baselines/lib/python3.7/site-packages/ray/_private/client_mode_hook.py", line 47, in wrap$
    return func(*args, **kwargs)
  File "/homes/kaushik/miniconda3/envs/design-baselines/lib/python3.7/site-packages/ray/worker.py", line 1481, in get
    raise value.as_instanceof_cause()
ray.exceptions.RayTaskError(TuneError): ^[[36mray::ImplicitFunc.train_buffered()^[[39m (pid=2049, ip=130.107.5.38)
  File "python/ray/_raylet.pyx", line 505, in ray._raylet.execute_task
  File "python/ray/_raylet.pyx", line 449, in ray._raylet.execute_task.function_executor
  File "/homes/kaushik/miniconda3/envs/design-baselines/lib/python3.7/site-packages/ray/_private/function_manager.py", line 556, in act$
    return method(__ray_actor, *args, **kwargs)
  File "/homes/kaushik/miniconda3/envs/design-baselines/lib/python3.7/site-packages/ray/tune/trainable.py", line 173, in train_buffered
    result = self.train()
  File "/homes/kaushik/miniconda3/envs/design-baselines/lib/python3.7/site-packages/ray/tune/trainable.py", line 232, in train
    result = self.step()
  File "/homes/kaushik/miniconda3/envs/design-baselines/lib/python3.7/site-packages/ray/tune/function_runner.py", line 366, in step
    self._report_thread_runner_error(block=True)
  File "/homes/kaushik/miniconda3/envs/design-baselines/lib/python3.7/site-packages/ray/tune/function_runner.py", line 513, in _report_$
    ("Trial raised an exception. Traceback:\n{}".format(err_tb_str)
ray.tune.error.TuneError: Trial raised an exception. Traceback:
^[[36mray::ImplicitFunc.train_buffered()^[[39m (pid=2049, ip=130.107.5.38)
  File "/homes/kaushik/miniconda3/envs/design-baselines/lib/python3.7/site-packages/ray/tune/function_runner.py", line 248, in run
    self._entrypoint()
  File "/homes/kaushik/miniconda3/envs/design-baselines/lib/python3.7/site-packages/ray/tune/function_runner.py", line 316, in entrypoi$
    self._status_reporter.get_checkpoint())
  File "/homes/kaushik/miniconda3/envs/design-baselines/lib/python3.7/site-packages/ray/tune/function_runner.py", line 580, in _trainab$
    output = fn()
  File "/homes/kaushik/Projects/xxxxx/design-baselines/design_baselines/bo_qei/__init__.py", line 279, in bo_qei
    score = task.predict(solution)
  File "/homes/kaushik/miniconda3/envs/design-baselines/lib/python3.7/site-packages/tensorflow/python/eager/def_function.py", line 780,$
    result = self._call(*args, **kwds)
  File "/homes/kaushik/miniconda3/envs/design-baselines/lib/python3.7/site-packages/tensorflow/python/eager/def_function.py", line 846,$
    return self._concrete_stateful_fn._filtered_call(canon_args, canon_kwds)  # pylint: disable=protected-access
  File "/homes/kaushik/miniconda3/envs/design-baselines/lib/python3.7/site-packages/tensorflow/python/eager/function.py", line 1848, in$
    cancellation_manager=cancellation_manager)
  File "/homes/kaushik/miniconda3/envs/design-baselines/lib/python3.7/site-packages/tensorflow/python/eager/function.py", line 1924, in$
    ctx, args, cancellation_manager=cancellation_manager))
  File "/homes/kaushik/miniconda3/envs/design-baselines/lib/python3.7/site-packages/tensorflow/python/eager/function.py", line 550, in $
    ctx=ctx)
  File "/homes/kaushik/miniconda3/envs/design-baselines/lib/python3.7/site-packages/tensorflow/python/eager/execute.py", line 60, in qu$
    inputs, attrs, num_outputs)
tensorflow.python.framework.errors_impl.UnknownError: 2 root error(s) found.
  (0) Unknown:  NameError: name 'training' is not defined
[[36mray::ImplicitFunc.train_buffered()^[[39m (pid=2049, ip=130.107.5.38)

  File "/homes/kaushik/miniconda3/envs/design-baselines/lib/python3.7/site-packages/tensorflow/python/ops/script_ops.py", line 244, in $
    ret = func(*args)

  File "/homes/kaushik/miniconda3/envs/design-baselines/lib/python3.7/site-packages/tensorflow/python/autograph/impl/api.py", line 302,$
    return func(*args, **kwargs)

  File "/homes/kaushik/Projects/xxxxx/design-baselines/design_baselines/data.py", line 992, in predict_numpy
    return self.wrapped_task.predict(x_batch)

  File "/homes/kaushik/miniconda3/envs/design-baselines/lib/python3.7/site-packages/design_bench/task.py", line 832, in predict
    return self.oracle.predict(x_batch, **kwargs)

  File "/homes/kaushik/miniconda3/envs/design-baselines/lib/python3.7/site-packages/design_bench/oracles/oracle_builder.py", line 505, $
    range(self.internal_measurements)], axis=0)

  File "/homes/kaushik/miniconda3/envs/design-baselines/lib/python3.7/site-packages/design_bench/oracles/oracle_builder.py", line 504, $
    x_sliced, **kwargs) for _ in

  File "/homes/kaushik/miniconda3/envs/design-baselines/lib/python3.7/site-packages/design_bench/oracles/tensorflow/transformer_oracle.$
    elif isinstance(training, DiscreteDataset):

NameError: name 'training' is not defined

[[node PyFunc (defined at /Projects/xxxxx/design-baselines/design_baselines/data.py:1016) ]]
  (1) Unknown:  NameError: name 'training' is not defined
^[[36mray::ImplicitFunc.train_buffered()^[[39m (pid=2049, ip=130.107.5.38)

  File "/homes/kaushik/miniconda3/envs/design-baselines/lib/python3.7/site-packages/tensorflow/python/ops/script_ops.py", line 244, in $
    ret = func(*args)

  File "/homes/kaushik/miniconda3/envs/design-baselines/lib/python3.7/site-packages/tensorflow/python/autograph/impl/api.py", line 302,$
    return func(*args, **kwargs)

  File "/homes/kaushik/Projects/xxxxx/design-baselines/design_baselines/data.py", line 992, in predict_numpy
    return self.wrapped_task.predict(x_batch)

  File "/homes/kaushik/miniconda3/envs/design-baselines/lib/python3.7/site-packages/design_bench/task.py", line 832, in predict
    return self.oracle.predict(x_batch, **kwargs)

  File "/homes/kaushik/miniconda3/envs/design-baselines/lib/python3.7/site-packages/design_bench/oracles/oracle_builder.py", line 505, $
    range(self.internal_measurements)], axis=0)

  File "/homes/kaushik/miniconda3/envs/design-baselines/lib/python3.7/site-packages/design_bench/oracles/oracle_builder.py", line 504, $
    x_sliced, **kwargs) for _ in

File "/homes/kaushik/miniconda3/envs/design-baselines/lib/python3.7/site-packages/design_bench/oracles/tensorflow/transformer_oracle.$
    elif isinstance(training, DiscreteDataset):

NameError: name 'training' is not defined


         [[node PyFunc (defined at /Projects/xxxxx/design-baselines/design_baselines/data.py:1016) ]]
         [[PyFunc/_4]]
0 successful operations.
0 derived errors ignored. [Op:__inference_predict_169205]

Errors may have originated from an input operation.
Input Source operations connected to node PyFunc:
 x (defined at /Projects/xxxxx/design-baselines/design_baselines/bo_qei/__init__.py:279)

Input Source operations connected to node PyFunc:
 x (defined at /Projects/xxxxx/design-baselines/design_baselines/bo_qei/__init__.py:279)

Function call stack:
predict -> predict

This looks like there is some error produced in the pip installed design-bench library. Could you please take a look at this? Any suggestions are greatly appreciated. Thanks !

Unable to download datasets from https://storage.googleapis.com/design-bench/...

Hi,

I am trying to run nas_bench, while an error occurs:
FileNotFoundError: [Errno 2] No such file or directory: '/home/***/anaconda3/envs/design-baselines/lib/python3.7/site-packages/design_bench_data/nas_bench/nas_bench-x-0.npy'

Then I find that the file nas_bench-x-0.npy cannot be downloaded from https://storage.googleapis.com/design-bench/nas_bench/nas_bench-x-0.npy. Around a month ago, this file could be accessed, but now it is not.

It seems that all files from https://storage.googleapis.com/design-bench/... cannot be downloaded. Is there anything wrong with the server? And are there any other ways to access the datasets?

Could you please take a look at this? Any suggestions are greatly appreciated. Thanks!

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.