Comments (5)
Hi,
it's a bit hard to say with little context, but I guess it might be because the flag is_tf_model=True
is not set (see here).
from auto-attack.
I can confirm this behavior. In each of the attacks, model(x)
is called. I believe this should be model.predict(x)
instead.
from auto-attack.
Hi,
could you please point to the exact points where this happens? I think there should always be an if
statement to distinguish whether the model is a TF one and then call model.predict
.
from auto-attack.
It happens in checks.py:
def check_dynamic(model, x, is_tf_model=False, logger=None):
if is_tf_model:
msg = 'the check for dynamic defenses is not currently supported'
else:
msg = None
sys.settrace(tracefunc)
model(x)
sys.settrace(None)
#for k, v in funcs.items():
# print(k, v)
if any([c > 0 for c in funcs.values()]):
msg = 'it seems to be a dynamic defense! The evaluation' + \
' with AutoAttack might be insufficient.' + \
f' See {checks_doc_path} for details.'
if not msg is None:
if logger is None:
warnings.warn(Warning(msg))
else:
logger.log(f'Warning: {msg}')
#sys.settrace(None)
from auto-attack.
Sorry for the late reply. This #92 should fix it.
from auto-attack.
Related Issues (20)
- Can AutoAttack be used to dense prediction task? HOT 2
- Softmax probabilities instead of logits HOT 3
- normalization with deepfool fmodel HOT 4
- About `n_iter`, to align with others HOT 4
- Question about variation in reported (clean & robust accuracy) metrics HOT 2
- eps 8./255. works fine 4./255. does not work fine. HOT 12
- Import error for pytorch version 1.10.0 HOT 3
- 4 classes model; targeted attacks are different HOT 2
- A Bug in Square Attack HOT 4
- Problem that forward output is tuple rather than tensor HOT 1
- "The connection to the C10d store has failed" on distributed evaluation HOT 2
- ensemble attack HOT 3
- max Linf perturbation is larger than the epsilon HOT 3
- gradient computation issue HOT 4
- Unable to use Python debugger HOT 4
- Parallelized computing HOT 5
- Invalid configuration for square attack HOT 2
- Using the tool for general interval of input region HOT 3
- TF1: How do labels get modified by batch_datapoint_idcs? HOT 8
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from auto-attack.