Comments (2)
Hi @shinglyu, both processing and training step types are included in the SDK docs when describing what SDK parameters will cause cache misses and step re-executions. These are the most heavily used by customers and so we prioritized specific examples for those.
You are right though, for the remaining step types, a translation is required from the SageMaker API Step parameters to the Python SDK objects for the reader in order to discern which PySDK params will cause cache hits / misses when changed. I agree it would be nice to include a table of some sort that lists all the params by step type so the customer doesn't have to make that translation, I can add this to our backlog. In the meantime, is there any specific step / situation I can help with?
from sagemaker-python-sdk.
I have spent a lot of time trying to get caching to work. It works well and I use it daily for all steps except for TransformStep
and Clarify
steps for which I have never been able to get caching to work. As Shing has mentioned, more documentation with examples would be very helpful.
from sagemaker-python-sdk.
Related Issues (20)
- ModelStep name includes "-RegisterModel" suffix HOT 1
- Tags are't inherited from the `sagemaker_config` to hyperparameter tuning requests
- ValueError: Invalid explanations value when creating ModelCard from ModelPackage
- AsyncPredictor fails if name is None, despite it being the default
- Newline chars are not supported in sagemaker feature store string types
- SageMaker Batch currently doesn't support Model entity with container definitions which use ModelDataSource attribute
- 'base_job_name' parameter is not used to name the Processing Jobs that are created by the Model Monitoring Schedule
- (AutoMLV2) UnboundLocalError: local variable 'input_config' referenced before assignment
- Import/get data from bigquery
- Endless loop when try to deploy a sagemaker pipeline from a windows machine HOT 2
- HuggingFaceProcessor with ProcessingStep results in import errors (similar to issues/2656) HOT 3
- Error in using Clarify with AWS Jumpstart image classification models
- Forbidden Access to S3 bucket after domain initialization
- Can I create lambda step from ecr image by using Lambda class in lambda_help.py?
- sagemaker.model_monitor.DefaultModelMonitor suggest_baseline is not able to read Japanese text HOT 2
- Model.is_repack should return a bool but sometimes returns a None
- Allow user to configure compresslevel for tarfile in sagemaker.util.repack_model
- When using the model_id with the DJLModel class in the SageMaker Python SDK, the entry_point is not working, and the code specified is not loaded into the container
- Project description not available on pypi.org/project/sagemaker/2.229.0/
- 500 Error for Long Input Videos in SageMaker Serverless Inference
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from sagemaker-python-sdk.