Comments (6)
Give it to me
from kuscia.
Stale issue message. Please comment to remove stale tag. Otherwise this issue will be closed soon.
from kuscia.
Hello~ I completed the task.
from kuscia.
Hello, I have completed the design proposal
from kuscia.
基本思路:
定期找出符合“无用”标准的KusciaJob和DomainData进行标记,按照更新时间的远近依次进行删除,检测是否删除成功,删除成功后将删除的KusciaJob和DomainData的名称和删除时间记录到数据表中(用户可以设置是否记录)。
相关参数:
DomainData:
vendor:表示 DomainData 的来源,仅用作标识,对于你手动创建的 DomainData,可以将其设置为manual,对于应用算法组件生成的表,由算法组件本身填充,secretflow算法组件会填充secretflow。
nodeStatuses[].lastTransitionTime:表示 Kuscia Agent 最近一次发生更新的时间。
NotReady:表示 Kusica Agent 状态异常
KusciaJob:
Cancelled: 任务被某一方取消,被取消的任务不可被再次执行。
completionTime:表示 KusciaJob 运行完成的时间戳。
lastReconcileTime:表示 KusciaJob 上次更新的时间戳。
思路:
1、定期(两周)读取列表,找出符合以下条件的进行标记:
对于DomainData:
Vendor类型为secretflow, 满足设定的可以被自动删除的最少时间(两周)。
对于KusciaJob:
满足设定的可以被自动删除的最少时间(两周)。
2、按照更新时间的远近依次进行删除。
3、检测是否删除成功,若失败进行二次删除(多次失败后对用户进行报错)。
4、删除成功后将删除的KusciaJob和DomainData的名称和删除时间记录到数据表中(用户可以设置是否记录)。
操作(后期以代码完成):
1、 清理
清理DomainData DomainData
删除这个 KusciaJob 和这个KusciaJob 创建的 KusciaTask。 kubectl delete kj {job-name} -n cross-domain
运行以下命令清理 Domain kubectl delete domain alice
2、 检查
检查 DomainData 是否已被清理。 kubectl get domaindata alice-table -n alice
Error from server (NotFound): domaindatas.kuscia.secretflow "alice-table" not found
from kuscia.
我完成了设计方案的完善和编写代码实现GC功能😊
from kuscia.
Related Issues (20)
- 请求/api/v1/job/watch/api/v1/job/watch没有返回结果 HOT 9
- Empty grafana dashboard HOT 13
- 查询job状态的时候,kuscia返回error HOT 1
- docker kuscia安装问题 HOT 12
- BFIA协议支持情况 HOT 5
- kuscia party reason错误日志是不是有长度限制 HOT 5
- kuscia多机部署点对点集群 HOT 1
- Request entity too large: limit is 3145728 HOT 8
- 导出模型异常 HOT 1
- KusciaTask 系统资源指标采集、暴露及统一导出 HOT 2
- Kuscia有没有helmchart提供部署 HOT 4
- K8S RunK点对点模式部署kuscia 测试作业运行失败 HOT 7
- 重装kuscia后,出现授权错误 HOT 3
- 咨询Kuscia故障处理方式 HOT 3
- 使用kuscia v0.11.0b0部署,appimage远程拉取镜像时报错 HOT 12
- 想要实现亿级别隐私求交的问题 HOT 4
- Kuscia K8S RunK运行时运行SCQL任务失败 HOT 21
- Docker多机部署点对点集群,运行任务时报错 HOT 3
- 中心化部署v0.11.0b0注册自定义算法镜像成功,自定义镜像在lite节点内已存在,但执行任务时,报找不到镜像 HOT 3
- 通过k3s启动的容器特权模式不生效 HOT 6
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from kuscia.