Code Monkey home page Code Monkey logo

Comments (6)

igffccm avatar igffccm commented on September 27, 2024 2

Give it to me

from kuscia.

github-actions avatar github-actions commented on September 27, 2024

Stale issue message. Please comment to remove stale tag. Otherwise this issue will be closed soon.

from kuscia.

2002ljy avatar 2002ljy commented on September 27, 2024

Hello~ I completed the task.

from kuscia.

igffccm avatar igffccm commented on September 27, 2024

Hello, I have completed the design proposal

from kuscia.

igffccm avatar igffccm commented on September 27, 2024

基本思路:
定期找出符合“无用”标准的KusciaJob和DomainData进行标记,按照更新时间的远近依次进行删除,检测是否删除成功,删除成功后将删除的KusciaJob和DomainData的名称和删除时间记录到数据表中(用户可以设置是否记录)。
相关参数:
DomainData:
vendor:表示 DomainData 的来源,仅用作标识,对于你手动创建的 DomainData,可以将其设置为manual,对于应用算法组件生成的表,由算法组件本身填充,secretflow算法组件会填充secretflow。
nodeStatuses[].lastTransitionTime:表示 Kuscia Agent 最近一次发生更新的时间。
NotReady:表示 Kusica Agent 状态异常
KusciaJob:
Cancelled: 任务被某一方取消,被取消的任务不可被再次执行。
completionTime:表示 KusciaJob 运行完成的时间戳。
lastReconcileTime:表示 KusciaJob 上次更新的时间戳。

思路:
1、定期(两周)读取列表,找出符合以下条件的进行标记:
对于DomainData:
Vendor类型为secretflow, 满足设定的可以被自动删除的最少时间(两周)。
对于KusciaJob:
满足设定的可以被自动删除的最少时间(两周)。
2、按照更新时间的远近依次进行删除。
3、检测是否删除成功,若失败进行二次删除(多次失败后对用户进行报错)。
4、删除成功后将删除的KusciaJob和DomainData的名称和删除时间记录到数据表中(用户可以设置是否记录)。
操作(后期以代码完成):
1、 清理
清理DomainData DomainData
删除这个 KusciaJob 和这个KusciaJob 创建的 KusciaTask。 kubectl delete kj {job-name} -n cross-domain
运行以下命令清理 Domain kubectl delete domain alice
2、 检查
检查 DomainData 是否已被清理。 kubectl get domaindata alice-table -n alice
Error from server (NotFound): domaindatas.kuscia.secretflow "alice-table" not found

from kuscia.

2002ljy avatar 2002ljy commented on September 27, 2024

我完成了设计方案的完善和编写代码实现GC功能😊

from kuscia.

Related Issues (20)

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.